Skip to main content
Waters Employee Login
 
Waters

Why are there differences in rounded values in Empower? - WKB93357

  1. Last updated
  2. Save as PDF
Article number: 93357

ENVIRONMENT

  • Empower
  • Review window
  • Background processing
  • Oracle
  • Windows OS

ANSWER

In certain circumstances, the results for some fields displayed in the Review window before they are saved may be slightly different than the same fields and results after they are saved. This is due to the fact that before results are saved they are governed by Microsoft Operating system rules. After saving they are governed by Oracle rules.

  • Microsoft uses the Institute of Electrical and Electronic Engineers (IEEE) floating point format.
  • Oracle uses the Binary Coded Decimal (BCD) format.
  • This directly affects the representation and rounding of numbers. Refer to the other KCS articles noted below and the tech note TECN1851937.
  • Reopening the saved result in Review or opening in Preview Publisher will display the stored field value.
  • Using the integrate and quantitate functions in Review will display values governed by IEEE rules; hence, they may differ.

Not able to find a solution? Click here to request help.