Skip to main content
Waters

What is the data precision difference between Empower software and Microsoft Excel? - WKB12663

Article number: 12663

ENVIRONMENT

  • Empower software
  • Microsoft Excel

ANSWER

For internal calculations, Empower uses 17 digits and Microsoft Excel 15 (depending on the used/calculated fields).
If you want to compare Empower and Excel sheet calculation, you must use at least 15 digits (the last digits in the results will
be different based on the 17-digit versus 15-digit precision).
Note that Empower can display a value of 1234, for example, but use 1234.0567123456789 for the calculations.
(In the precision field of the column properties, you can change the displayed precision. If you want to use rounded values for further calculation, you must create custom field calculations by using the ROUND function.)

Not able to find a solution? Click here to request help.