| Article ID | Journal | Published Year | Pages | File Type |
|---|---|---|---|---|
| 7616111 | Journal of Chromatography B | 2016 | 6 Pages |
Abstract
The term precision of a value describes the total number of significant digits that are used to express that value. False precision is presented in data, where the sampling and chosen data file format coding return values with extra non-valid digits. The proper precision in value thus depends on so-called magnitude in digital data coding. The presence of the false precision is file format dependent. The amount of dataset points could be decreased by removing false precision (where it is present) to almost 10% of the raw measurement without loss of information.
Related Topics
Physical Sciences and Engineering
Chemistry
Analytical Chemistry
Authors
Jan Urban,