In search of numerical consistency in parallel programming

We present methods that can dramatically improve numerical consistency for parallel calculations across varying numbers of processors. By calculating global sums with enhanced precision techniques based on Kahan or Knuth summations, the consistency of the numerical results can be greatly improved with minimal memory and computational cost. This study assesses the value of the enhanced numerical consistency in the context of general finite difference or finite volume calculations.

Research highlights
► Improving numerical consistency for parallel calculations with different numbers of processors.
► Reducing errors in global sums.
► Making production parallel programming easier.