Scalable and fault tolerant orthogonalization based on randomized distributed data aggregation

► We present the push-flow algorithm (PF), a new distributed data aggregation algorithm (DDAA). ► PF has better resilience properties than previously existing DDAAs. ► PF has very good asymptotic scaling behavior on hypercube topologies. ► Based on DDAAs, we design the new rdmGS algorithm for orthogonalizing a set of vectors in a decentralized distributed fashion. ► rdmGS is capable of producing fully accurate results even if several nodes fail permanently.