The Bit Complexity of Distributed Sorting

Abstract

We study the bit complexity of the sorting problem for asynchronous distributed systems. We show that for every network with a tree topology T, every sorting algorithm must send at least Ω ( ΔT log(L/A)) bits in the worst case, where {1, 2, . . . L} is the set of possible initial values, and ΔT is the sum of distances from all the vertices to a median of the tree. In addition, we present an algorithm that sends at most O (ΔT log((L · N)/ ΔT)) bits for such trees. These bounds are tight if either L = Ω (N1+ε) or ΔT = Ω(N2). We also present results regarding average distributions. These results suggest that sorting is an inherently nondistributive problem, since it requires an amount of information transfer that is equal to the concentration of all the data in a single processor, which then distributes the final results to the whole network. The importance of bit complexity - as opposed to message complexity - stems also from the fact that, in the lower bound discussion, no assumptions are made as to the nature of the algorithm.