Ad-hoc aggregate query processing algorithms based on bit-store for query intensive applications in cloud computing

Ad-hoc Aggregate query is extremely important for query intensive applications in cloud computing which extracts valuable summary information on massive datasets to help the decision-maker make right decisions. Current data storage schemes (row-store and column-store) cannot efficiently answer ad-hoc aggregate query on massive data sets in cloud computing. A new data storage structure (bit vector storage structure, bit-store for short) is proposed in this paper. The paper focuses on proposing ad-hoc aggregate query algorithms based on bit-store. Firstly, the storage model of bit-store including its attribute encoding schemes and bit file organization is introduced. Secondly, different aggregate operations for query processing are presented based on different encoding schemes. Thirdly, cost analysis for different aggregate operations is presented. Finally, the effectiveness and efficiency of the proposed algorithms is showed by the analytical and experimental results.

► Ad-hoc aggregate query processing algorithms based on bit-store are proposed. ► A new data storage structure named bit-store is proposed. ► Different aggregate operations are presented and their cost analysis are discussed. ► Experimental results show the effectiveness and efficiency of the algorithms.