Research of Hadoop-based data flow management system

The data flow is very important at the field of network management, network security and network experiments. But with the rapidly growing of computer network data, traditional data flow management system has been unable to meet the current needs. Combined the features of data flow management systems and the advantages of Hadoop cloud computing platforms, this paper design and implement a Hadoop-based platform for distributed data flow management systems, using MapReduce to process the user request, using Hadoop distributed file system (HDFS) to manage the data flow files, and using Hadoop database (HBase) to manage the data flow information. Test shows that this system is better than the traditional data flow management system in aspects of efficiency, scalability and reliability. And it can meet the large demands for data flow management better.