Network big data processing system

Abstract

The invention discloses a network big data processing system. The network big data processing platform includes a data acquisition server, a sending server, receiving servers, and a central controller. The data acquisition server acquires data of the Internet and preliminarily classifies the data. The sending server, after receiving the data sent from the data acquisition server, stores the received data and establishes a sending queue table. The receiving servers only receive data of the same kind according to data classification, and store the received data. The central controller acquires the states of the receiving servers, and establishes a receiving queue table on the basis of the acquired states. The working states and busy conditions of the receiving servers are stored in the receiving queue table. The central controller detects the sending queue table through a cycle mode, and controls data transmission on the basis of data recorded in the receiving queue table. In this way, data is prevented from being lost.

Description

technical field [0001] The present invention relates to the field of computers, in particular to a network big data processing system. Background technique [0002] At present, with the development of computer technology and the Internet, many governments and enterprises are building big data, and the construction of big data plays a very important role in the development direction of enterprises, the improvement of government management level and service methods, However, in the existing big data processing, the data is often collected together and then classified, resulting in a heavy workload in the later stage. Due to the huge amount of data, the network is blocked when receiving data, and there is a problem of data loss. Contents of the invention [0003] The object of the present invention is to propose a network big data processing system to achieve the advantages of preventing data loss in view of the above problems. [0004] In order to achieve the above object, ...

AI Technical Summary

Problems solved by technology

[0002] At present, with the development of computer technology and the Internet, many governments and enterprises are building big data, and the construction of big data plays a very important role in the development direction of enterprises, the improvement of government management level and service methods, However, in the existing big data processing, the data is often collected together and then classified, resulting in a large workload in the later stage. Due to the huge amount of data, the network is blocked when receiving data, and there is a problem of data loss.