Mass data processing method based on files
A technology for massive data and data processing, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as large data volume, low fault tolerance, difficulty, etc., to ensure data security and efficiency. , to ensure the effect of stability
- Application Information
AI Technical Summary
Problems solved by technology
 In order to better understand the present invention, the invention will be described in detail below with reference to the drawings and specific embodiments.
 A method for processing massive file-based data of the present invention is to group the massive data received by the data processing system into files first, and then process them concurrently through multiple threads (processes). Such as figure 1 As shown, the data processing system of this embodiment includes a hardware environment consisting of two data processing computers and a disk cabinet. The disk provides data processing computer sharing, and both computers can access the disk cabinet; in addition, the data processing computers are connected to the database server. Connected.
 Such as figure 2 As shown, the specific processing process of this implementation is as follows:
 (1) Mutual exclusive control between multiple data processing servers, the specific steps are as follows:
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction