Distributed data statistical processing system and method, storage medium and terminal

A distributed data and statistical processing technology, applied in the field of data processing, can solve problems such as high computational complexity, low fault tolerance rate, and heavy workload, and achieve the effects of high fault tolerance rate, reduced workload, and improved efficiency

Pending Publication Date: 2020-08-28
CHONGQING UNIVERSITY OF SCIENCE AND TECHNOLOGY
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] To sum up, the problems existing in the existing technology are: the existing statistical processing of data generally relies on the core processing, single server or cloud serv

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data statistical processing system and method, storage medium and terminal
  • Distributed data statistical processing system and method, storage medium and terminal
  • Distributed data statistical processing system and method, storage medium and terminal

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0061] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0062] In view of the problems in the prior art, the present invention provides a distributed data statistical processing system, method, storage medium, and terminal. The present invention will be described in detail below with reference to the accompanying drawings.

[0063] Such as figure 1 As shown, the distributed data statistical processing system provided by the embodiment of the present invention includes:

[0064] The data acquisition module 1 is used to acquire tasks to be processed, and collect or upload data to be processed based on the processing tasks.

[0065] The data preprocessing module 2 is used to normali...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of data processing, and discloses a distributed data statistical processing system and method, a storage medium and a terminal, and the system comprises: adata collection module which is used for obtaining a to-be-processed task and collecting to-be-processed data; a data preprocessing module which is used for performing data normalization processing;a data classification module which is used for extracting, analyzing and classifying keywords; a task issuing module which is used for dividing the data processing task into a plurality of processingsubtasks; a data processing module which is used for processing different sub-tasks by utilizing different servers; a result statistics module which is used for task processing results; a database which is used for storing the collected data and processing results; a result output module which is used for outputting a processing result of the whole data processing task; and a query module which isused for performing data query through the input instruction. According to the invention, the load of the server is reduced, the operation complexity is reduced, the workload of each server or processor is reduced, and the statistical processing efficiency is improved.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a distributed data statistical processing system, method, storage medium, and terminal. Background technique [0002] At present, with the development of automation control system technology, it has become a trend to rely on the database for statistical processing of data. Existing technologies mainly rely on cloud servers or single servers for data processing, and using cloud servers or single servers for data processing not only has a large load, but also has high computational complexity, heavy workload, and slow efficiency. At the same time, a single processor or a single server is used for data statistical processing. Once a calculation error occurs in a certain step, data statistical processing needs to be performed again, and the fault tolerance rate is not high. [0003] To sum up, the problems existing in the existing technology are: the existing sta...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/215G06F16/242G06F16/2458G06F40/289
CPCG06F16/215G06F16/242G06F16/2462G06F40/289
Inventor 王昌酉王洪珂丁昌华袁玉兴杨文艳李海霞
Owner CHONGQING UNIVERSITY OF SCIENCE AND TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products