Check patentability & draft patents in minutes with Patsnap Eureka AI!

Data processing method, device and system

A data processing and original data technology, applied in the computer field, can solve the problems of increasing the end time and reducing the efficiency of data statistical processing, so as to achieve the effect of improving efficiency

Active Publication Date: 2018-08-21
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF13 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Based on the above processing method, whenever statistical processing is performed, the computing server needs to wait for each storage server to transmit data. This process will increase the time from the triggering of statistical processing to the end, thereby reducing the efficiency of data statistical processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method, device and system
  • Data processing method, device and system
  • Data processing method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] An embodiment of the present invention provides a data processing method, which can be used in a data processing system, such as figure 1 As shown, the system may include at least a distribution server and a computing server, and the system may include multiple computing servers, and may include one or more distribution servers. A communication connection can be established between the distribution server and the computing server. In order to avoid the need for data to be transmitted between servers during the aggregation calculation process, after the distribution server obtains the original data of the data source, it can distribute the same type of original data to the same calculation server, and can distribute each type of original data Distributed to each computing server. The calculation server can perform statistical processing on the raw data to obtain aggregated data. The above-mentioned distribution server and calculation server can realize the correspondin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention disclose a data processing method, device and system, and belong to the technical field of computers. The method comprises the following steps of: determining a target type of original data after the original data is obtained by a distribution server, determining a target calculation server to which the original data belongs according to the target type, and sending the original data of the target type through sending a data storage request to the target calculation server; and receiving the data storage request sent by the distribution server by the target calculation server, storing the original data of the target type, and when a preset aggregation period arrives at each time, determining aggregated data of the target type in the current aggregation period according to the original data, of the target type, received in the current aggregation period. By adoption of the method, device and system, the efficiency of data statistical processing can be improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method, device and system. Background technique [0002] The statistical law of data can be applied to the monitoring and analysis of things. For example, using the statistical law of the CPU (Central Processing Unit, central processing unit) utilization rate of each server in the computer room can monitor and analyze the operation of the server, and use the precipitation of each region The statistical law of the city can monitor and analyze the weather changes in various regions, the statistical law of the performance of each student in the city can be used to monitor and analyze the education situation of the city, and the statistical law of the wages of citizens across the country can be used to monitor and analyze the national living standards of this year. situation etc. [0003] Data used for monitoring can be randomly stored in multiple storage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/2291G06F16/2462G06F16/254H04L67/1097H04L67/63H04L67/10
Inventor 胡洋张赞李泽敏
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More