Unlock instant, AI-driven research and patent intelligence for your innovation.

Data statistical analysis method and system based on flow calculation and computer program

A data statistical analysis and streaming computing technology, applied in the field of data analysis, can solve problems such as poor efficiency, speed, and flexibility

Inactive Publication Date: 2018-06-01
GLOBAL TONE COMM TECH
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (1) The most important thing in the existing technology is that the conventional statistical calculation can only be calculated according to one dimension, and the analysis results can only be seen after the calculation is completed, and the efficiency, speed and flexibility are poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data statistical analysis method and system based on flow calculation and computer program
  • Data statistical analysis method and system based on flow calculation and computer program

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0039] In the present invention, part of the analysis results can be seen in the calculation of the stream-calculated data, and the analysis results can be aggregated again to generate analysis data in different directions.

[0040] Such as figure 1 As shown, the data statistical analysis method based on streaming computing provided by the embodiment of the present invention has several steps: receiving data, data classification, data calculation, data storage, and secondary aggregation.

[0041] Receive data: receive data provided by the data provider;

[0042] Data classification: process data according to various clas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of data analysis and discloses a data statistical analysis method and system based on flow calculation and a computer program. The method includes the steps that data is screened through specified conditions; aggregation, calculation and statistics are conducted on the data through different rules and different time dimensions; statistical results are classified and stored; after a batch of data is received, the data is put into a streaming task; first the data is classified, the data is grouped according to various data classes, the same classifieddata is simply calculated and saved, and then, based on saved results, aggregation is conducted to obtain the demanded results of news analysis; after a piece of data is received, the data is classified. The analysis results can only be seen after calculation is completed, the efficiency, speed and flexibility are all poor, but a new version of analysis makes the speed of the analysis results begradually increased, and the efficiency and flexibility are higher.

Description

technical field [0001] The invention belongs to the technical field of data analysis, and in particular relates to a flow computing-based data statistical analysis method, system, and computer program. Background technique [0002] At present, the existing technologies commonly used in the industry are as follows: [0003] Big data computing mainly has two forms: batch computing and stream computing. In the traditional data processing process, data is always collected first and then put into the DB. When people need to query the data through the DB, get the answer or perform related processing. Although this seems very reasonable, the result is very compact and, especially in some specific problems in some real-time search application environments, offline processing similar to MapReduce cannot solve the problem well. This leads to a new data computing structure --- stream computing. It can analyze large-scale flow data in real time during the changing movement process, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/24568G06F16/285
Inventor 喻银根朱秀松程国艮
Owner GLOBAL TONE COMM TECH