Optimization method and system for rapid statistics

An optimization method and fast technology, applied in the field of data statistics, can solve problems such as effectiveness impact, large network bandwidth and computing resources occupation, and achieve a balance between efficiency and accuracy

Active Publication Date: 2019-11-22
PEKING UNIV
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If traditional statistical methods are used, such as traversing the data of each node and making statistics, it will take up a lot of network bandwidth and computing resources
And it will have a serious impact on the real-time performance and effectiveness of the network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Optimization method and system for rapid statistics
  • Optimization method and system for rapid statistics
  • Optimization method and system for rapid statistics

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0083] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0084] Quick statistics of data refers to one of the most common computing scenarios in the actual application scenarios of the Internet in the system. There are related needs in data analysis, network monitoring, optimization work and other fields. In practical applications, the rapid data statistics process is divided into three steps: 1. Collect and summarize the data scattered in various databases to obtain the statistical data sets to be counted. 2. Deduplicate (remove duplicate data) the collected statistical data sets, obtain the required statistics and feed them back to the user. 3. In the face of frequent statistics scenarios, such as network monitoring, etc., it is necessary to update the data quickly, and repeat the fi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an optimization method and system for rapid statistics. The method and system are applied to a graph structure distributed account book. The method comprises a statistical method and a feedback guidance method. The statistical method comprises: obtaining the statistical requirement of a user, and a main node broadcasting and distributing the statistical requirement to each number chain node; reading a first data set in the number chain node according to the statistical requirement, and extracting original data in the first data set; after the original data is hashed, calculating a bucket number corresponding to the hashed original data and the position where the first '1' of the remaining digit after the bucket number of the original data is removed, and updating thebucket information of the bucket number. According to the method, rapid, accurate and real-time statistics of graph structure distributed account book data can be realized, and meanwhile, the statistical method can be properly adjusted according to the change of the production environment within fixed time so as to ensure high adaptability of the method.

Description

technical field [0001] The invention relates to the field of data statistics, in particular to a fast statistical optimization method and a fast statistical optimization system. Background technique [0002] Statistical requirements are one of the very common requirements in the Internet field. In the context of big data statistics, statistical needs can be divided into two types, one is precise statistics, and the other is fuzzy statistics on big data, that is, estimates. There are two reasons for the latter: first, in the face of big data, accurate statistics often need to consume a lot of time and space resources, and in the case of limited resources, accurate statistics are often impossible to achieve; second, users usually do not care about the specifics of big data. Values, but have a certain tolerance for errors, only need statistics to control the magnitude of the data, or care about the trend of change. [0003] Distributed ledger technology is characterized by de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/27G06F16/22G06Q10/06G06Q20/38G06Q40/00
CPCG06Q10/06393G06Q20/389G06Q40/125G06F16/2255G06F16/2462G06F16/2468G06F16/27
Inventor 姜海鸥常媛黄罡蔡华谦景翔
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products