Data statistics method and device

A data statistics and data technology, applied in the field of data processing, can solve problems such as unsatisfactory data volume and large application requirements, and achieve the effects of avoiding excessive system load, solving large data volumes, and high efficiency

Pending Publication Date: 2020-07-03
HANGZHOU HIKVISION DIGITAL TECH
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, this application provides a data statistics method and device to solve the problem that related technologies cannot meet the application requirements of large data volume and real-time statistics

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data statistics method and device
  • Data statistics method and device
  • Data statistics method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0026] The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data statistics method and device. The method comprises the steps of constructing an inverted index and a forward index according to source data; when a data statistics condition is received, obtaining a query condition from the data statistics condition; querying field values meeting query conditions from the inverted index, and determining a data ID set according to queried data IDs to which the field values belong; acquiring an aggregation condition from the data statistics conditions; and querying the field value of the to-be-aggregated field contained in each dataID in the data ID set from the forward index, and performing aggregation statistics to obtain a statistical result. An inverted index and a forward index are constructed for source data stored in a big data platform; when statistical analysis is needed, data statistical conditions are input into the big data platform, statistical results are obtained by inquiring the inverted index and the forward index, the application requirement problem that the data size is large and real-time statistics is needed can be solved, meanwhile, the statistical results do not need to be written into a cache, and the problems that the system load is large and the statistical results are lost can be avoided.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a data statistics method and device. Background technique [0002] With the rapid development of cloud computing and artificial intelligence, various fields will generate massive data, that is, big data, and the value of these big data is being deeply tapped and utilized in various industries. At present, the regular statistical method is often used for statistical needs with a relatively large amount of data or complex and time-consuming statistical processes; real-time statistical methods based on stream computing are often used for simple and short-term statistical needs. [0003] However, timing statistics and real-time statistics cannot meet the application requirements of large amount of data and real-time statistics. Contents of the invention [0004] In view of this, the present application provides a data statistics method and device to solve the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2458G06F16/22
Inventor 李聪
Owner HANGZHOU HIKVISION DIGITAL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap