Data statistic method and system

A technology of data statistics and database, applied in the field of big data processing, can solve the problems of low statistical efficiency, high consumption of computing, network resources, etc.

Inactive Publication Date: 2016-06-01
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the amount of data stored in the big data platform is very large, and the number of tables is also very

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data statistic method and system
  • Data statistic method and system
  • Data statistic method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] Such as figure 1 As shown, the embodiment of the present invention provides a data statistics method, the method may include the following steps:

[0033] Step 101: Create a data extraction record table in advance, and set target conditions in advance.

[0034] Step 102: Monitor at least one relational database connected to the big data platform.

[0035] Step 103: When the target condition is met, the incremental data in the relational databas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data statistic method and system. The method comprises the following steps: pre-creating a data extraction record chart, presetting a target condition and monitoring at least one relational database connected with a big data platform; when the target condition is satisfied, extracting incremental data in the relational database with the incremental data into the big data platform; updating the data extraction record chart; and when a statistic instruction is obtained, responding the statistic instruction according to the data extraction record chart. According to the scheme, the data extraction record chart is updated after the data in the relational database is extracted into the big data platform; and when statistic is carried out on the data in the big data platform, response can be carried out by utilizing the data extraction record chart without traversing all the data in the big data platform, so that the statistic efficiency can be improved and a mass of computation and network resources are saved.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a data statistics method and system. Background technique [0002] At present, distributed clusters have become a hot spot in cloud computing research at home and abroad. Distributed clusters have good read and write capabilities, can support tables with large amounts of data, and are suitable for simple businesses and online databases and data warehouses with huge amounts of data. Because distributed clusters are not suitable for business databases, general business databases are often served by relational databases, and distributed clusters are responsible for collecting data in various relational databases. For a big data platform such as a distributed cluster, the data volume is an important indicator. [0003] In the prior art, all the data stored in the big data platform can be traversed through the MapReduce program, and the timestamp field can be used to cou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/23G06F16/2462G06F16/284
Inventor 臧勇真赵明超周正德牛硕刘安
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap