Real-time data statistics method and device

A real-time data statistics, real-time data technology, applied in database model, database index, digital data processing and other directions, can solve problems affecting the throughput and processing speed of real-time data statistics system, reduce throughput and processing speed, reduce The effect of influencing and eliminating bottlenecks

Active Publication Date: 2019-03-26
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Based on this, it is necessary to provide a real-time data statistics method and device for the problem that the read performance of the above-mentioned database storage system affects the throughput and processing speed of the real-time data statistics system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data statistics method and device
  • Real-time data statistics method and device
  • Real-time data statistics method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0029] The real-time data statistics method in this application document is a limitation on the data processing process of the database storage system.

[0030] figure 2 It is a partial structural block diagram of a server running the real-time data statistics method described in this application in an embodiment. Such as figure 2 As shown, in one embodiment, the server includes a processor, a storage medium, a memory, and a network interface connected through a system bus. Among them, the network interface is used for network communication; the storage medium stores an operating system, a dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time data statistic method. The method comprises the steps of writing received real-time data into a database memory space; writing the data of the database memory space in a database disk memory space as files in batches according to a sequence when the data memory amount in the database memory space reaches a threshold value; and carrying out statistic collection on data items with same keys in the records of to-be-combined files or getting the data items with the newest time stamps when the files in the database disk memory space satisfy a preset file merging condition, combining the collected data items and the obtained data items with the newest time stamps into new records corresponding to the keys, and storing the combined files formed by the new records in the database disk memory space. According to the method, the times of reading the data from a database are reduced, and therefore, the influences of the reading performance of the database on the throughput and processing speed of the real-time data statistic system are reduced. Moreover, the invention also provides a real-time data statistic device.

Description

technical field [0001] The invention relates to the technical field of real-time data statistics and databases, in particular to a method and device for real-time data statistics. Background technique [0002] In some Internet application fields, such as data mining, it is necessary to perform real-time statistics and summary of real-time generated data, such as summing real-time data. Real-time data statistics system in the prior art, such as figure 1 As shown, the real-time data generated by one or more clients is generally received by the statistical server, the corresponding data is read from the database storage system, and the real-time data and the corresponding data read from the database storage system are statistically summarized, and further , and write the data obtained by statistical summary into the database storage system. Real-time statistics and summarization of massive data requires a huge number of data reads from the database; and some data storage syst...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/2458G06F16/248G06F16/28
Inventor 王周王才平沈健
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap