Real-time data statistics method of mass data

A massive data and data technology, applied in the field of real-time data statistics under massive data, can solve problems such as small scope of application, narrowing the scope of queries, etc., achieve great practicality, reduce the amount of raw data, improve speed and the effect of human-computer interaction experience

Active Publication Date: 2014-03-26
XIAMEN YAXON NETWORKS CO LTD
View PDF7 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Use the method of partition to narrow the scope of query, which is suitable for t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data statistics method of mass data
  • Real-time data statistics method of mass data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be further described in detail below in conjunction with the examples.

[0040] A method for real-time statistics of data under massive data, the steps are as follows:

[0041] 1) The data receiving server sends the data received from the terminal to the data processing server for processing;

[0042] 2) The data processing server stores the original signal in the database;

[0043] 3) The data processing server performs signal statistics and analysis:

[0044] 3.1) Distinguish the data type of the signal, identify it as a numeric type and a non-numeric type;

[0045] 3.2) For numerical type signals, count the maximum value, minimum value, and average value of each signal of numerical type within a fixed period of time, and store them in the database table of numerical type; for non-numeric type signals, count non-numeric values ​​within a fixed period of time The number of occurrences and the frequency of changes of each state of each sign...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a real-time data statistics method of mass data. The real-time data statistics method of the mass data includes the following steps that: (1) a data receiving server transmits data received from a terminal to a data processing server for data processing; (2) the data processing server performs database storage on original signals; (3) the data processing server performs signal statistics and analysis, wherein the step (3) specifically includes: 3.1) distinguishing data types of the signals, and recognizing the data types as a numeric type and a nonnumeric type; 3.2) for the signals of the numeric type, achieving the maximum value, the minimum value and the average value of each signal of the numeric type in fixed duration through statistics, and storing the maximum value, the minimum value and the average value of each signal of the numeric type into a database list of the numeric type; for the signals of the nonnumeric type, achieving appearance times and variation frequency of each state of each signal of the nonnumeric type in the fixed duration, and storing the appearance times and the variation frequency of each state of each signal of the nonnumeric type into a database list of the nonnumeric type. By adopting the real-time data statistics method of the mass data, the volume of original data to be queried is greatly reduced, and the speed of report query and the human-computer interaction experience sense are greatly improved.

Description

technical field [0001] The invention relates to a method for data collection and statistics, and more specifically, relates to a method for real-time statistics of massive data. Background technique [0002] In the signal acquisition system, the semaphore reported by the vehicle terminal is very high frequency, and the frequency of reporting is in milliseconds. A single terminal can report up to 10,000 pieces per second. With the increase of the number of vehicles, the amount of data reported is even greater. Faced with such a large amount of data, some occasions such as report display and other occasions that require high real-time query of data, the traditional data query method must have problems such as slow query speed and poor user experience. [0003] Chinese invention patent application 200610027566.9 discloses a mass data statistics method, which has three database tables MT, MC, and MO, and five data table spaces are respectively established in the three tables. T...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/2453
Inventor 彭振文何应祥王国清江永聪
Owner XIAMEN YAXON NETWORKS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap