Data acquisition system storage management method

A data acquisition system and storage management technology, applied in the field of telecommunications, can solve the problems of data loading speed impact, processing speed not keeping up with data generation speed, etc., to improve feasibility, clear processing method, and solve the contradiction of data query performance problem effect

Inactive Publication Date: 2008-07-09
ZTE CORP
View PDF0 Cites 76 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In order to meet the faster query speed, it is necessary to build an index on the query keyword; but when the data table is indexed, the speed of data loading will be affected, and the degree of impact is related to the indexed data
The test data shows that adding several indexes will reduce the storage speed to a fraction, which may cause the processing speed to fail to keep up with the data generation speed
So there is a contradiction between storage speed and query speed improvement

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition system storage management method
  • Data acquisition system storage management method
  • Data acquisition system storage management method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

[0024] refer to figure 1 According to the storage management method of the data acquisition system of the present invention, the storage management method comprises the following steps:

[0025] Step S102, setting one or more database tables, and partitioning the database tables according to time ranges.

[0026] Preferably, different database tables are set up to store different types of data.

[0027] Optionally, the time interval between two temporally adjacent database tables is one day.

[0028] Preferably, the partitions of the same database table are stored in the same table space, and different database tables use different table spaces.

[0029] Step S104, setting the index of the database table, and the index is partitioned according to the rules consistent with the partitioning rules of the database table.

[0030] Step S106, when it is necessary ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a storage management method for a data collection system. The method includes the following steps: step S102 is to create one or a plurality of database tables and to partition the database tables by the time range; step S104 is to create an index of the database tables and to partition the index with the same partition rule of the database tables; step S106 is to create a new database district to add into the database tables when needing to add the data which are not included within the existing time range and to add the new data into the time-corresponding district of database tables when needing to add the data which are included with the existing time range; step S108 is to set up an index for the database table district after collecting the data corresponding to the database table district. The invention enhances the system data collecting and processing capacity and meanwhile meets the data query requirement , thus solving the contradiction between the data loading speed of the bill record data collecting system and the and real-time query requirement and meanwhile enhancing the maintainability of the stored data.

Description

technical field [0001] The invention relates to a data acquisition system in the field of telecommunication, in particular to a storage management method of the data acquisition system. Background technique [0002] In the field of telecommunications, a lot of raw data is provided by the original bills of operating equipment. The processing of such data has several characteristics: the amount of data is large, and the data of a few months can reach T level; the processing performance requirements are high, and the processing The speed requires several thousand records / second. [0003] These data need to be queried in real time, aggregated and calculated, and built into a data warehouse. While satisfying real-time data storage, it is also necessary to support instant query of the stored data. In order to meet the faster query speed, it is necessary to build an index on the query keyword; but when the data table is indexed, the speed of data loading will be affected, and the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04M3/36
Inventor 文秀林杜贤俊唐文彬田珂
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products