Data processing method and data processing device

A data processing and data technology, applied in the field of communication, can solve problems such as slow query speed, dynamic adjustment, and inability to support application system storage and query, so as to avoid bottleneck problems and improve speed

Inactive Publication Date: 2011-05-25
ZTE CORP
View PDF3 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The existing technology cannot dynamically adjust the storage method according to the actual situation of the bureau site, and cannot support storage and query of different dimensions of the application system, so it cannot save storage space on the premise of ensuring system functions
[0005] The establishment of the index required for data query is not convenient and fast enough to balance the contradiction between resource consumption caused by query and index maintenance
[0006] When writing and reading operations on the same database table at the same time, it will cause the disk input (I) / output (O) bottleneck problem, and the query speed is slow
[0007] Delayed arrival of collected data, resulting in incomplete data in the database

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and data processing device
  • Data processing method and data processing device
  • Data processing method and data processing device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The embodiment of the present invention provides a data processing method and device, aiming at the data storage and query performance in the mass data analysis system, it realizes the database technology in the system such as batch data loading and large data volume query, so as to avoid disk I / O / O bottleneck problem, improve the speed of data storage and query.

[0024] In order to solve the problems encountered in batch loading and real-time query of massive data, the embodiment of the present invention provides a local index that divides the storage table used to store the collected data according to different time granularities, and establishes partitions of the partition table in chronological order. A database platform that separates storage tables and partition tables. After being tested and verified in a large data volume environment, the solution can better support system operation, realize real-time collection, batch loading, and real-time query of massive d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and a data processing device, which are used for avoiding the bottleneck problem of disk input I / O (input / output) and improving the data storage and query speed. The data processing method provided by the invention comprises the following steps of: writing acquired data into a plurality of storage tables which are divided according to time granularity in advance, wherein each storage table is used for storing data acquired in a specific time segment; and when the operation of writing the data into the storage tables is completed, merging the data in the storage tables into subareas of subarea tables, which correspond to the storage tables, wherein the subsareas are used for providing data which need to be queried for a user.

Description

technical field [0001] The present invention relates to the field of communication technologies, in particular to a data processing method and device. Background technique [0002] The development of communication technology has enriched people's communication and life. While enjoying this convenience, people have higher and higher requirements for communication quality. For example, the signaling monitoring system is a statistical analysis system that analyzes communication quality by monitoring link signaling. Based on the collected signaling data, the system analyzes the quality of voice communication and data communication from multiple dimensions. [0003] However, due to the huge scale of the current network, the signaling and other data collected by the system are massive. Therefore, in the process of processing these data, the existing technology has the following problems: [0004] The existing technology cannot dynamically adjust the storage method according to t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 李兴彦
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap