Method and system for performing lossless compression storage and retrieval on network management data

A compression storage and network management technology, which is applied in the field of lossless compression storage and retrieval of network management data and system, can solve the problem of not making full use of network management data, etc.

Active Publication Date: 2014-05-07
中国人民解放军91655部队
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing compression methods do not take full advantage o

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for performing lossless compression storage and retrieval on network management data
  • Method and system for performing lossless compression storage and retrieval on network management data
  • Method and system for performing lossless compression storage and retrieval on network management data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention comprises network management data packet deduplication module, network management data attribute compression storage module, network management data retrieval module and network management compressed data recovery module composed of four parts, such as figure 1 shown. The details are as follows:

[0022] 1. Network management data packet deduplication module

[0023] For a given network management data record that is continuously recorded, it is grouped and stored according to a certain value range of a certain attribute according to the retrieval needs of the network management. For the data in the group, according to the data characteristics of the network management, remove the parameters that change frequently, and deduplicate the records. Identified duplicate records are stored in a separate storage area.

[0024] Let R(A 1 ,A 2 ...,A n ) is an n-tuple relational frame of certain network management data T, T has N records, and T is shown...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for performing lossless compression storage and retrieval on network management data and is applied to compression, retrieval, long-term storage and recovery of the network management data. The method comprises the following steps: reading an original network management data table, and performing packet compression storage on infrequent changed attribute value in advance; recording increments but not totals changed in an interval for continuous attribute values; performing compression by adopting packet storage for discrete attribute values; performing storage by adopting data sets after VLB variable length compression for record number sets; performing statistics and building indexes while the compression is performed according to preset query conditions. The system consists of four parts: a network management data packet de-duplication module, a network management data attribute compression storage module, a network management data retrieval module and a network management packed data recovery module.

Description

technical field [0001] The invention provides a method and system for compressing, storing and retrieving data in a relational database, especially suitable for massive network management data containing a large number of similar data records. Background technique [0002] With the development of information technology, the construction of communication network is developing in the direction of multi-service, multi-functional and high-speed. Provide high quality service. The network management system needs to collect, store, and process a large amount of network management data such as SNMP, Syslog, ICMP detection, and traffic. These data are generally requested and collected according to the time granularity of minutes or less. However, in order to realize the high-speed data retrieval of the network management system and meet the needs of limited storage capacity, the data collected a period of time ago are often combined and stored in a lossy way. It is unable to provid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2228G06F16/284
Inventor 王璐赵瑜刘勇李帅孙宁伟王峰商云飞刘海峰薛芸
Owner 中国人民解放军91655部队
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap