Method for realizing high efficient data compression in rapid data management system

A data management system and data compression technology, applied in electrical components, code conversion, etc., can solve the problems of unprocessed data and waste of storage space, and achieve the effect of saving storage space and efficient compression

Active Publication Date: 2012-02-22
BEIJING SHOUGANG AUTOMATION INFORMATION TECH
View PDF2 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a method for realizing high-efficiency data compression in a fast data management system, which solves the problem of realizing high-efficiency compression for a large amount of process data collected.
Compared with the traditional data acquisition system, this method solves the problem of storing a large amount of process data in database tables or files without processing, resulting in a large amount of waste of storage space

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for realizing high efficient data compression in rapid data management system
  • Method for realizing high efficient data compression in rapid data management system
  • Method for realizing high efficient data compression in rapid data management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The specific method of the compression process will be described below with reference to the accompanying drawings.

[0015] figure 1 It is a schematic diagram of the overall architecture of data acquisition and analysis in the industrial production process. The PLC side is the data source, continuously sending the process data to the data receiving end. After the data receiving service receives the data, it sends it to the fast data analysis system. The data analysis system compresses this part of the data.

[0016] Taking the on-site water temperature parameter as an example, the minimum value is 0 degrees Celsius, and the maximum value is 100 degrees Celsius. The threshold value is first set to 0.1, and the sampling period is 500ms. If no processing is done, after one day, the space occupied by the water temperature data file is: 4×2×24×3600=691200 bytes. The compression process is as follows:

[0017] Assume that the change trend of water temperature during the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention, which belongs to the compression processing technology field after collection of mass process data in a flow factory, relates to a method for realizing high efficient data compression in a rapid data management system. The compression method has the following steps that: according to a data type and a value range of process data, basic compression of types is carried out on the process data; a change point storage method with an adaptive threshold is employed; and a segmentation paging type time storage method is utilized. Advantages of the method provided in the invention are as follows: a mode in which process data are directly stored into a database during a general system sampling process is abandoned; instead, compression processing is directly carried out on a process data file, so that a binary file is formed; therefore, high efficient compression on a historical data file is realized and storage space is also effectively saved.

Description

technical field [0001] The invention belongs to the technical field of compressing and processing a large amount of process data after collection in a process factory, and particularly relates to providing a method for realizing high-efficiency data compression in a fast data management system. It specifically relates to a method for realizing efficient data compression for a large amount of data after collecting a large amount of fast data and common process data. Background technique [0002] In process engineering, equipment is becoming more and more complex as the level of automation continues to increase. There are also more and more data points for the growth process. Playing back these process data can not only reproduce the production process, but also is an effective means for equipment debugging, production process data optimization, and production process failure problems. Usually, these data collection cycles are small and the data communication volume is large...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H03M7/30
Inventor 李亮举高雷凌杰彭会军周月杰
Owner BEIJING SHOUGANG AUTOMATION INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap