Dynamic lossless compressing method for real-time historical data

A technology of historical data and data dynamics, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of no data application characteristics, lost data changes, and only suitable for recurring data, so as to solve the distortion phenomenon, The effect of high compression efficiency

Active Publication Date: 2012-07-25
SHANGHAI BOILER WORKS +1
View PDF9 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The aforementioned methods all adopt the same compression mode and compression accuracy for all process data and their full range. Many data changes that can reflect process failure symptoms or transient processes in time are lost, so the recurring data is only suitable for steady-state analysis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic lossless compressing method for real-time historical data
  • Dynamic lossless compressing method for real-time historical data
  • Dynamic lossless compressing method for real-time historical data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Attached below figure 1 ~ attached Figure 4 Let the embodiments of the present invention be described in detail. The embodiments are implemented on the premise of the technical solutions of the present invention and provide specific implementation solutions and system structures, but the protection scope of the present invention is not limited to the following embodiments.

[0043] as attached figure 1 Shown, start historical data record process 1 on the historical data server that adopts the inventive method to realize, and read in following setting parameter:

[0044] - Historical data buffer area ΔF: This parameter defines the size of each historical data file, which can be set as a fixed file size or a fixed length of storage time. In this example, select ΔF = 8 hours, that is, the storage of a historical data file will be completed every 8 hours, because ΔF also corresponds to the size of the historical data buffer area, which must be set according to the actual...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic lossless compressing method for real-time historical data in an industrial production procedure, which comprises the following steps: storing the latest real-time data firstly in a compressing buffer area according to a time slice; processing lossless storage to all dynamic real-time data more than a threshold value in each preset time slice; after processing the data in the compressing buffer area in a method of only storing characteristic values of stable-state real-time data with little change according to different preset modes, then, storing the data in a historical data buffer area and a historical data file timely. The method disclosed by the invention realizes computer programming conveniently; filtering distortion phenomenon of each current linear loss compressing algorithm is solved; in addition, integral compressing efficiency of the data is increased on a condition of ensuring relatively high data fidelity.

Description

technical field [0001] The invention relates to a process data compression method, in particular to a dynamic lossless compression method for real-time historical data which can perform cache preprocessing on production process data and adopt full-scale threshold multi-mode compression and preserve dynamic data losslessly. Background technique [0002] In the process of industrial production, because the process control system (Process Control System, referred to as PCS system) or production information system (Operation Information System, referred to as OIS system) needs to collect and store a large amount of production process data with a very high frequency, The duration is very long. Therefore, methods of compressing real-time historical data, discarding some data sampling points reasonably, or performing mathematical fitting on process data before storing them are used to reduce the demand for physical storage space and improve computer processing. Efficiency and reduc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H03M7/30G06F17/30
Inventor 叶敏徐雪元吴乃新丁怡若孙晅张岩刘仕君
Owner SHANGHAI BOILER WORKS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products