Industrial Internet of Things real-time database single-point lossy compression method and device

A technology of industrial Internet of things and compression method, which is applied in the field of real-time database, can solve the problems of incompressible trend description and recording, etc., and achieve the effect of reducing human intervention factors, more data redundancy, and improving compression ratio

Pending Publication Date: 2022-03-04
SHANGHAI MAGUS TECH
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is still the problem that it is impossible to describe and record the changes in the compression trend

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Industrial Internet of Things real-time database single-point lossy compression method and device
  • Industrial Internet of Things real-time database single-point lossy compression method and device
  • Industrial Internet of Things real-time database single-point lossy compression method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0067]This embodiment proposes a lossy compression method in a real-time database of the Industrial Internet of Things. First, read in the continuous real-time data of the agreed number of times, and calculate the upper and lower limits of the initial slope and the slope limit rate according to the corresponding real-time collected data and the error allowable range; read in the new data, combine the slope limit rate interval, and calculate the new slope upper limit Lower limit: Compare the upper and lower limits of the slope of the new data with the current upper and lower limits of the slope, and decide whether to save the new data. The present invention aims at the problems that the real-time system of the Industrial Internet of Things generates a large amount of data in a short period of time, the data is redundant, and has high requirements for real-time performance, and there is still room for improvement in the compression ratio and restoration accuracy of the current lo...

Embodiment 2

[0101] Such as Figure 5 As shown, this embodiment provides a single-point lossy compression device for an industrial Internet of Things real-time database, including:

[0102] The data collection module is used for collecting data based on a preset time period, and performing data preprocessing on the collected data;

[0103] The data initialization module is used to calculate the slope between two pairs of the first k preprocessed data, obtain the upper and lower limits of the current slope based on the preset error tolerance range and sort them, and obtain the current slope limit rate at the same time, and determine the slope The data corresponding to the limit rate is used as the slope limit rate point, the data before the slope limit rate point is written into the database, and the slope limit rate point is recorded as "last written data", and the kth data is recorded as "last read data ";

[0104] The data calculation module is used to read in new data, and calculate a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a single-point lossy compression method and a single-point lossy compression device for a real-time database of an industrial internet of things. The method comprises the following steps: firstly, reading continuous real-time data of an appointed number of times, and calculating the upper and lower limits of an initial slope and a slope limit rate according to corresponding real-time collected data and an error allowable range; new data are read in, and new slope upper and lower limits are calculated in combination with a slope limit value rate interval; and comparing the slope upper and lower limits of the new data with the current slope upper and lower limits, and determining whether to store the new data. Aiming at the problems that an industrial internet-of-things real-time system generates a large amount of data in a short time, data redundancy is high, the requirement for real-time performance is very high, and the compression ratio and the reduction precision of an existing lossless compression algorithm still have a space for improving the compression ratio and the reduction precision and the like, through dynamic correction and prediction, quick and efficient lossy compression is carried out on real-time data, and the real-time data compression efficiency is improved. The requirement of the system on the reduction precision can be met while the compression ratio is improved, and the method can be suitable for the storage requirement of a real-time database in the industrial Internet of Things.

Description

technical field [0001] The invention relates to a method in the field of real-time databases, in particular to a method and device for lossy compression of real-time database data of the Industrial Internet of Things through dynamic prediction, correction and inspection. Background technique [0002] With the rapid development of the Industrial Internet of Things, the amount of data that needs to be processed and stored has increased sharply. These data are of great significance for the analysis of production conditions and the monitoring of equipment performance. Recording these data in the database, thus A real-time database is generated. Aiming at the problems that a real-time system generates a large amount of data in a short period of time, has a lot of data redundancy, and has high requirements for real-time performance, it is very necessary to introduce data compression technology into a real-time database system, and look for high compression ratio and high compressi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H03M7/30
CPCH03M7/3059
Inventor 杨永军丁飞朱跃郑雁鹏黄伟韬张美楠马文
Owner SHANGHAI MAGUS TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products