Numeric data compression method and system based on bitwise variable-length storage

A data compression and numerical technology, applied in the direction of electrical digital data processing, digital data information retrieval, digital data processing components, etc., can solve the problem of insufficient data storage capacity

Pending Publication Date: 2021-03-19
SHANDONG LUNENG SOFTWARE TECH
View PDF9 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] In order to overcome the deficiencies of the above-mentioned prior art, the present disclosure provides a numerical data compression method based on bit-wise variable-length storage to reduce the amount of time series data and solve the problem of tight data storage capacity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Numeric data compression method and system based on bitwise variable-length storage
  • Numeric data compression method and system based on bitwise variable-length storage
  • Numeric data compression method and system based on bitwise variable-length storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] This embodiment discloses a numerical data compression method based on bit-by-bit variable-length storage, which compresses and decompresses data by analyzing the binary storage format of the data, so as to reduce the amount of time series data and solve the problem of insufficient data storage capacity. In the process of integer data compression, from the high bit to the low bit, the storage bits that are consecutively 0 in the binary storage unit are removed, and only the effective bits containing 1 are stored; in the process of floating-point data compression, according to the actual size and precision range of the value, Implement drop storage. Based on the above ideas, the numerical and string data can be stored with variable length. No matter how the data precision of the database is set, they can be stored according to the minimum length to realize data compression processing; during the decompression process, there is no need to associate up and down, only need t...

Embodiment 2

[0106] The purpose of this embodiment is to provide a computing device, including a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the program, the method in the first embodiment above is implemented. A step of.

Embodiment 3

[0108] The purpose of this embodiment is to provide a computer-readable storage medium.

[0109] A computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps of the method in the first embodiment above are performed.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a numeric data compression method based on bitwise variable-length storage. The numeric data compression method comprises the steps: judging the data type of to-be-compressed data; querying a memory binary storage mode of the to-be-compressed data, judging whether the adjustment of the length of the data type unit meets a compression condition or not, and determining the to-be-compressed data again; performing variable-length storage on the to-be-compressed data so as to store the to-be-compressed data according to the minimum length, and achieving data compression processing: in the integer data compression process, removing continuous 0 storage bits in the binary storage unit from a high bit to a low bit, and only storing 1-containing valid bits; in the floating point type data compression process, carrying out bit reduction storage according to the actual size and the precision range of the numerical value. By means of the storage mode of the data in the computer, bit-by-bit variable-length storage is achieved, up-down associated information and other key information between the data do not need to be considered, compression bits do not need to be stored,and compression storage can be achieved to the maximum extent on an existing storage structure.

Description

technical field [0001] The disclosure belongs to the technical field of electric power sequential data compression, and in particular relates to a numerical data compression method and system based on bit-by-bit variable-length storage. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] With the development of electric power informatization, a large amount of business data has been accumulated in the long-term operation. At the same time, business operations urgently need to obtain more and more valuable information from the vast amount of data. Therefore, electric power big data technology is widely used in the electric power industry. It has received extensive attention and vigorous development. Due to the continuity of power production, the number of real-time data collection points usually ranges from thousands to hundreds of thousands,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/174G06F3/06G06F7/499
CPCG06F16/1744G06F3/0608G06F7/49947
Inventor 赵鹏王立峰李洪海马晶董斌陶明峰翟勇任兴辉苑丽伟张荣贵路宽
Owner SHANDONG LUNENG SOFTWARE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products