Unlock instant, AI-driven research and patent intelligence for your innovation.

Lossy compression method with pointwise relative error limit

A relative error and lossless compression technology, applied in the field of lossy compression, can solve the problems of time-consuming and complex lossy compression, and achieve the effect of avoiding logarithmic transformation and accelerating lossy compression

Active Publication Date: 2019-07-05
HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Leads to complex and time-consuming lossy compression with point-wise relative error bounds

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lossy compression method with pointwise relative error limit
  • Lossy compression method with pointwise relative error limit
  • Lossy compression method with pointwise relative error limit

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] The present invention will be further described below in conjunction with the description of the drawings and specific embodiments.

[0021] Such as figure 1 As shown, a method of lossy compression with point-by-point relative error bounds includes the following steps:

[0022] A. Tabulation, according to the error requirements provided by the user and the interval of the quantization factor to tabulate, for use in subsequent steps;

[0023] B. Obtain the quantization factor and calculate the actual value X i and predicted value X′ i ratio of Then use the table generated in step A to query the quantization factor through the obtained R;

[0024] C. Huffman coding, compressing the sequence of quantization factors generated in step B by Huffman coding;

[0025] D. Use a lossless compression method, using a conventional lossless compression method such as gzip or zstd to compress the Huffman code and the Huffman tree generated in step C.

[0026] Such as figure 2 ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a lossy compression method with a pointwise relative error limit, which comprises the following steps of: A, tabulation: performing tabulating according to an error requirementand an interval of a quantization factor; b, obtaining a quantization factor; c, Huffman coding: compressing the quantization factor sequence generated in the step B through the Huffman coding; and D,compressing the Huffman code and the Huffman tree generated in the step C by using a lossless compression method. The method has the beneficial effects that time-consuming logarithmic transformationin lossy compression with a point-by-point relative error limit can be avoided, a quantization factor value is obtained by looking up a table, and lossy compression with the point-by-point relative error limit is greatly accelerated.

Description

technical field [0001] The present invention relates to a lossy compression method, in particular to a lossy compression method with a point-by-point relative error limit. Background technique [0002] Scientific simulations in high-performance computing (HPC) environments generate huge amounts of data, which can cause severe I / O bottlenecks at runtime and impose huge storage space burdens for post-analysis. Unlike traditional data reduction schemes such as deduplication or lossless compression, lossy compression can significantly reduce data size while meeting user requirements for error control. To automatically adapt to the accuracy requirements in datasets, lossy compression with point-wise relative error bounds (ie, the compression error depends on the data value) is widely used in many scientific applications. [0003] The original lossy compression with point-by-point relative error bounds requires all data to undergo a logarithmic transformation during the compressi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H03M7/40
CPCH03M7/40
Inventor 夏文邹翔宇王轩张伟哲
Owner HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL