Floating-point-type data lossless compression method for scientific calculation

A data lossless and compression method technology, which is applied in the field of data processing, can solve the problems of slow compression and low compression rate of floating-point data, and achieve the effect of speeding up data compression

Inactive Publication Date: 2015-11-04
XIAN UNIV OF TECH
View PDF2 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a lossless compression method for floating-point data oriente

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Floating-point-type data lossless compression method for scientific calculation
  • Floating-point-type data lossless compression method for scientific calculation
  • Floating-point-type data lossless compression method for scientific calculation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0031] A lossless compression method for floating-point data oriented to scientific computing, mainly for single-precision floating-point data, according to the IEEE754 format, using the high density between data to design mantissa integer (Think Mantissa as Integer, TMI) Compression technology, specifically implemented according to the following steps:

[0032] Step 1. Data compression: map and compress the symbol field, exponent field and mantissa field of floating-point data respectively, and store the compressed data in units of binary bits. The specific steps are as follows:

[0033] Step 1.1, copy the reference data and the compressed data in memory, and convert them into 4-byte integers respectively; wherein, the reference data is the previous compressed data;

[0034] Step 1.2, according to the IEEE754 format, extract the sign field,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a floating-point-type data lossless compression method for scientific calculation. A data compression part comprises steps: a symbol domain, an exponential domain and a mantissa domain of floating-point-type data are mapped respectively and compressed respectively and the compressed data is stored with a binary bit as a unit. A decompression part comprises steps: effective data of the mantissa domain difference, the exponential difference, the symbol domain and the like are obtained from flag bits, and original data is recovered completely according to the IEEE754 format and reference data. In the compression method, data is divided according to physical meanings of floating-point-type data, and the compression ratio is high. The compression method has no excessive data prediction or transformation algorithms, and thus the compression speed of data is accelerated.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a lossless compression method for floating-point data oriented to scientific calculation. Background technique [0002] With the increasing development of society, hundreds of millions of data generated by scientific research (astronomy, biology, oceanography), social network (facebook, QQ, Renren), natural environment monitoring (rainstorm, flood, earthquake), etc. Data is growing explosively, and large-scale data processing is hotly sought after in both industry and academia. [0003] The diversity and exponential growth of data have brought enormous pressure to data storage and transmission, seriously hindering the application and development of high-performance computing in the scientific field. Data compression has always been a hot technology used by people to solve such problems. Finding efficient data compression technology can effectively reduce the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H03M7/30
Inventor 王彬李帆黑新宏刘文娟张丹谢国王磊
Owner XIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products