Data parallelism compression method

A compression method and data technology, applied in the direction of electrical components, code conversion, etc., can solve the problems of reducing the cost of compression process time, not high, to achieve the effect of reducing time cost, increasing parallelism, and improving performance

Active Publication Date: 2013-09-25
TSINGHUA UNIV
View PDF3 Cites 70 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of the above, it is necessary to provide a data parallel compression method, which can greatly reduce the time overhead of the compression process while achieving a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data parallelism compression method
  • Data parallelism compression method
  • Data parallelism compression method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Such as figure 1 Shown is the application environment diagram of the data parallel compression system of the present invention. The data parallel compression method is applied in the electronic device 1 to compress, encode and decode data. The electronic device 1 also includes a memory 12 , a data parallel compression system 13 and a processor 14 , and the electronic device 1 is also connected to the storage device 3 and the client 2 . The electronic device 1 and the client 2 may be a computer, a mobile phone, a PDA (Personal Digital Assistant, personal digital assistant) and the like. The storage device 3 is used for storing the data to be compressed, and may be a magnetic disk, a hard disk, a floppy disk, and a U disk.

[0020] The memory 12 is used to store the program code of the data parallel compression system 13 and compressed data and other materials.

[0021] The processor 14 is used to execute a series of computer program segments with certain fixed functio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data parallelism compression method. The data parallelism compression method comprises the step of reading, namely, data to be compressed are read from a memory device through an I/O, the step of segmenting, namely, data to be compressed are evenly segmented into N data blocks which are stored in an input buffering area corresponding to each data block, the step of compressing and encoding, namely, processes control the data blocks in the corresponding input buffering areas, the data blocks are compressed and encoded through a multithreading method, and the data which are compressed and encoded are stored in an output buffering area, and the step of writing, the data which are compressed and encoded in all processes in the output buffering area are merged, and the merged data are written to an output file. According to the data parallelism compression method, an ideal compression ratio is obtained, time for compressing is greatly shortened, the data parallelism compression method can be well applied to a cloud storage or database system, the problem of low compression timeliness is solved, and whole performance of compression is improved.

Description

technical field [0001] The invention relates to the field of data compression, in particular to a data parallel compression method. Background technique [0002] A data compression algorithm refers to an algorithm that uses fewer bits to represent original data by means of encoding. The functions of the data compression algorithm mainly include three aspects: 1. Reduce the consumption of storage space brought by massive data; 2. Store and read disk data after data compression, reducing the I / O load. Thus, the overall performance of the system is improved; 3. Data compression before transmission can reduce the load on network bandwidth. [0003] There are two main indicators for evaluating the quality of a compression algorithm: compression time and compression ratio. The compression time refers to the time required for the compression process, and the compression ratio refers to the ratio of data size before and after compression. Compression time and compression ratio are...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H03M7/30
Inventor 付昊桓甘霖魏腾鹏王英侨黄小猛杨广文
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap