Systems and methods for data compression

A data compression and data block technology, applied in the field of communication, can solve the problem that the compression speed is difficult to meet the increasing demand of data volume and data generation speed, and achieve the effect of rapid compression and improvement of energy efficiency

Active Publication Date: 2018-12-07
HUAWEI TECH CO LTD +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the current compression speed is still difficult to meet the increasing demand of data volume and data generation speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for data compression
  • Systems and methods for data compression
  • Systems and methods for data compression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0029] figure 1 It is a schematic block diagram of a data compression system 100 according to an embodiment of the present invention. Such as figure 1 As shown, the system 100 includes a preprocessing module 110 , a management module 120 and a compression module 130 .

[0030] specific, figure 2 As shown, the preprocessing module 110 is configured to obtain the compression information of each data block in N data blocks, where N is a positive integer g...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present invention provide a system and method for data compression. The system includes: a preprocessing module, used for acquiring compression information of each data block in N data blocks; a management module, used for according to the preprocessing The compression information of each data block obtained by the module determines resource allocation information, and the resource allocation information includes N target parallelisms corresponding to the N data blocks one-to-one; Allocate information to generate N compression processors. The embodiments of the present invention can dynamically adjust the parallelism of the compression processors for data blocks to be compressed with different compression information, so that the parallelism of the multiple compression processors generated by the compression module can further improve the system compression speed under the condition of satisfying the system compression speed. Therefore, the embodiments of the present invention can flexibly and quickly implement data compression.

Description

technical field [0001] The present invention relates to the communication field, and more particularly, to a data compression system and method in the communication field. Background technique [0002] With the continuous growth of data volume and data generation speed, data storage and analysis put forward higher performance requirements for data compression. On the one hand, data compression can significantly reduce the storage space of data on the disk; on the other hand, data compression can reduce the bandwidth requirements for data transmission in the network and data analysis system. [0003] Among many data compression algorithms, LZ77 provides a lossless data compression algorithm based on dictionaries, and has become the basis of most LZ algorithm variants such as LZW, LZSS, etc. and some other compression algorithms. For byte strings that have already appeared, LZ77 replaces repeated occurrences with a "distance-length" pair pointing to its matching byte string. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06H04L29/08
CPCH04L63/0245H04L63/0428H04L69/04H04L67/5651
Inventor 汪玉李於彬孙羽良
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products