Hardware realizing system for improved LZ4 compression algorithm

A hardware implementation and compression algorithm technology, applied in electrical components, code conversion, etc., can solve the problems of low processing efficiency, large CPU resource occupation, poor compression rate, etc., and achieve the goal of reducing CPU load, strong processing performance, and low delay Effect

Active Publication Date: 2015-12-30
SOUTHEAST UNIV
View PDF7 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it is precisely because the LZ4 compression algorithm reduces the number of hash table updates to improve the compression speed that the compression rate of the LZ4 compression algorithm will be worse than other compression algorithms based on LZ variants.
However, all current evaluations of the LZ4 compression algorithm are based on software implementation. Due to the limitation of the CPU architecture, the speed advantage of the LZ4 compression algorithm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hardware realizing system for improved LZ4 compression algorithm
  • Hardware realizing system for improved LZ4 compression algorithm
  • Hardware realizing system for improved LZ4 compression algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The technical scheme of the present invention is described in detail below in conjunction with accompanying drawing:

[0035] figure 1 It is a kind of improved LZ4 compression algorithm flowchart of the present invention; As figure 1 Shown, a kind of improved LZ4 compression algorithm of the present invention comprises the following steps:

[0036] Step 1. Initialize the hash table and sliding dictionary. The contents of all hash table storage units are initialized to 0. The initial address and tail address of the sliding dictionary coincide, that is, the capacity of the sliding dictionary is 0; when the hardware circuit is initialized, the size of the sliding dictionary is 0. , and then process the subsequent characters one by one, and the processed characters will gradually become part of the sliding dictionary until the continuous characters contained in the sliding dictionary reach 64KB;

[0037]Step 2, read in the first 4-byte character string from the file to be...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hardware realizing system for an improved LZ4 compression algorithm. The speed is higher than the processing speed of a current existing LZ series lossless compression algorithm, and the improved LZ4 compression algorithm is suitable for high-bandwidth data compression occasions. According to the realizing method for the improved LZ4 compression algorithm, a method for full-range word-for-word hash is adopted, and the defect that in an original LZ4 algorithm, hash table recording is not carried out in matched character strings is overcome. The invention further discloses the hardware realizing system for realizing the algorithm, a hardware circuit is utilized for realizing the improved LZ4 compression algorithm, and the maximum performance of the compression algorithm can be brought into play. The compression speed is higher than that of the current existing LZ series lossless compression algorithm, and possibility is provided for using LZ compression algorithm in the high-bandwidth data processing process.

Description

technical field [0001] The invention relates to computer data lossless compression technology, in particular to a hardware realization system of an improved LZ4 compression algorithm. Background technique [0002] With the rapid development of computer and network technology, the amount of data generated by the Internet every day is showing an explosive growth trend. How to store the continuously generated massive data and how to improve the utilization efficiency of memory is becoming a major problem for storage system designers. [0003] Since two Israeli researchers J.Ziv and A.Lempel proposed the LZ77 compression algorithm in 1977, various variants of the LZ compression algorithm based on dictionary matching have been proposed, including LZ78, LZW, LZO, LZSS, etc. Most of the variants based on LZ77 are widely used for lossless compression of text and bitmap, and the efficiency of its compression coding can largely approach the information entropy value of the source. Ho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H03M7/30
Inventor 李冰顾巍王超凡董乾陈帅赵霞刘勇王刚
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap