Supercharge Your Innovation With Domain-Expert AI Agents!

Method and device for incremental compression based on dynamic anchor points

A technology of incremental compression and anchor point, applied in the field of data processing, it can solve the problems that the reference data cannot match the target data, the character string cannot be found, and the compression ratio is reduced.

Inactive Publication Date: 2018-07-10
深圳前海信息技术有限公司
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to certain delete or insert operations, the reference data often cannot match the target data
However, if the misalignment between the reference data and the target data is too large, the target data input in the reference data window cannot find a matching string, which will greatly reduce the compression ratio.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for incremental compression based on dynamic anchor points
  • Method and device for incremental compression based on dynamic anchor points
  • Method and device for incremental compression based on dynamic anchor points

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0056] It should be noted that the descriptions of "first", "second" and so on in the present invention are only for the purpose of description, and should not be understood as indicating or implying their relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In addition, the technical solutio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for incremental compression based on dynamic anchor points. The method comprises following steps: scanning a target data stream and a reference data streamaccording to the rolling Hash algorithm, and marking the target candidate anchor point with the same rolling hash value as the reference candidate anchor point as an anchor point pair; dividing the reference data stream and the target data stream into multiple paragraphs using the anchor pair; for paragraphs that have not been changed, recording the interval of the paragraph and encoding; for thechanged paragraph, when the target data stream and the reference data stream flow into the matching module for string matching, the target window or reference window is automatically aligned accordingto the detected anchor point pair; encoding the results of string matching; outputting encoded data. The technical solution of the invention can simplify calculation and improve operation efficiency;can save a large amount of memory resources on the chip, can be realized by hardware.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a method and device for incremental compression based on dynamic anchor points. Background technique [0002] Unlike most current compression techniques, which involve processing a single data stream, delta compression compresses data by computing the delta between a target data stream and a reference data stream. A delta can be viewed as an encoding of the difference between the target and reference data streams, and thus, the target data stream can also be recovered from the deltas and the reference data stream. [0003] Delta compression was first applied in version control systems. By storing different version deltas instead of actual data, system storage requirements can be significantly reduced. For example, MacDonald's Xdelta File System (XDFS) is implemented using delta compression. Another application of delta compression is software distribution, typi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30H03M7/30
CPCG06F16/90344H03M7/30
Inventor 张宇弘王界兵张伟董迪马耿涛黄嘉乐
Owner 深圳前海信息技术有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More