Data compression method and device

A data compression and data technology, applied in the field of data processing, can solve problems such as disk space occupation and disk space waste, and achieve the effects of improving performance, reducing disk fragments, and improving pre-reading accuracy

Inactive Publication Date: 2017-05-17
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method and device for data compression to overcome the defects of the prior art that data is compressed and written to the disk, many disk fragments are generated in the disk, a large amount of disk space is occupied, and disk space is wasted

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data compression method and device
  • Data compression method and device
  • Data compression method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Embodiment one: a kind of data compression device of the present invention such as figure 1 Shown, comprise data writing module 12, data reading module 14, data compression module 16, parameter setting module 11, judging module 15, information sending module 13 and data writing disk module 17; Described parameter setting module 11 is sequential With data writing module 12 , information sending module 13 , data reading module 14 , judgment module 15 , data compression module 16 and data writing module 17 to disk.

[0040] The parameter setting module 11 is used to pre-set the value of the time window and the fixed capacity; the data writing module 12 is used to write the data into the compressed cache; the information sending module 13 is used to return the success of writing data to the host; the data reading module 14 It is used for the compression engine to read data from the compression cache in a fixed-capacity mode or the compression engine reads data from the comp...

Embodiment 2

[0041] Embodiment two: a method of data compression of the present invention such as figure 2 shown, including the following steps:

[0042] Step S201, setting the values ​​of the time window and the fixed capacity in the system file in advance.

[0043] Step S202, writing the data into the compressed cache.

[0044] Step S203, returning data writing success to the host, realizing online real-time data compression.

[0045] Step S204, the compression engine reads data from the compressed cache in a fixed-capacity manner according to the time window; the data in the same time window has a high degree of correlation, and the time window is used to improve the pre-reading accuracy of the compressed data degree, thereby improving the performance of the system. Data in the same time window is recorded through metadata, which shortens the time for the compression engine to read data from the compression cache.

[0046] Step S205, judging whether the capacity of the data reaches...

Embodiment 3

[0058] Embodiment 3: Another data compression device of the present invention such as Figure 4 As shown, it includes a data writing module 41 , a data reading module 42 and a data compression module 43 , and the data reading module 42 is connected to the data writing module 41 and the data compression module 43 respectively.

[0059] The data writing module 41 is used for writing data into the compression cache; the data reading module 42 is used for the compression engine to read data from the compression cache in a fixed capacity mode; the data compression module 43 is used for the compression engine to read the above-mentioned data to compress.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data processing, and discloses a data compression method which includes the steps: firstly, writing data into a compression buffer memory; secondly, reading the data from the compression buffer memory by a compression engine in a fixed capacity manner; finally, compressing the read data by the compression engine. The invention further discloses a data compression device which comprises a data writing module, a data reading module and a data compression module, the data writing module is used for writing the data into the compression buffer memory, the data reading module is used for reading the data from the compression buffer memory by the compression engine in a fixed capacity manner; the data compression module is used for compressing the read data by the compression engine. The data compression method solves the problems that compressed data are written in the disk, disk fragmentations are generated in a disk, a lot of disk space is occupied, so that disk space is wasted in the prior art.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data compression method and device. Background technique [0002] In today's society, massive amounts of data are generated every day, and many of these generated data are repetitive data. How to analyze and use these data reasonably and save them in disk is a very important task. Saving such huge data requires too many disks to complete, which will greatly increase the cost of an enterprise, especially Internet companies. Therefore, it is necessary to compress the data before saving the data, which can greatly save disk space and improve disk space utilization. [0003] There are many compressed products at present, but most of the compressions are based on fixed blocks for data input, and then these input data no longer have a fixed size after compression, and it is difficult for these data to have a uniform format when stored on the disk. A lot of disk fragments ar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0638G06F3/0655G06F3/0656G06F3/0676
Inventor 赵鹏
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap