An adaptive data compression system and method thereof
A data compression and self-adaptive technology, applied in the field of compression system, can solve the problems of lack of opening or closing the compression function, inflexible data compression method, etc., to overcome the inflexibility of the compression method, improve the space utilization rate, and improve the space utilization rate Effect
Active Publication Date: 2020-11-17
NANJING CITY VOCATIONAL COLLEGE
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0007] In the existing storage system, the method of data compression is very inflexible, either turn on the compression function, or turn off the compression function, or adopt the same compression strategy for data with different temperatures
There is no need to dynamically turn on or turn off the compression function according to the compression rate and access popularity, and there is an urgent need to propose an adaptive data compression method and system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0029] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. The following examples are explanations of the present invention and the present invention is not limited to the following examples.
[0030] Such as figure 1 As shown, an adaptive data compression system of the present invention includes a time control module, a heat judgment module, and a compression and decompression control module, and the time control module, heat judgment module, and compression and decompression control module are connected in pairs.
[0031] Time control module, the system slices the time according to the time slice threshold, and the access frequency counted at the end of the current time slice determines the current popularity of the data, which also determines the acceptable compression of the data in the current time slice Rate.
[0032] The popularity judgment module, which is responsible for recording the access freq...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an adaptive data compression system. The system is characterized by comprising a time control module, a heat judgment module and a compression and decompression control module which are interconnected, wherein the time control module is used for slicing time according to a time slicing threshold; the heat judgment module is used for recording access frequency of each data of a current time slice and performing heat judgement on all the data according to the access frequency when the time slice is finished; and the compression and decompression control module is used for traversing all the data when the current time slice starts. According to the invention, the defect of inflexibility of a conventional compression method in an existing storage system is overcome, the data is compressed at a reasonable compression ratio, the space utilization rate is improved, the read / write performance is also enhanced, and the benefit gained by the system due to compression is far greater than the cost generated due to the compression.
Description
technical field [0001] The invention relates to a compression system and its method, in particular to an adaptive data compression system and its method. Background technique [0002] In storage systems (including but not limited to distributed file systems, local file systems, distributed block storage systems, object storage systems, databases, etc.), data (including but not limited to files, data fragments, data pages, metadata, etc. ) compression technology is a conventional means to save storage space and reduce costs (hereinafter collectively referred to as revenue). However, data compression technology increases the amount of calculation. When reading data, it must be decompressed before reading, and when writing, it must be compressed and placed on the disk first, which will increase the burden on the CPU and increase the delay of reading and writing data (hereinafter collectively referred to as cost). In a sense, data compression technology is a typical technology ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H03M7/30
CPCH03M7/30
Inventor 强慧媛杨洪章
Owner NANJING CITY VOCATIONAL COLLEGE