A storage optimization method based on data compression and data deduplication
A data compression and storage optimization technology, applied in memory address/allocation/relocation, input/output to record carrier, etc., can solve the problem of data compression mechanism and data de-redundancy mechanism not working together, and achieve good time efficiency and storage efficiency, universal applicability, optimization and perfection
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0027] Such as figure 1 As shown, this embodiment discloses a storage optimization method based on data compression and data deduplication collaboration, including the following steps:
[0028] Step 1, assuming that the computer needs to reclaim and release the space of N data blocks in the storage medium (memory, disk) to store more new data under certain circumstances, the candidate data block set DSet that can be used for release contains M data blocks (M>N), then the data storage ratio S=N / M expected to be released by this processing. Set the sampling ratio threshold R, 0%<R≤100%, and the data de-redundancy execution percentage threshold P, 0%<P≤100%;
[0029] Step 2, use the random generator provided by the system to generate a random seed, fill in the pseudo-random algorithm to generate a data block random scanning sequence Block 1 、Block 2 、...Block M ;
[0030] Step 3, choose a fast deduplication scanning hash algorithm H, and block the first M×R data blocks 1 、B...
Embodiment 2
[0039] This implementation case discloses the application of a storage optimization method based on the collaboration of data compression and data deduplication to memory management of an operating system. The implementation scenarios are as follows:
[0040] A computer system has a fixed size of physical memory RAM and disk swap SWAP. If the program in the system is constantly applying for memory exceeding the capacity of RAM, then the system needs to perform slow disk swap in exchange for more physical memory space. Contemporary operating systems such as Linux and OS X have memory compression mechanism (ZSWAP) and page memory deduplication mechanism (KSM) to relieve the pressure of swapping and improve the efficiency of system memory usage, but they cannot work together.
[0041] In this scenario, the specific implementation steps of the method in this embodiment are:
[0042] Step 1, assuming that the system attempts to reclaim N pages due to insufficient memory space at a...
Embodiment 3
[0051] This implementation case discloses the application of a storage optimization method based on data compression and data deduplication cooperation in a disk storage system. The implementation scenarios are as follows:
[0052]A computer system uses a hard disk to store file data, organizing data in 4k disk blocks. If the disk is getting full, you need to optimize storage space to get more free storage. Contemporary server file systems such as zfs, btrfs, etc. all have the functions of deduplication and compression at the same time. However, these two functions operate independently in a synchronous or asynchronous manner, and the two cannot work together. After implementing the method, the hard disk storage can obtain more free storage, and the overall optimization speed is improved.
[0053] In this scenario, the specific implementation steps of the method in this embodiment are:
[0054] Step 1, assuming that there are only A free data blocks in the computer disk, bu...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com