Low-cost efficient internal storage redundancy removing method and system

Abstract

The invention discloses an internal storage space redundancy removing method and system, relates to computer internal storage managing, and belongs to the field of operation systems. The method comprises the steps that a webpage in internal storage space is sampled, wherein sampling coefficients are set, the sampling range is determined according to the sampling coefficients, and the sampled webpage is acquired according to the sampling range; the internal storage space is searched for a webpage with the webpage content same as that of the sampled webpage, the webpage serves as a redundancy webpage and is combined with the sampled webpage, and the information of the redundancy webpage is recorded; the content in the redundancy webpage is deleted, and redundancy in the internal storage space is removed. According to the internal storage space redundancy removing method and system, a scanning area can be dynamically selected, the internal storage space redundancy removing method and system are suitable for a scene with a large number of repeating webpages and also suitable for a scene with a little internal storage redundancy, and the system cost can be reduced.

Description

technical field [0001] The invention relates to computer memory management and belongs to the field of operating systems, in particular to a low-overhead and high-efficiency memory de-redundancy method and system. Background technique [0002] Memory is one of the most important resources of a computer. In order to efficiently use limited memory resources, modern operating systems use many techniques to save memory usage. In recent years, a new technology for saving memory usage has emerged in the Linux operating system, that is, memory de-redundancy technology, that is, KSM (KernelSamepage Merging, memory merging) technology. KSM technology scans the virtual memory area, finds the same physical memory pages, and merges them. This technology makes the memory in use in the host operating system running the virtual machine significantly reduced, and the memory usage efficiency is significantly improved, so that the same physical configuration Linux hosts can run more virtual...

AI Technical Summary

Problems solved by technology

[0007] XEN is a very popular virtual machine software, widely used in cloud computing, VPS (Virtual Private Server, virtual private server) and other fields, similar to KVM, XEN is also an excellent application scenario for memory-oriented deduplication technology, XEN Dedup (a de-redundancy system) can eliminate redundant memory on XEN very well, but XEN Dedup is not based on page content redundancy checks, and the scanning range of XEN Dedup cannot be specified by the user, and some active pages are not merged at all Meaning, its application scenarios are limited to XEN virtualization scenarios

[0008] KSM also has its own problems and deficiencies. A large number of literature and experimental data show that it has strong performance in merging redundant memory between virtual machines. In scenarios where there is very little redundant memory, applying KSM technology to these programs not only cannot reduce memory usage, but also increases memory overhead due to the memory required to run KSM itself

Images