A file migration method and related device based on file classification
A file migration and file grading technology, which is applied in the file system, file access structure, file system management, etc., can solve the problems of small fast pool space, fast pool write-through, and impact on storage system performance, so as to improve overall performance and avoid The effect of writing through
Active Publication Date: 2022-07-22
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Fast pools are expensive, so fast pools have less space
Since the data is first written into the fast pool, when the water level of the fast pool is high, that is, when there is a lot of data written in the fast pool, if the data in the fast pool cannot be migrated out in time, the newly created data cannot be written into the fast pool , resulting in the risk of the fast pool being written through, affecting the overall performance of the storage system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0043] The core of the present application is to provide a file migration method based on file classification, which can prevent the fast pool from being written through and improve the overall performance of the storage system. Another object of the present application is to provide a file migration device, device and computer-readable storage medium based on file classification, all of which have the above technical effects.
[0044] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary s...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present application discloses a file migration method based on file classification, including querying whether there is a high-water-level data pool; the high-water-level data pool is a data pool whose data volume reaches a preset percentage; when there is no high-water-level data pool, sequentially Migrate each to-be-migrated file in the index table; when there is a high-water data pool, migrate the to-be-migrated files located in the high-water data pool in the index table one by one, and each time the high-water data pool is located in the file to be migrated After the to-be-migrated files in the pool are migrated, query whether there is still a high-water-level data pool, and then migrate the remaining files to be migrated in the index table in sequence until there is no high-water-level data pool. This method can prevent the fast pool from being written through, and improve the overall performance of the storage system. The present application also discloses a file migration device, device and computer-readable storage medium based on file classification, all of which have the above technical effects.
Description
technical field [0001] The present application relates to the technical field of distributed storage, in particular to a file migration method based on file classification; and also to a file migration device, device and computer-readable storage medium based on file classification. Background technique [0002] The distributed storage system is a cluster composed of multiple file storage node servers. The files are stored in blocks, and the object is the basic unit. It supports a piece of data to be stored on multiple nodes, and each node can obtain complete data through inter-node communication. data. When the node is down, complete data recovery can be performed according to the configured strategy, which has the characteristics of high availability, high performance, and high scalability. Each node provides a metadata server for various access operations of metadata to balance business pressure. A distributed storage system will be configured with fast pools such as so...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/11G06F16/13G06F16/182
CPCG06F16/119G06F16/13G06F16/182
Inventor 孙业宽孟祥瑞
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD