Fragmentation management method and fragmentation management device
A management method and sharding technology, which is applied in the computer field, can solve problems such as rising user costs and verifying shards occupying a large storage space.
Active Publication Date: 2020-11-06
HUAWEI TECH CO LTD
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, verifying shards also takes up a lot of storage space, and when using expensive high-speed storage media, it will lead to a substantial increase in user costs
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0037] The terms "comprising" and "having" and any variations thereof in the description and claims of the present invention and the above drawings are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally further includes For other steps or units inherent in these processes, methods, products or apparatuses. The terms "first", "second", "third" and "fourth", etc. are used to distinguish different objects, not to describe a specific order.
[0038] The embodiments of the present invention can be applied to a distributed storage system scenario. The distributed storage system referred to in the embodiment of the present invention means a storage system including a plurality of storage media (storage media such as solid-state disk SSD, magnetic disk, U disk, rewritabl...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A slice management technology, applied in a distributed storage system, the computing node reads the metadata of the first check slice, and obtains the first storage location where the first check slice is located; The computing node selects a second storage location, the second storage location is located in a second-level storage medium, the reading speed of the second-level storage medium is lower than that of the first-level storage medium, and the second storage location has Free space; the computing node sends a migration instruction to the storage node where the first verification segment is located, instructing the storage node where the first verification segment is located to send the first verification segment to the second The storage node where the storage location is located; the storage node where the second storage location is located stores the first verification fragment in the second storage location; the computing node instructs to update the information of the second storage location to the second storage location - Verify the metadata of the shard. Applying this technology can reduce the occupation of high-speed storage media and reduce the cost of the storage system.
Description
technical field [0001] The present invention relates to computer technology, in particular to the field of storage. Background technique [0002] Distributed storage methods such as cloud storage are becoming increasingly popular. With the explosive growth of information, the data scale of users in the cloud storage system is also increasing. The ever-increasing amount of data has brought cost pressures to both storage service providers and users. [0003] In order to improve data reliability, the cloud storage system will perform erasure code (EC) technology redundancy on the data. The redundant data is divided into data slices and check slices (collectively referred to as slices). When the total number does not exceed the threshold, arbitrarily damage some shards, and rely on undamaged shards to reconstruct the damaged shards. Furthermore, in addition to the EC, a local reconstruction code (LRC) technology may also be used. In the LRC technology, parity slices include a...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0638G06F3/0647G06F3/067G06F3/061G06F3/0685G06F11/1076G06F3/0604G06F3/0619
Inventor 王晨姚唐仁王锋
Owner HUAWEI TECH CO LTD