A file modification algorithm optimization method based on erasure code storage

An optimization method and erasure code technology, which is applied in the field of data storage and erasure code, can solve the problems of large write volume and low data efficiency, and achieve the effect of small write volume and high efficiency

Inactive Publication Date: 2019-06-21
高珍丽
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the stored large file is modified, the content to be modified is often very small, but the amou

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A file modification algorithm optimization method based on erasure code storage
  • A file modification algorithm optimization method based on erasure code storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] The technical solution of the present invention is realized in the following manner, a method for optimizing a file modification algorithm based on erasure code storage, the method comprising:

[0025] The data stored according to the erasure code technology will be split according to the K:M method after calculation by the algorithm, and the K data blocks and the M check blocks are objectified and stored in units of objects;

[0026] When the stored data is modified, when the modified part of the data is mapped to the corresponding data block, the object name corresponding to the data on the block can be located, that is, if the data is modified, the specific object has changed;

[0027] When the data objects are changed, the algorithm will record these changed objects, so that the data objects that have not changed can be locked and the corresponding relationship between them can be marked;

[0028] After the modified data is stored, the new object data will be writte...

Embodiment 2

[0032] As in the above embodiment, the data is stored according to the existing erasure code technology. When the data is modified, only the modified part of the data needs to be rewritten. The algorithm will reorganize the unmodified data and the newly written data. After the data reorganization is completed, it will generate New erasure check data, .

Embodiment 3

[0034] According to the above-mentioned embodiment, the data is stored according to the existing erasure code technology. When the data is modified, only the modified part of the data needs to be rewritten. The algorithm will reorganize the unmodified data and the newly written data. After the data reorganization is completed New erasure verification data will be generated.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an erasure code storage-based file modification algorithm optimization method, which comprises the following steps of: calculating data stored according to an erasure code technology, splitting the data according to a K: M manner, carrying out objectification processing on K data blocks and M check blocks, and storing the K data blocks and the M check blocks by taking an object as a unit; when the stored data is modified and the data of the modified part is mapped to the corresponding data block, an object name corresponding to the data on the block can be positioned, i.e., the data is modified and a specific object is changed; when the data objects are changed, the changed objects can be recorded by the algorithm, so that the data objects which are not changed canbe locked, and the corresponding relationship among the data objects can be marked; and writing the modified data into new object data after the modified data is stored. The method has the advantagesthat the writing amount of the modified stored large file is small, and the re-storage efficiency of the modified data is high.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to the technical field of erasure codes. Background technique [0002] From RAID technology to distributed storage systems, erasure codes are now widely used in storage systems to ensure the security of stored data. However, when the stored large file is modified, the content to be modified is often very small, but the amount of writing after modification is large, resulting in low efficiency of data modification and re-storage. Contents of the invention [0003] The main purpose of the present invention is to optimize the data modification part based on the existing erasure code storage technology, reduce the amount of data written after the data is modified, and improve the efficiency of data modification. [0004] In order to achieve the above object, the present invention provides a file modification algorithm optimization method based on erasure code storage, the method...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/10
Inventor 高珍丽
Owner 高珍丽
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap