Erasure code storage-based file modification algorithm optimization method

An optimization method and erasure coding technology, applied in the field of data storage and erasure coding, can solve the problems of low data efficiency and large writing volume, and achieve the effect of small writing volume and high efficiency

Inactive Publication Date: 2017-04-26
TOYOU FEIJI ELECTRONICS
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the stored large file is modified, the content to be modified is often very small, but the amount of writing after the modification is large, resulting in low efficiency of data modification and re-storage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Erasure code storage-based file modification algorithm optimization method
  • Erasure code storage-based file modification algorithm optimization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] The technical solution of the present invention is realized in the following manner, a method for optimizing a file modification algorithm based on erasure code storage, the method comprising:

[0026] The data stored according to the erasure code technology will be split according to the K:M method after calculation by the algorithm, and the K data blocks and the M check blocks are objectified and stored in units of objects;

[0027] When the stored data is modified, when the modified part of the data is mapped to the corresponding data block, the object name corresponding to the data on the block can be located, that is, if the data is modified, the specific object has changed;

[0028] When the data objects are changed, the algorithm will record these changed objects, so that the data objects that have not changed can be locked and the corresponding relationship between them can be marked;

[0029] After the modified data is stored, the new object data will be writte...

Embodiment 2

[0033] As in the above embodiment, the data is stored according to the existing erasure code technology. When the data is modified, only the modified part of the data needs to be rewritten. The algorithm will reorganize the unmodified data and the newly written data. After the data reorganization is completed, it will generate New erasure check data, .

Embodiment 3

[0035] According to the above-mentioned embodiment, the data is stored according to the existing erasure code technology. When the data is modified, only the modified part of the data needs to be rewritten. The algorithm will reorganize the unmodified data and the newly written data. After the data reorganization is completed New erasure verification data will be generated.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses an erasure code storage-based file modification algorithm optimization method. The method comprises the steps of calculating data stored through an erasure code technology by using an algorithm, then splitting the data in a K:M manner, performing object processing on K data blocks and M verification blocks, and then storing in a unit of object; when the stored data is modified, mapping the modified data to the corresponding data block, so as to locate an object name corresponding to data on the block, that is, data modification refers to change of a specific object; when the data object is changed, recording the changed objects by the algorithm so as to lock unchanged data objects, and marking a correspondence; and writing new object data after the modified data is stored. The method has the advantages that the writing amount of the modified stored large file is small and modified data is restored efficiently.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to the technical field of erasure codes. Background technique [0002] From RAID technology to distributed storage systems, erasure codes are now widely used in storage systems to ensure the security of stored data. However, when the stored large file is modified, the content to be modified is often very small, but the amount of writing after modification is large, resulting in low efficiency of data modification and re-storage. Contents of the invention [0003] The main purpose of the present invention is to optimize the data modification part based on the existing erasure code storage technology, reduce the amount of data written after the data is modified, and improve the efficiency of data modification. [0004] In order to achieve the above object, the present invention provides a file modification algorithm optimization method based on erasure code storage, the method...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/0619G06F3/064G06F3/067G06F3/0689
Inventor 张勤孟军
Owner TOYOU FEIJI ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap