A data storage method and device, a data recovery method and device

A data storage and data technology, applied in the field of computer information, can solve the problems of IO consumption and ineffective use of IO, and achieve the effect of reducing the amount of data and reducing the data

Active Publication Date: 2019-03-12
北京三快云计算有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, in the recovery process of the invalid data block, the above-mentioned RS method usually needs to read all the non-invalid data blocks and parity blocks, that is, the above-mentioned RS method cannot effectively use IO (input output, InputOutput) in the data recovery process. ), usually 30% redundant RS method needs to read 100M data during the data recovery process, which will cause 10 times IO consumption

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data storage method and device, a data recovery method and device
  • A data storage method and device, a data recovery method and device
  • A data storage method and device, a data recovery method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0075] In order to make the above objects, features and advantages of the present application more obvious and comprehensible, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0076] Storage method embodiment

[0077] refer to figure 1 , which shows a flow chart of the steps of an embodiment of a data storage method of the present application, which may specifically include the following steps:

[0078] Step 101, according to the local data of the data to be stored, split the rows of the overall generation matrix to obtain the corresponding local generation matrix; the split rows of the local generation matrix may include zero elements;

[0079] Step 102: Using the local generation matrix, encode the overall data of the data to be stored to obtain corresponding overall verification data; the overall verification data may specifically include: local verification data related t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the present application provides a data storage method and device, a data recovery method and device, wherein the data recovery method specifically includes: for the data to be recovered, reading the corresponding local verification data and Local data; wherein, the local verification data is obtained by encoding the overall data of the data to be stored according to a local generation matrix, the local generation matrix is ​​obtained by splitting the rows of the overall generation matrix, and the local generation The split rows of the matrix include zero elements; the data to be restored is restored according to the read partial check data and partial data. The embodiment of the present application can reduce the amount of data read during the data recovery process, and further can greatly reduce the IO consumption during the data recovery process.

Description

technical field [0001] The present application relates to the field of computer information technology, in particular to a data storage method and device, and a data recovery method and device. Background technique [0002] At present, with the rapid development of the information technology industry, due to cost, reliability and other considerations, more and more manufacturers choose to deploy distributed systems in their products, which makes distributed systems develop rapidly. [0003] In the existing distributed system architecture, files are generally divided into multiple data blocks for storage; in order to ensure the robustness and disaster recovery capabilities of the system, data blocks generally have multiple copies and are stored in different physical location. However, the above-mentioned multi-copy disaster recovery method needs to configure more storage devices, thereby increasing the cost of storage devices. Taking three copies as an example, the above-men...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/10G06F11/14
CPCG06F11/1068G06F11/1469G06F11/10H03M13/1515H03M13/373H03M13/616G06F11/1076
Inventor 张帅陈晓辉尹殷李凯
Owner 北京三快云计算有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap