Increment erasure code storage method and increment erasure code storage system under multiple network disks

A storage system and erasure code technology, applied in the field of high-efficiency access device systems, can solve the problems of storage cloud space waste, low access efficiency, and low reliability

Active Publication Date: 2016-07-13
TIANJIN UNIVERSITY OF SCIENCE AND TECHNOLOGY
View PDF4 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to solve the problems of low reliability of files, extremely low access efficiency and invalid waste of storag

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Increment erasure code storage method and increment erasure code storage system under multiple network disks
  • Increment erasure code storage method and increment erasure code storage system under multiple network disks
  • Increment erasure code storage method and increment erasure code storage system under multiple network disks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0086] Embodiment 1. Incremental erasure code storage system based on multiple network disks

[0087] The incremental erasure code storage system based on multiple network disks provided by the present invention includes the following:

[0088] The "file system meta server" device 200 , the "file system client" device 100 and the "network disk" device 300 . The "file system meta server" device 200 is mainly used to manage and store the metadata of the file system, and provide "file" level and "file block" level redundant management for files.

[0089] The "file system client" device 100 is mainly used to manage the system configuration information base, the decomposition and synthesis of "file blocks", the encoding and decoding of "erasure data blocks", and the network disk uploading and processing of "erasure data blocks". Download, deduplicate, and provide transparent access to files externally.

[0090] The "network disk" device 300 is mainly used to store file data conte...

Embodiment 2

[0123] Embodiment 2, the reading method of the incremental erasure code storage system based on multiple network disks

[0124] The reading method of the incremental erasure code storage system based on multiple network disks provided by the present invention includes the following specific steps:

[0125] 1. The "file access interface" module obtains the required read operation area of ​​the caller's "read operation request" file, that is, the file offset and length of the read operation;

[0126] For example: if Figure 4 In the example shown, in the specific read operation read(intfd,void*buf,size_tcount) of file 1, the count is 1048577 bytes (that is, 1MB+1 byte), and the current offset is 0: then the file is biased The offset is 0 and the length is 1048577 bytes.

[0127] 2. The "file access interface" module obtains system global configuration information, user information and network disk information;

[0128] For example:

[0129] Examples of system global configur...

example 2

[0132] Network disk information example 2: network disk number (02), network disk name (Sina network disk), network disk user name (usrxmxl), network disk access password (mimaxl), network disk network address (http: / / pan.sina .com), network disk path user root directory ( / data2) and network disk capacity limit (1TB);

[0133] Network disk information example 3: network disk number (03), network disk name (Huawei network disk), network disk user name (usrxmhw), network disk access password (mimahw), network disk network address (http: / / pan.hw .com), network disk path user root directory ( / data), and network disk capacity limit (500MB);

[0134] Network disk information example 4: network disk number (04), network disk name (dropbox), network disk user name (usrxmdb), network disk access password (mimadb), network disk network address (http: / / www.dropbox.com ), network disk path user root directory ( / mydata) and network disk capacity limit (1TB);

[0135] Network disk informa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an increment erasure code storage method and an increment erasure code storage system under multiple network disks. The increment erasure code storage method under multiple network disks comprises the following steps: firstly dividing a file into multiple 'file blocks'; converting the 'file blocks' into multiple 'erasure data blocks' by an erasure code algorithm; and finally separately storing all 'erasure data blocks' into the multiple network disks and providing 'file block-level' reduced redundancy storage. The increment erasure code storage system under the multiple network disks comprises a 'network disk' device, a 'file system meta server' device and a 'file system client' device, wherein the 'network disk' device takes charge of storing data content of the file; the 'file system meta server' device takes charge of storage of metadata of a file system and reduced redundancy management of the 'file blocks'; the 'file system client' device takes charge of decomposition and synthesis of the 'file blocks', encoding and decoding of the 'erasure data blocks', network disk uploading and downloading of the 'erasure data blocks', redundancy removal and outward providing of file access service. According to the increment erasure code storage method and the increment erasure code storage system under the multiple network disks, the reliability, the access efficiency and the space utilization rate of a multi-network disk-based storage system can be effectively improved.

Description

technical field [0001] The invention belongs to the field of computers, and mainly focuses on a device system and method for improving the reliability of files based on multiple network disks, efficient utilization of storage space, and high-efficiency access. Background technique [0002] In the case of public storage clouds, file storage based on multiple network disks can effectively prevent public storage cloud service providers from illegally accessing user files. Absolute dependence of suppliers. The current existing solution is that the user encodes the entire file with an erasure code and then stores the erasure code file on a different network disk. The disadvantage of this solution is that even if the user only wants to read part of the file, the The user needs to download all erasure code files on multiple network disks to the local, and then use erasure code decoding to generate the entire original file, and finally read the specified part of the file. The acces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F17/30H04L29/08
CPCG06F3/064G06F3/0641G06F3/0643G06F3/0652G06F3/067G06F16/183H04L67/1097
Inventor 张春霞
Owner TIANJIN UNIVERSITY OF SCIENCE AND TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap