Distributed adaptive coding and storing method

An adaptive coding and distributed technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve the problems of increasing data storage costs, expensive special storage devices, and not easy to expand, and improve scalability. and self-adaptation, the improvement of disaster tolerance, and the realization of the effect of sustainable disaster tolerance

Inactive Publication Date: 2010-09-15
CAS OF CHENGDU INFORMATION TECH
View PDF3 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, in order to improve the reliability or performance of the system, the replication scheme is mainly adopted, but effectively realizing the consistency of shared data in a large-scale distributed system is the main problem faced by the replication technology
At the same time, in order to improve the reliability of the system, multiple copies of files greatly increase the redundancy of data. For the storage of large amounts of data, the cost of data storage is greatly increased. At the same time, special storage devices are expensive and not easy to expand

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed adaptive coding and storing method
  • Distributed adaptive coding and storing method
  • Distributed adaptive coding and storing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The specific implementation manner of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0047] The distributed self-adaptive coding storage method of the present invention is applied in a distributed system, including a file storage process and a file acquisition process.

[0048] Combine below Figure 1-Figure 3 , detailing the file storage process of the distributed adaptive coding storage method of the present invention. Such as figure 1 As shown, the file storage process mainly includes the following steps:

[0049] S11. Detect the number of storage nodes in the distributed system, such as figure 2 As shown, it is a distributed system, and there are m storage nodes connected through a computer network;

[0050] S12. Adaptively adjust the code word according to the number of storage nodes in the system, and perform adaptive encoding on the files to be stored, specifically including the following steps:

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed adaptive coding and storing method comprising the following steps of: detecting the number of storage nodes in a distributed system; adaptively adjusting digits according to the number of the storage nodes in the system and adaptively coding files required to be stored; equalizing the coded files according to the number of the nodes; packaging the equalized files into file blocks by a unified file packaging form; storing the packaged file blocks to each node in the system; detecting on-line stored nodes and judging whether the nodes are completed or not when a certain node sends a file requirement request; if the nodes are uncompleted, acquiring deleted information blocks by the decoding of file blocks of the on-line stored nodes and recombining the decoded deleted information blocks and the traditional information blocks in sequence to obtain an original file. Compared with the prior art, since a coding method is used to realize the storage of the files, the invention realizes higher storage effect of disaster-tolerant node number with lower redundancy.

Description

technical field [0001] The invention relates to an encoding storage method in the field of information security storage, in particular to a distributed self-adaptive encoding storage method. Background technique [0002] In the data-centric information age, especially in recent years, data has shown explosive growth. How to securely and effectively obtain data security and availability with low storage space is a major problem in the storage field. Safely and reliably storing data with low redundancy is one of the challenging issues in the storage field in the new century, and how to improve the sustainable disaster recovery capability of storage systems has also become the focus of industry research. At present, in order to improve the reliability or performance of the system, the replication scheme is mainly adopted, but effectively realizing the consistency of shared data in a large-scale distributed system is the main problem faced by the replication technology. At the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L29/06G06F17/30
CPCH04L29/08549H04L65/602H04L29/06489H04L67/1097H04L65/607H04L29/0651H04L65/762H04L65/70
Inventor 王晓京蒋海波唐聃王一丁肖宜龙方佳嘉蔡红亮王谦孙宣东陈峥
Owner CAS OF CHENGDU INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products