Mass data distributed storage method

A technology of distributed storage and massive data, applied in the field of distributed storage of massive data, it can solve the problems of low redundancy and high security of big data, and achieve the effect of optimizing load balancing ability, improving speed and reducing storage cost.

Inactive Publication Date: 2016-04-27
CAS OF CHENGDU INFORMATION TECH
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the above-mentioned shortcomings of the prior art, the present invention provides a method for distributed storage of massive data, which can no

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The method of the invention divides the data storage area into: data area, copy area and coding area. The data area is used to store source data, that is, the area where data is stored when the data enters the storage platform for the first time; the copy area is used to store copy data, that is, when a certain data is stored in the data area, it is immediately copied in the copy area The method stores a copy of the data; the copy area and the data area constitute an HDFS system implementing a dynamic copy strategy (multi-copy full backup disaster recovery system); the coding area is used to form a complete information-associated disaster recovery system with the data area .

[0016] In this method, the copy area and the data area constitute a multi-copy full backup disaster recovery system implementing a dynamic copy strategy. Every time data is written, the original data is first written into the data area, and then the system automatically copies the data by using t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mass data distributed storage method. A data storage area is divided into a data area, a copy area and a coding area; the data area is used for storing source data; the copy area is used for storing copy data; the copy area and the data area form a multi-copy full backup disaster recovery system; the coding area and the data area form a complete information association disaster recovery system. Compared with the prior art, the invention is advantaged by that on the basis of mass data storage cost, efficiency and load equalization, a new method combined with a data information association strategy and a dynamic copy strategy is proposed; the cluster data security is ensured, at the same time, the data recovery speed of the system is remarkably improved, the load equalization capability of the system is optimized, and the integrated storage cost of the system is reduced.

Description

technical field [0001] The invention relates to a method for distributed storage of massive data. Background technique [0002] The rapid development of Internet technology, the popularization of information equipment, and the extensive application of information technology by enterprises and individuals have promoted the large-scale growth of data. If in the past data was mainly generated and utilized by business departments, now it is all people who create and share data. Data is becoming ubiquitous and affecting the business of enterprises and everyone's life in every possible way. The society has entered the era of big data (bigdata). [0003] The crazy growth of data has also brought new challenges to the traditional data storage model: while the disk capacity is increasing rapidly, its access speed has not been significantly improved. For massive data processing tasks, Google took the lead in designing and implementing a new distributed file system GFS (Google File S...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F11/14
CPCH04L67/1097G06F11/1448G06F11/1456G06F11/1464H04L67/1095
Inventor 钟勇周渭博王阳李振东
Owner CAS OF CHENGDU INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap