Multi-disk storage method and system for mass data management

A mass data management and data storage technology, applied in the field of mass data storage management research, can solve problems such as insufficient multi-disk processing strategies, achieve good adaptability and scalability, and improve efficiency.

Active Publication Date: 2014-04-30
INST OF INFORMATION ENG CAS
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the present invention is to propose a multi-disk storage method and system for mass data management, which is used to solve the technical problem of insufficient multi-disk processing strategies for data storage nodes in mass data management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-disk storage method and system for mass data management
  • Multi-disk storage method and system for mass data management
  • Multi-disk storage method and system for mass data management

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0035] Such as figure 2 As shown, Embodiment 1 provides a multi-disk storage method for massive data management, including:

[0036] Step 1, establish a four-layer tree-type data storage structure, from top to bottom: a Master node, several data storage nodes under the Master node, several disks under each data storage node, and several disks under each disk data fragmentation;

[0037] Step 2, set up a multi-disk manager on each data storage node to maintain the disk information of the current data storage node, and under the management of the multi-disk manager, add data fragmentation or delete;

[0038] Step 3, through the multi-disk manager, perform a load balancing analysis on the load among the data storage ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multi-disk storage method and system for mass data management. The method comprises the steps that a four-layer-tree type data storage structure is built, wherein the structure comprises a Master node, a plurality of data storage nodes located below the Master node, a plurality of magnetic disks located below the data storage nodes, and a plurality of data fragments located below the magnetic disks; a multi-disk manager is arranged on each data storage node and used for maintaining the magnetic disk information of the current data storage node, the data fragments are added or deleted in the magnetic disks under the management of the multi-disk managers; by means of the multi-disk managers, load equilibrium analysis is conducted on loads between the data storage nodes, and load equilibrium analysis is conducted on loads between the magnetic disks in the data storage nodes at the same time. According to the multi-disk storage method and system for mass data management, influences, caused when a data disk breaks down, on the data of other disks can be minimized, meanwhile, the data redundancy rate is not increased, and system efficiency is greatly improved.

Description

technical field [0001] The invention relates to the research field of mass data storage management, in particular to a multi-disk storage method and system for mass data management. Background technique [0002] With the rapid development of social network applications such as Web2.0, mobile Internet, and Weibo, the data generated every year around the world is growing exponentially. In order to maintain and manage these massive data, various massive data management systems have been designed and developed in academia and industry. The most influential ones are: BigTable, HBase, Hypertable, Cassandra, MongoDB, etc. These data management systems do not provide specific processing strategies and optimization schemes for storage nodes with multiple disks: BigTable, HBase, and Hypertable store data on distributed file systems GFS and Hadoop, while Cassandra and MongoDB do not provide specific multiple disks processing strategy. If you want to take full advantage of multiple di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F9/50
Inventor 王海平王树鹏张永铮吴广君周晓阳
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap