Dynamic cloud storage method and system

A cloud storage and dynamic technology, applied in the field of cloud storage, can solve problems such as bandwidth and flow waste, and affect the efficiency of file reading and writing, and achieve the effect of strengthening management, solving poor security of shared data, and ensuring safe and stable operation

Inactive Publication Date: 2017-12-15
柏域信息科技(上海)有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, the practice of maintaining consistency through the heartbeat mechanism between many data storage servers and metadata

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic cloud storage method and system
  • Dynamic cloud storage method and system
  • Dynamic cloud storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] figure 1 It is a flow chart of a dynamic cloud storage method provided by Embodiment 1 of the present invention. This embodiment is applicable to the case of cloud storage of data. The method can be executed by a cloud storage system, and specifically includes the following steps:

[0029] Step S110, loading the metadata file into the first memory of the metadata server to form a memory directory tree, and organize message module data according to a preset data structure based on the memory directory tree.

[0030] After the metadata server starts, it loads the local metadata files into its own memory to form a memory directory tree, and at the same time organizes the data into the data structure required in the message module, and provides a read-only file directory to the outside world.

[0031] Among them, the HDFS cluster has two kinds of nodes, which run in the mode of manager-worker, that is, a name node (NameNode) and multiple data nodes (DataNode). Among them, ...

Embodiment 2

[0041] Figure 5 It is a flowchart of a dynamic cloud storage method provided by Embodiment 2 of the present invention. This embodiment is applicable to the case of cloud storage of data. The method can be executed by a cloud storage system, and specifically includes the following steps:

[0042] Step S210, configure the information of each physical node in the cloud storage platform through a configuration file.

[0043] Use the configuration file to configure the information of each physical node in the HDFS cluster. After completing the configuration, start the HDFS cluster.

[0044] Step S220, checking the startup status of the metadata server and the storage device management server.

[0045] Among them, after the HDFS cluster is started, the metadata server and the storage device management server start separately. At the same time, no matter whether the metadata server is started or the storage device management server is started, they will check each other's startup s...

Embodiment 3

[0061] Figure 6 A schematic structural diagram of a dynamic cloud storage system provided by Embodiment 3 of the present invention. This embodiment is applicable to cloud storage of data. The dynamic cloud storage system 310 specifically includes: a loading organization module 320 and a synchronization module 330 and update module 340 .

[0062] The entire secure cloud storage system consists of three parts: metadata server, storage device management server, and data storage server. The structural diagram of the entire secure cloud storage system is shown in Figure 7 shown. Wherein, the metadata server 401 is in the safe user enterprise space 405, and the user 404 directly interacts with the metadata server 401; the storage device management server 402 and the data storage server 403 are in the cloud storage space, and the storage device management server 402 directly communicates with the data storage server 403 performs communication interaction, and the storage device m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic cloud storage method and system. The method comprises the following steps: loading a metadata file in a first memory of a metadata server to form a memory directory tree, and organizing message module data according to a preset data structure based on the memory directory tree; synchronizing the message module data in a second memory of a storage device management server in a message transmission manner; and when the storage device management server accomplishes storage information collection of a cloud storage platform, updating the message module data in the second memory, and synchronizing the message module data to the metadata server in a memory sharing manner. The invention provides a shared data consistency keeping strategy, the data management of the metadata server is enhanced, and the communication process between the metadata server and the storage device management server is optimized to solve the problems of low transmission efficiency and poor shared data security, the overall cloud storage reading and writing efficiency and the cloud storage data security performance are improved, and the safe and stable operation of the whole cloud storage system is guaranteed.

Description

technical field [0001] Embodiments of the present invention relate to cloud storage technologies, and in particular to a dynamic cloud storage method and system. Background technique [0002] Cloud computing is a service that uses virtualization technology to provide users with dynamically scalable shared hardware and software resources through the Internet. The dynamic and elastic characteristics of cloud computing enable users to use and pay according to the number of used resources. Users can dynamically adjust resource usage according to the current service load to reduce resource waste. Cloud storage system is an important part of cloud computing system. From a technical point of view, the cloud storage system is actually a large-scale distributed network storage system, which is a special kind of shared storage. Users are provided with a special storage service that is paid on demand. [0003] As the underlying file system foundation of many Hadoop projects, the HDF...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F21/62G06F17/30
CPCG06F16/183G06F21/6218H04L67/1095H04L67/1097
Inventor 许宇峰陈明雄
Owner 柏域信息科技(上海)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap