HDFS (hadoop distributed file system) cluster based distributed cloud storage system

A cloud storage system and distributed technology, applied in the field of cloud storage, can solve the problems of difficult control of file transmission and inability of users to customize, and achieve the effects of improving data reliability, rational use of resources, and storage efficiency.

Inactive Publication Date: 2013-02-13
SUZHOU LIANGJIANG TECH
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a distributed cloud storage system based on HDFS clusters, which solves the problems in the prior art that cloud storage uses centralized storage for file storage, users cannot customize, and file transmission is difficult to control.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • HDFS (hadoop distributed file system) cluster based distributed cloud storage system
  • HDFS (hadoop distributed file system) cluster based distributed cloud storage system
  • HDFS (hadoop distributed file system) cluster based distributed cloud storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0025] The HDFS cluster-based distributed cloud storage system obtained in this embodiment includes a name node responsible for managing file namespaces and client access and a data node responsible for managing data storage. The name node includes a registration authentication module and user customization module, the registration authentication module is used to provide the user to register and authenticate the user login request; the user customization module is used to customize the storage space capacity of the registered user, and when the user successfully logs in, the user sets the storage space remaining reminder .

[0026] Such as figure 1 As shown, the process of map-reduce data decomposition in HDFS cluster. For specific deployment, see the specific implementation steps figure 2 ,Described as follows:

[0027] 1) Build a cluster, configure HDFS, set Namenode / Datanode nodes, one master node, two slave nodes, and the number of copies.

[0028] 2) User registrati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an HDFS (hadoop distributed file system) cluster based distributed cloud storage system which comprises a name node and a data node, wherein the name node is responsible for managing file namespaces and client access, and the data node is responsible for managing data storage. The system is characterized in that the name node comprises a registration/certification module and a user customization module, wherein the registration/certification module is used for providing users with a login service and carrying out certification on user login requests; and the user customization module is used for customizing the capacity of a storage space of a login user, and after the user logins successfully, the user sets a storage space allowance reminder. According to the method, the size of a storage space of a user is customized, therefore, an effect of distribution based on need is achieved, and resources are rationally used; the application of distributed storage improves the storage efficiency; and the application of multi-copy storage improves the data reliability of storage.

Description

technical field [0001] The invention belongs to the technical field of cloud storage, and in particular relates to a distributed cloud storage system based on an HDFS cluster. Background technique [0002] With the development of Internet technology, the amount of information is increasing explosively, and data storage has gradually become a key issue restricting the development of enterprises. More and more enterprises are beginning to separate data storage and manage it as an independent project. High reliability, high versatility, high scalability, and large capacity, cloud storage is becoming an important choice for enterprises to improve efficiency and reduce costs with its advantages that traditional data centers cannot match. [0003] Compared with traditional storage devices, cloud storage is not just a piece of hardware, but a system composed of network devices, storage devices, servers, application software, public access interfaces, access networks, and client pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 陈国庆郭蒙蒙
Owner SUZHOU LIANGJIANG TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap