Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

File storage system, data scheduling method and data node

A file storage and data node technology, which is applied in electrical digital data processing, input/output process of data processing, redundant data error detection in operations, etc., can solve the problem of slow data writing speed, etc. Data write speed, the effect of reducing network transfer and storage time

Active Publication Date: 2017-06-20
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the existing file reading and writing method, the next data block will be written only after all the data nodes have finished writing the data, and the data writing speed is relatively slow.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File storage system, data scheduling method and data node
  • File storage system, data scheduling method and data node
  • File storage system, data scheduling method and data node

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The following will clearly and completely describe the technical solution in this embodiment with reference to the drawings in this embodiment. Obviously, the described embodiment is only a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0044] An embodiment of the present invention provides a file storage system, such as figure 2 As shown, it includes: a client 21 and a server group 22. Wherein, the client includes a distributed file system (Distributed FileSystem) module 211 and a file system data output stream (FSData OutputStream) module 212 . The server group adopts a master-slave structure, including a name node 221, a master data node 222, and at least one backup data node 223; wherein, the master data node and at least one backup dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of file systems and discloses a file storage system, a data scheduling method and a data node. The data scheduling method includes: a main data node receives a write operation instruction sent by a client, wherein the write instruction includes to-be-written data; the main data node writes the to-be-written data into a first distributed storage subsystem, sends a notification message to a name node and sends the client a reply message; the main data node sends an updating request to a first backup data node, wherein the updating request includes a storage position of the to-be-written data in the first distributed storage subsystem and attribute information of the to-be-written data. The file storage system, the data scheduling method and the data node are applied to a file storage process.

Description

technical field [0001] The invention relates to the field of file systems, in particular to a file storage system, a data scheduling method and a data node. Background technique [0002] Hadoop Distributed File System (Hadoop Distributed File System, HDFS) is a distributed file system suitable for running on commodity hardware. It has high scalability and can realize dynamic expansion without stopping; high reliability, It can realize automatic data detection and replication, high-throughput access, and eliminate access bottlenecks. [0003] In the prior art, the system architecture of HDFS is as follows figure 1 As shown, it includes: a client 11 and a server group 12. Wherein, the client 11 includes a distributed file system (Distributed FileSystem) module 111 and a file system data output stream (FSData OutputStream) module 112 . The server group adopts a master-slave structure, and is composed of a name node (Name Node, NN) 121 and multiple data nodes (Data Node, DN) ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06G06F11/14
CPCG06F3/0613G06F3/067G06F11/1448G06F3/06
Inventor 董阳单卫华殷晖
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com