Data routing method, data management device and distributed storage system
A data management device and data routing technology, applied in special data processing applications, transmission systems, electrical components, etc., can solve problems such as inability to guarantee client feedback to ChunkServer, inability to obtain metadata in time, and reduce operation and maintenance deployment costs, The effect of improving accuracy
Active Publication Date: 2015-04-29
成都全景智能科技有限公司
View PDF4 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] However, factors such as network jitter and node failures can easily lead to changes in the Chunk Server corresponding to the key, and the Master, as a management node, cannot be informed of the metadata changes in the above cases in a timely manner. Therefore, it cannot guarantee that the correct Chunk Server information will be fed back to the client.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0075] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0076] refer to figure 2 , which shows a schematic flow chart of the steps of a data routing method according to an embodiment of the present invention, which may specifically include the following steps:
[0077] Step 201, the data node receives the metadata routing request from the client; wherein, the metadata routing request carries the first keyword information of the data;
[0078] Step 202, the data node matches its own me...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
Embodiments of the invention provide a data routing method, a data management device and a distributed storage system, wherein the method specifically comprises the following steps: a data node receives a metadata routing request from a client, wherein the metadata routing request carries first keyword information of data; the data node matches an own metadata table based on the first keyword information, and obtains data node information corresponding to the first keyword information, wherein the metadata table stores data node information corresponding to keywords and is obtained on the basis of the communication and maintenance between the data nodes; the data node returns the data node information to the client. According to the embodiments of the invention, the feedback of correct data node information to the client can be ensured, the metadata routing accuracy can be improved, and the operation and maintenance costs of the distributed storage system can be reduced.
Description
technical field [0001] The invention relates to the technical field of distributed storage, in particular to a data routing method, a data management device and a distributed storage system. Background technique [0002] GFS (Google File System, Google File System) is a large-scale distributed file system that provides massive storage for Google Cloud Computing and is closely integrated with MapReduce (mapping simplification) technology. [0003] refer to figure 1 , shows a schematic structural diagram of a GFS in the prior art, GFS divides the nodes of the entire system into three types of roles: Client (client), Master (main server) and Chunk Server (data block server); wherein, Client is GFS provides an access interface for applications; Master is the management node of GFS, logically there is only one, it saves system metadata and is responsible for the management of the entire file system; Chunk Server is responsible for specific storage work, and data is stored in the...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCG06F16/182H04L67/1097H04L65/40
Inventor 陈营李明昊宋昭陈宗志王超
Owner 成都全景智能科技有限公司