Unlock instant, AI-driven research and patent intelligence for your innovation.

Data storage system and data search method

A data storage system and metadata technology, applied in the field of electricity, can solve problems such as the difficulty in expanding the system scale and system crashes

Active Publication Date: 2017-12-12
HUAWEI TECH CO LTD
View PDF13 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, there will be a large number of hosts that need to search the stored file metadata. Because the service capability of the Name Node is often not enough to cope with such a large number of searches, it is easy to cause system crashes, making it difficult to continue to expand the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage system and data search method
  • Data storage system and data search method
  • Data storage system and data search method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Embodiments of the present invention provide a data storage system and a data search method for distributed storage of file metadata.

[0040] In order to enable those skilled in the art to better understand the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described implementation Examples are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0041] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention disclose a data storage system and a data search method. The data storage system is used for distributed storage of file metadata. The method involves a metadata host used for storing the file metadata and returning objective file metadata, and a query host used for receiving a metadata query request for the objective file metadata, determining an objective metadata host which stores the objective file metadata and obtaining the objective file metadata from the objective metadata host. When the scale of the system is larger and larger, the quantity of hosts capable of being used for storing the file metadata is larger and larger, namely, the quantity of hosts capable of receiving query on the file metadata is larger and larger, so that the system extension is not limited by the service capability of the metadata host.

Description

technical field [0001] The invention relates to the field of electricity, in particular to a data storage system and a data search method. Background technique [0002] Distributed storage technology is the key technology of big data systems. This storage technology can share the local storage of multiple hosts and use the multiple hosts as a unified storage system. In such a storage system, any host can transparently access any host in the storage system. [0003] Currently the most widely used distributed storage technology is the distributed file system HDFS. In HDFS, the host that actually stores data files is called a Data Node, and an HDFS system includes multiple Data Nodes. Any Data Node in the system will generate file metadata based on the data file, and then store the file metadata on another specific host, which is called the Name Node. Generally speaking, in an HDFS system, there will be two Name Nodes, which store the same content respectively and serve as m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/148G06F16/182G06F16/2471
Inventor 金中良
Owner HUAWEI TECH CO LTD