Unlock instant, AI-driven research and patent intelligence for your innovation.

A data storage system and data search method

A data storage system and metadata technology, applied in the field of electricity, can solve problems such as difficulty in expanding the scale of the system and system collapse.

Active Publication Date: 2021-01-29
HUAWEI TECH CO LTD
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, there will be a large number of hosts that need to search the stored file metadata. Because the service capability of the Name Node is often not enough to cope with such a large number of searches, it is easy to cause system crashes, making it difficult to continue to expand the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data storage system and data search method
  • A data storage system and data search method
  • A data storage system and data search method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Embodiments of the present invention provide a data storage system and a data search method for distributed storage of file metadata.

[0040] In order to enable those skilled in the art to better understand the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described implementation Examples are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0041] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data storage system and a data search method for distributed storage of file metadata. The method in the embodiment of the present invention includes: a metadata host, configured to store file metadata, and return the target file metadata; a query host, configured to receive a metadata search request for the target file metadata, and determine that the target file metadata is stored. A target metadata host of the target file metadata obtains the target file metadata from the target metadata host. As the scale of the system grows larger, more and more hosts can be used to store file metadata, that is, more and more hosts can accept queries on file metadata, so the system will not expand Limited by the service capabilities of the metadata host.

Description

technical field [0001] The invention relates to the field of electricity, in particular to a data storage system and a data search method. Background technique [0002] Distributed storage technology is the key technology of big data systems. This storage technology can share the local storage of multiple hosts and use the multiple hosts as a unified storage system. In such a storage system, any host can transparently access any host in the storage system. [0003] Currently the most widely used distributed storage technology is the distributed file system HDFS. In HDFS, the host that actually stores data files is called a Data Node, and an HDFS system includes multiple Data Nodes. Any Data Node in the system will generate file metadata based on the data file, and then store the file metadata on another specific host, which is called the Name Node. Generally speaking, in an HDFS system, there will be two NameNodes, each of which stores the same content and serves as the m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182G06F16/14G06F16/2458
CPCG06F16/148G06F16/182G06F16/2471
Inventor 金中良
Owner HUAWEI TECH CO LTD