Data processing method based on distributed storage system, and storage equipment

A technology of distributed storage and storage devices, which is applied in electrical digital data processing, input/output process of data processing, transmission systems, etc. The effect of reducing the number of copies, improving performance, and reducing latency

Active Publication Date: 2017-02-15
HUAWEI TECH CO LTD
View PDF3 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention is to provide a data processing method and storage device based on a distributed storage system, which can solve the problems in the prior art that read operations require a large number of copies of successful reads, a large delay in successful reads, and poor read performance. technical issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method based on distributed storage system, and storage equipment
  • Data processing method based on distributed storage system, and storage equipment
  • Data processing method based on distributed storage system, and storage equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0038] figure 1 is a schematic diagram of a distributed storage system according to an embodiment of the present invention, such as figure 1 As shown, a distributed storage system includes multiple storage nodes (or called nodes, for example, storage devices or hard disks), data cluster servers and cluster management modules; wherein, nodes ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method based on a distributed storage system, and storage equipment. The method comprises the following steps: a storage node in any logic partition of the distributed storage system is selected as a main storage node; during data reading, after having received a reading IO request, the main storage node judges whether a target data object on the main storage node which is requested to be read according to the reading IO request is trusted or not; and if the target data object is trusted, the target data object is directly read from the main storage node and returned to an initiating end sending the reading IO request. The method has the advantages that if the target data object stored on the main storage node is trusted, data only needs to be read from the single storage node, and the reading of the data object from other storage nodes is no more needed; and compared with the Quorum mechanism, the method achieves the effect that the number of copies for reading operation is greatly reduced, so that the reading operation time delay is shortened, and the reading operation performance is improved.

Description

technical field [0001] The invention belongs to the technical field of data reading and writing, and in particular relates to a data processing method and a storage device based on a distributed storage system. Background technique [0002] In a distributed storage system with redundant data, redundant data objects store multiple copies among different storage devices. But multiple copies of a data object can only be used for reading or writing at the same time. [0003] The Quorum mechanism is a voting algorithm used in distributed systems to ensure data redundancy and eventual consistency. This mechanism has three key values ​​N, R, and W, and can also be called the NRW mechanism, where N represents the number of copies of the data, R represents the minimum number of copies required to complete the read operation, and W represents the number of copies required to complete the write operation. The minimum number of replicas that need to be written. With this mechanism, i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0613G06F3/067H04L67/1097G06F3/0623G06F3/0659G06F3/06G06F3/0619G06F3/064G06F3/0643H04L67/1051
Inventor 冯永刚
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap