Unlock instant, AI-driven research and patent intelligence for your innovation.

Detection of Slow Nodes in Distributed Storage Systems

A distributed storage and storage node technology, applied in the field of distributed storage systems, can solve problems such as the impact of data reading process, and achieve the effect of reducing time consumption

Active Publication Date: 2019-12-03
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When a user reads data from distributed storage, if the read copy is a slow node or there is a problem with the network between the client and the read copy, the data reading process will also be affected

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Detection of Slow Nodes in Distributed Storage Systems
  • Detection of Slow Nodes in Distributed Storage Systems
  • Detection of Slow Nodes in Distributed Storage Systems

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050]Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations as sequential processing, many of the operations may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

[0051] The term "computer equipment" in this context, also referred to as "computer", refers to an intelligent electronic device that can perform predetermined processing procedures such as numerical calculations and / or logic calculations by running predetermined programs or instructions, which may include a processor and The memory is realized by the processor ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention aims to provides a method for detecting slow nodes in a distributed storage product, a device, a system and a computer program product. When a slow node event is detected, a client sends an asynchronous request to each replica node of a file, and the replica nodes are storage nodes for storing copies of the file. According to response information of each replica node, slow nodes are determined from each replica node. A main node is notified about all the slow nodes, and the main node deletes all the slow nodes from a replica node list. The replica node list of the file is refreshed to carry out data write-in operation to the file copy of one replica node again. Compared with the prior art, through detection and the avoidance strategy of the slow node in the distributed storage system, the time consumption long tail of the distributed storage system is greatly reduced in the read-write request of the user.

Description

technical field [0001] The invention relates to the technical field of distributed storage systems, in particular to a technology for detecting slow nodes in a distributed storage system. Background technique [0002] In the current distributed storage system, as the number of cluster nodes increases linearly, the probability of slow nodes also increases. [0003] For example, a distributed storage system may experience slow nodes when: [0004] As the hardware resources of the machine reach the bottleneck, the corresponding processing program resources are insufficient and processing requests are slowed down. Scenarios such as: the machine fails; the hardware conditions of the machine itself are not uniform; other services mixed on the machine occupy more resources. [0005] The stand-alone instance of the software itself has reached a bottleneck, resulting in insufficient processing capacity. Scenarios such as: uneven number of requests distributed to a single instance; s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F3/06
CPCG06F3/0611G06F3/0629G06F3/0653G06F3/067H04L67/06H04L67/1095H04L67/1097
Inventor 李志文郭波
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD