Method and device for writing data in distributed system

A distributed system, data writing technology, applied in the field of communication, can solve the problem of long delay time for data writing, and achieve the effect of avoiding redundant time

Inactive Publication Date: 2020-04-03
HUAWEI TECH CO LTD
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present application provides a method and device for writing data in a distributed system to solve the problem of too long data writing delay time in the distributed system caused by the performance jitter of individual nodes, thereby improving the data quality of the distributed system. write efficiency
In this way, through the performance detection to determine the standby nodes that need to ignore the feedback and need to wait for the feedback, the master node can effectively avoid the problem of long and inefficient feedback writing success in the entire distributed system due to the slow feedback of the standby node with low performance. Thereby improving the data writing efficiency of the distributed system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for writing data in distributed system
  • Method and device for writing data in distributed system
  • Method and device for writing data in distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] A distributed system includes many nodes. In order to ensure the reliability of the data written by the terminal request, generally the distributed system needs to write a piece of data to be written to the master node, and also write multiple nodes of the master node. on the standby node. At present, the method of writing data in the distributed system adopts the method of maintaining strong consistency, that is, the data is required to be written successfully on each node before the request for writing data is completed, and the feedback write The input is successfully sent to the corresponding terminal. The following is an example to illustrate the process of writing data while maintaining strong consistency in a distributed system.

[0034] figure 1 It is a schematic diagram of the process of writing data in a specific distributed system. Such as figure 1 As shown, the scenario may specifically include: a distributed system 10 and a terminal 20 , where the distri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for writing data into a distributed system. When data is requested to be written into the distributed system; the main node can detect whether the performance of each standby node meets the requirement or not; for a standby nodeS with relatively low performance, the main node can temporarily ignore the feedback of the standby nodes; only the write-in success feedback of the standby node of which the performance meets the requirement is waited, namely, as long as the standby node with the performance meeting the requirement returns a response message,the main node can feed back writing success to the terminal; compared with whether a standby node with poor performance exists or not, the main node feeds back a successfully written distributed system data writing mode to the terminal only after all the standby nodes feed back a successfully written response message. The problems of long time and low efficiency of feedback writing success of thewhole distributed system due to slow feedback of the standby node with low performance can be effectively avoided, so that the data writing efficiency of the distributed system is improved.

Description

technical field [0001] The present application relates to the technical field of communications, and in particular to a method and device for writing data in a distributed system. Background technique [0002] A distributed system is a high-performance system that can provide multiple copies of fault tolerance. Typically, strong consistency is maintained across multiple copies of data in a distributed system. When receiving a write data request, the distributed system will report that the write is successful only if all replica nodes (that is, all standby nodes) are successfully written. However, due to the high usage of the CPU (Center Processing Unit) by operations such as flashing disks, network jitter, and other reasons, some nodes may experience short-term performance degradation and cannot write data in time. The latency of data writing on these nodes will be extended. And because the data writing time on these nodes is too long, the delay time for the distributed s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0631G06F3/067
Inventor 叶小杰陈家强江舟
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products