Data processing method and device, electronic device and computer readable storage medium

A data processing and data technology, applied in the direction of electrical digital data processing, input/output process of data processing, calculation, etc., can solve the problems of cumbersome operation and prolongation of data writing time, so as to simplify the operation steps and reduce the writing time. Latency, the effect of ensuring write consistency

Pending Publication Date: 2021-08-13
BIGO TECH PTE LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present invention provides a data processing method, device, electronic equipment, and computer-readable storage medium, which solve the problems of cumbersome operations and long data writing delays to a certain extent

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic device and computer readable storage medium
  • Data processing method and device, electronic device and computer readable storage medium
  • Data processing method and device, electronic device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] figure 1 is a flow chart of the steps of a data processing method provided by an embodiment of the present invention, such as figure 1 As shown, the method may include:

[0026] Step 101. In the case of multiple write requests sent by the client to the storage system, the first node in the storage system sets a logical identifier for each of the write requests; The setting order changes monotonously in turn; the first node is the first node in the storage system that receives the multiple write requests.

[0027] Embodiments of the present invention may be applied to a storage system including multiple nodes, and the storage system may be a distributed storage system (Distributed Storage System) or a storage system in other forms, which is not limited in the present invention. The storage system can disperse and store data on multiple nodes, and multiple nodes can be set up in different geographical locations, so as to receive write requests from clients in different ...

Embodiment 2

[0037] Optionally, in an implementation manner, the target information in this embodiment of the present invention includes target dependencies, which can be used to represent whether there is a dependency between write requests, for example, the data carried in write request 1 A is generated based on the data B carried in write request 2, therefore, the target dependency can be obtained as write request 1 depends on write request 2;

[0038] Correspondingly, in this embodiment of the present invention, before the first node synchronizes the target information of each write request to each second node in the storage system, the following sub-steps may be performed:

[0039] Sub-step (1): The first node counts the requests that each of the write requests depends on to generate a first dependency, and obtains a second dependency determined by each fourth node in the target node cluster; the The second dependency relationship is determined by the fourth node by counting the reque...

Embodiment 3

[0063] Optionally, in another implementation manner, in the embodiment of the present invention, before the step of writing the data to be written corresponding to the write request according to the target execution sequence, the following sub-steps may be performed:

[0064] Sub-step (6): The third node adjusts the state of the write request to a preset state.

[0065] In the embodiment of the present invention, the preset state may be the execution (Commit) state, and the state of the write request is adjusted to the preset state, which may be the state recorded in the tag of the write request in the tag associated with the write request Modified to execute state.

[0066] In the embodiment of the present invention, the above-mentioned writing of the data to be written corresponding to the write request according to the target execution sequence may include the following sub-steps:

[0067] Sub-step (7): When the state of the write request is a preset state, the third node ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and device, an electronic device and a computer readable storage medium, and belongs to the technical field of electronic devices. In the method, under the condition that a client sends a plurality of write-in requests to a storage system, a first node in the storage system sets logic identifiers for the write-in requests, the logic identifiers are monotonically changed in sequence according to a setting sequence, then the first node synchronizes the target information of the write-in requests to the second nodes in the storage system, and finally, each third node in the storage system determines a target execution sequence among the write requests according to the logic identifiers, and writes the to-be-written data corresponding to the write requests according to the target execution sequence. According to the invention, the nodes do not need to select a master node and do not need to negotiate the write-in sequence, and the execution sequence of each write-in request is directly stipulated by the first node which receives the request firstly, so that the write-in consistency can be ensured, the operation steps can be simplified, and the write-in time delay can be reduced.

Description

technical field [0001] The invention belongs to the technical field of electronic equipment, and in particular relates to a data processing method, device, electronic equipment and computer-readable storage medium. Background technique [0002] With the rapid development of electronic technology and higher and higher requirements for data storage, distributed storage systems are more and more widely used in daily life. For example, in a large enterprise, storage servers can be established in different regions, and a distributed storage system can be composed of multiple storage servers, so that data can be read and written in different regions, and the data in the storage system can be guaranteed to be highly available and consistent sexual. [0003] In the existing distributed storage system, before performing the operation of writing data according to the received write request, the nodes in the storage system often need to elect a supervisor node, and the supervisor node...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0655G06F3/067
Inventor 简怀兵
Owner BIGO TECH PTE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap