Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device, electronic equipment and storage medium

A processing device and data processing technology, which is applied in the computer field, can solve problems such as incomplete copy data, inconsistent data copy, large resource overhead, etc., and achieve the effect of resuming transmission from breakpoints

Active Publication Date: 2021-08-24
ALIBABA CLOUD COMPUTING LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, some distributed systems may have inconsistent data copies due to various reasons. For example, in the Cassandra database, when users write data to multiple data copies at different levels such as one, two, and quorum, some of the copies will be incomplete data
Common distributed systems also have their own data repair functions, such as the hint&read-reapair repair mechanism of the Cassandra database, but this repair mechanism will cause large system resource overhead and high operation and maintenance costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily realize them. Also, for clarity, parts not related to describing the exemplary embodiments are omitted in the drawings.

[0062] In the present disclosure, it should be understood that terms such as "comprising" or "having" are intended to indicate the presence of features, numbers, steps, acts, components, parts or combinations thereof disclosed in the specification, and are not intended to exclude one or a plurality of other features, numbers, steps, acts, parts, parts or combinations thereof exist or are added.

[0063] In addition, it should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data processing method and device, electronic equipment and a storage medium. The method comprises the steps of determining a main data range on a current node, wherein the main data in the main data range corresponds to a plurality of copy data stored on other nodes; segmenting the main data range into a plurality of first sub-data ranges; and performing data restoration for each first sub-data range so as to restore the sub-data in the first sub-data range to be consistent with the inconsistent data in the corresponding sub-data of the copy in the data of the copy. According to the technical scheme, the defect of resource waste caused by multiple times of restoration of data with multiple copies stored on multiple nodes in the data restoration process can be overcome.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular to a data processing method, device, electronic equipment, and storage medium. Background technique [0002] In order to ensure data reliability, a distributed system usually stores a piece of data on multiple nodes, and needs to keep the data on multiple nodes consistent. However, some distributed systems may have inconsistent data copies due to various reasons. For example, in the Cassandra database, when users write data to multiple data copies at different levels such as one, two, and quorum, some of the copies will be Incomplete data. Common distributed systems also have their own data repair functions, such as the hint&read-reapair repair mechanism of the Cassandra database, but this repair mechanism will cause a large system resource overhead and high operation and maintenance costs. Contents of the invention [0003] Embodiments of the present disclosure p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/215
CPCG06F16/278G06F16/215G06F16/2365
Inventor 郭超李飞飞
Owner ALIBABA CLOUD COMPUTING LTD