Data processing method and system

A data processing and data technology, applied in special data processing applications, structured data retrieval, database distribution/replication, etc., can solve problems such as time delay and data conflict, and achieve the effect of reducing time delay and data conflict

Pending Publication Date: 2021-11-16
北京星辰天合科技股份有限公司
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] This application provides a data processing method and system to solve the problem of time delay and data conflicts between nodes in the related technology by using the data synchronization method of first recording the log locally and then initiating task synchronization according to the log

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and system
  • Data processing method and system
  • Data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0032] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is an embodiment of a part of the application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0033] It should be noted that the terms "first" and "second...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and system. The method comprises the following steps: acquiring to-be-synchronized data in a synchronization task of a first data center; synchronizing the to-be-synchronized data to a second data center according to the target synchronization rule, the second data center being a data center indicated by the target synchronization rule; updating the metadata of the to-be-synchronized data in the metadata cluster, wherein the metadata cluster is used for storing the metadata of the stored data in all the data centers, and the metadata at least comprises information of the data centers where the stored data are located. Through the invention, the problems of time delay and data conflicts among the nodes due to the adoption of a data synchronization mode of locally recording the log and then initiating task synchronization according to the log in the related technology are solved.

Description

technical field [0001] The present application relates to the technical field of data storage, and in particular, to a data processing method and system. Background technique [0002] With the rapid development of Internet applications, massive unstructured data needs to be stored, and object storage can provide a massive storage solution, supporting the storage of tens of billions or hundreds of billions of objects of different specifications. [0003] In the field of object storage, in many application scenarios, it is necessary to implement disaster recovery and multi-active for stored data to improve the security and reliability of the cluster, and it is necessary to read data at each site. [0004] In order to do disaster recovery and multi-active for stored data, data synchronization is required. Since each site is independent of each other, related technologies first record logs locally, and then initiate task synchronization asynchronously to synchronize data to othe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27
CPCG06F16/273
Inventor 卢行周维张旭明王豪迈胥昕
Owner 北京星辰天合科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products