Data processing system, method and device

A data processing system and data technology, applied in the database field, can solve problems such as occupation, synchronization backlog, and multiple network bandwidth, and achieve the effect of solving data backlog, improving efficiency, and saving network bandwidth.

Pending Publication Date: 2021-08-24
ALIBABA GRP HLDG LTD
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional data synchronization method sends log data to the target cluster from the master cluster, and the target cluster parses the log data and uses the mechanism of API playback to achieve data synchronization. This requires that the write throughput of the target end be greater than or equal to the source cluster, otherwise it will be easy There is a backlog of synchronization, and this method of data synchronization needs to occupy more network bandwidth. Therefore, it is urgent to provide a data processing method that is different from the traditional data playback through API to solve such problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing system, method and device
  • Data processing system, method and device
  • Data processing system, method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0095] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the specification. However, this specification can be implemented in many other ways different from those described here, and those skilled in the art can make similar extensions without violating the connotation of this specification, so this specification is not limited by the specific implementations disclosed below.

[0096] Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "the", and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present specification refers t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing system, method and device. The data processing system comprises a source database cluster and a migration service subsystem. The migration service subsystem is configured to receive a data migration task and send a recording request of the to-be-migrated data of the target data partition to the source database cluster; the source database cluster is configured to create an initial file information list, monitor file generation information under the target data partition, and update the initial file information list based on the partition identifier of the target data partition and the file generation information to obtain a file information list; and the migration service subsystem is further configured to access the file information list, determine file information of the to-be-migrated data corresponding to the access, read a target file corresponding to a file identifier from a target data partition of the source database cluster according to a mapping relationship between the file identifier in the file information and the target data partition, and migrate the target file to the target database.

Description

technical field [0001] The embodiments of this specification relate to the technical field of databases, and in particular to a data processing system. One or more embodiments of this specification also relate to a data processing method, a data processing device, two computing devices, and two computer-readable storage media. Background technique [0002] With the rapid development of the Internet, the types and scale of data in the Internet are also growing rapidly. At present, due to the performance and scale bottlenecks of traditional relational databases when dealing with the storage, query and analysis of big data, various non-relational databases have emerged as the times require and become important data storage and analysis fields. processing means. The data storage of non-relational databases does not require a fixed table structure, and usually there is no connection operation, so it has strong scalability. Non-relational databases are classified based on diffe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/25
CPCG06F16/214G06F16/256G06F16/258
Inventor 熊嘉男
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap