Method and system for synchronizing data

A technology for synchronizing data and data, which is applied in the field of data processing, and can solve problems such as resynchronizing data and filtering dirty data, and the inability of large data platforms to apply high-concurrency queries, etc.

Active Publication Date: 2019-10-22
ADVANCED NEW TECH CO LTD
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the big data platform has the problem of being unable to apply high-concurrency queries, so the key-value pair database is required as a cache for real-time data queries
[0003]Currently, the big data platform will synchronize the operation resu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for synchronizing data
  • Method and system for synchronizing data
  • Method and system for synchronizing data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034]In order to illustrate the technical solution of this embodiment more clearly, the drawings that need to be used in the description of the embodiment will be briefly introduced below. Apparently, the accompanying drawings in the following description are only some examples or embodiments of this embodiment, and those of ordinary skill in the art can also make this embodiment according to these drawings without creative work. apply to other similar situations. Unless otherwise apparent from context or otherwise indicated, like reference numerals in the figures represent like structures or operations.

[0035] It should be understood that "system", "device", "unit" and / or "module" as used herein is a method for distinguishing different components, elements, components, parts or assemblies of different levels. However, the words may be replaced by other expressions if other words can achieve the same purpose.

[0036] As shown in this embodiment and the claims, words such...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Some embodiments of the present specification disclose a method and a system for synchronizing data. The method comprises the steps of performing calculation through a big data platform to obtain a current to-be-synchronized data table; obtaining a version number of the current to-be-synchronized data table according to the calculation history of the big data platform and the historical to-be-synchronized data table; splicing a main key of the current to-be-synchronized data table and the version number to obtain a row main key; and storing the row main keys and the corresponding numerical values into a key value pair database to facilitate query.

Description

technical field [0001] Some of the embodiments in this specification relate to the technical field of data processing, and in particular to a method and system for synchronizing data. Background technique [0002] With the development of network technology, the demand for data volume, data speed, and data diversity is increasing day by day. The emergence of big data platforms has solved the problem that traditional databases cannot handle. However, there is a problem that the big data platform cannot apply high-concurrency queries, so the key-value database is required as a cache for real-time data queries. [0003] At present, the big data platform will synchronize the operation results to the key-value pair database for storage, but the process of synchronizing data only considers writing data, and does not consider how to quickly and effectively re-synchronize data and filter dirty data when errors occur in big data operations. data. Therefore, a more reliable method fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/21G06F16/22G06F16/2458
CPCG06F16/27G06F16/219G06F16/2282G06F16/2458
Inventor 高帮胜刘承成
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap