Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Asynchronous data synchronization method and system based on http service aspect and log system

A technology of asynchronous data and data synchronization, applied in the direction of electronic digital data processing, structured data retrieval, database distribution/replication, etc., can solve problems such as maintenance difficulties, complex operations, code changes, etc., and achieve high scalability and complexity Controlled, synchronized latency reduction effects

Active Publication Date: 2020-01-17
杭州魔方互联软件有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most of these methods are relatively complex in operation and poor in flexibility, and cannot achieve good organization and management of data; they cannot automatically complete data migration, and users need to clearly understand the storage structure of the database, and it takes a lot of time to debug; and once the database The structure changes, the code needs to be changed a lot, and the later maintenance is very difficult
In addition, the system tools have certain limitations, rely more on specific database products, and lack versatility. It is necessary to use these tools to write appropriate migration programs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Asynchronous data synchronization method and system based on http service aspect and log system
  • Asynchronous data synchronization method and system based on http service aspect and log system
  • Asynchronous data synchronization method and system based on http service aspect and log system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The principles of the present disclosure will now be described with reference to some example embodiments. It will be understood that these embodiments are described only for illustration and purpose of helping those skilled in the art to understand and practice the present disclosure, and not to suggest any limitation on the scope of the present disclosure. The present disclosure described herein may be implemented in various ways other than those described below.

[0036] As used herein, the term "including" and its various variants can be understood as open-ended terms meaning "including but not limited to". The term "based on" may be understood as "based at least in part on". The term "one embodiment" may be understood to mean "at least one embodiment." The term "another embodiment" may be understood to mean "at least one other embodiment."

[0037] It can be understood that the client in this application refers to a client based on the http protocol, such as a b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a system and a method for asynchronous data synchronization on the basis of an http service aspect and log system. The method includes: intercepting an interface request of a client, and recording interface access logs; taking the access logs as a request event source, transmitting to a message queue and analyzing the access logs in the message queue; restoring in and / or out parameters after analysis, performing data mapping of new and old systems after data conversion, and writing into a new database. By recording of the interface access logs, submitting of the logs to any of data sources and adopting of processing programs for processing of data source logs, data conversion and synchronization to the new database, synchronization delay of asynchronous data can be reduced, and complexity controllability is realized.

Description

technical field [0001] The invention relates to the field of asynchronous data synchronization, in particular to an asynchronous data synchronization method and system based on an HTTP service aspect and a log system. Background technique [0002] A 2010 survey by the Bloor Institute estimates that the data migration market will exceed $5 billion and is growing. Many companies now have different approaches to database migration, such as extract / transform / load (ETL for short), replication and manual scripting. However, these methods face some problems, and the job becomes more complicated when the amount of data is growing on the one hand, and the downtime allowed on the other hand is decreasing. The statistics under data migration are roughly as follows: [0003] 16% of data migration partial projects were successful [0004] 37% budget overrun [0005] 64% did not finish on time [0006] So, migrations need to be carefully planned and executed to minimize downtime and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27
CPCG06F9/546G06F16/178G06F16/1815G06F16/182G06F2209/548
Inventor 胡杨
Owner 杭州魔方互联软件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products