Method for capturing movement data increment based on track change

Abstract

The invention discloses a method for capturing movement data increment based on track change. The method comprises the following steps of enabling a trigger to capture operation logs; recording the operation change process of an operation data sheet; combining the operation logs by a purifying method, so as to capture the net increment and record the whole operation change process. The method has the advantages that the existing trigger mechanism of a movable database and the characteristic of lower writing frequency of movable nodes in the movable computing environment are sufficiently utilized, the increment capturing efficiency is obviously improved, the purifying operation is further adopted when the increment is extracted, the minimum increment data is ensured, the synchronous data communication amount is greatly reduced, the requirement of the synchronous system on the network bandwidth is lowered, and the communication cost is reduced; when the final consistency of the data is influenced because of the accidental interruption or severe timeout of the synchronous system, the operation change process can be used as the effective evidence for the rollback operation of the synchronous system, and the robustness of the synchronous system is improved.

Description

technical field [0001] The invention relates to an incremental capture method, which belongs to the application field of mobile computing and database intersecting technologies, in particular to a trajectory change-based mobile data incremental capture method. Background technique [0002] With the development and popularization of mobile computing technology and wireless communication technology, mobile applications are becoming increasingly complex and diverse. In order to meet mobile users' requirements for reliable processing of mobile service data, mobile computing systems need to allow users to process data offline and support a distributed storage mechanism with multiple data copies. At present, Optimistic Replication is commonly used in distributed storage mechanisms to ensure the availability of business data and control the consistency of business data. Due to the weak connectivity of the mobile network and the relatively limited communication delay and bandwidth,...

AI Technical Summary

Problems solved by technology

They have their own advantages and disadvantages. Snapshot compares the old and new snapshots of the data table to extract information increments. This method is widely applicable, but requires high storage space. With the increase of data tuples, the comparison detection algorithm is easy Will become the performance bottleneck of the system

Trigger uses triggers to capture incremental data, and the incremental capture efficiency is high, but it is only used in data management systems with a trigger mechanism, and when there is a large amount of data in the data set for operations, triggers have a greater impact on system performance

Log uses the operation log of the analysis database itself to extract increments, which does not increase system overhead and is highly efficient. However, databases and management systems generally have strict permission restrictions on log access; in addition, most of the log formats of data management systems are different. are not the same, resulting in many restrictions on the use of the log method

Timestamp sets a timestamp field in the tuple. When synchronizing, extract all fields greater than the last synchronization time to obtain the increment. It is simple and easy to implement, but this method requires changing the structure of the business data set, and it is difficult to capture the delete operation , which limits its scope of application

[0004] Most of the existing incremental data capture methods are oriented to stable distributed computing environments, and are not suitable for mobile computing environments. Simple transplantation can easily lead to low efficiency and high overhead

Images