Database log-based data merging method and apparatus, and terminal device

By analyzing the database logs and operating on the target database based on preset mapping rules, the problem of primary key update, data deletion and time stamp update in data integration from relational database to big data platform is solved, and the accuracy and efficiency of data integration and synchronization are achieved.

CN119691060APending Publication Date: 2025-03-25中邮人寿保险股份有限公司
0 Cites 0 Cited by

Patent Information

Application Number
CN202411600712.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-11
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

When the data integration between relational databases and big data platforms is integrated, the existing technology has problems such as primary key updates, data deletion and time stamps not being updated in time, resulting in inaccurate data integration and synchronization.

Method used

By analyzing the database log, determining the execution operations of the source database, determining the primary key information based on these operations, and assigning and operating fields in the target database based on preset mapping rules, and finally merging the target database to the data platform.

Benefits of technology

It solves the problems of primary key update, data deletion and time stamp update due to irregular design operations, realizes the accuracy of data integration and synchronization, and reduces the transformation cost and impact on database performance.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a data merging method and device based on database logs and terminal equipment. The method comprises the steps that execution operation on a source end database is determined; determining primary key information based on the execution operation; assigning a value to an added field in the target end database based on a preset mapping rule, and operating the target end database based on the execution operation to obtain a target database; and merging the target database to the data platform based on the primary key information. According to the data merging method, the problem that in the data integration and synchronization process, due to the fact that design operation is not standard, main key updating, data deletion, untimely updating of timestamps and other problems are caused, and consequently data integration and synchronization cannot be accurately conducted can be solved, the transformation cost is reduced, and the influence on database performance is reduced; normal operation of a source end system can be guaranteed, and accurate data integration of a downstream system is achieved.
Need to check novelty before this filing date? Find Prior Art