Data consistency verification method and device and electronic equipment

By obtaining the database change log and real-time synchronization to the message queue, the theme classification mechanism of the message queue is used for consistency verification, which solves the problem of low data consistency verification efficiency caused by the large number of data consumer ends in the message queue, and achieves high efficiency , accurate data consistency verification.

CN119025513APending Publication Date: 2024-11-26CHINA CONSTRUCTION BANK +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411166523.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-23
Publication Date
2024-11-26

Smart Images

  • Figure CN119025513A_ABST
    Figure CN119025513A_ABST
Patent Text Reader

Abstract

The invention provides a data consistency verification method and device and electronic device.The method comprises the steps that a first set of changed data is analyzed from a data change log of a first database, and a second set of changed data received by a target message queue is obtained, and performing consistency verification on the changed data in the first set and the second set to obtain a verification result. According to the scheme, the data in the target message queue is creatively compared with the data change log of the database, and the comparison result serves as the data consistency verification result. The scheme has no requirement on the data consumption end of the message queue, and is suitable for any number of data consumption ends in any implementation mode; an agent program does not need to be installed, reading and writing of data blocks are not involved, and a database, a message queue and a data consumption end are not affected; the data in the data change log of the database is used for verification, real-time verification of incremental data can be achieved, and the timeliness and accuracy of the verification result are high.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Message queue-based data synchronization method, apparatus and device, and storage medium

    CN112380227A

  • Data synchronization method for fusing stock data and incremental data based on message queue

    CN115599870A

  • Data consistency verification method and device based on binary log and medium

    CN115757616A

  • Data processing method and device, computer readable storage medium and computer equipment

    CN115965481A

  • Mass data transmission control method, device and equipment

    CN116089530A