Method, device and equipment for data consistency detection

Abstract

The invention discloses a method, a device and equipment for data consistency detection, and relates to the technical field of data processing. to the method, the device and the equipment can detect the consistency of a large amount of data in time, reduce delay and improve the data consistency detection efficiency. The method comprises the following steps: setting a to-be-detected field and service logic corresponding to the to-be-detected field; responding to monitoring that data related to the to-be-detected field in table data associated with the distributed system is changed, adding change data corresponding to the to-be-detected field into a cache; retaining the change data in the effective monitoring time; performing consistency detection on the change data in the effective monitoring time based on the service logic corresponding to the to-be-detected field; and generating prompt information according to the consistency detection result, and sending the prompt information to a touch platform associated with a communication tool. The method, the device and the equipment are suitable for data consistency detection.

Description

technical field [0001] The present application relates to the technical field of data detection, in particular to a method, device and equipment for data consistency detection. Background technique [0002] With the expansion of business scale, enterprise systems become more and more complex. Under this complex distributed system architecture, it is inevitable that remote call failures, message sending failures, and concurrent bugs will occur. Data inconsistency leads to impaired user experience. [0003] In the existing technology, the routine operation to deal with the problem of business data inconsistency is to configure timing tasks, extract the change data in the binlog log data from multiple business databases at each fixed time point, and use Kafka to write the change data to the summary library, and then determine whether there is inconsistent data through task setting sql. [0004] In the process of realizing the present invention, the inventors have found that t...

AI Technical Summary

Problems solved by technology

[0006] In view of this, the present application provides a method, device and equipment for data consistency detection, the main purpose of which is to solve the problem that complex logic formulas in sql judgment cannot be quickly processed in the current process of data consistency detection, which affects data consistency The problem of the efficiency of sexual detection

Images