Data collection method, device, equipment and readable storage medium

Abstract

The invention discloses a data collection method, a device, equipment and a readable storage medium, and relates to the technical field of big data and the technical field of cloud computing. According to the specific implementation scheme, the method comprises the steps of obtaining an operation request of a user, and extracting user operation information from the operation request; generating aninsertion statement for writing the user operation information into a service database; submitting the insertion statement and the business data change statement to the business database, so that thebusiness database writes the user operation information by executing the insertion statement and changes the business data by executing the business data change statement; and according to the binarylog of the service database, collecting the service data before and after the change and the user operation information. According to the embodiment of the invention, user operation information and service data before and after change are completely collected; meanwhile, data collection and service decoupling are achieved.

Description

technical field [0001] This application relates to computer technology, especially to the field of big data technology. Background technique [0002] The operating mode of the existing business system is generally to execute a series of operations in response to the user's operation request, and to change the corresponding business data in the business database. During this process, it is necessary to completely record user operation information and business data before and after the change, so as to carry out secondary development of functions such as security verification, user portrait analysis, data synchronization, and post-event backtracking, thereby improving product competitiveness. [0003] In the prior art, it is usually to find a specific code fragment in the business code and perform log burying. If the user operation information and the business data before and after the change cannot be completely obtained, it is necessary to query the business database multip...

AI Technical Summary

Problems solved by technology

If the user operation information and the business data before and after the change cannot be completely obtained, it is necessary to query the business database multiple times to obtain the business data, which increases the pressure of reading and writing of the database and increases the performance loss; moreover, the way of burying the log leads to inconsistency with the original business The logic is highly coupled, which reduces the readability and scalability of the code; at the same time, it increases the time consumption of the business system interface and affects the performance of the business system

Images