WriteSet-based universal database log parallel playback method and system

Abstract

The invention belongs to the technical field of databases, and particularly discloses a WriteSet-based universal database log parallel playback method and system, and the method comprises the steps: obtaining log data, dividing the log data into a plurality of ordered write set WriteSet groups by taking a transaction as a unit, carrying out the optimization processing of the operation with the same hash value in the same WriteSet, and carrying out the optimization processing of the operation with the same hash value in the WriteSet. The optimized WriteSet is obtained and used for parallel playback; analyzing a conflict condition among the affairs of the optimized WriteSet according to the Hash value, and packaging the WriteSet without conflicts based on the conflict condition to form a log packet; and dynamically monitoring the log accumulation condition and each performance index of the server through a packet distributor, dynamically adjusting the number of packet actuators according to the log accumulation condition and each performance index of the server, and distributing the log packets to each actuator by taking WriteSet as a unit so as to execute parallel playback. By means of the method and device, balance between data consistency and performance of log playback can be achieved.

Images