Read-Write Node Asynchronous Log Playback for Cloud Database Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional cloud databases face challenges such as high storage and computing costs, long backup times, slow creation of read-only instances, and limited scalability due to their architecture, particularly when trying to separate computing from storage while ensuring data consistency across nodes.
Innovation Solution
An operation request processing method that involves a read-write node in a shared storage service cluster, where the method performs a locking operation on a data table, writes a log of locking into a redo log file, and monitors the playback of this log by read-only nodes to ensure all nodes have processed the operation before proceeding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the read-write node waits for all read-only nodes to complete log playback before returning a completion message, then data consistency is ensured, but the request processing time increases
Solution Approach 1:
The patent applies preliminary action by performing the locking operation and writing the log to the redo log file before returning the completion message to the requester. The read-write node locks the data table and records the operation in advance, then returns the completion message immediately without waiting for read-only nodes to replay the log. This ensures that the critical path for request processing is shortened while maintaining data consistency through the pre-recorded log that can be used for recovery and synchronization.
2Adaptability or versatility
If the system uses shared storage architecture to separate computing from storage, then scalability and elasticity are improved, but the complexity of coordinating operations across multiple nodes increases
Solution Approach 1:
The patent uses the redo log file as an intermediary mechanism to coordinate operations across distributed nodes. Instead of requiring complex real-time communication and synchronization protocols between the read-write node and read-only nodes, the system uses the log file as a shared intermediary that all nodes can independently process. The read-write node writes operations to the log, and read-only nodes independently replay the log to maintain consistency, eliminating the need for complex coordination protocols.
3Reliability
If the read-write node performs locking operations and waits for read-only nodes to replay logs, then data integrity is maintained, but the processing efficiency decreases
Solution Approach 1:
The patent applies preliminary action by completing the locking operation and log writing before returning the completion message. The read-write node performs the essential data integrity actions (locking and log recording) in advance, then immediately returns the completion message without waiting for read-only nodes to replay the log. This separates the critical path for request processing from the non-critical path for synchronization, maintaining data integrity while improving processing efficiency.
Data Source
AI summary
Embodiments in the present description provide an operation request processing method and apparatus, and a device, and a readable storage medium, and a system. In the present embodiment, after obtaining an operation request for a data table, a read-write node can return a request processing completion message to a requester in time without waiting for all read-only nodes; a locking operation is performed on the data table, a log of locking the data table is written into a redo log file; and after status information of the log of locking is written into a status record, a monitoring processing process can achieve log playback monitoring of all the read-only nodes by using the status record and the log of locking. Thus, an asynchronous processing mechanism is achieved, and the stability and efficiency of operation request execution are improved.