Data management method and system based on LSM tree storage structure and medium
By dynamically adjusting the merging operations of memory tables and execution hierarchy strategies in the LSM tree storage structure, the problems of load adaptability and transaction coordination of the LSM tree storage structure in distributed databases are solved, optimizing read efficiency and system stability, and preventing resource exhaustion and transaction isolation violations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Filing Date
- 2026-04-24
- Publication Date
- 2026-07-17
AI Technical Summary
Existing LSM tree storage structures lack load adaptability in distributed databases, have limited resource monitoring dimensions, lack transaction coordination, and affect transaction isolation during disk flushing and merging operations, making it difficult to accurately reconstruct transaction states during crash recovery.
By determining whether the capacity or write pressure of the memory table has reached the freeze threshold, the memory table is converted into a read-only immutable structure. A new memory table is created to receive write operations, and the data is persisted in key order as the lowest-level file of the LSM tree storage structure. Indexes and fast query filters are generated, merge operations are performed according to the hierarchical strategy, historical version data is cleaned up, and I/O throttling mechanism is used to control the bandwidth of the merge operation.
It optimizes read efficiency, controls read amplification and storage amplification, improves the long-term stability of the system, prevents compaction storms and resource exhaustion, and ensures transaction isolation and system reliability.
Smart Images
Figure CN122412418A_ABST