Transactional Memory Durability via Selective Non-Volatile Logging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Transactional memory systems relying on volatile memory lack durability, as they are susceptible to data loss due to events like power failures, which can erase or alter memory contents, compromising the system's consistency and requiring mechanisms to restore a consistent state.
Innovation Solution
A durable transactional memory system is implemented with a transaction durability engine that selectively stores data in non-volatile memory, using partitioned logging and checkpoints, along with logical sequence numbers, to ensure recovery in case of data loss, and operates in both synchronous and asynchronous modes to manage transaction commitment and durability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If volatile memory is used for transactional memory system, then access speed is improved, but durability is worsened due to susceptibility to data loss from power failures
Solution Approach 1:
The patent introduces a durability layer as an intermediary component between the volatile memory and the transactional memory system. This durability layer interceptates memory operations, selectively persists critical data to non-volatile storage, and manages recovery processes, thereby resolving the contradiction by maintaining fast volatile memory access while ensuring durability through the intermediary persistence mechanism
Solution Approach 2:
The system performs preliminary actions by proactively identifying and persisting critical transaction data to non-volatile storage before power failures can occur. The durability layer continuously monitors transaction states and pre-persists necessary information, so that when a power failure occurs, the system can quickly recover without data loss, thus resolving the speed-durability contradiction through advance preparation
2Reliability
If durability mechanisms are added to transactional memory system, then data loss prevention is improved, but system complexity is worsened
Solution Approach 1:
The patent segments the transactional memory system into distinct functional layers: the original transactional memory system using volatile memory, and a separate durability layer handling persistence and recovery. This segmentation isolates the complexity of durability mechanisms into a dedicated module, allowing the core transactional memory system to remain simple while still achieving durability through the specialized durability layer
Solution Approach 2:
The durability layer acts as an intermediary that abstracts away the complexity of durability mechanisms from the transactional memory system. It provides a simple interface for persistence operations while handling the complex logic of selective data identification, non-volatile storage management, and recovery processes internally, thus resolving the contradiction by hiding complexity behind a simplified interface
3Reliability
If selective data storage in non-volatile memory is implemented, then recovery capability is improved, but access speed is worsened due to slower non-volatile memory
Solution Approach 1:
The patent applies local quality by implementing selective persistence only for critical transaction data that requires durability, rather than persisting all memory contents. The durability layer intelligently identifies which data structures and transaction states need to be preserved, storing only those in non-volatile memory, thereby maintaining fast access speeds for frequently accessed data in volatile memory while ensuring recovery capability for critical information
Solution Approach 2:
The system performs partial persistence action by storing only the necessary subset of data in non-volatile memory rather than the entire memory state. The durability layer analyzes transaction patterns and data criticality, persisting only the essential portions needed for recovery, thus achieving recovery capability without the performance penalty of storing and accessing all data from slow non-volatile storage
Data Source
AI summary
A transactional memory system uses a volatile memory as primary storage for transactions. Data is selectively stored in a non-volatile memory to impart durability to the transactional memory system to allow the transactional memory system to be restored to a consistent state in the event of data loss to the volatile memory.