Multi-Bitmap Transaction Retirement in Multi-Chunk File System Logs

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing systems using single-chunk logs for file system modifications are not scalable and often become bottlenecks, requiring continuous validation of transaction dependencies, leading to high resource usage and potential file system inconsistencies during crashes or failures.

Innovation Solution

Implementing a multi-chunk storage log system with transaction marker lists and log holds to track and synchronize modified system metadata, allowing for parallel synchronization of chunks and reducing dependency checks, thus enabling efficient retirement of transaction markers without continuous validation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If single-chunk logs are used for file system modifications, then implementation is simple, but scalability is poor and system becomes a bottleneck

Engineering Contradiction:

Improveimplementation simplicityVSAvoidscalability

Core Design Contradiction:

Ease of manufactureVSProductivity

Solution Approach 1:

The patent divides the single log chunk into multiple independent log chunks (first log chunk, second log chunk, etc.). Each chunk can be modified, synchronized, and retired independently. This segmentation enables parallel processing of log operations across multiple chunks, eliminating the bottleneck of single-chunk logs while maintaining implementation simplicity through modular design.

Inventive Principle:

Principle #1Segmentation

2Reliability

If continuous validation of transaction dependencies is performed, then file system consistency is maintained, but resource usage increases

Engineering Contradiction:

Improvefile system consistencyVSAvoidresource usage

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent introduces transaction markers that are assigned to transactions before they are executed and stored in transaction marker lists. These markers pre-identify the log entries associated with each transaction, eliminating the need for continuous validation during execution. The system validates transactions only at retirement stage, significantly reducing resource usage while maintaining consistency through the ordered retirement process.

Inventive Principle:

Principle #10Preliminary action

3Productivity

If parallel synchronization of log chunks is enabled, then productivity is improved, but complexity of tracking transaction markers increases

Engineering Contradiction:

Improvesynchronization speedVSAvoidtracking complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces transaction marker lists as an intermediary data structure that bridges transactions and log chunks. Each transaction marker contains a reference to its associated log entry and is stored in ordered lists. This intermediary mechanism enables parallel synchronization of multiple log chunks while maintaining simple tracking through the structured marker lists, which automatically manage the complexity of cross-chunk transaction tracking.

Inventive Principle:

Principle #24Intermediary (Mediator)

4Use of energy by moving object

If transaction markers are retired without continuous validation, then resource usage is reduced, but risk of file system inconsistencies increases

Engineering Contradiction:

Improveresource usageVSAvoidfile system consistency

Core Design Contradiction:

Use of energy by moving objectVSReliability

Solution Approach 1:

The patent implements a feedback mechanism through the ordered retirement process. Transaction markers are retired in sequence based on their position in the transaction marker lists, with each retirement checked against the current state of other chunks. This feedback-controlled retirement ensures that no transaction is retired until all its dependencies are satisfied, maintaining file system consistency while allowing most markers to be retired efficiently without continuous validation.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12360954B2Multiple bitmap single head/tail retirement transaction order

Publication Date: 2025.07.15 DELL PROD LP

AI summary

A method facilitating an update to a file system comprises storing a set of transaction log entries at log space of a storage log associated with the file system, the transaction log entries comprising instructions for fulfilling a set of transactions that define change to the file system, assigning, in an ordered sequence corresponding to a sequence order of journalling of the set of transaction log entries to the log space, transaction markers to a set of transaction marker lists, wherein the transaction markers reference the set of transaction log entries, and, for individual transaction markers of the transaction markers, preventing reuse of the log space corresponding thereto until an evaluation of the set of transaction marker lists results in a determination that writing of all modified system metadata corresponding thereto has been executed and that the transaction marker is set equal to a global head transitioning the transaction markers.