Transaction Log Tracking via Record Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional file systems generate numerous unnecessary records in transaction logs, leading to increased processing load and performance degradation due to the storage and processing of non-essential records.
Innovation Solution
An algorithmically-based method that restructures record sets, identifies and removes records associated with temporary files, and consolidates operations into a single transaction set, reducing the overall number of records processed and database load by building an in-memory database with a predetermined record depth and queue flush time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional file systems generate comprehensive transaction logs for all operations, then complete tracking of all file system actions is achieved, but processing load and performance degradation increase due to storage and processing of non-essential records
Solution Approach 1:
The patent extracts and removes unnecessary records from transaction logs based on analysis of record content and patterns. The system identifies and eliminates redundant records such as those for temporary files, already-committed transactions, and non-critical operations, keeping only essential records that maintain tracking reliability while reducing processing load.
Solution Approach 2:
The patent changes the parameter of record retention by dynamically determining which records to keep or remove based on multiple criteria including record age, transaction status, file importance, and system load. This selective retention approach transforms the binary keep/remove decision into a nuanced parameter-based filtering system that optimizes both completeness and performance.
2Loss of information
If all transaction log records are stored and processed, then complete audit trail is maintained, but storage space and processing resources are wasted on non-essential records
Solution Approach 1:
The patent extracts unnecessary records from the transaction log by analyzing record characteristics and removing those that do not contribute to meaningful audit trails. This includes eliminating records for temporary files, redundant operations, and non-critical system events while preserving records that provide genuine audit value.
Solution Approach 2:
Instead of starting with complete record retention and removing what's unnecessary, the patent inverts the approach by starting with the assumption that records should be removed and only retaining those that prove essential for audit purposes. This inversion mindset systematically reduces log volume while maintaining audit completeness.
3Manufacturing precision
If transaction logs are processed without consolidation, then detailed operation history is preserved, but processing time and system load increase
Solution Approach 1:
The patent merges multiple individual record processing operations into consolidated batch processing. Related records are grouped and processed together as units, reducing the overhead of individual record handling while maintaining the detail of operation history. This consolidation applies to both removal operations and analysis operations.
Solution Approach 2:
The patent performs preliminary analysis and grouping of records before actual processing occurs. By pre-identifying which records to remove, which to consolidate, and which to retain in detail, the system prepares the record set in advance, reducing the complexity and time of the actual processing phase while preserving operation history detail where needed.
Data Source
AI summary
Systems and methods for improving transaction log tracking are described. In one embodiment, the systems and methods may include selecting a portion of records in a transaction log, assembling records in the portion of records into groups of related records, analyzing one or more actions associated with particular records of the groups of related records, and removing one or more records from the portion of records based at least in part on the analysis. In some cases, at least one of the records of the transaction log record an action performed in relation to one or more data objects associated with the storage system.