Multi-Frame Data Decompression with Last Known Good State Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data decompression processes are inefficient when handling multiple frames, as they often require restarting from the beginning upon encountering errors, leading to unnecessary computational overhead and complexity.
Innovation Solution
Implementing a decompressor that maintains a 'Last Known Good State' (LKGS) to resume decompression from the failed frame, reducing the need to parse frame information and improving throughput by allowing partial decompression and error handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the decompressor restarts from the beginning upon encountering errors, then error handling is simplified, but decompression throughput decreases and computational overhead increases
Solution Approach 1:
The decompressor performs preliminary actions by maintaining a Last Known Good State (LKGS) that records the position and state before an error occurred. This allows the system to prepare for error recovery in advance, storing necessary context information (such as dictionary state and processing position) so that when an error is detected, the decompressor can resume from the LKGS rather than restarting from the beginning, thus maintaining both reliability and throughput
2Device complexity
If the decompressor restarts from the beginning upon encountering errors, then processing logic is simplified, but computational overhead increases
Solution Approach 1:
The decompressor creates a copy of the processing state at the Last Known Good State (LKGS) point, storing it in a buffer or memory location. This copying mechanism allows the system to preserve the state before an error without requiring complex rollback logic. When resuming, the decompressor restores this copied state rather than re-computing from scratch, reducing computational overhead while maintaining manageable processing logic complexity
3Reliability
If the decompressor parses frame information to determine what data was not successfully decompressed, then accurate error recovery is achieved, but device complexity increases
Solution Approach 1:
The patent introduces an intermediary mechanism - the Last Known Good State (LKGS) buffer - that acts as a mediator between the decompression process and error recovery. Instead of requiring complex parsing of frame information to determine what data was not successfully decompressed, the LKGS buffer automatically tracks and stores the state at each good checkpoint. This intermediary simplifies the error recovery process by providing ready-to-use state information without requiring the decompressor to re-parse or analyze frame structures
Data Source
AI summary
Examples described herein relate to an accelerator configured to: perform offloaded decompression of multiple frames of data based on a data compression format, wherein the perform offloaded decompression of the multiple frames of data comprises: based on failure to decompress a frame of the multiple frames of the data: indicate, to a requester, device data identifying at least one of: a successfully decompressed frame of the multiple frames of data or an unsuccessfully decompressed frame.