Data Duplication with Compression Look-Ahead for Forensic Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In computer forensics, existing systems face challenges in determining whether data compression will reduce or expand data blocks during the acquisition phase, requiring efficient comparison of compressed and original data to optimize memory usage while maintaining high sequential data throughput.
Innovation Solution
Implementing a look-ahead compression method using a duplicator with a compression look-ahead unit that segments data into chunks, calculates both uncompressed and compressed lengths, and copies the version requiring the least memory to the destination storage device, utilizing an FPGA for high throughput.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data compression is applied during the acquisition phase, then memory usage on the destination storage device is reduced, but the system cannot determine whether compression will actually reduce or expand data blocks without additional processing time
Solution Approach 1:
The patent applies preliminary action by calculating the compressed length of data blocks before actually copying them to the destination storage device. The compression look-ahead unit computes the expected compressed size in advance, allowing the system to determine whether compression will reduce or expand data before committing to the copy operation, thus optimizing memory usage without excessive processing delays.
Solution Approach 2:
The patent segments the acquisition process into distinct functional units: a compression look-ahead unit that calculates compressed lengths, and a data copying unit that executes copies based on those calculations. This segmentation allows independent optimization of each function, enabling fast length prediction without bottlenecking the overall data throughput.
2Productivity
If the system copies data without compression to maintain high sequential data throughput, then processing speed is improved, but memory usage on the destination storage device increases
Solution Approach 1:
The system performs a preliminary calculation of the compressed data length before executing the copy operation. This advance assessment allows the system to make an informed decision about whether to compress or copy directly, optimizing both throughput and memory usage based on the specific characteristics of each data block.
Solution Approach 2:
The patent changes the parameter being measured from actual compression performance to predicted compression length. By calculating the expected compressed size without performing the full compression operation, the system can quickly assess whether compression is beneficial while maintaining high data throughput during the acquisition phase.
3Quantity of substance
If the system performs full compression calculation before copying each data block, then memory optimization is improved, but the complexity of the duplicating device increases
Solution Approach 1:
The patent extracts the compression length calculation function into a separate compression look-ahead unit, distinct from the main data copying unit. This extraction allows the duplicating device to perform optimization calculations without adding significant complexity to the core data transfer function, as the length prediction is handled by a dedicated auxiliary component.
4Productivity
If the system uses specialized computer hardware to maintain high sequential data throughput, then data acquisition speed is improved, but the cost and complexity of the system increases
Solution Approach 1:
The patent segments the duplicating device into specialized hardware components: a compression look-ahead unit for length prediction and a data copying unit for high-speed transfer. This segmentation allows each component to be optimized for its specific function, maintaining high data acquisition speed while managing system complexity through functional decomposition.
Data Source
AI summary
A method of duplicating electronically stored data that includes coupling a duplicating device between an original information storage device and a destination storage device, and streaming data from the original information storage device to the duplicating device. An embodiment of the method also includes segmenting the streaming data, determining a length of an uncompressed data segment, and calculating a length of the data segment when compressed. This embodiment further includes determining if the length of the data segment when compressed is less than some threshold, and copying a compressed data segment to the destination storage device if the length of the compressed data segment is less than the threshold, otherwise copying the uncompressed data segment to the destination storage device.