Multi-Buffer Sequential Data Writing for Storage Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data transfer methods using parallel processing can result in fragmented files due to out-of-order data block reception, leading to increased read time and complex handling of end-of-file markers across different platforms.
Innovation Solution
A method involving the use of multiple buffers and parallel processing threads to sequentially read and write data blocks, ensuring that data is processed and stored in a contiguous manner, with the inclusion of an end-of-file marker to simplify writing operations across various platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If parallel processing threads are used to transfer data blocks simultaneously, then data transfer speed is improved, but data blocks may be received out of order causing file fragmentation
Solution Approach 1:
The patent divides the file into multiple data blocks that can be processed in parallel, while using multiple buffers to maintain proper sequencing. Each buffer handles specific blocks, allowing simultaneous processing without losing file integrity.
Solution Approach 2:
The patent introduces buffers as intermediary storage between the parallel processing threads and the final file output. These buffers temporarily hold data blocks and ensure they are written to the file in the correct sequential order, resolving the conflict between parallel processing and file continuity.
2Ease of operation
If data blocks are written to storage medium in order of receipt, then writing simplicity is maintained, but read head must perform seek operations reducing read speed
Solution Approach 1:
The patent performs preliminary sorting and sequencing of data blocks in the buffers before writing to the storage medium. This ensures that blocks are written in sequential order on the storage medium, enabling continuous read operations without seek movements, thus improving read speed while maintaining writing simplicity.
3Productivity
If end of file marker is processed immediately upon receipt, then processing efficiency is improved, but complexity increases for handling writes after marker across different platforms
Solution Approach 1:
The patent implements a universal buffer management system that handles the end of file marker in a platform-independent manner. The buffers and sequential writing mechanism provide a unified approach that works across different operating systems (macOS, Windows, Linux) without requiring platform-specific code, thus reducing complexity while maintaining processing efficiency.
Data Source
AI summary
Computer readable media, methods and apparatuses are disclosed that may be configured for sequentially reading data of a file stored on a storage medium. The disclosure also provides for alternating writing, in a sequential order, portions of the file data to a first buffer and a second buffer. The disclosure also provides for writing from a first buffer and a second buffer to a first track until the first track is filled.