Direct Data Stream Recording via Buffer Arbitration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face throughput limitations and fragmentation issues when recording and playing back multiple variable rate data streams, leading to increased processor loading, hardware input/output constraints, and reduced playback speeds due to the need for software intervention and random disk writes in file systems.
Innovation Solution
The solution involves capturing and storing data streams directly to a storage device without software intervention, using individual data buffers and a common buffer to prevent overflow, allowing for large sequential writes and reducing overhead by writing metadata periodically, enabling efficient recording and playback of multiple variable rate data streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data streams are recorded using existing file systems with software intervention, then data can be stored and retrieved, but system throughput is reduced due to increased processor loading and file system overhead
Solution Approach 1:
The patent extracts the file system overhead and software intervention layer from the data recording path. By writing data directly to raw storage devices without file system abstraction, the system eliminates processor loading associated with file allocation, directory management, and metadata maintenance, thereby improving throughput while reducing computational complexity
Solution Approach 2:
The patent introduces a buffer memory as an intermediary between the high-speed data stream input and the storage device. This buffer absorbs variable rate data streams and provides a steady output flow to the storage device, decoupling the recording process from file system operations and enabling direct writing without software intervention
2Speed
If data streams are written to file systems, then data can be organized and accessed, but random disk writes cause fragmentation and reduce playback speeds
Solution Approach 1:
The patent performs preliminary organization of data in buffer memory before writing to storage. By pre-assembling data chunks in the buffer and preparing write commands in advance, the system can execute large sequential writes without random access patterns, eliminating fragmentation and maximizing playback speed while maintaining writing efficiency
Solution Approach 2:
The patent implements periodic large sequential writes instead of continuous small random writes. Data accumulates in the buffer over time and is written to storage in periodic large chunks, which optimizes disk I/O performance and enables both high writing efficiency and fast sequential playback without fragmentation
3Quantity of substance
If multiple variable rate data streams are recorded simultaneously, then comprehensive data capture is achieved, but throughput limitations and I/O constraints are exceeded
Solution Approach 1:
The patent segments multiple variable rate data streams into separate buffer memory regions, with each stream having its own buffer space. This segmentation allows independent management of each data stream's variable rate characteristics while collectively utilizing the full I/O bandwidth of the storage device, thereby capturing comprehensive data without exceeding throughput limitations
Solution Approach 2:
The patent adds the buffer memory dimension between the multiple data stream inputs and the storage device output. This intermediate dimension provides time buffering and rate matching capabilities, allowing simultaneous recording of multiple variable rate streams by absorbing rate variations and smoothing the aggregate data flow to match storage device I/O capacity
Data Source
AI summary
Systems and methods for recording and playback of multiple data streams. One device includes a storage controller coupled to an electronic storage device, a first data buffer storing data received from a first data stream, a second data buffer storing data received from a second data stream, a fragment buffer storing fragment metadata, a storage buffer including a plurality of data fragments, and an electronic processor. The electronic processor receives information designating a data stream storage area of the electronic storage device. The electronic processor arbitrates between the first and second data buffers to select a data fragment for writing to the storage buffer. The electronic processor writes the data fragment to the storage buffer, and writes fragment metadata defining the data fragment to the fragment buffer. The electronic processor controls the storage controller to sequentially write from the plurality of data fragments to the data stream storage area.