Shard-Based NDVR Storage Architecture for High Write Speed
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage systems are inadequate for providing high write speeds required by networked digital video recording (NDVR) systems, especially during peak usage periods, as they often have limited write bandwidth and are either expensive, difficult to operate, or fragile.
Innovation Solution
The NDVR system divides storage into shards, each with recording writers and readers, allowing for scalable write throughput by distributing recording requests across multiple shards, and uses a directory system to manage metadata for efficient storage and retrieval, enabling high write speeds without modifying the underlying storage system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If conventional storage systems are used for NDVR, then system simplicity is maintained, but write speed is insufficient during peak usage periods
Solution Approach 1:
The storage system is divided into multiple independent storage subsystems, each capable of handling write operations autonomously. This segmentation allows the system to achieve high write speeds by distributing recording requests across multiple subsystems in parallel, while each subsystem remains relatively simple in design and operation.
2Quantity of substance
If storage capacity is increased to handle more recordings, then user storage needs are met, but write bandwidth becomes limited
Solution Approach 1:
The storage system is divided into multiple independent storage subsystems, each capable of handling write operations autonomously. This segmentation allows the system to achieve high write speeds by distributing recording requests across multiple subsystems in parallel, while each subsystem remains relatively simple in design and operation.
Solution Approach 2:
The system transitions from a single-dimensional storage architecture to a multi-dimensional architecture by introducing multiple storage subsystems that can operate independently. This dimensional expansion allows simultaneous write operations across multiple subsystems, effectively increasing write bandwidth without requiring each individual subsystem to have excessive capacity.
3Speed
If expensive high-performance storage systems are used, then write speed requirements are met, but operational complexity and fragility increase
Solution Approach 1:
The storage system is divided into multiple independent storage subsystems, each capable of handling write operations autonomously. This segmentation allows the system to achieve high write speeds by distributing recording requests across multiple subsystems in parallel, while each subsystem remains relatively simple in design and operation.
Solution Approach 2:
The system creates multiple copies of the same storage subsystem architecture, each with identical capabilities. This copying approach allows the system to achieve high write speeds through parallel operations while maintaining simplicity, as each copied subsystem can be managed independently using the same operational procedures.
Data Source
AI summary
Techniques and mechanisms described herein facilitate the storage of digital media recordings. According to various embodiments, a system may include a plurality of shards. Each shard may include a storage system operable to store a plurality of digital media recordings. Each shard may also include one or more recording writers. Each recording server may be operable to store digital media recordings stored in the storage system. According to various embodiments, the system may also include a recording manager. The recording manager may be operable to select one of the plurality of shards for storing a designated digital media recording. The recording manager may also be operable to transmit an instruction to the selected shard to store the designated digital media recording.