Chunk-Based Deduplication for nDVR Storage Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional network-based digital video recorder (nDVR) storage solutions face inefficiencies in deduplicating recordings due to variations in start and end times among users, leading to increased storage costs and complexity in archival storage.
Innovation Solution
The approach involves dividing recordings into chunks with predetermined start and stop times, allowing for bit-for-bit identical chunks across instances, even if overall start and stop times differ, using a method that calculates chunk start times based on a common reference like the Unix epoch, enabling efficient deduplication during archiving.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If recordings are stored separately for each requesting user in conventional nDVR storage solutions, then each user's recording requirements are met, but costly enterprise class storage must be used to store each recording separately
Solution Approach 1:
The recording is divided into multiple time-based segments or chunks. Each segment corresponds to a specific time interval and can be independently stored and retrieved. This segmentation allows different users with different recording time requirements to access the same base recording without requiring separate complete copies, thereby reducing overall storage capacity needs while meeting individual user requirements.
2Quantity of substance
If recordings of a program are deduplicated to a single instance when archived, then storage efficiency is improved, but two recordings of a single program will not be bit-for-bit identical if the two recordings do not begin at identical times and end at identical times
Solution Approach 1:
By segmenting recordings into time-based chunks, the system can identify and deduplicate identical segments across different recordings. Even if complete recordings have different start and end times, their overlapping time intervals will produce identical chunks that can be deduplicated. This maintains bit-for-bit identity for matching segments while enabling storage efficiency through deduplication.
Solution Approach 2:
The system changes the parameter of comparison from entire recording files to individual time-based segments. Instead of requiring complete bit-for-bit identity of entire recordings, the system compares and deduplicates based on segment-level identity. This parameter change allows deduplication to proceed effectively even when recordings have different temporal boundaries.
3Quantity of substance
If conventional deduplication methods are used, then bit-for-bit identical recordings can be deduplicated, but variations in start and end times among users prevent effective deduplication
Solution Approach 1:
The system segments recordings into discrete time intervals, creating a framework where deduplication can occur at the segment level rather than requiring complete recording identity. This segmentation enables effective deduplication to proceed despite variations in overall recording start and end times, as long as the time intervals themselves are identical. The approach maintains adaptability to different user recording time requirements while achieving deduplication effectiveness.
Data Source
AI summary
In embodiments of a method, system, and device for deduplicating recordings of an audiovisual content, while a stream time is at least equal to a recording start time, and while the stream time has not yet reached a recording end time, a next chunk start time is determined and a new current chunk of the plurality of chunks is recorded, repeatedly until the next chunk start time has been reached. Chunks that each have identical chunk start times and identical chunk end times are deduplicated.