Non-Uniform Video Frame Encoding for Temporal Scalability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression schemes are limited in their ability to incrementally adjust the frame rate of digital video streams, resulting in an exponential increase in frames per second when multiple layers are combined, leading to non-uniform time intervals that can compromise visual quality.
Innovation Solution
The method involves encoding video frames using a non-uniform sequence of time values generated from an equidistributed sequence, allowing for temporal scalability by assigning frames to multiple layers at non-uniform time intervals, enabling a linear increase in frame rate without changing the encoding process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If multiple layers are combined using existing video compression schemes, then the frame rate increases, but the time intervals become non-uniform and visual quality deteriorates
Solution Approach 1:
The video stream is divided into multiple temporal layers, each containing frames at specific time intervals. The encoder segments frames into different layers based on their temporal positions, allowing independent encoding and transmission of each layer. This segmentation enables flexible combination of layers to achieve different frame rates while maintaining uniform time intervals within each layer.
Solution Approach 2:
The patent introduces a temporal dimension to the encoding structure by organizing frames into multiple layers with different temporal resolutions. Instead of uniformly increasing frame rate in a single dimension, the system adds a layer dimension where each layer operates at a different temporal granularity, allowing frame rate adjustment without compromising time interval uniformity within individual layers.
2Adaptability or versatility
If existing video compression schemes use multiple layers to support varying bitrate requirements, then flexibility in bitrate adjustment is achieved, but the frame rate increases exponentially rather than linearly
Solution Approach 1:
The system dynamically assigns frames to different temporal layers based on the desired output frame rate. Each layer is encoded with a specific temporal resolution, and the combination of layers can be adjusted dynamically to achieve linear frame rate increments. This dynamic layer assignment allows flexible bitrate adjustment while maintaining controlled, linear frame rate increases rather than exponential growth.
3Ease of manufacture
If frames are encoded at uniform time intervals, then the encoding process is simple, but the ability to support granular frame rate adjustments is limited
Solution Approach 1:
The encoding process is segmented into multiple passes or stages, where frames are first identified and assigned to temporal layers, then encoded separately. This segmentation maintains relative simplicity in each encoding stage while enabling granular frame rate adjustments through the combination of layers. Each layer can be encoded independently with uniform time intervals, preserving encoding simplicity while achieving fine-grained frame rate control.
Data Source
AI summary
A system, apparatus, and method for encoding a plurality of frames in a video stream with temporal scalability. The method includes identifying a non-uniform sequence of time values within a period, determining a frame corresponding to each time value in the non-uniform sequence, within at least one period, and assigning each of the determined frames to one of a plurality of temporal encoding layers.