Frame-Rate Scalable Video Coding for HDR Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies for distributing high dynamic range (HDR) video content are limited to specific resolutions and frame rates, such as 4K at 60 frames per second, and are not compatible with existing playback devices, requiring content producers to create multiple versions of their content.
Innovation Solution
The development of frame-rate scalable video coding techniques that allow for the encoding and decoding of video frames at various frame rates and shutter angles, while maintaining compatibility with existing playback devices, by using metadata to indicate original frame rates and shutter angles and allowing for the combination of consecutive frames to achieve desired frame rates and shutter angles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video content is encoded at a specific frame rate (e.g., 60 fps), then playback quality is optimized for that frame rate, but compatibility with playback devices supporting different frame rates (e.g., 24 fps, 120 fps) is reduced
Solution Approach 1:
The video content is segmented into multiple temporal layers, each encoded at a different frame rate. A base layer is encoded at a lower frame rate (e.g., 24 fps), and enhancement layers are encoded at higher frame rates (e.g., 60 fps, 120 fps). This segmentation allows playback devices to select and decode only the layers appropriate for their capabilities, optimizing both quality and compatibility.
Solution Approach 2:
The solution adds a temporal dimension to the video coding structure by introducing multiple temporal layers with different frame rates. This dimensional expansion allows the same video content to be represented at multiple frame rates simultaneously, enabling playback devices to choose the appropriate temporal resolution based on their capabilities.
2Adaptability or versatility
If multiple versions of video content are created for different frame rates, then compatibility with various playback devices is improved, but content distribution complexity and storage requirements increase
Solution Approach 1:
Multiple video versions for different frame rates are merged into a single scalable video bitstream. The base layer and enhancement layers are combined in a unified coding structure, allowing all frame rate versions to be transmitted or stored together. This eliminates the need for separate content distribution channels for each frame rate.
Solution Approach 2:
The scalable video bitstream structure serves multiple functions simultaneously: it provides compatibility with legacy devices, supports high frame rate playback on advanced devices, and enables flexible adaptive streaming. A single bitstream structure achieves what previously required multiple separate content versions.
3Manufacturing precision
If video content is encoded at higher frame rates (e.g., 120 fps), then motion smoothness and quality on high refresh rate displays are improved, but compatibility with existing playback devices (e.g., 60 fps displays) is reduced
Solution Approach 1:
The high frame rate information is extracted as a separate enhancement layer from the base video content. Devices capable of high frame rate playback can extract and utilize the enhancement layer for smooth motion, while legacy devices simply use the base layer, ensuring backward compatibility without compromising motion smoothness for capable devices.
Data Source
AI summary
Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.