Video Stream Reception for Dynamic Frame Rate Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in enabling seamless display when frame rates dynamically change, leading to display gaps and requiring costly high-capability receivers for high frame frequency services.
Innovation Solution
A reception device and method that classifies image data into multiple layers, generates multiple video streams with controlled decoding intervals, and inserts display control information to manage frame rate changes, ensuring continuous decoding and display without gaps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If services of high frame frequency are provided, then display quality is improved, but receiver cost increases
Solution Approach 1:
The video stream is segmented into multiple layers with different temporal resolutions. The base layer contains low-resolution temporal data accessible to all receivers, while enhancement layers contain high-resolution temporal data for advanced receivers. This segmentation allows cheap receivers to decode only the base layer at lower frame rates, while expensive receivers can access enhancement layers for high frame rate display, thus resolving the contradiction between display quality and receiver cost.
Solution Approach 2:
The system dynamically adapts the frame rate and layer composition based on receiver capabilities. Receivers can selectively decode layers according to their processing power and memory capacity. This dynamic adaptation allows the same video stream to be efficiently received by both low-cost and high-cost receivers, enabling high frame frequency services without mandating expensive hardware upgrades for all users.
2Ease of manufacture
If frame rate is restricted to low frequency, then receiver cost is reduced, but display quality deteriorates
Solution Approach 1:
The video content is divided into base layer and enhancement layers. Cheap receivers decode only the base layer which provides acceptable quality at lower frame rates, while the enhancement layers remain available in the stream for future use with advanced receivers. This segmentation ensures that low-cost receivers get functional service now, while the infrastructure supports future quality improvements without requiring hardware upgrades.
Solution Approach 2:
The high frame rate enhancement layers are pre-encoded and included in the video stream in advance, even though current cheap receivers cannot utilize them. This preliminary preparation ensures that when receivers are upgraded or new high-performance receivers are deployed, the high quality service is immediately available without requiring re-encoding or additional content production.
3Adaptability or versatility
If scalable encoding is used to support multiple frame frequencies, then service versatility is improved, but decoding complexity increases
Solution Approach 1:
The encoded video stream is segmented into independently decodable layers with clear hierarchical relationships. Each layer contains self-contained decoding information, allowing receivers to stop decoding at any layer according to their capabilities. This segmentation simplifies the decoding process for low-cost receivers (which only decode the base layer) while enabling advanced receivers to progressively decode enhancement layers, thus managing decoding complexity across different device classes.
Solution Approach 2:
Receivers perform partial decoding by selectively processing only the layers they can handle. Cheap receivers perform partial action by decoding only the base layer, avoiding the complexity of enhancement layers. Advanced receivers can perform excessive action by decoding all layers beyond their immediate needs. This partial/excessive action approach allows the system to support multiple frame frequencies without requiring every receiver to implement the full decoding complexity.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
An excellent display can be performed even when the frame rate changes dynamically at the reception side. When a switching portion at which a sequence of video streams to be transmitted is switched from a first sequence to a second sequence having a different frame rate from the first sequence is provided, display control information is inserted into at least encoded image data of a picture corresponding to the switching portion or a packet containing the encoded image data. A reception side performs display control of pictures using the display control information and implements an excellent display.