Image Decoding Apparatus Frame Rate Control via Temporal Layer Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image decoding technologies struggle to accurately control the frame rate of moving images, particularly in non-specific regions encoded at a lower rate, leading to restricted frame rate control during decoding and playback, which limits the ability to achieve a desired frame rate.
Innovation Solution
An image decoding apparatus that utilizes temporal scalable coding, where frames are divided into tiles and a rate calculation unit determines the appropriate frame rate based on processing performance and region settings, allowing for flexible frame rate adjustment during decoding and display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the frame rate for a non-specific region is reduced during encoding, then the overall data transmission efficiency is improved, but the frame rate control flexibility during decoding is restricted
Solution Approach 1:
The screen is divided into specific regions and non-specific regions, allowing different frame rates to be applied to different areas. This segmentation enables the non-specific regions to be encoded at lower frame rates for efficiency while preserving the ability to decode and playback these regions at higher frame rates when needed, thus resolving the contradiction between transmission efficiency and frame rate control flexibility.
Solution Approach 2:
The decoding apparatus dynamically adjusts the frame rate for non-specific regions based on playback requirements. Even though these regions were encoded at lower frame rates, the system can flexibly control and increase the frame rate during decoding and playback operations, transforming a static encoding constraint into a dynamic playback capability.
2Adaptability or versatility
If temporal scalable coding is used to encode frames at different temporal layers, then the adaptability to different playback requirements is improved, but the device complexity increases
Solution Approach 1:
The video stream is segmented into different temporal layers with distinct frame rates. The decoding apparatus processes these layers separately, allowing flexible combination and playback at different frame rates. This segmentation approach provides playback adaptability while managing complexity through structured, modular processing of temporal layers.
Solution Approach 2:
The decoding apparatus is designed to handle multiple temporal layers and provide multiple playback frame rates from a single encoded stream. This multi-functional capability allows the system to adapt to different playback requirements (different frame rates) without requiring separate decoding systems, thus achieving universality that balances adaptability with manageable complexity.
Data Source
Figure 1~2
Figure 3(a)~3(h)
Figure 4A~5A
AI summary
An image decoding apparatus, the image decoding apparatus decoding encoded data obtained by performing hierarchical coding on a moving image including one or more images using a plurality of temporal layers, includes a first acquisition unit configured to acquire information regarding frame rates of the moving image corresponding to the plurality of temporal layers used in the hierarchical coding, a second acquisition unit configured to acquire information regarding the size of a region of interest of the one or more images, a determination unit configured to determine a frame rate to be used in a case where the region of interest is displayed, in accordance with the information regarding the frame rates corresponding to the respective temporal layers, and the information regarding the size of the region of interest, and a decoding unit configured to decode the region of interest at the determined frame rate.