Video Decoder Resolution Enhancement With Reused Prediction Engines
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High resolution displays are often limited by the availability of low-resolution video content and the computational resources required for high-quality upsampling techniques like super resolution, which are prohibitive for portable devices.
Innovation Solution
A decoder system that reuses components for both base and enhanced resolution video processing, utilizing motion compensation and adaptive transfer to generate enhanced resolution frames with reduced computational and power requirements, including a neural processing unit for key frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If super resolution algorithms are used to improve visual quality, then manufacturing precision is improved, but device complexity increases
Solution Approach 1:
The decoder components (spatial prediction engine, temporal prediction engine, reconstruction engine) are designed to perform both base resolution decoding and enhanced resolution generation using the same hardware blocks. The controller dynamically configures these components to operate in different modes (base resolution mode or enhanced resolution mode) depending on the processing requirements, eliminating the need for separate dedicated super-resolution hardware.
Solution Approach 2:
The patent changes the operational parameters of existing decoder components to achieve enhanced resolution. By adjusting the prediction and reconstruction processes to operate at higher resolution levels and using adaptive transfer techniques, the system generates super-resolution output without requiring fundamentally different hardware architecture.
2Manufacturing precision
If super resolution algorithms are used to improve visual quality, then manufacturing precision is improved, but power consumption increases
Solution Approach 1:
The same decoder hardware components are used for both base resolution decoding and enhanced resolution generation, eliminating the need for separate power-intensive super-resolution processing units. The controller manages the operational mode to optimize power usage based on processing requirements.
Solution Approach 2:
The decoder generates enhanced resolution output by leveraging its own existing prediction and reconstruction engines rather than relying on external or dedicated super-resolution processing resources. This self-service approach reduces overall system power consumption.
3Device complexity
If simple interpolation and filtering are used to reduce computational complexity, then device complexity is reduced, but manufacturing precision deteriorates
Solution Approach 1:
The patent enables the same decoder components to deliver both low-complexity base resolution decoding and high-quality enhanced resolution generation by dynamically adjusting their operational mode. This eliminates the need to choose between simple interpolation and complex super-resolution algorithms.
Solution Approach 2:
The controller dynamically configures the operational mode of the decoder components based on the processing requirements. The system can switch between base resolution mode (using standard decoding processes) and enhanced resolution mode (using adaptive transfer and higher-resolution prediction), allowing flexible adaptation to different quality and performance requirements.
4Manufacturing precision
If enhanced resolution generation is performed to improve visual quality, then manufacturing precision is improved, but loss of time increases
Solution Approach 1:
The decoder components are designed to perform enhanced resolution generation using the same hardware blocks that perform base resolution decoding, eliminating the need for separate processing pipelines and reducing overall processing time.
Solution Approach 2:
The spatial and temporal prediction engines prepare prediction data at the required resolution level during the decoding process itself, rather than performing separate upscaling operations afterward. This preliminary preparation of high-resolution prediction data reduces subsequent processing time.
Data Source
AI summary
A device includes a decoder that includes a spatial prediction engine, a temporal prediction engine, a reconstruction engine, and a decoded picture buffer. The device also includes a controller configured to cause the decoder to, in a base resolution mode, reconstruct a base resolution version of a block of a frame using the reconstruction engine and at least one of the spatial prediction engine or the temporal prediction engine. The controller is also configured to cause the decoder to, in an enhanced resolution mode, generate an enhanced resolution version of the block using the reconstruction engine and the at least one of the spatial prediction engine or the temporal prediction engine.