Video Residual Encoding with Selective Residual Masking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing hybrid backward-compatible coding technologies face challenges in reducing overall data size while maintaining user experience and optimizing processing speed and complexity, particularly in balancing the impact of residual elements on reconstructed signals.
Innovation Solution
A method of encoding input signals by generating and modifying sets of residuals based on differences between input and reconstructed signals, including selecting subsets not to encode, transforming, and quantizing residuals, with optional pre-quantization and residual masking to optimize data size and computational efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If all residual elements are encoded to maintain signal reconstruction quality, then manufacturing precision is improved, but loss of substance increases
Solution Approach 1:
The patent extracts and removes a subset of residual elements from the encoding process based on spatial and temporal characteristics. By identifying and eliminating redundant residuals that contribute minimally to reconstruction quality, the system reduces data size while preserving essential information for maintaining signal fidelity.
Solution Approach 2:
The patent applies differential encoding strategies to different spatial and temporal regions of the signal. Residuals in high-importance regions are encoded with higher precision, while residuals in low-importance regions are either coarsely encoded or discarded, optimizing the balance between reconstruction quality and data efficiency.
2Loss of substance
If a subset of residuals is selected not to encode to reduce data size, then loss of substance is reduced, but manufacturing precision deteriorates
Solution Approach 1:
The patent implements partial encoding of residuals by selectively encoding only the most significant subset based on spatial and temporal analysis. This partial action approach encodes sufficient residuals to maintain acceptable reconstruction quality while avoiding the excessive encoding of all residuals, thereby reducing data size.
3Productivity
If residual modification and selection processing is added to optimize data size, then productivity is improved, but device complexity increases
Solution Approach 1:
The patent performs preliminary analysis of residual spatial and temporal characteristics before the main encoding process. By pre-identifying which residuals are significant and which can be discarded, the system prepares the residual set in advance, streamlining the subsequent encoding steps and improving overall processing efficiency despite the added initial analysis complexity.
Data Source
AI summary
According to aspects of the invention there is provided a method of modifying sets of residuals data where residual data can be used to correct or enhance data of a base stream, for example a frame of a video encoded using a different video coding technology. There may be provided a method of encoding an input signal, the method comprising: receiving an input signal; generating one or more sets of residuals based on a difference between the input signal and one or more reconstructed signals at one or more respective resolutions; modifying the one or more sets of residuals based on a selected residual mode; and encoding the one or more sets of modified residuals to generate one or more respective encoded streams, wherein the encoding includes transforming the one or more sets of modified residuals, and wherein the modifying includes selecting a subset of residuals not to encode based on the selected residual mode. An encoder may also be provided.