Multiview Video Coding Mode Decision Using Co-located Macroblock Windows
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing multiview video coding (MVC) encoding process is computationally intensive due to its exhaustive rate distortion optimization (RDO) technique, which is time-consuming and inefficient, especially for systems with limited processing power or those handling multiple encoding jobs.
Innovation Solution
An efficient coding mode decision algorithm that reduces computational complexity by determining a window around a co-located macroblock (MB) in the base view, calculating coding mode complexity or motion vectors, and performing RDO using a reduced or full set of modes based on thresholds, thereby accelerating the MVC encoding process without sacrificing quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If exhaustive rate distortion optimization (RDO) technique is used to find efficient coding mode, then coding quality is improved, but encoding time and computational complexity increase significantly
Solution Approach 1:
The patent segments the exhaustive RDO process into two stages: (1) a fast initial evaluation stage that computes a simplified cost metric to filter out obviously suboptimal modes, and (2) a refined RDO stage that performs full rate-distortion optimization only on the reduced set of candidate modes. This segmentation reduces the overall computational burden while preserving the ability to achieve high coding quality through the second-stage optimization.
Solution Approach 2:
The patent applies partial action by performing a complete RDO evaluation only for a subset of coding modes (those that pass the initial fast evaluation), rather than exhaustively evaluating all possible modes. This partial evaluation approach maintains adequate coding quality for the selected modes while significantly reducing the total computational effort required.
2Productivity
If exhaustive RDO is performed for each macroblock to select optimal coding mode, then coding efficiency is improved, but processing speed decreases
Solution Approach 1:
The patent divides the mode selection process into two sequential phases: a rapid pre-screening phase that eliminates inefficient modes using a simplified metric, and a detailed optimization phase that applies full RDO only to the remaining candidate modes. This segmentation enables the system to maintain high processing speed through the first phase while achieving good coding efficiency in the second phase.
Solution Approach 2:
The patent performs preliminary action by conducting a fast initial evaluation of all coding modes before the full RDO process. This preliminary step identifies and eliminates modes that are unlikely to be optimal, so that the computationally intensive RDO operation is applied only to a reduced set of promising candidates, thereby improving processing speed without significantly compromising coding efficiency.
3Productivity
If multiple encoding jobs are handled simultaneously, then system throughput is improved, but computational resource demand increases
Solution Approach 1:
The patent segments the encoding workflow to perform fast preliminary mode evaluation for all macroblocks across multiple jobs before initiating full RDO operations. This allows the system to process multiple encoding jobs in parallel through the low-resource first stage, then concentrate computational resources on the reduced set of candidate modes that require intensive optimization, thereby improving system throughput while managing computational resource demand.
Solution Approach 2:
The patent applies partial action by performing complete RDO optimization only for a subset of macroblocks and modes that are most likely to benefit from it, rather than applying exhaustive optimization uniformly across all encoding jobs. This selective approach enables the system to handle multiple encoding jobs simultaneously with reduced computational resource demand while maintaining adequate coding efficiency where it matters most.
Data Source
AI summary
A method for determining a macroblock (MB) coding mode for a current MB in a dependent view. A window around a co-located MB in a base view is determined, wherein the co-located MB is a MB in the base view having a same location as the current MB in the dependent view. A coding mode complexity value (CMCV) is determined for each MB in the window, wherein the CMCV is based on a coding mode used to encode the MB. Rate distortion optimization (RDO) is performed for the current MB using a reduced number of coding modes if a total CMCV for all MBs in the window is less than a threshold, or using all supported coding modes if the total CMCV for all MBs in the window is greater than the threshold. A coding mode for the current MB is determined based on the RDO results.