Video Encoding Reference Information Determination for Multi-View Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-view video encoding, inter-view motion prediction is hindered by issues such as vector sharing limitations due to camera arrangement, and existing methods like NBDV require additional disparity vectors, increasing code amount when motion or disparity is not equivalent, leading to reduced encoding efficiency.
Innovation Solution
A video encoding and decoding apparatus that determines second reference information from previously-encoded reference information to generate a predicted image, allowing for improved prediction accuracy by using both temporal and disparity-based reference information, and updating candidate lists with this information for enhanced prediction residual encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If inter-view motion prediction is used in multi-view video encoding, then encoding efficiency is improved, but vector sharing limitations due to camera arrangement reduce prediction accuracy
Solution Approach 1:
The patent introduces an intermediate reference information determination step that processes reference information from previously-encoded pictures before using it for prediction. This intermediary processing allows the system to adapt reference information to overcome camera arrangement limitations while maintaining the efficiency benefits of inter-view motion prediction.
Solution Approach 2:
The patent changes the parameters used for prediction by determining second reference information from previously-encoded reference information rather than directly using original motion vectors. This parameter transformation enables better adaptation to different camera arrangements while preserving encoding efficiency.
2Measurement precision
If additional disparity vectors are used in NBDV method, then prediction accuracy is improved, but code amount increases
Solution Approach 1:
The patent extracts only the necessary reference information from previously-encoded pictures rather than using complete additional disparity vectors. This selective extraction maintains prediction accuracy while reducing the code amount required for transmission.
Solution Approach 2:
The patent performs preliminary determination of second reference information from previously-encoded reference information before the actual prediction process. This preliminary action prepares optimized reference data that reduces subsequent code requirements while maintaining accuracy.
3Quantity of substance
If conventional reference information methods are used, then code amount is reduced, but prediction accuracy deteriorates in scenarios with limited vector sharing
Solution Approach 1:
The patent adds a temporal dimension by determining second reference information from previously-encoded pictures, creating a new dimension for reference information that complements traditional spatial methods. This dimensional addition improves prediction accuracy without proportionally increasing code amount.
Solution Approach 2:
The patent creates a universal reference information determination mechanism that works across different camera arrangements and prediction scenarios. The method of determining second reference information from previously-encoded reference information provides multi-functional adaptability that maintains accuracy while controlling code amount.
Data Source
AI summary
A video encoding apparatus that predictive-encodes an encoding target image included in an encoding target video. The apparatus includes a prediction device that predicts the encoding target image with reference to a previously-encoded picture as a reference picture and determines first reference information which indicates a first reference region as a reference destination; a second reference information determination device that determines, from reference information used when the first reference region was predictive-encoded, second reference information which indicates a second reference region as another reference destination for the encoding target image; and a predicted image generation device that generates a predicted image based on the second reference information, or both the first reference information and the second reference information.