MAI SEI Persistence for Efficient Multiview Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face challenges in efficiently managing multiview acquisition information (MAI) supplemental enhancement information (SEI) messages, particularly in specifying their persistency scope, location, and content within coded video sequences, which affects video coding efficiency and compatibility across different devices.
Innovation Solution
The proposed solution involves specifying the persistency scope, location, and content of MAI SEI messages within a coded video sequence, allowing for conversion between video and bitstream based on these messages, and utilizing intrinsic and extrinsic camera parameters for processing decoded views on 3D displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If MAI SEI messages are included in every access unit to ensure complete camera parameter information, then measurement precision of camera parameters is improved, but device complexity and processing overhead increase
Solution Approach 1:
The patent segments the MAI SEI message insertion strategy by access unit type: inserting into IRAP AUs for complete parameter initialization, and using persistence mechanisms for non-IRAP AUs to avoid redundant insertion. This selective segmentation resolves the contradiction by providing complete parameters where needed while reducing overhead where persistence suffices.
Solution Approach 2:
The patent applies preliminary action by inserting MAI SEI messages into IRAP access units at the beginning of video sequences or after scene changes, where camera parameters are most critical. This ensures parameters are available before processing begins, while avoiding redundant insertion in subsequent frames where persistence maintains the information.
2Reliability
If MAI SEI messages are inserted into every access unit to ensure parameter availability, then reliability of video coding is improved, but loss of time in processing increases
Solution Approach 1:
The patent segments processing based on access unit types: IRAP AUs receive full MAI SEI insertion for reliability, while non-IRAP AUs rely on persistence mechanisms that avoid re-insertion. This segmentation maintains reliability where parameters must be re-established while reducing processing time where persistent state suffices.
Solution Approach 2:
The patent performs preliminary MAI SEI insertion into IRAP access units before the main video processing begins, ensuring parameters are ready in advance. This preliminary action ensures reliability for subsequent processing while minimizing the time impact during actual video decoding.
3Manufacturing precision
If MAI SEI messages are repeated in every access unit to maintain parameter consistency, then manufacturing precision of video coding is improved, but quantity of data to be processed increases
Solution Approach 1:
The patent segments the data transmission strategy by inserting MAI SEI messages only into IRAP access units rather than repeating them in every access unit. This segmentation maintains parameter consistency at critical boundaries while significantly reducing the quantity of repeated data in non-IRAP regions.
Solution Approach 2:
The patent uses persistence mechanisms as intermediaries between IRAP access units and non-IRAP access units. The persistence system acts as a mediator that maintains parameter consistency without requiring explicit re-transmission of MAI SEI messages in every access unit, thereby reducing data volume while preserving precision.
Data Source
AI summary
A method implemented by a video coding apparatus. The method includes determining that a multiview acquisition information (MAI) supplemental enhancement information (SEI) message is present in a first access unit (AU) of a coded video sequence (CVS) whenever any MAI SEI message is present in any AU of the CVS; and performing a conversion between a video and a bitstream of the video based on the MAI SEI message. A corresponding video coding apparatus and non-transitory computer readable medium are also disclosed.