SEI View Position Signaling for Multiview Video Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently signaling multiview view positions, leading to suboptimal compression and rendering of multidimensional video data.
Innovation Solution
The implementation of a supplemental enhancement information (SEI) message in the bitstream to convey multidimensional coordinates for multiple views, allowing for the determination and rendering of vertical and horizontal view positions, and reordering of pictures based on these coordinates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional video coding techniques are used for multiview video, then the coding process is simple, but the compression efficiency is insufficient and rendering accuracy is poor
Solution Approach 1:
The patent introduces a second dimension (horizontal view position) to the traditional one-dimensional (vertical) view position signaling. This dimensional expansion allows for more precise representation of multiview camera arrangements in a two-dimensional coordinate system, improving both compression efficiency and rendering accuracy by capturing the spatial relationships between multiple cameras more effectively
Solution Approach 2:
The patent changes the parameter representation from simple one-dimensional view indices to two-dimensional coordinates (horizontal and vertical positions). This parameter transformation enables more accurate modeling of camera geometries and improves the precision of view synthesis while maintaining efficient coding through coordinated signaling of position parameters
2Measurement precision
If one-dimensional view position signaling is used, then the signaling process is simple, but the rendering accuracy for multidimensional video data is insufficient
Solution Approach 1:
The patent adds a horizontal dimension to the view position signaling, transforming it from one-dimensional to two-dimensional. This allows the system to preserve and transmit spatial information about camera arrangements in both vertical and horizontal directions, eliminating the information loss that occurs with one-dimensional signaling
3Adaptability or versatility
If existing SEI message formats are used, then the message structure is simple, but the ability to convey multidimensional coordinates is insufficient
Solution Approach 1:
The patent segments the view position information into separate horizontal and vertical coordinate components. This segmentation allows each dimension to be coded independently using efficient syntax elements, making the overall structure manageable while providing comprehensive two-dimensional coordinate representation capability
Solution Approach 2:
The SEI message structure is extended to include two-dimensional coordinate information by adding horizontal position parameters alongside the existing vertical position parameters. This dimensional expansion provides the versatility needed to represent multidimensional video data while organizing the message structure in a systematic way that balances complexity and capability
Data Source
AI summary
Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes pictures associated with views in a bitstream and determines, from a supplemental enhancement information (SEI) message, positions of multidimensional coordinates in a multidimensional space respectively for the views. In an example, a position of a view is defined in the SEI message by at least a vertical view position and a horizontal view position in the multidimensional space. Further, the processing circuitry determines a rendering picture from the pictures based on a rendering view that is defined by at least the vertical view position and the horizontal view position in the multidimensional space.