Omni Media Texture Mapping Metadata for VR Interoperability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) media technologies rely on a single rectangular video for texture mapping, which limits interoperable rendering across different camera configurations and stitching methods, necessitating standardized metadata for consistent VR content rendering.
Innovation Solution
A method and apparatus for generating omni media texture mapping metadata, involving a video processor that identifies geometric frame shapes and regions of interest, maps these to planar frames, and transmits signals to video players for accurate texture mapping, enabling view-dependent tone mapping in VR environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single rectangular video is used for texture mapping in VR, then the system is simple to implement, but interoperable rendering across different camera configurations and stitching methods cannot be ensured
Solution Approach 1:
The patent applies preliminary action by generating texture mapping metadata during the video encoding stage rather than during playback. The video processor identifies geometric frame shapes and regions of interest, and embeds this mapping information into the bitstream in advance. This allows the video player to directly use the pre-computed metadata for consistent rendering across different VR configurations without requiring complex real-time computation.
Solution Approach 2:
The patent introduces an intermediary metadata structure that acts as a bridge between the source video and the final rendered output. This metadata includes geometric frame shape information, region of interest mappings, and area of interest coordinates that mediate between different camera configurations and stitching methods. The intermediary metadata enables interoperable rendering by providing a standardized interface that both encoder and decoder can use consistently.
2Manufacturing precision
If geometric frame mapping with region of interest is implemented, then texture mapping accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the geometric frame into multiple regions of interest, each with its own mapping parameters. Instead of treating the entire frame uniformly, the system identifies specific areas (such as focal regions) that require higher mapping precision and allocates resources accordingly. This segmentation allows accurate texture mapping in critical areas while maintaining reasonable processing complexity overall.
Solution Approach 2:
The patent implements local quality by applying different mapping precision and detail levels to different regions of the frame. Regions of interest receive higher quality mapping with more detailed metadata, while less important areas use standard mapping. This local differentiation improves texture mapping accuracy where needed without uniformly increasing processing complexity across the entire image.
3Adaptability or versatility
If standardized metadata is defined for VR rendering, then interoperability across players is improved, but flexibility in handling various camera configurations is reduced
Solution Approach 1:
The patent applies universality by designing a metadata structure that can handle multiple camera configurations and stitching methods through a unified interface. The geometric frame shape descriptors and region of interest mappings are defined in a way that works across different VR setups (e.g., 360-degree cameras, multi-camera arrays, various stitching algorithms). This universal metadata format provides adaptability to various configurations while maintaining a consistent standardized structure.
Data Source
AI summary
A video player for generating omni media texture mapping metadata is provided. The video player includes a memory and a processor connected to the memory. The processor is configured to receive, from a video processor, a signal indicating a shape of a geometric frame for a video and an area of interest on a planar frame. The processor is also configured to map the area of interest on the planar frame to a region of interest on the geometric frame based on the shape of the geometric frame. The processor is further configured to generate the geometric frame with the region of interest.