VR Bitstream Scale Metadata for Binocular Disparity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality technologies face challenges in accurately defining binocular disparity for monoscopic visual overlays in stereoscopic viewing, leading to inconsistent rendering of omnidirectional visual content and overlays, as they lack a proper scale for converting relative distances to real-world units.

Innovation Solution

A method and apparatus that generate and decode a bitstream containing omnidirectional visual media content and a visual overlay, with metadata indicating a scale to convert relative distances to real-world units, enabling the derivation of binocular disparity for stereoscopic viewing. This involves indicating first and second relative distances, and using metadata to determine the appropriate scale for accurate rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If relative distances are used for omnidirectional visual content and overlays, then device complexity is reduced, but manufacturing precision deteriorates due to inability to accurately define binocular disparity

Engineering Contradiction:
Improvecomplexity of distance representationVSAvoidaccuracy of binocular disparity
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent introduces scale metadata as an intermediary element that bridges relative distance values and real-world distance units. This metadata acts as a conversion factor that enables accurate binocular disparity calculation without requiring complex absolute distance measurements, thus maintaining simplicity while improving precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the distance representation parameter from pure relative units to a hybrid system that incorporates scale factors. By changing the parameter definition to include metadata about real-world unit conversions, the system achieves both simplicity and accuracy in binocular disparity definition.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If scale metadata is added to convert relative distances to real-world units, then manufacturing precision improves for binocular disparity, but device complexity increases due to additional metadata processing

Engineering Contradiction:
Improveaccuracy of binocular disparityVSAvoidcomplexity of metadata processing
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The scale metadata is prepared and attached in advance during content creation or preprocessing stages. This preliminary action allows the metadata to be readily available when needed for rendering, eliminating the need for complex real-time calculations and reducing processing complexity during actual playback.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If consistent binocular disparity is achieved for overlays, then manufacturing precision improves, but loss of information increases due to additional scale conversion requirements

Engineering Contradiction:
Improveconsistency of overlay renderingVSAvoidinformation loss during distance conversion
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent preserves the original relative distance information by copying it into the metadata structure alongside the scale factors. This copying approach ensures that the source data is not lost or transformed beyond recognition, allowing for accurate reconstruction of binocular disparity while maintaining the ability to revert to original representations if needed.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11218685B2Method, an apparatus and a computer program product for virtual reality
Publication Date: 2022.01.04 NOKIA TECHNOLOGIES OY
  • US11218685B2 patent drawing
  • US11218685B2 patent drawing
  • US11218685B2 patent drawing

AI summary

The invention relates to a solution wherein a bitstream defining a presentation is generated, the presentation comprising an omnidirectional visual media content and a visual overlay. A first relative distance of the omnidirectional visual media content and a second relative distance of the visual overlay are indicated in the bitstream. Metadata indicative of a scale applicable to convert the first relative distance and the second relative distance to real-world distance units is also associated with the generated bitstream, wherein the scale is for deriving a binocular disparity for the visual overlay. The invention also concerns a solution for decoding the bitstream to obtain data for deriving binocular disparity for the visual overlay.