Omnidirectional Media Overlay Bitstream Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR media consumption lacks a flexible interface to integrate and interact with external information sources, leading to disruptions and limitations in immersive media experiences.

Innovation Solution

A method and apparatus for generating and parsing a bitstream that defines omnidirectional visual media content, allowing for the overlay of external media with specified placement, synchronization, and interaction parameters, enabling seamless integration of external content during rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If external media is overlaid on omnidirectional visual media content, then the immersive experience is enhanced, but the complexity of the rendering system increases

Engineering Contradiction:
Improveintegration of external mediaVSAvoidrendering system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the rendering system into distinct functional modules: an omnidirectional media player that handles the base content, an overlay manager that processes external media, and a composition engine that combines them. This segmentation allows each component to be optimized independently, reducing overall system complexity while enabling versatile media integration.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an overlay manager as an intermediary component between the external media source and the omnidirectional media player. This mediator handles the complex tasks of placement, synchronization, and interaction management, shielding the core rendering system from complexity while enabling flexible external media integration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If multiple parameters are specified for overlay placement and synchronization, then the precision of external media integration is improved, but the complexity of parameter management increases

Engineering Contradiction:
Improveoverlay placement precisionVSAvoidparameter management complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent specifies overlay parameters (placement, synchronization, interaction) in advance during the media encoding stage, storing them in the bitstream. This preliminary action eliminates the need for complex real-time parameter management during playback, as the overlay manager simply retrieves and applies pre-defined parameters, achieving high precision with minimal runtime complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent enables dynamic parameter changes by allowing overlay parameters to be updated through metadata in the bitstream during media playback. This approach maintains precision by using structured parameter definitions while reducing management complexity through standardized parameter interfaces that can be modified without changing the core system architecture.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If external media is integrated into omnidirectional content, then the functionality of the VR system is enhanced, but the difficulty of synchronization increases

Engineering Contradiction:
Improveexternal media integrationVSAvoidsynchronization difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements a feedback mechanism where the overlay manager continuously monitors the playback state of omnidirectional media and adjusts external media synchronization accordingly. By using timestamp information and playback position feedback, the system maintains precise synchronization without requiring complex predictive algorithms, reducing the difficulty of measuring and maintaining sync while enhancing integration capability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11094130B2Method, an apparatus and a computer program product for video encoding and video decoding
Publication Date: 2021.08.17 NOKIA TECHNOLOGIES OY
  • US11094130B2 patent drawing
  • US11094130B2 patent drawing
  • US11094130B2 patent drawing

AI summary

The embodiments relate to a method, and a technical equipment for implementing the method. The method comprises generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content; and indicating in the bitstream a definition for an external media to be overlaid on the omnidirectional visual media content during rendering; wherein the definition comprises at least an overlay placement information for the external media on the omnidirectional visual media content. The embodiments also relate to a method and technical equipment for decoding the bitstream.