Interactive Overlay Design for VR Omnidirectional Media

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Virtual Reality (VR) environments with omnidirectional media content lack interactive capabilities, particularly in overlay design, which restricts user interaction and immersion within 360° video applications.

Innovation Solution

The method involves building a VR environment using formatted video content according to the Omnidirectional Media Format (OMAF), defining interactive overlays with position information on a viewpoint, and enabling interactions such as resizing, moving, switching, and rotating overlays, allowing users to interact with the entire OMAF application.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If omnidirectional media content is consumed with head-mounted display and headphones, then only parts of media corresponding to user's viewing orientation are rendered, but user interaction capability is limited

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidoverlay interaction options
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The overlay is transformed from a static element to a dynamic interactive component. Users can resize, move, switch, and rotate overlays based on their viewing orientation and interaction needs. The overlay's position, size, and other properties change dynamically in response to user actions and environmental context, enabling rich interaction capabilities while maintaining immersion in the omnidirectional media environment.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If standardized OMAF format is used for omnidirectional media, then fragmentation is avoided, but overlay interactivity is not supported

Engineering Contradiction:
Improveoverlay interactivityVSAvoidformat standardization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent extends the OMAF standard to support multiple overlay interaction modes (resizing, moving, switching, rotating) while maintaining backward compatibility and interoperability. The standardized format now serves dual purposes: ensuring consistent media playback across different devices and enabling rich interactive overlay experiences. This universal extension allows the same standardized format to work both for traditional omnidirectional media consumption and for interactive overlay applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If interactive overlays are added to VR environment, then user engagement is improved, but system complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidoverlay system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The overlay system operates autonomously based on user viewing orientation and interaction patterns. The system automatically determines overlay positions, sizes, and properties without requiring complex manual configuration. Overlay behavior is driven by sensor input and pre-defined interaction rules, reducing the need for complex programming and system configuration while maintaining high user engagement.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12108124B2Method and apparatus with improved overlay design used in a virtual reality environment
Publication Date: 2024.10.01 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US12108124B2 patent drawing
  • US12108124B2 patent drawing

AI summary

A method, a system and an apparatus are employed in a virtual reality (VR) environment. The method of building a virtual reality (VR) environment includes building the VR environment as formatted video content; defining at least one interactive overlay; and providing the at least one interactive overlay with a position information on a viewpoint of the VR environment.