Triggered Virtual Objects in VR AR Video Streams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR and AR systems provide a static and passive experience when viewing 2D media content, failing to leverage their potential for immersive interactions.

Innovation Solution

A method is introduced to generate virtual objects in VR/AR environments in response to triggers, synchronizing 2D video triggers with 2D and 3D objects, allowing users to interact with these objects and enhancing the immersive experience by embedding triggers within the media content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a fixed 3D environment is generated with projected 2D media content, then the system provides a stable viewing platform, but the user experience becomes static and passive

Engineering Contradiction:
Improveuser interactionVSAvoidenvironment generation
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transforms the static fixed 3D environment into a dynamic one by introducing virtual objects that can be triggered, animated, and interacted with during media playback. The environment evolves based on detected triggers from the media content, allowing users to interact with dynamically generated virtual objects rather than viewing a static projection.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary actions by detecting triggers embedded in the media content beforehand and preparing virtual objects for generation. When triggers are detected during playback, the corresponding virtual objects are generated and made available for user interaction, creating a seamless interactive experience without real-time processing delays.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If 2D media content is projected on a virtual display screen, then the content is easily viewable, but the user experience lacks immersion

Engineering Contradiction:
Improveimmersive experienceVSAvoidcontent viewing
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent enhances the 2D media content experience by adding a third dimension through virtual objects that exist in the 3D VR/AR environment. These virtual objects can be viewed from multiple angles and interacted with spatially, transforming the flat 2D viewing experience into an immersive 3D environment while maintaining the original content visibility.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If virtual objects are generated in response to triggers, then interactivity is enhanced, but processing complexity increases

Engineering Contradiction:
Improveuser interactionVSAvoidtrigger detection and object generation
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system implements self-service by having virtual objects automatically generated and managed based on trigger detection from the media content. The triggers embedded in the media content self-activate the corresponding virtual objects without requiring manual user input or complex real-time processing, reducing the computational burden while maintaining high interactivity.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11587292B2Triggered virtual reality and augmented reality events in video streams
Publication Date: 2023.02.21 ADEIA MEDIA HOLDINGS INC
  • US11587292B2 patent drawing
  • US11587292B2 patent drawing
  • US11587292B2 patent drawing

AI summary

Various embodiments of the invention disclosed herein provide techniques for generating a virtual object for a VR/AR environment in response to a trigger. A VR/AR application executing on a client device receives a media content item. The VR/AR application detects an event trigger associated with the media content item. The VR/AR application generates at least a portion of a virtual object based on the event trigger. The VR/AR application displays the media content item and the at least a portion of the virtual object on a display associated with a user device.