Artificial Reality Trigger System for Environmental Feature Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing artificial reality systems lack the ability to automatically detect environmental features and apply relevant effects without relying on dedicated input devices, leading to potential user distraction from irrelevant information and a less immersive experience.

Innovation Solution

A system that determines a set of candidate triggers based on environmental features, such as shapes, sounds, and wireless signals, and generates corresponding effects according to a predetermined policy, allowing for the automatic application of relevant information and enhancements to the artificial reality without the need for dedicated input devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If automatic detection of environmental features is implemented, then user experience and immersion are improved, but device complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The HMD device integrates multiple functions including environmental feature detection through cameras and microphones, trigger determination logic, and effect generation capabilities. This multi-functional approach allows the device to automatically adapt to environmental contexts without requiring separate dedicated input devices, thereby improving user experience while managing complexity through consolidation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs automatic environmental feature detection and trigger determination without requiring user input through dedicated devices. The HMD autonomously captures images and audio, detects features, determines triggers, and applies effects, enabling the device to serve itself in the information gathering and processing tasks that enhance user immersion.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If relevant information is automatically presented, then immersion is improved, but information overload and distraction may occur

Engineering Contradiction:
ImproveimmersionVSAvoiduser distraction
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system applies different processing and presentation strategies to different detected features based on their relevance. Not all detected environmental features trigger effects - the system selectively applies triggers and effects only to features that are deemed relevant to the user's context and activity, thereby maintaining immersion without causing information overload or distraction from irrelevant data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11430157B1Effects in artificial reality based on environmental features
Publication Date: 2022.08.30 META PLATFORMS TECHNOLOGIES LLC
  • US11430157B1 patent drawing
  • US11430157B1 patent drawing
  • US11430157B1 patent drawing

AI summary

Disclosed herein are related to a device and a method of generating triggers to provide effects to an artificial reality based on features in an environment. In one aspect, a set of candidate triggers for applying effects to the artificial reality provided by the device is determined according to features in an environment. In one aspect, a subset of the set of candidate triggers is determined according to a predetermined policy. In one aspect, corresponding effects to apply to the artificial reality are generated by the device according to the subset of the set of candidate triggers.