Digital Assistant Bridge for Seamless VR Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users engaged in virtual reality environments face difficulties in interacting with the real world or commanding other devices without disrupting their virtual experience, as existing solutions either require removing the VR headset or are limited to specific applications.

Innovation Solution

A method that detects an activation command to activate a digital assistant on a disparate device, establishes a connection, and receives user commands to perform actions within the virtual environment, allowing seamless interaction with real-world devices while immersed in VR.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users interact with real-world devices or digital assistants while in VR, then the functionality and capability are improved, but the immersion and continuity of the virtual experience deteriorates

Engineering Contradiction:
Improvecapability to interact with real-world devicesVSAvoidcontinuity of virtual experience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a digital assistant as an intermediary that bridges the virtual reality environment and the real world. The digital assistant receives user commands from the VR environment and executes real-world actions, allowing users to interact with physical devices without breaking VR immersion. The system detects activation commands in the virtual environment, establishes connections with disparate devices, and performs real-world actions while maintaining the virtual experience.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If users remove the VR headset to interact with the real world, then the ability to command real-world devices is improved, but the duration and immersion of the virtual experience deteriorates

Engineering Contradiction:
Improveability to command real-world devicesVSAvoidduration of virtual experience
Core Design Contradiction:
Adaptability or versatilityVSDuration of action of moving object

Solution Approach 1:

The system enables self-service by allowing the digital assistant to autonomously execute real-world commands without requiring user intervention to exit the VR environment. The digital assistant independently establishes connections with devices, receives commands from the virtual environment, and performs real-world actions, eliminating the need for users to remove their headsets to interact with physical devices.

Inventive Principle:
Principle #25Self-service

3Ease of manufacture

If existing solutions are used to interact with devices in VR, then the implementation is simplified, but the applicability is limited to specific applications

Engineering Contradiction:
Improvesimplicity of implementationVSAvoidapplicability across applications
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements a universal digital assistant system that can interact with multiple types of devices across different applications. The system establishes connections with disparate digital assistant devices and can perform various real-world actions including controlling smart home devices, answering calls, and executing commands. This multi-functional approach allows the same VR interface to work across diverse applications and device types, not limited to specific use cases.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12047453B2Digital assistant utilization in a virtual environment
Publication Date: 2024.07.23 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US12047453B2 patent drawing
  • US12047453B2 patent drawing
  • US12047453B2 patent drawing

AI summary

One embodiment provides a method, including: detecting, while in a virtual environment effectuated by a virtual reality device, an activation command to activate a digital assistant embodied on a disparate digital assistant device; establishing a connection with the disparate digital assistant device; receiving, subsequent to the establishing and at the virtual reality device, a user command directed toward the digital assistant; and performing, using the digital assistant while in the virtual environment, an action corresponding to the user command. Other aspects are described and claimed.