Bidirectional VR Interface for Immersive AI Service Communication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice-only based communication systems fail to exploit the immersive experience possibilities of the metaverse, limiting the interaction capabilities in virtual environments.
Innovation Solution
A system enabling bidirectional user interaction in a graphically simulated environment using a computing system with a processor, memory, and network connection, displaying a simulated agent in a VR presentation, engaging users through a user-customized graphical indicium, and conducting communication sessions with conversational AI or human agents.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If voice-only based communication systems are used, then system simplicity is maintained, but immersive experience capability is limited
Solution Approach 1:
The patent transitions communication from traditional voice-only (1D audio) to immersive 3D spatial audio with visual components, adding spatial and visual dimensions to the communication experience. This allows users to perceive direction, distance, and spatial relationships of audio sources while seeing visual indicators, creating a multi-dimensional immersive experience that resolves the contradiction between simplicity and immersive capability.
2Extent of automation
If traditional VRU systems are used, then automated response capability is achieved, but interaction immersion is reduced
Solution Approach 1:
The patent introduces a simulated agent as an intermediary that bridges automated response systems and immersive interaction. The simulated agent, represented by a visual avatar in the virtual environment, maintains automated response capabilities while providing visual presence and spatial audio cues that enhance immersion. This intermediary layer allows automated systems to communicate in an immersive manner without requiring direct human operator presence.
3Extent of automation
If chat engines are used, then automated communication is achieved, but spatial awareness is lost
Solution Approach 1:
The patent replaces traditional flat 2D chat interface mechanics with immersive 3D virtual environment mechanics. Instead of text-based communication on a screen, the system uses spatial audio positioning, visual avatars, and three-dimensional spatial relationships to convey information. This substitution preserves automated communication capabilities while restoring and enhancing spatial awareness through multi-sensory spatial cues.
Data Source
AI summary
In a bidirectional user interaction in a graphically simulated environment, a network connection operatively connects a computing system to at least one user device. The computing system performs steps including: causing display, on the user device, of a simulated agent of a first entity in the three dimensional virtual environment; controlling the simulated agent to engage a user represented by a user customized graphical indicium in the three dimensional virtual environment; conducting a bidirectional communication session with the user via the simulated agent and the user customized graphical indicium in the three dimensional virtual environment; receiving a request from the user regarding at least one service of multiple services made available at least in part by the first entity; and disseminating at least a first information item associated with the at least one service.