3D Virtual Interaction Using Avatars and Environment Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing videoconferencing technologies are inadequate for communicating complex actions in 3D space, limiting effective virtual interaction between users.
Innovation Solution
A system and method for virtual interaction using VR, AR, and MR devices that enable a host user to see a guest user's avatar in their environment and interact with it, while the guest user sees the host's environment in 3D, allowing for immersive and interactive communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If videoconferencing technology is used for remote communication, then users can visually interact at a distance, but the technology is not well adapted for communicating complex actions in 3D space
Solution Approach 1:
The patent creates virtual copies (avatars) of users and their physical environments. The host assembly captures the host environment and creates a virtual reconstruction, while the guest assembly captures the guest user and creates a virtual avatar. These virtual copies enable complex 3D actions to be communicated effectively by preserving spatial relationships and environmental context that traditional videoconferencing cannot convey.
Solution Approach 2:
The patent transitions from 2D videoconferencing to 3D virtual interaction by capturing and transmitting environmental information, spatial positions, and orientation data. The system reconstructs the host environment in three dimensions and positions the guest avatar within this 3D space, enabling natural hand gestures, body movements, and spatial interactions that are impossible in traditional flat video calls.
2Reliability
If virtual reality devices are used to enable immersive 3D interaction, then complex actions can be communicated effectively, but the device complexity and system requirements increase significantly
Solution Approach 1:
The patent divides the virtual interaction system into separate functional assemblies: the host assembly (capturing host environment and creating virtual reconstruction), the guest assembly (capturing guest user and creating virtual avatar), and communication modules for transmitting data between them. This segmentation allows each component to be optimized independently and simplifies the overall system architecture by distributing functionality across multiple devices rather than requiring a single complex system.
Data Source
AI summary
A method for virtual interaction between a host user at a first physical location and a guest user at a second physical location is provided. The method includes receiving, by the guest assembly, environmental information relating to a host environment in the first physical location; displaying, a 3D virtual reconstruction of the host environment at the second physical location using the environmental information; and displaying a virtual avatar of the host user within the 3D virtual reconstruction. A guest user can enter a predefined area of the second physical location to be virtually transported to the host environment. The method further provides for virtual reconstruction of surfaces of the host environment and applying textures to those surfaces. A corresponding system and non-transitory computer readable medium are also described.