AR Meeting System Using HMD Orientation for Spatial Video Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video conferencing systems fail to create an immersive experience for remote participants, as they do not effectively simulate the presence of others in the same physical space, lacking the visual cues and spatial awareness of being in the same room.
Innovation Solution
The system uses head-mounted displays (HMDs) to compile orientation and view information, determining changes in video presentation to place remote participants in a virtual or augmented reality environment, allowing participants to see each other as if they are in the same location, with elements like documents or whiteboards being dynamically positioned based on user input and movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional video conferencing systems are used, then participants can view each other on display screens, but the experience does not simulate being in the same room adequately
Solution Approach 1:
The patent creates a virtual copy of the physical meeting room environment where remote participants are represented as video feeds positioned at their actual seating locations. This copying approach allows local participants to see remote participants in their correct spatial context, simulating in-person presence without requiring complex haptic or force feedback systems.
Solution Approach 2:
The patent transitions from traditional 2D display screen viewing to immersive 3D spatial visualization through augmented reality. By positioning video feeds in three-dimensional space corresponding to actual room layouts, the system adds a spatial dimension that enhances realism and immersion without significantly increasing device complexity.
2Loss of information
If video conferencing is used, then remote participants can be viewed, but visual cues and spatial awareness of being in the same room are lacking
Solution Approach 1:
The system captures and reproduces visual cues from the physical environment by overlaying video feeds of remote participants onto the actual meeting room view. This includes preserving facial expressions, gestures, and body language in their natural spatial context, thereby recovering visual information that is typically lost in traditional video conferencing.
Solution Approach 2:
The augmented reality display acts as an intermediary that combines the real-world view with virtual video elements. This mediator preserves natural visual cues by displaying remote participants as if they were physically present, maintaining spatial relationships and visual authenticity without requiring direct user manipulation.
3Adaptability or versatility
If head-mounted displays are used to create immersive experience, then participants can see each other as if in the same location, but the system complexity increases
Solution Approach 1:
The head-mounted display system serves multiple functions simultaneously: it captures the real-world environment, overlays virtual video feeds, tracks user head movements, and adjusts video positioning in real-time. This multi-functionality achieves sophisticated spatial presence without requiring separate specialized systems for each function, thereby managing overall complexity.
Solution Approach 2:
The system automatically tracks head orientation and dynamically repositions video feeds based on user movement without requiring manual control. This self-adjusting behavior eliminates the need for complex user interfaces or manual calibration, reducing operational complexity while maintaining high spatial presence.
4Adaptability or versatility
If dynamic video positioning is implemented based on orientation information, then immersive experience is enhanced, but processing requirements increase
Solution Approach 1:
The system implements dynamic video positioning that automatically adjusts video feed placement based on real-time head orientation data. Videos are repositioned to maintain correct spatial relationships as the user moves, creating an adaptive immersive experience without requiring pre-programmed scenarios or complex processing for each possible view.
Solution Approach 2:
The system continuously monitors head orientation and uses this feedback to automatically adjust video positioning. This closed-loop feedback mechanism enables real-time adaptation to user movement with simple processing logic, avoiding the need for complex predictive algorithms or extensive computational resources.
Data Source
AI summary
Embodiments disclosed herein provide methods, systems, and computer readable storage media for facilitating controlling a meeting between remote Augmented Reality (AR) and Virtual Reality (VR) participants. In a particular embodiment, a method provides, during a conference session wherein a plurality of head mounted displays (HMDs) are each worn by one of a plurality of participants, compiling first orientation information and first view information from a first HMD of the plurality of HMDs. The orientation information describes current orientation of the first HMD. Based on the first orientation information and the first view information, the method provides determining a first change to how video is presented the first HMD. Also, the method provides directing the first HMD to implement the first change.