AR Glasses Video Adjustment for Eye Contact and Social Distance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video conferencing technologies, particularly in augmented reality (AR) scenarios, struggle to provide a perception of in-person meeting experiences, including maintaining eye contact and appropriate social distance between participants due to mismatched camera settings, resolutions, and participant movements.
Innovation Solution
A network entity determines camera settings and adjustments based on input from participant devices, including AR glass resolution and eye tracking information, to maintain eye contact and social distance by scaling and positioning video feeds for AR conferencing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If standard video conferencing is used in AR glasses, then basic communication functionality is provided, but the perception of in-person meeting experience including eye contact and social distance is lost
Solution Approach 1:
The system dynamically adjusts video feed parameters including scaling, positioning, and orientation based on eye tracking data and camera settings. This transforms standard video conferencing into an immersive AR experience by continuously modifying display parameters to maintain perceived eye contact and appropriate social distance
Solution Approach 2:
The system uses eye tracking information as feedback to continuously adjust the video feed presentation. By monitoring where the user is looking and how participants move their eyes and heads, the system real-time modifies the video display to maintain the perception of natural eye contact and social interaction
2Ease of operation
If video feeds are adjusted for eye contact and social distance perception, then immersive experience is improved, but system complexity increases due to multiple camera settings and resolutions
Solution Approach 1:
The system automatically determines and adjusts camera settings, scaling factors, and positioning parameters without requiring manual user configuration. The AR glasses and conferencing nodes self-adjust based on received eye tracking information and participant movements, eliminating the need for users to manually configure complex camera parameters
Solution Approach 2:
The system is designed to work with multiple types of AR glasses and conferencing cameras through a universal adjustment mechanism. By receiving eye tracking data and participant video feeds from various sources and applying standardized processing algorithms, the system maintains compatibility across different hardware configurations while achieving consistent immersive results
3Loss of information
If video scaling and positioning adjustments are made in real-time, then perception of eye contact is maintained, but processing requirements and energy consumption increase
Solution Approach 1:
The system applies video processing adjustments selectively based on detected eye movements and participant actions. Rather than continuously processing all video feeds at full resolution, the system adjusts processing intensity and resolution based on when eye contact maintenance is most critical, reducing overall energy consumption while preserving the perception of eye contact
Data Source
AI summary
Video conferencing can be provided between a first participant using first augmented reality, AR, glasses with a first forward facing glasses camera and using a first conferencing camera and a second participant using second AR glasses with a second forward facing glasses camera and using a second conferencing camera. A video of the second participant can be received from the second conferencing camera. A video can be received from the first forward facing glasses camera of the first AR glasses. The video of the second participant can be adjusted based on the video from the first forward facing glasses camera to provide adjusted video. The adjusted video can be provided to be rendered by the first AR glasses for the first participant.