Eye-Line Augmentation via AR Display Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
During video conferences, participants often fail to make direct eye contact due to the offset position of the camera and display, leading to an unnatural appearance and discomfort.
Innovation Solution
A method and apparatus using a head-mounted augmented reality display to overlay the incoming video stream on the camera's position, allowing participants to appear as if they are making eye contact by aligning their focus with the camera while viewing the display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the display is positioned offset from the camera to provide incoming video stream, then the participant can view the incoming video, but the participant's eye line is offset from the camera causing unnatural appearance
Solution Approach 1:
The patent introduces a fiducial marker as an intermediary element positioned on or near the display. This marker serves as a visual reference point that helps the participant align their eye line with the camera position. The marker acts as a mediator between the display position and camera position, enabling the participant to adjust their gaze to achieve proper eye contact alignment while still viewing the incoming video stream on the offset display.
2Area of stationary object
If the display is positioned offset from the camera, then the incoming video stream can be displayed, but the participant appears to be looking away from the camera in the outgoing video stream
Solution Approach 1:
The patent applies preliminary action by pre-positioning the fiducial marker on the display before the video conference begins. The marker is placed at a specific location that corresponds to the camera position relative to the display. This advance preparation allows the participant to quickly align their eye line with the camera by simply following the marker, eliminating the need for real-time adjustment during the conference and ensuring proper eye contact positioning from the start.
3Ease of operation
If the display and camera are at different positions, then the video conference setup is practical, but the participant's focus is diverted from the camera to the display
Solution Approach 1:
The fiducial marker serves as a visual intermediary that bridges the gap between the display position and camera position. By positioning the marker on the display at the location that aligns with the camera, it creates a visual cue that guides the participant's line of sight. This allows the participant to maintain focus on the display area while simultaneously aligning their gaze with the camera, effectively resolving the conflict between viewing convenience and eye contact alignment.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method, apparatus and computer program product are disclosed to provide for eye-line augmentation during a video conference. In the context of a method, an incoming video stream is received and a position of a camera configured to capture video images of a participant is determined. The method also includes causing a representation of the incoming video stream to be overlaid upon the position of the camera by a head-mounted augmented reality display worn by the user. As such, the focal point for the participant within the representation of the incoming video stream coincides with the position of the camera, thereby causing the participant to appear to be making eye contact with the other, remote participants in the video conference.