Image Rectification for Natural Eye Contact in Video Calls
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional videoconferencing systems fail to provide natural eye contact during video calls, especially when the videoconference window is not centered on the screen, as they only consider the transmitter's camera position and not the receiver's usage context, leading to an unnatural line of sight perception.
Innovation Solution
An image rectification method and device that measures and synthesizes angular deviations for both the transmitter and receiver, including a horizontal and vertical angular deviation, and an inclined angle of the screen, to generate an eye-to-eye image using algorithms like Motion Estimation and Depth Image Based Rendering (DIBR), ensuring the receiver perceives the transmitter as looking directly at them.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional video devices perform image rectification based only on transmitter's camera position, then the transmitter's line of sight can be adjusted, but the receiver still perceives unnatural eye contact when the videoconference window is not centered
Solution Approach 1:
The invention makes the image rectification system dynamic by detecting the actual position of the videoconference window on the receiver's screen and adjusting the rectification parameters accordingly. The system continuously adapts to different window positions rather than relying on fixed predetermined parameters, enabling natural eye contact perception regardless of where the window appears on the receiver's display.
Solution Approach 2:
The invention implements a feedback mechanism where the receiver's video device detects the window position and communicates this information back to the transmitter's video device. The transmitter then uses this feedback to adjust the image rectification parameters, creating a closed-loop system that ensures accurate eye contact perception adapted to the actual viewing conditions.
2Ease of operation
If the videoconference window is positioned away from the center of the screen, then the receiver can use other applications simultaneously, but the transmitter appears to be looking in the wrong direction
Solution Approach 1:
The system dynamically adjusts the image rectification based on the actual window position detected at runtime. When the window is moved away from the center, the system calculates the angular deviation and modifies the rectification parameters accordingly, maintaining accurate line of sight alignment regardless of the window's position on the screen.
Solution Approach 2:
The invention changes the rectification parameters (horizontal and vertical angular deviations) based on the window's position on the screen. By adjusting these parameters dynamically, the system compensates for off-center window positions and ensures the transmitter appears to be looking directly at the receiver's eyes.
3Manufacturing precision
If multiple angular deviations are measured and considered, then natural eye contact can be achieved, but the system complexity increases
Solution Approach 1:
The invention makes the existing camera and screen components multi-functional. The camera not only captures the transmitter's image but also determines angular deviations. The screen not only displays the videoconference window but also detects its own window position. This universal use of existing components achieves accurate eye contact without adding dedicated complex measurement devices.
Solution Approach 2:
The system uses its own components to measure the necessary angular deviations. The transmitter's camera determines the angular deviation of the transmitter's line of sight, while the receiver's video device detects the position of its own window on the screen. This self-service approach eliminates the need for external complex measurement systems.
Data Source
AI summary
An image rectification method for a video device includes receiving an image that is a facial image of a transmitter from the transmitter, obtaining a first angular deviation with respect to line of sight of the transmitter according to the image, obtaining a second horizontal angular deviation and a second vertical angular deviation with respect to line of sight of a receiver using the video device, and performing an image synthesis procedure on the image according to the first angular deviation, the second horizontal angular deviation and the second vertical angular deviation, for generating an eye-to-eye image sent to the receiver.