Line-of-Sight Superimposition for Realistic Remote Eye Contact
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote video communication techniques fail to achieve realistic eye contact between users due to positional discrepancies between users and camera angles, leading to difficulties in maintaining natural communication.
Innovation Solution
An information processing apparatus and method that includes a display control section to superimpose a second user object on a captured image of first users based on line-of-sight information, allowing for more realistic communication by simulating eye contact across different locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a user rotates an imaging device and display device in accordance with gazing direction, then the user can achieve more realistic communication, but eye contact between users at different locations cannot be achieved
Solution Approach 1:
The patent creates a virtual image of the remote user that is superimposed on the captured image, positioning it according to the local user's line of sight. This virtual copy allows the local user to see the remote user's image at the correct angular position, achieving eye contact without physically rotating devices.
Solution Approach 2:
The patent transitions from physical device rotation in three-dimensional space to virtual image positioning in the two-dimensional display plane. By calculating the angular position of the local user's line of sight and mapping it to a virtual image position on the display, the system achieves eye contact through dimensional transformation rather than physical rotation.
2Device complexity
If the positional relationship between user and camera is fixed, then device complexity is reduced, but line of sight alignment and eye contact become difficult to achieve
Solution Approach 1:
The patent replaces the mechanical approach of physically rotating imaging and display devices with an information processing approach. The system calculates the angular position of the local user's line of sight and uses this information to position a virtual image of the remote user on the display, substituting mechanical rotation with computational geometry.
Solution Approach 2:
The patent introduces line-of-sight information as an intermediary parameter that connects the local user's viewing direction with the virtual image positioning. By measuring or estimating the angular position of the local user's line of sight and using it to determine virtual image placement, the system achieves accurate alignment without complex mechanical adjustments.
Data Source
AI summary
There is provided an information processing apparatus including a display control section that controls a second display device present in a second space. The second display device displays a first captured image obtained by imaging at least one or more first users present in a first space. The display control section superimposes and displays a second user object on the first captured image in accordance with line-of-sight relevant information of each of the first users. The second user object corresponds to each of at least one or more second users present in the second space. This makes it possible to achieve more realistic communication.