3D Avatar Head Positioning for Eye Contact Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In copresence communication sessions, especially those involving head-mounted devices, there is an offset between the camera viewpoint and the eye viewpoint, leading to mismatched eye contact as the displayed avatar's eyes appear to look above the receiver's eyes rather than directly at them, disrupting the natural eye contact experience.
Innovation Solution
Adjusting the position and orientation of the 3D representation of the user on the receiving device based on offset information between the camera viewpoint and the eye viewpoint, allowing the avatar's eyes to appear as if they are directly looking at the receiver's eyes, while maintaining the correct positioning of other body parts like hands to avoid visual gaps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the 3D representation is displayed using camera viewpoint data, then the positioning is straightforward, but the avatar's eyes appear to look above the receiver's eyes rather than directly at them, disrupting natural eye contact
Solution Approach 1:
The patent segments the 3D representation into multiple adjustable components: head position, eye position, and body position. By independently adjusting the head and eye positions based on offset information while keeping the body position fixed, the system achieves accurate eye contact without disrupting the overall avatar positioning or creating visual gaps in the body representation.
2Measurement precision
If the 3D representation is repositioned to correct eye contact, then natural eye contact is achieved, but visual gaps may appear in other body parts like hands
Solution Approach 1:
The patent divides the 3D representation into separable components (head/eyes and body), allowing independent transformation of each segment. The head and eyes are repositioned using offset information to achieve accurate eye contact, while the body remains in its original position to maintain correct spatial relationships and avoid visual gaps.
Solution Approach 2:
The patent applies different transformation qualities to different parts of the 3D representation. The head and eye regions undergo positional adjustments based on offset information to achieve accurate eye contact, while the body and extremities maintain their original positioning to preserve visual consistency and avoid gaps.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that provide a view of an adjusted position of a three-dimensional (3D) representation of another user (e.g., an avatar) during a communication session. At a first device, 3D representation data corresponding to at least a portion of a second user of a second device (e.g., a sender) is obtained during a communication session. Offset information (e.g., a vertical offset value) corresponding to an offset between a camera viewpoint position and an eye viewpoint position associated with the second device is obtained. A position of a first portion of a 3D representation of the second user (e.g., head and torso) is adjusted relative to a 3D environment associated with the first device. A view that includes the first portion of the 3D representation of the second user in the 3D environment is provided during the communication session.