Wearable Face Capture Using Eye Cameras for 3D Avatar Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices struggle to capture accurate face images for generating realistic avatars due to limitations in field of view and positioning of inward- and outward-facing imaging systems, leading to difficulties in creating a 3D face model.
Innovation Solution
The wearable device captures face images using inward-facing imaging systems while the user is putting on or taking off the device, leveraging eye cameras for stereoscopic or monocular vision techniques to generate a 3D face model, and automatically starts and stops imaging based on detection triggers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If inward-facing imaging systems are used to capture face images, then the device can capture the user's face during normal wear, but the field of view is limited and positioning is difficult
Solution Approach 1:
The system captures face images during the transitional periods when the user is putting on or taking off the device, before the device is fully positioned on the user's head. This preliminary action allows the imaging system to capture the face when it is within the available field of view, avoiding the limitation of the narrow FOV during normal wear
2Measurement precision
If the device captures face images during normal wear, then avatar representation is improved, but additional user actions are required
Solution Approach 1:
The device automatically detects when the user is putting on or taking off the device using motion sensors or camera-based detection, and autonomously initiates the face image capture process without requiring any manual input from the user. The system serves itself by identifying the optimal capture时机 and executing the imaging function automatically
Solution Approach 2:
The system proactively captures face images during the natural transitional actions of putting on or taking off the device, before the user becomes aware of the need for face model creation. This preliminary capture occurs during routine behaviors, eliminating the need for separate user actions
3Manufacturing precision
If eye cameras are used for stereoscopic vision, then 3D face model quality is improved, but device complexity increases
Solution Approach 1:
The eye cameras, originally designed for a单一 function of tracking user eye movements for display rendering, are repurposed to also capture face images for 3D model creation. This multi-functional use of existing components achieves high-quality 3D face modeling without adding dedicated imaging hardware, thereby avoiding increased device complexity
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for the generation of a realistic 3D face model without additional user actions, enabling improved avatar representation and device fitting, user identification, and operational tuning.
Implementation Method 1
one or more eye cameras configured to image the face of the user
Data Source
AI summary
Systems and methods for generating a face model for a user of a head-mounted device are disclosed. The head-mounted device can include one or more eye cameras configured to image the face of the user while the user is putting the device on or taking the device off. The images obtained by the eye cameras may be analyzed using a stereoscopic vision technique, a monocular vision technique, or a combination, to generate a face model for the user. The face model can be used to generate a virtual image of at least a portion of the user's face, for example to be presented as an avatar.