3D Eyeglasses Model Placement on Face Scans
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Accurately placing virtual eyeglasses on a 3D face model is challenging due to the proximity of eyeglasses to the face, making physical measurement difficult and requiring a more efficient method for simulation.
Innovation Solution
A system utilizing a 3D face scanner and processing system to capture and process facial data, including facial landmarks and depth information, to generate accurate placement information for virtual eyeglasses, using methods like Iterative Closest Point (ICP) for registration and bounding volume generation to align eyeglasses models on the face.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If physical measurement is used to obtain placement information for eyeglasses, then the measurement can be performed, but the proximity of eyeglasses to the face makes the measurement exceedingly difficult and imprecise
Solution Approach 1:
The patent creates a 3D digital copy of the user's face and eyeglasses through scanning, replacing difficult physical measurement with digital data capture. The 3D face model serves as a precise replica that can be measured and processed computationally, eliminating the measurement difficulties associated with physical proximity and occlusion.
Solution Approach 2:
The patent replaces mechanical physical measurement with optical scanning and computational processing. Instead of using physical tools to measure the eyeglasses placement, the system uses 3D optical scanning to capture geometric data, then processes this data through algorithms to determine placement information, substituting mechanical measurement with optical and computational methods.
2Productivity
If 3D face scanning is used to obtain placement information, then the measurement becomes simple, fast, and accurate, but the device complexity increases
Solution Approach 1:
The patent employs a 3D face scanner that serves multiple functions: capturing the user's facial geometry, identifying facial landmarks, and extracting placement information for eyeglasses. This multi-functional approach consolidates what would otherwise require separate measurement systems into a single device, improving productivity while managing complexity through functional integration.
3Ease of operation
If virtual try-on system is implemented, then users can simulate eyeglasses appearance without physical try-on, but the realism and accuracy of the simulation becomes critical for user conviction
Solution Approach 1:
The patent applies local quality by focusing the 3D scanning and processing on specific critical areas of the face where eyeglasses are worn - particularly around the eyes, nose, and ears. The system identifies and processes facial landmarks in these specific regions with higher precision to ensure accurate eyeglasses placement and realistic appearance, rather than treating the entire face uniformly.
Data Source
AI summary
In some embodiments, a computer-implemented method includes obtaining a without-eyeglasses face scan of a subject, the without-eyeglasses face scan being a three-dimensional (3D) model of a face of the subject without eyeglasses; obtaining a with-eyeglasses face scan of the subject, the with-eyeglasses face scan being a 3D model of the subject with eyeglasses; and using the without-eyeglasses face scan and the with-eyeglasses face scan to place a 3D eyeglasses model on a face model of the subject. In some embodiments of the computer-implemented method, the 3D eyeglasses model is placed on the face model of the subject using frame placement information generated using the without-eyeglasses face scan and the with-eyeglasses face scan.