3D Face Mesh Look Matching for Personalized Makeup Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to account for a user's unique facial features, desires, and needs when recommending cosmetic products or routines, making it challenging to adapt a cosmetic look from an inspiration source to oneself.
Innovation Solution
A system generates a personalized 3D face mesh using AI and computer vision to identify facial features, recommends cosmetic products and routines tailored to the user's unique composition, and provides step-by-step guidance through visual, audial, and haptic outputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If generic cosmetic recommendations are provided without considering individual facial features, then the system is simple and easy to implement, but the recommendations do not fit the user's unique needs and facial composition
Solution Approach 1:
The system performs preliminary 3D face mesh generation and facial feature identification before providing cosmetic recommendations. This preliminary action captures the user's unique facial composition, enabling personalized recommendations without increasing the complexity of the recommendation engine itself.
Solution Approach 2:
The system creates a digital 3D copy of the user's face (face mesh) that replicates their unique facial features, proportions, and geometry. This digital copy serves as the basis for personalized cosmetic recommendations, allowing the system to adapt generic recommendations to individual features without complex real-time analysis.
2Measurement precision
If detailed 3D face mesh analysis is performed to capture unique facial features, then personalized recommendations can be provided, but the processing time and computational resources increase
Solution Approach 1:
The 3D face mesh generation and facial feature extraction are performed as preliminary steps before the actual cosmetic recommendation process. This allows the system to capture detailed facial measurements once, store them, and reuse them for multiple recommendation sessions, reducing processing time for subsequent interactions.
Solution Approach 2:
The system replaces complex real-time mechanical or manual facial analysis with automated computer vision and AI-based 3D face mesh generation. This substitution enables high-precision facial feature identification while significantly reducing the time and computational resources required compared to traditional methods.
3Manufacturing precision
If the system provides comprehensive step-by-step guidance with multiple verification steps, then the user can achieve accurate cosmetic application, but the ease of operation decreases due to the complexity of following multiple instructions
Solution Approach 1:
The cosmetic application process is divided into discrete, manageable steps with specific verification points. Each step focuses on a single aspect of application (e.g., product selection, application technique, blending), making the complex process more manageable while maintaining overall accuracy through systematic breakdown.
Solution Approach 2:
The system incorporates verification mechanisms that provide immediate feedback to users after each step. This feedback loop allows users to confirm their progress and receive corrective guidance only when necessary, maintaining ease of operation while ensuring application accuracy through targeted verification rather than continuous monitoring.
Data Source
AI summary
Systems and methods generate personalized combinations of cosmetics and cosmetic application techniques (“looks”) based upon various sources of inspiration, e.g., favorited, saved, or liked photos/videos representing cosmetics applied on another person(s). Further, systems and methods identify the composition of the inspiration's cosmetic look, and adapt the look to be more suitable to the user's unique facial composition as represented via a three-dimensional face mesh. Moreover, systems and methods guide the user through applying the personalized look, e.g., through step-by-step instructions that verify whether the user has successfully applied the generated look and encourage the user to take on new cosmetic challenges.