3D Facial Model for Remote Virtual Makeup Application
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Individuals face challenges in achieving professional makeup results despite investing in makeup tools and accessories, as conventional self-help guides are insufficient for replicating expert techniques.
Innovation Solution
A system and method for virtual makeup application, where a makeup consultation platform generates a 3D facial model from digital images, allowing professionals to apply cosmetic effects and transmit commands for real-time virtual makeup application on client devices, enabling precise control over zoom, orientation, and effect placement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional self-help guides are used, then individuals can access makeup information independently, but they cannot achieve professional-level makeup results
Solution Approach 1:
The system introduces a remote makeup professional as an intermediary who provides real-time guidance through a digital interface. The professional controls virtual makeup application and provides instructions, bridging the gap between independent application and professional results without requiring physical presence.
Solution Approach 2:
The system creates a virtual copy of the user's facial features using camera input and 3D modeling, allowing the makeup professional to apply makeup to this digital replica. This copy enables precise visualization and application guidance that would be difficult to achieve through traditional self-help materials.
2Manufacturing precision
If a makeup professional provides in-person consultation, then professional makeup results can be achieved, but the device complexity and cost increase substantially
Solution Approach 1:
The digital interface and communication system serve as intermediaries that enable remote interaction between the makeup professional and user. This eliminates the need for physical presence while maintaining the professional guidance capability, reducing the complexity associated with in-person consultation infrastructure.
Solution Approach 2:
The system replaces the mechanical aspect of in-person physical consultation with a digital communication system. The makeup professional's expertise is transmitted through digital interfaces, camera feeds, and virtual makeup tools rather than requiring physical proximity and manual application assistance.
3Manufacturing precision
If virtual makeup application is implemented, then professional results can be achieved remotely, but the system complexity increases
Solution Approach 1:
The system creates a 3D digital model of the user's face by capturing images from multiple angles and constructing a virtual representation. This copy allows for precise virtual makeup application that accurately reflects how makeup will appear on the actual face, achieving high precision while keeping the physical system relatively simple.
Solution Approach 2:
The system transitions from 2D image processing to 3D facial modeling, enabling more accurate representation of facial features and makeup application. This dimensional enhancement improves precision by accounting for facial depth, contours, and lighting effects that 2D systems cannot capture.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A makeup application device utilized by a makeup professional obtains a makeup consultation request from a user of a client device and obtains at least one digital image of a facial region of the user from the client device. A three-dimensional (3D) facial model is generated based on the at least one digital image, and user input is obtained from the makeup professional for applying virtual cosmetic effects to the 3D facial model. The makeup application device generates a command based on the user input from the makeup professional for applying a virtual cosmetic effect and transmits the command to the client device. The command causes a virtual cosmetic effect to be applied to the at least one digital image of the facial region of the user and displaying the at least one digital image.