Virtual Makeup Application with Adjustable Orientation View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for virtual application of makeup effects struggle to accurately display composite images when a user's head is turned, limiting the usability of augmented reality makeup editing on portable devices.
Innovation Solution
A computing device records and stores video of a user's head, extracts digital images at various orientations, and applies selected makeup effects, allowing users to view their face from different angles with adjustable orientation controls, including 3D facial reconstruction for enhanced visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user turns their head to view makeup effects from different angles, then the usability and viewing experience improve, but the accuracy of composite image display deteriorates
Solution Approach 1:
The system transitions from a single fixed viewing angle to multiple orientation views by capturing images at different head orientations and reconstructing them in a 3D coordinate system. This dimensional expansion allows users to view makeup effects from various angles while maintaining accurate composite image display through spatial transformation and registration techniques.
2Adaptability or versatility
If multiple orientation views are captured and processed, then the viewing flexibility improves, but the computational complexity and processing time increase
Solution Approach 1:
The system performs preliminary actions by capturing multiple orientation views during an initial recording phase before the actual makeup application. These pre-captured images are stored and can be retrieved for later processing, allowing the computationally intensive tasks of 3D reconstruction and composite image generation to be performed on demand rather than in real-time during makeup application.
Solution Approach 2:
The system creates digital copies of the user's face from captured images at different orientations. These 2D image copies are then transformed and registered into a 3D coordinate system to generate accurate composite images. This copying approach avoids the need for complex real-time 3D scanning while achieving similar visualization results.
3Measurement precision
If 3D facial reconstruction is performed, then the visualization accuracy improves, but the processing time and computational resources increase
Solution Approach 1:
The system uses the user's own head movements and captured images to automatically perform the 3D reconstruction process. By having the user turn their head to specific orientations during recording, the system collects necessary data points that enable self-contained 3D model generation without requiring external 3D scanning equipment or professional photogrammetry services.
Data Source
AI summary
A computing device records and stores a video of a user's head. The computing device retrieves a plurality of target orientation views and extracts digital images of a face of the user from the video at each of the plurality of target orientation views. The computing device displays a user interface and obtains a selection of a makeup effect. The computing device performs virtual application of the selected makeup effect onto a digital image of the user's face. The computing device obtains an orientation view and displays the user's face at the obtained orientation view with the selected makeup effect applied to the user's face.