Virtual Makeup Rendering With Facial Feature Tracking Precision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Consumers face challenges in achieving professional-quality makeup results despite investing in tools and accessories, even with conventional self-help guides.
Innovation Solution
A system and method for real-time virtual application of makeup effects during live video streaming using an applicator device that tracks facial features, applies cosmetic effects, and displays the process in multiple windows for precise application.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional self-help guides are used for makeup application, then consumers can learn basic makeup techniques, but they cannot achieve professional-quality results
Solution Approach 1:
The system creates a virtual copy of the user's face by capturing facial features via camera and generating a 3D facial model. This virtual replica allows precise replication of professional makeup techniques without requiring the consumer to physically practice complex application methods, thereby achieving professional-quality results while maintaining ease of operation.
Solution Approach 2:
The patent replaces the mechanical process of physical makeup application with a virtual simulation system. Instead of requiring manual application skills, the system uses computer vision, 3D modeling, and virtual rendering to demonstrate and apply makeup effects, eliminating the difficulty of achieving precise professional results through manual practice.
2Manufacturing precision
If real-time virtual makeup application is implemented, then professional-quality results can be achieved, but system complexity increases
Solution Approach 1:
The system divides the complex makeup application process into separate modular components: facial feature detection module, 3D facial model generation module, virtual makeup effect application module, and real-time rendering module. This segmentation allows each component to be optimized independently, managing overall system complexity while maintaining high precision in makeup application.
Solution Approach 2:
The patent introduces a virtual 3D facial model as an intermediary between the user's physical face and the makeup application process. This intermediary simplifies the system by providing a standardized digital representation that can be processed by algorithms, reducing the complexity of directly analyzing and manipulating real-time facial images while achieving precise makeup application.
3Measurement precision
If multiple windows are displayed for tracking facial regions, then precision in cosmetic application is improved, but user interface complexity increases
Solution Approach 1:
The user interface is segmented into multiple functional windows: a first window displaying the full facial region tracking, a second window showing enlarged views of specific target facial features, and a third window presenting makeup effect options. This segmentation organizes complex information into manageable sections, improving precision in facial feature tracking while preventing interface overload through structured information presentation.
Solution Approach 2:
The system adds spatial dimensionality to the interface by displaying facial regions at different zoom levels and perspectives across multiple windows. Instead of a single flat 2D view, the interface provides 3D-like navigation through facial features, enabling precise tracking and selection of target areas while maintaining an organized, manageable interface structure.
Data Source
AI summary
An applicator device receives a request from a client device to initiate a communication session and causes a camera of the client device to capture a video of a user of the client device. The applicator device obtains the video of the user. The applicator device tracks a facial region of the user depicted in the video and displays the tracked facial region in a first window. The applicator device determines a target facial feature in the tracked facial region and displays a target sub-region surrounding the target facial feature within the tracked facial region in a second window. The applicator device performs virtual application of a selected cosmetic effect and displays the virtual application of the selected cosmetic effect in the first window and the second window on the applicator device.