AR Beauty Product Tutorials with Real-Time Product and Motion Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face challenges in applying beauty products effectively due to the complexity of the application process and the lack of accessible, engaging tutorials that provide sufficient information without being tedious.
Innovation Solution
An augmented reality (AR) tutorial system that identifies beauty products applied by a presenter, synchronizes their effects and motions with a user's live view, and allows customization, enabling users to learn and apply beauty products efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video-based tutorials are used to teach beauty product application, then users can access training information, but the tutorials become tedious and time-consuming to create
Solution Approach 1:
The system enables presenters to automatically create AR tutorials by recording themselves applying beauty products. The system self-captures video footage, identifies beauty products through image recognition, tracks application motions, and generates structured tutorial data without requiring manual scripting or editing, thus making the tutorial creation process self-service and dramatically reducing creation time
Solution Approach 2:
The system transforms the tutorial creation process from a manual, time-intensive video production workflow to an automated process by changing key parameters: using real-time beauty product identification algorithms, motion tracking technology, and automatic video segmentation based on detected application steps, thereby converting a creative task into a technical automation task
2Loss of information
If detailed tutorials are provided to ensure sufficient information, then users can learn effectively, but the tutorials become tedious and less engaging
Solution Approach 1:
The tutorial system automatically segments the application process into distinct steps by detecting when the presenter applies different beauty products or transitions between application areas. Each segment contains only the necessary information for that specific step, preventing information overload while ensuring completeness. Users can navigate between segments or follow the automatic progression, making detailed information accessible without being tedious
Solution Approach 2:
The AR tutorial system dynamically adapts the presentation of information based on user interaction. The system can pause at key steps, provide additional details on demand, or skip ahead based on user progress. The AR overlay dynamically updates to show relevant application guidance only when needed, transforming static detailed tutorials into a dynamic, responsive learning experience that maintains engagement while providing sufficient information
3Ease of operation
If users seek help from salons or beauty counters for product application, then they receive expert guidance, but it becomes expensive and difficult to access
Solution Approach 1:
The system creates a digital copy of the expert demonstration process. By recording and analyzing a presenter (expert) applying beauty products, the system captures the nuanced techniques and transforms them into an AR-guided tutorial that users can access freely. This digital copy replicates the expert guidance experience without requiring physical presence at a salon or beauty counter, eliminating cost and accessibility barriers while preserving the quality of expert instruction
Data Source
AI summary
Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.