3D Face Augmentation Templates for Real-Time AR Customization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems are limited in their ability to allow users to dynamically adjust pre-generated augmented reality content in real time, restricting the range of options available for customization.
Innovation Solution
An online system applies template-based facial augmentations using a facial augmentation template that includes a structure for application and display parameters, allowing users to dynamically change these parameters through a user interface, and maps anchor points to corresponding feature points on a user's 3D face model to render augmented images in real time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If pre-generated augmented reality content is used, then the content structure and display characteristics are predetermined and easy to implement, but the ability for users to adjust the content in real time is limited
Solution Approach 1:
The patent transforms static pre-generated AR content into dynamic, user-adjustable content by introducing real-time modification capabilities. Users can change display characteristics such as color, size, and position of virtual objects during the AR experience, allowing the system to adapt content properties dynamically while maintaining the underlying pre-generated structure.
Solution Approach 2:
The patent enables users to modify specific parameters of AR content (color, size, position, opacity) without regenerating the entire content. This allows real-time adjustment of display characteristics by changing numerical parameters, resolving the contradiction between predetermined structure and real-time adaptability.
2Adaptability or versatility
If many different alternatives are pre-generated to provide wide range of choices, then user customization options increase, but the system complexity and content generation burden increase
Solution Approach 1:
The patent separates AR content into modular components with distinct adjustable parameters (color, size, position, etc.). Instead of creating entirely different pre-generated alternatives, the system provides a base content structure with independent parameter controls, allowing users to combine one base content with multiple parameter variations to achieve diverse customization options without proportionally increasing system complexity.
Solution Approach 2:
The patent creates a universal content framework where a single pre-generated AR content can serve multiple purposes through parameter adjustment. One base content asset can be customized in real-time to fulfill multiple user preferences, replacing the need for numerous separate pre-generated alternatives and reducing overall system complexity.
Data Source
AI summary
The present disclosure describes an online system that applies template-based facial augmentations to images as part of an augmented reality experience. A facial augmentation template is a template for an augmented reality (AR) modification to apply to a user's face. These templates include a structure for how the augmentation should be applied to the face and display parameters that a user can set for how the templates should be rendered (e.g., color, specularity, or opacity). The online system identifies feature points on a 3D model of the user's face that correspond to features on the user's actual face, and localizes the template relative to the 3D model by mapping anchor points of the template to corresponding feature points on the 3D model. The online system renders the facial augmentation template at the localization to generate an augmented image of the user's face.