Dynamic 3D Eyelash Attachment for Video Augmented Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video editing techniques fail to provide individually tailored visual effects for user-specific face features, resulting in poor augmented reality experiences.
Innovation Solution
A method and system for rendering dynamic eyelash attachments to a video, involving the selection of a dynamic eyelash template, identification of eye keypoints, attachment of eyelash skeleton branches, and dynamic rotation and bouncing effects based on eye movement, using a computing device with face detection algorithms and physics simulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional video editing techniques are used to add visual effects, then the implementation is simple, but the visual effects are not individually tailored to user-specific face features resulting in poor augmented reality effects
Solution Approach 1:
The eyelash effect is divided into multiple skeleton branches that are individually attached to different eye keypoints. Each branch can be independently transformed and animated based on its attachment point's movement, allowing the overall effect to adapt to individual eye shapes while maintaining manageable complexity through modular structure
Solution Approach 2:
The patent transitions from 2D video frames to 3D spatial transformation by establishing a three-dimensional coordinate system. Eye keypoints are detected in 2D images but then used to define 3D positions and orientations, enabling the eyelash skeleton branches to be positioned and rotated in three-dimensional space to conform to the curvature and shape of the eye, achieving individual tailoring through dimensional elevation
2Reliability
If the eyelash skeleton branches are rigidly attached to eye keypoints, then the attachment is stable, but the eyelash cannot rotate and bounce during eye movement reducing realism
Solution Approach 1:
The patent transforms the rigid attachment system into a dynamic one by introducing rotational and bouncing capabilities. Each eyelash skeleton branch is allowed to rotate around its attachment keypoint and bounce along its length in response to the movement of the underlying eye. This dynamic behavior is controlled through transformation matrices that are continuously updated based on eye movement detection, maintaining stable attachment while enabling realistic dynamic response
Solution Approach 2:
The system continuously detects eye keypoint positions and uses this feedback to adjust the position, orientation, and deformation of eyelash skeleton branches in real-time. The transformation parameters are dynamically calculated based on the detected eye movement, creating a closed-loop system where eye movement directly controls lash behavior, ensuring both stable attachment and adaptive realism
3Productivity
If the eyelash effect is applied to all videos uniformly, then the processing is efficient, but the augmented reality effect does not conform to individual eye shapes
Solution Approach 1:
The patent performs preliminary detection and configuration by first identifying eye keypoints and determining eye shape characteristics before applying the eyelash effect. The eyelash skeleton is pre-configured with multiple branches and attachment points that can be mapped to detected keypoints. This preliminary setup enables efficient processing of subsequent video frames while maintaining high precision conformity to individual eye shapes through the pre-established parametric model
Solution Approach 2:
The system uses parametric control to adapt the eyelash effect to individual eye shapes. Key parameters such as the positions of attachment keypoints, the orientation of skeleton branches, and the deformation characteristics are dynamically adjusted based on detected eye geometry. This parameter-based approach allows efficient processing through mathematical transformations while achieving precise conformity to varying eye shapes without requiring custom modeling for each case
Data Source
AI summary
Systems and methods directed to rendering a dynamic eyelash attachment to an eye identified in a video are described. In examples, a dynamic eyelash template may be applied to a video, where the dynamic eyelash template configures an eyelash skeleton that includes eyelash skeleton branches. Further, the video with one or more video frames may be received such that eye keypoints associated with a shape of the eye in the video frames can be identified. Accordingly, the eyelash skeleton branches may be attached to areas corresponding to eye keypoints based on the dynamic eyelash template. A three-dimensional rotation of the eyelash skeleton branches may be configured to conform to the shape of the eye defined by the eye keypoints during an eye movement. Thus, a dynamic effect can be added to the eyelash skeleton to allow the eyelash skeleton branches to rotate and bounce during the eye movement.