Static Photo Facial Expression Editing Using Real-Time Face Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current facial beautification methods, especially those based on 3D face recognition, lack the ability to edit facial expressions in static photos, limiting their effectiveness to skin color and face contour adjustments, and do not utilize real-time facial expression editing.
Innovation Solution
A method and device that utilize a camera to capture a video stream of a user's face, allowing for real-time editing of facial expressions in static photos by comparing and aligning facial features across multiple frames to achieve a more realistic expression adjustment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If 3D face-based beautification method is used, then face shape and color beautification effect is improved, but facial expression editing capability is lost
Solution Approach 1:
The system integrates multiple functions into a single platform: it maintains 3D face beautification capabilities while adding expression editing functionality. The processing system can handle both face shape/color adjustment and facial expression modification, allowing one system to serve multiple beautification needs simultaneously.
Solution Approach 2:
The patent introduces dynamic expression editing capability to a previously static 3D face beautification system. By enabling real-time expression adjustment based on captured facial expressions, the system transitions from static shape/color modification to dynamic expression manipulation, enhancing versatility while maintaining precision.
2Ease of operation
If 2D face-based beautification method is used, then operation simplicity is maintained, but three-dimensional expression editing capability is limited
Solution Approach 1:
The system transitions from 2D face processing to 3D expression editing by incorporating depth information and three-dimensional face models. This dimensional upgrade enables realistic expression manipulation while maintaining user-friendly operation through automated processing and intuitive interfaces.
Solution Approach 2:
The patent replaces manual 2D editing mechanisms with automated 3D processing systems. By using algorithms that automatically capture, process, and apply three-dimensional expression changes, the system achieves sophisticated editing capabilities while maintaining operational simplicity through automation.
3Measurement precision
If real-time camera capture is used for expression editing, then expression accuracy is improved, but processing time requirement increases
Solution Approach 1:
The system performs preliminary processing by capturing and storing facial expression data in advance. The processing system pre-processes captured expressions and prepares transformation parameters before final editing is needed, reducing real-time processing requirements while maintaining high expression accuracy.
Solution Approach 2:
The patent implements continuous processing where facial expression data is captured and processed in an ongoing manner. The system maintains continuous engagement with the user through real-time preview and adjustment, eliminating idle processing time while ensuring continuous improvement of expression accuracy.
Data Source
Figure 1a
Figure 1b
Figure 2
AI summary
A facial expression editing method and an electronic device are provided. The method includes: obtaining a to-be-edited image, where the to-be-edited image includes a first face image of a user; obtaining, by using a camera, a first video stream including a second face image of the user; editing the first face image of the user in the to-be-edited image based on the first face image of the user in the first video stream to obtain an edited image, where a facial expression of the user in the edited image is associated with a facial expression of the user in the first video stream. This can re-edit a facial expression of a user in a static photo based on the user's face image captured by using a camera in real time, implement an expression re-editing function, achieve more realistic effect, and improve user experience.