Multi-Image Face Compositing for Expression and Pose Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile devices struggle to produce high-quality photos and videos, particularly in situations where users are dissatisfied with facial expressions or poses, requiring reshoots to achieve desired results.
Innovation Solution
An electronic device and method for processing images by identifying a base image and a source image based on completion level and swap compatibility, extracting face regions, and compositing them to generate a correction image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users take multiple photos to capture different facial expressions and poses, then the quality and variety of images improve, but the time consumption and operational complexity increase
Solution Approach 1:
The patent merges multiple images with different facial expressions and poses into a single composite image. The system automatically selects the best face regions from multiple photos and combines them into one corrected image, allowing users to capture various expressions in one shot without requiring multiple separate photos.
Solution Approach 2:
The system performs preliminary actions by automatically analyzing multiple images, identifying the best face regions, and preparing a composite image before the user needs the final result. This pre-processing eliminates the need for users to manually select and edit multiple photos, saving time and effort.
2Manufacturing precision
If users manually select and edit images to achieve desired facial expressions, then image quality improves, but device complexity and operation difficulty increase
Solution Approach 1:
The system performs self-service by automatically analyzing multiple images, identifying the best face regions, and generating a composite image without requiring user intervention. The device autonomously completes the image selection and editing process, eliminating the need for users to manually edit while maintaining high image quality.
Solution Approach 2:
The patent replaces manual mechanical image editing operations with automated computational processes. Instead of users manually selecting and editing images, the system uses algorithms to automatically identify face regions, assess image quality, and generate composites, substituting manual operations with automated digital processing.
3Manufacturing precision
If users reshoot to correct unsatisfactory facial expressions, then image quality improves, but productivity and time efficiency decrease
Solution Approach 1:
The system merges the best facial expressions from multiple shots into a single composite image. By combining successful face regions from different photos, the system achieves high-quality facial expressions without requiring users to reshoot, thereby maintaining productivity while improving image quality.
Solution Approach 2:
The system discards unnecessary redundant shooting operations by automatically selecting the best face regions from existing photos. Instead of requiring users to reshoot, the system recovers and utilizes the best portions from previous shots, eliminating wasted time and maintaining efficiency.
Data Source
AI summary
Provided is a method including: obtaining a plurality of images each comprising a plurality of persons, identifying one image among the plurality of images as a base image, identifying a source image among the plurality of images based on a completion level of each of the plurality of images and a swap compatibility of each of the plurality of images, extracting a face region of a person of the plurality of persons from the source image, and generating a correction image by compositing the extracted face region on the base image, wherein, for each respective image of the plurality of images, the completion level comprises a completion level of shooting a face region of the image of the person in the respective image, and the swap compatibility comprises a swap compatibility between a face region of the image of the person in the base image and the face region of the image of the person in the respective image.