Face Direction Estimation for Natural Image Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies struggle to modify face images naturally when the face is not in a frontal view, often resulting in unnatural lines or areas, particularly with the chin or cheek, due to inadequate adjustment of correction target areas based on the face's direction and degree of turn.
Innovation Solution
An image processing apparatus and method that estimates the face direction and degree of turn, adjusts the correction target area by changing its position and size accordingly, and divides it into smaller areas for modification, ensuring natural-looking results even for side-facing faces by enlarging areas opposite to the face direction as the turn increases.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a fixed correction target area is used for face modification, then the process is simple and fast, but the modification result becomes unnatural when the face is turned to the side
Solution Approach 1:
The correction target area is dynamically adjusted based on the estimated face direction and degree of turn. The area setting unit changes the position and size of the correction target area according to the face orientation, transforming a static fixed-area approach into a dynamic adaptive approach that maintains natural modification results across different face directions
Solution Approach 2:
The position and size parameters of the correction target area are changed based on the face direction estimation results. By adjusting these geometric parameters according to the face turn angle, the system optimizes the modification accuracy for each specific face orientation without requiring complex manual intervention
2Manufacturing precision
If the correction target area is enlarged more toward the opposite side as the degree of turn increases, then natural lines are preserved on turned faces, but the area setting becomes more complex
Solution Approach 1:
Different regions of the correction target area are treated differently based on the face direction. The area setting unit enlarges the correction target area more toward the side opposite to the face direction, providing localized adjustment that preserves natural lines on turned faces while maintaining appropriate coverage of relevant facial features
Solution Approach 2:
The correction target area is adjusted asymmetrically based on the face turn direction. Instead of uniform enlargement, the system applies differential enlargement where the opposite side receives greater expansion, creating an asymmetric configuration that compensates for the perspective distortion caused by face turning
Data Source
AI summary
An image processing apparatus includes a face direction estimating unit that estimates the direction and the degree of turn of a face with the front direction of the face included in a face image used as a reference for a target image that includes the face image, and an area setting unit that changes a first area based on the direction and the degree of turn of the face and sets a correction target area with the changed first area used as a reference when an area that includes the first area is set as the correction target area with the first area that includes predetermined facial organs of the face image used as a reference.