Face Warping Mesh Correction for Wide-Angle Perspective Distortion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Perspective distortion artifacts in images, particularly noticeable in Wide Field of View imaging systems, cause disagreeable distortions of human faces and objects, reducing image quality and user experience.
Innovation Solution
A method involving a warping mesh optimization that applies conformal projections to facial regions and perspective projections to the rest of the image, correcting geometric distortions while preserving straight lines, using a mesh optimization problem to combine these projections and generate a corrected output image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conformal projections are applied to facial regions to correct geometric distortions, then face distortion is reduced, but edge straightness may be compromised
Solution Approach 1:
The image is divided into facial regions and non-facial regions, with different projection transformations applied to each segment. Facial regions use conformal projections to correct face geometry, while non-facial regions use perspective projections to preserve edge straightness.
Solution Approach 2:
Different transformation qualities are applied to different parts of the image: conformal transformations with angle-preserving properties are applied locally to facial regions to correct geometric distortions, while perspective transformations are applied to other regions to maintain straight line integrity.
2Shape
If perspective projections are applied to preserve straight lines, then edge straightness is maintained, but face geometric distortions persist
Solution Approach 1:
The image processing is segmented into different transformation zones: perspective projections are applied to non-facial regions to preserve straight lines, while conformal projections are applied to facial regions to correct geometric distortions.
Solution Approach 2:
The transformation quality is localized according to region type: perspective transformations that preserve straightness are applied where needed, while conformal transformations that correct face geometry are applied specifically to facial regions.
3Device complexity
If a unified projection transformation is applied to the entire image, then processing is simple, but both face distortion and edge distortion cannot be simultaneously corrected
Solution Approach 1:
Rather than applying a single unified transformation, the image is segmented into multiple regions with different transformation rules. This increases processing complexity slightly but enables simultaneous correction of face distortions and preservation of edge straightness.
Solution Approach 2:
Different transformation qualities are applied locally to different regions of the image based on their specific requirements, achieving optimal correction for both facial regions and non-facial regions simultaneously.
Data Source
AI summary
Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions, and determining second costs associated with the warping mesh that include costs of edge-related transformations for preserving straightness of edges of the image. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.