Image Gaze Correction Using Flow Fields and Contour Masks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gaze correction methods for images suffer from low accuracy due to sequential calculation of multiple parameters, which leads to error accumulation and magnification.
Innovation Solution
An image gaze correction method that involves acquiring a to-be-corrected eye image, generating an eye motion flow field and an eye contour mask, and performing gaze correction processing based on these to obtain a corrected eye image, thereby improving accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If sequential calculation of multiple parameters is used for gaze correction, then the correction process can be implemented through standard image processing steps, but error accumulation and magnification occur leading to low accuracy
Solution Approach 1:
The patent combines multiple sequential parameter calculations (head pose angle, head offset direction, gaze angle, eyeball position correction) into a single integrated deep learning model. The model directly maps input eye images to corrected output images in one end-to-end process, eliminating the need for separate calculation steps and preventing error accumulation while maintaining ease of implementation through a unified neural network architecture.
2Ease of operation
If multiple parameters are calculated sequentially for gaze correction, then the process can follow a logical step-by-step approach, but the time consumption increases and stability decreases
Solution Approach 1:
The patent implements continuous processing by using a deep learning model that processes the entire gaze correction task in a single forward pass. Instead of executing multiple discrete calculation steps that require intermediate storage and repeated data processing, the model maintains continuous transformation from input to output, significantly reducing processing time while preserving the logical flow through the network's layered architecture.
3Adaptability or versatility
If sequential parameter calculation is used, then each parameter can be optimized independently, but error accumulation magnifies the overall error leading to low reliability
Solution Approach 1:
The patent merges independent parameter optimization into a unified end-to-end deep learning model where all parameters are jointly optimized through backpropagation. The model learns optimal transformations for head pose, gaze direction, and eyeball positioning simultaneously, ensuring that errors in one parameter do not accumulate from separate calculations but are instead coordinated through the shared neural network weights, thereby improving reliability.
Data Source
AI summary
An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product. The image gaze correction method includes: acquiring a to-be-corrected eye image from a to-be-corrected image, generating, based on the to-be-corrected eye image, an eye motion flow field and an eye contour mask, the eye motion flow field being used for adjusting a pixel position in the to-be-corrected eye image, and the eye contour mask being used for indicating a probability that the pixel position in the to-be-corrected eye image belongs to an eye region, performing, based on the eye motion flow field and the eye contour mask, gaze correction processing on the to-be-corrected eye image to obtain a corrected eye image, and generating a gaze corrected image based on the corrected eye image.


