Image Gaze Correction Using Flow Fields and Contour Masks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing gaze correction methods for images suffer from low accuracy due to sequential calculation of multiple parameters, which leads to error accumulation and magnification.

Innovation Solution

An image gaze correction method that involves acquiring a to-be-corrected eye image, generating an eye motion flow field and an eye contour mask, and performing gaze correction processing based on these to obtain a corrected eye image, thereby improving accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If sequential calculation of multiple parameters is used for gaze correction, then the correction process can be implemented through standard image processing steps, but error accumulation and magnification occur leading to low accuracy

Engineering Contradiction:
Improveease of implementationVSAvoidgaze correction accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent combines multiple sequential parameter calculations (head pose angle, head offset direction, gaze angle, eyeball position correction) into a single integrated deep learning model. The model directly maps input eye images to corrected output images in one end-to-end process, eliminating the need for separate calculation steps and preventing error accumulation while maintaining ease of implementation through a unified neural network architecture.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If multiple parameters are calculated sequentially for gaze correction, then the process can follow a logical step-by-step approach, but the time consumption increases and stability decreases

Engineering Contradiction:
Improvelogical processing flowVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements continuous processing by using a deep learning model that processes the entire gaze correction task in a single forward pass. Instead of executing multiple discrete calculation steps that require intermediate storage and repeated data processing, the model maintains continuous transformation from input to output, significantly reducing processing time while preserving the logical flow through the network's layered architecture.

Inventive Principle:
Principle #20Continuity of useful action

3Adaptability or versatility

If sequential parameter calculation is used, then each parameter can be optimized independently, but error accumulation magnifies the overall error leading to low reliability

Engineering Contradiction:
Improveparameter optimization flexibilityVSAvoidgaze correction reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent merges independent parameter optimization into a unified end-to-end deep learning model where all parameters are jointly optimized through backpropagation. The model learns optimal transformations for head pose, gaze direction, and eyeball positioning simultaneously, ensuring that errors in one parameter do not accumulate from separate calculations but are instead coordinated through the shared neural network weights, thereby improving reliability.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12346494B2Image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product
Publication Date: 2025.07.01 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12346494B2 patent drawing
  • US12346494B2 patent drawing
  • US12346494B2 patent drawing

AI summary

An image gaze correction method, apparatus, electronic device, computer-readable storage medium, and computer program product. The image gaze correction method includes: acquiring a to-be-corrected eye image from a to-be-corrected image, generating, based on the to-be-corrected eye image, an eye motion flow field and an eye contour mask, the eye motion flow field being used for adjusting a pixel position in the to-be-corrected eye image, and the eye contour mask being used for indicating a probability that the pixel position in the to-be-corrected eye image belongs to an eye region, performing, based on the eye motion flow field and the eye contour mask, gaze correction processing on the to-be-corrected eye image to obtain a corrected eye image, and generating a gaze corrected image based on the corrected eye image.