Eye Gaze Tracking Using Camera Segmentation and Prediction Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing eye gaze tracking techniques suffer from low accuracy and slow response speed in determining the gaze position on a screen.

Innovation Solution

An eye gaze tracking method using at least two cameras to capture facial images, employing pre-trained convolutional neural network-based eye detection and eye gaze recognition models to segment and predict gaze positions, with features like similarity calculation and deep learning for improved accuracy and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional eye gaze tracking methods are used, then the system is simpler, but the accuracy and response speed are low

Engineering Contradiction:
Improvegaze position accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the eye gaze tracking task into multiple independent modules: eye detection module for locating eyes, gaze direction calculation module for computing gaze direction, and position mapping module for converting to screen coordinates. This segmentation allows each module to be optimized independently, improving overall accuracy while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary coordinate transformation process that bridges the gap between eye coordinate systems and display screen coordinate systems. This intermediary mapping layer, combined with the prediction mechanism, enables accurate gaze position determination without requiring direct complex measurements, thus improving precision while managing system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If traditional eye gaze tracking methods are used, then the computational load is lower, but the response speed is slow

Engineering Contradiction:
Improveresponse speedVSAvoidcomputational load
Core Design Contradiction:
SpeedVSPower

Solution Approach 1:

The patent applies preliminary action by using a prediction mechanism that anticipates gaze position based on eye motion trends. The system predicts the next gaze position before the user actually looks at it, reducing the real-time computational burden and improving response speed. The prediction model processes historical eye position data to forecast future gaze locations, enabling faster response without excessive computational load.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic adaptation by adjusting the tracking methodology based on real-time conditions. When eye motion is detected, the system switches to prediction mode for faster response; when eye motion is minimal, it uses direct detection mode. This dynamic switching optimizes the balance between response speed and computational load, allowing the system to respond quickly without consistently consuming high computational resources.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If deep learning models are applied, then the accuracy is improved, but the processing time increases

Engineering Contradiction:
Improvegaze position accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the deep learning processing into two parts: an offline training phase where the prediction model is trained using deep learning on historical data, and an online execution phase where the pre-trained model makes rapid predictions. This segmentation allows the computationally intensive deep learning to be performed once during training, improving accuracy without significantly increasing real-time processing time during actual eye gaze tracking.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by pre-training the prediction model using deep learning algorithms on extensive historical eye gaze data before actual tracking begins. During real-time operation, the pre-trained model makes fast predictions without requiring continuous deep learning computation. This preliminary training phase captures complex patterns and relationships, enabling accurate gaze position determination with reduced real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11941171B1Eye gaze tracking method, apparatus and system
Publication Date: 2024.03.26 BOE TECHNOLOGY GROUP CO LTD
  • US11941171B1 patent drawing
  • US11941171B1 patent drawing
  • US11941171B1 patent drawing

AI summary

An eye gaze tracking method, apparatus and system are provided, which belong to the technical field of image processing. The eye gaze tracking method includes: capturing, by at least two cameras, frames of facial images when a viewer views display screen; segmenting a current frame of facial image with pre-trained eye detection model to obtain an image for left and right eyes; calculating a similarity between the current frame of facial image and each of previous N frames of facial images; if the similarity between the current frame of facial image and each of previous N frames of facial images is less than the preset threshold, detecting a position on display screen at which the eyes of the viewer gaze with pre-trained eye detection model. Embodiments of the present disclosure can improve accuracy and efficiency of eye gaze tracking.