Integrated Gaze Tracker Processing Partial Image Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Gaze tracking technologies face challenges in achieving real-time processing speed and power efficiency while maintaining a small form factor, which is crucial for applications like Head Mounted Displays and driver monitoring systems.
Innovation Solution
An integrated gaze tracker system comprising a pixel array, memory, and processor that captures images, processes partial image data in units of rows or columns, and generates gaze vectors using feature points detection, ellipse fitting, and pupil center detection, with the ability to output data via MIPI or serial interfaces, enhancing processing speed and reducing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the entire image data is processed to generate gaze vectors, then the accuracy of gaze tracking is improved, but the processing time increases and real-time performance deteriorates
Solution Approach 1:
The patent divides the entire image data into multiple line units (e.g., horizontal scan lines) and processes only selected portions of these lines for gaze vector calculation. This segmentation allows the system to maintain accuracy by focusing on relevant regions while reducing overall processing time by excluding unnecessary data.
Solution Approach 2:
The patent extracts only the necessary image data units required for gaze tracking from the complete image. By identifying and processing only the relevant portions (such as specific row ranges containing eye information), the system achieves real-time performance without sacrificing gaze tracking accuracy.
2Loss of information
If the entire image data is transmitted externally for processing, then comprehensive analysis is achieved, but power consumption increases and the device cannot maintain a small form factor
Solution Approach 1:
The patent merges the image sensor, memory, and processor into an integrated gaze tracking device. This integration allows the device to perform complete gaze analysis internally without external data transmission, thereby reducing power consumption while maintaining analysis completeness and enabling a compact form factor suitable for wearable applications.
Solution Approach 2:
The integrated device performs self-processing of image data through its embedded processor, eliminating the need for external computation resources. This self-service capability reduces power consumption by avoiding data transmission and enables the device to maintain a small form factor while achieving comprehensive gaze analysis.
3Productivity
If image data is processed in large blocks, then processing efficiency is improved, but the ability to achieve real-time gaze tracking deteriorates
Solution Approach 1:
The patent implements dynamic processing where the processor adaptively selects which line units to process based on real-time requirements. This dynamic approach allows the system to maintain high processing efficiency by focusing computational resources on relevant data while achieving real-time gaze tracking through flexible, on-demand processing rather than fixed large-block operations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The integrated gaze tracker system improves gaze vector generation speed, reduces latency, and minimizes power consumption, enabling efficient use in various applications with a small form factor, while enhancing security by processing partial image data internally without external data exchange.
Implementation Method 1
generate the gaze vector based on a light signal generated by reflecting short wave infrared (SWIR) to a pupil
Data Source
AI summary
An integrated gaze tracker includes a pixel array configured to capture an image to provide an output signal comprising the image; a memory configured to store an image data unit to be read out in units of lines based on the output signal of the pixel array; and a processor configured to generate a gaze vector based on partial image data comprising the image data unit, among entire image data included in the output signal.