Integrated Eye Tracking Chip Using Pixel-Level Pupil Center Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional eye tracker devices require multiple peripheral components, leading to increased costs, power consumption, and difficulty in miniaturization, with slow pupil center identification due to limited performance of CCD and DSP chips.

Innovation Solution

An integrated chip with a CMOS image sensor pixel array that includes 'shrink' and 'expand' functions to minimize interference, using a M×N cellular neural network, winner-take-all circuits, and loadable shift registers to accurately identify the pupil center at a pixel level, reducing component count and processing time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional CCD camera and DSP chip are used for eye tracking, then image acquisition and processing can be performed, but device complexity increases and power consumption increases

Engineering Contradiction:
Improveeye tracking functionalityVSAvoidnumber of peripheral devices
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the CCD camera, A/D converter, and DSP chip into a single integrated chip that performs image acquisition, analog-to-digital conversion, and digital signal processing simultaneously. This consolidation eliminates the need for separate peripheral devices while maintaining complete eye tracking functionality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated chip is designed to perform multiple functions within a single device: it acts as both the image sensor (CCD), the signal converter (A/D), and the processing unit (DSP). This multi-functional design reduces device complexity while preserving all necessary eye tracking capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If traditional CCD camera and DSP chip are used for eye tracking, then image processing can be performed, but power consumption increases

Engineering Contradiction:
Improveeye tracking functionalityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

By integrating all functional blocks (CCD, A/D converter, DSP) into a single chip, the patent eliminates the power consumption overhead of multiple separate devices and their associated interconnections, reducing overall power consumption while maintaining eye tracking functionality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces the traditional separate hardware components with a unified integrated circuit that uses more efficient signal processing techniques, substituting the mechanical/electronic complexity of multiple discrete components with a streamlined semiconductor-based solution that consumes less power.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If traditional DSP chip with image processing algorithm is used, then pupil center can be identified, but processing time increases

Engineering Contradiction:
Improvepupil center identification accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The integrated chip performs preliminary signal processing and feature extraction directly during image capture, rather than processing raw images later. This preliminary action reduces the computational burden and time required for subsequent pupil center identification.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional software-based image processing algorithms running on DSP chips with hardware-accelerated processing techniques implemented in the integrated circuit, significantly reducing processing time while maintaining or improving pupil center identification accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Reliability

If traditional CCD camera is used for eye tracking, then images can be captured, but device size increases making miniaturization difficult

Engineering Contradiction:
Improveimage capture capabilityVSAvoiddevice size
Core Design Contradiction:
ReliabilityVSVolume of moving object

Solution Approach 1:

The patent combines multiple functional components (CCD array, A/D converter, DSP core) into a single integrated chip, dramatically reducing the volume required for eye tracking functionality while maintaining complete image capture and processing capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated chip employs a nested architecture where smaller functional blocks (A/D converter, DSP units) are embedded within the CCD chip structure, allowing compact packaging and miniaturization while preserving all necessary functions for reliable eye tracking.

Inventive Principle:
Principle #7Nested doll (Nesting)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables high-speed, accurate detection of eye movement with reduced component costs and power consumption, allowing for more efficient and compact eye tracking systems suitable for various applications, including HCI and interactive games.

Implementation Method 1

each pixel of the CIS pixel array comprises a photodiode, where an output voltage of the photodiode is changed depending on brightness of light

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS7697032B2Integrated chip for detecting eye movement
Publication Date: 2010.04.13 EYECHIP CORP(US)
  • US7697032B2 patent drawing
  • US7697032B2 patent drawing
  • US7697032B2 patent drawing

AI summary

According to one embodiment, the present invention relates to an integrated chip for detecting eye movement. An eye tracker device may include a CMOS image sensor which provides an imaging process of a user's eye image. The eye tracker device may be implemented on a single chip where pixel-level image processing is performed, thereby achieving high operating speed. A smart CMOS Image Sensor (CIS) pixel array may include a CMOS image sensor with a “shrink” function of locating a center of a pupil while eliminating influence of a black region around the eyebrow or pupil at the pixel level so as to accurately find the location at which a user views. The CIS pixel array may include an “expand” function of removing glint or other interference occurring in the pupil due to external light or other source.