Eye-Controlled Interface Using Image Sensor Reflections

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional eye-controlled user interfaces for electronic devices are hindered by difficulties in accurately determining the angle of a user's vision, are often expensive, complex, bulky, inconvenient, and intrusive to user privacy, and require extensive calibration.

Innovation Solution

An eye-controlled user interface system that uses an image sensor to detect eye-related characteristics, such as shape and orientation, to enable non-physical control of devices by analyzing reflections from the eye, allowing users to control electronic devices through gaze direction without the need for cumbersome hardware or extensive calibration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional eye-tracking devices (head-mounted or camera-based) are used to determine gaze direction, then visual control capability is achieved, but device complexity and cost increase significantly

Engineering Contradiction:
Improvevisual control capabilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the eye-tracking functionality from complex head-mounted devices or multi-camera systems and implements it using a single image capture device positioned near the display. This extraction principle simplifies the overall system while maintaining the core visual control capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The image capture device serves multiple functions: it captures images for eye position detection, provides display functionality, and acts as the interface for visual control. This multi-functionality reduces the number of separate components needed in the system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If conventional eye-tracking solutions are implemented, then gaze direction detection is possible, but the devices become bulky and inconvenient to wear or carry

Engineering Contradiction:
Improvegaze direction detectionVSAvoiddevice bulk
Core Design Contradiction:
Ease of operationVSWeight of moving object

Solution Approach 1:

The patent merges the image capture device with the display device, combining two functions into a single integrated unit. This integration eliminates the need for separate head-mounted equipment, reducing bulk and improving convenience.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Instead of using complex optical systems to directly measure eye position, the patent captures an image of the eye and processes it computationally to determine gaze direction. This copying approach using standard imaging technology reduces hardware complexity and weight.

Inventive Principle:
Principle #26Copying

3Measurement precision

If conventional eye-tracking systems are used, then visual control is achieved, but extensive calibration is required to maintain accuracy

Engineering Contradiction:
Improvegaze direction accuracyVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs automatic calibration by capturing images of the user's eye and computing gaze position without requiring manual intervention or setup procedures. The processor automatically adjusts for individual eye characteristics, eliminating the need for time-consuming calibration sessions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements continuous background calibration that occurs automatically during normal operation, rather than requiring a separate preliminary calibration step. This preliminary action is performed continuously to maintain accuracy without user intervention.

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If conventional eye-tracking devices are deployed, then control functionality is provided, but user privacy is compromised

Engineering Contradiction:
Improvecontrol functionalityVSAvoidprivacy intrusion
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent processes eye images locally on the device itself, analyzing only the specific region of interest (the eye) without capturing or storing broader visual information about the user or environment. This localized processing approach maintains privacy while enabling control functionality.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides a user-friendly, privacy-respecting, and cost-effective means of controlling electronic devices using gaze direction, improving accuracy and convenience while reducing the complexity and bulk associated with traditional solutions.

Implementation Method 1

an image sensor to detect eye-related characteristics, such as shape and orientation, to enable non-physical control of devices by analyzing reflections from the eye

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS9696801B2Eye-controlled user interface to control an electronic device
Publication Date: 2017.07.04 DONALDSON THOMAS ALAN
  • US9696801B2 patent drawing
  • US9696801B2 patent drawing
  • US9696801B2 patent drawing

AI summary

Techniques for providing an eye-controlled user interface for an electronic device are described. In some examples, a process includes establishing a control link between a device and a visual control circuit, the visual control circuit having an image sensor and a visual feature disposed substantially proximate to the image sensor at a control point, receiving an image by the image sensor, evaluating the image to determine whether an eye is oriented substantially toward the control point, determining whether a control action is intended, and, if the control action is intended, deriving the control action, and using the control link to perform the control action.