Eye Tracker and Proximity Sensor for Non-Touch Screen Gesture Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

One-dimensional arrays of proximity sensors are not accurate enough to determine a two-dimensional location of a pointer within a two-dimensional plane, limiting the ability to enable touch screen functionality on non-touch screen devices and providing intuitive user interfaces that track user attention.

Innovation Solution

A user interface system with a multi-faceted housing incorporating an eye tracker and a proximity sensor, where the eye tracker identifies the user's gaze and the proximity sensor detects gestures, allowing the processor to map gestures to the appropriate application control, enabling intuitive touch screen functionality on non-touch screen devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a one-dimensional array of proximity sensors is used, then the device structure remains simple, but the accuracy of determining two-dimensional pointer location is insufficient

Engineering Contradiction:
Improvepointer location accuracyVSAvoidsensor array complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transitions from a one-dimensional array of proximity sensors to a two-dimensional array arrangement. This dimensional change enables the sensor system to accurately determine both x and y coordinates of a pointer location on the touch screen surface, resolving the limitation of insufficient measurement precision while maintaining a relatively simple grid-based structure

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The touch screen surface is divided into a two-dimensional grid of sensor regions, where each region corresponds to a specific spatial location. This segmentation allows the system to map gesture locations precisely to the two-dimensional plane by identifying which grid region detects the gesture, thereby achieving accurate location determination through structured spatial division

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If an eye tracker and proximity sensor system is integrated, then user attention tracking capability is enhanced, but the device complexity increases

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidsystem integration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines the eye tracker and proximity sensor systems into a single integrated user interface framework. The eye tracker identifies which control the user is viewing, while the proximity sensor detects gestures, and both inputs are merged to determine the target application. This merging enables comprehensive user attention tracking and gesture recognition without requiring separate independent systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated system serves multiple functions: the eye tracker monitors user attention, the proximity sensor detects gestures, and the processor combines both inputs to enable touch screen functionality. This multi-functional approach allows the system to provide both gaze-based control and gesture-based interaction, enhancing adaptability while sharing common processing resources

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate gesture detection and mapping, allowing non-touch screen devices to function like touch screens, providing intuitive user interfaces that track user attention and enhance user interaction with gestures and eye direction.

Implementation Method 1

an eye tracker mounted in a first facet of the housing, the first facet being distal from the display surface, the eye tracker identifying a control on the display surface at which a user's eyes are directed

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a proximity sensor mounted in a second facet of the housing, the second facet being between the first facet and the display, the proximity sensor detecting a gesture performed by an object opposite the second facet

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentUS12147631B2User interface
Publication Date: 2024.11.19 NEONODE INC
  • US12147631B2 patent drawing
  • US12147631B2 patent drawing
  • US12147631B2 patent drawing

AI summary

A method for interacting with controls in a graphical user interface (GUI), including recording user interface gestures performed by a user, for each recorded gesture: when the gesture includes the user virtually touching a specific GUI control, applying the gesture to the specific GUI control; and when the gesture is performed without the user virtually touching a specific GUI control, identifying a particular GUI control that the user is gazing at and applying the gesture to that particular GUI control.