Gaze Tracking Menu Selection Using Button Click Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing menu selection methods using gaze tracking require the driver's gaze to be fixed on a menu for an extended period, which can hinder safe driving as they divert attention from the road.

Innovation Solution

A menu selection apparatus that uses gaze tracking to detect the menu item a driver is looking at, considering human response time, by tracking the driver's gaze and recognizing a button click as a selection, with a controller calculating the average of gaze vectors within a critical time frame to determine the intended menu item.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the driver's gaze is fixed on the menu for a predetermined time or more to select a menu item, then the menu selection accuracy is improved, but the driving safety deteriorates

Engineering Contradiction:
Improvemenu selection accuracyVSAvoiddriving safety
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary gaze tracking and menu highlighting before the driver makes a selection. The gaze tracker continuously monitors the driver's gaze position and pre-highlights potential menu items, so that when the driver gazes at a menu item for the predetermined time, the selection is already prepared and can be executed immediately without requiring prolonged fixation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The menu selection interface dynamically adjusts based on the driver's gaze position in real-time. As the driver's gaze moves across the menu, the system dynamically highlights different menu items and updates the selection state, allowing the menu to adapt to the driver's natural gaze movements rather than requiring static fixation

Inventive Principle:
Principle #15Dynamics

2Reliability

If the driver gazes at the specific menu on a display for a predetermined time or more to select a menu item, then the menu selection reliability is improved, but the response time deteriorates

Engineering Contradiction:
Improvemenu selection reliabilityVSAvoidresponse time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system uses periodic sampling of the driver's gaze position at high frequency (e.g., 30-60 times per second) to track gaze movements. This periodic detection allows the system to accurately determine when the driver's gaze has been directed at a menu item for the predetermined time while maintaining rapid response capability

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system provides visual feedback by highlighting the menu item that the driver is currently gazing at. This feedback mechanism confirms to the driver that their intended selection is recognized, and the system continuously monitors gaze position to provide real-time feedback, ensuring reliable selection while minimizing the time required

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9696800B2Menu selection apparatus using gaze tracking
Publication Date: 2017.07.04 HYUNDAI MOTOR CO LTD
  • US9696800B2 patent drawing
  • US9696800B2 patent drawing
  • US9696800B2 patent drawing

AI summary

A menu selection apparatus using gaze tracking includes: a gaze tracker configured to track a gaze of a driver and to output time series gaze data; a timer included in the gaze tracker and configured to output a timing pulse; a buffer configured to store the time series gaze data; a counter configured to count the timing pulse to adjust synchronization with the timer; a button configured to output a click signal when being clicked by the driver; and a controller configured to extract the time series gaze data for a critical time based on button click timing as the click signal is output from the button and to then calculate an average of gaze vectors within each time series gaze data.