Gaze Tracking System for Hands-Free Display Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current eye-tracking systems are limited in their ability to seamlessly integrate with consumer-level displays such as televisions and mobile devices, and lack efficient methods for tracking gaze information in real-world environments, hindering hands-free interaction and effective analysis of viewer behavior.
Innovation Solution
A method utilizing gaze tracking systems that obtain and analyze gaze information to enable interaction with media content on displays, including the integration of imaging devices to track subject gaze and orient cameras for accurate gaze tracking, even in complex environments like augmented reality, and on portable devices where cameras are positioned and powered accordingly to maintain functionality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If eye-tracking systems are integrated with consumer-level displays in real-world environments, then hands-free interaction and viewer behavior analysis capabilities are improved, but system complexity and difficulty of detecting and measuring gaze information in uncontrolled environments increase
Solution Approach 1:
The display device integrates multiple functions including display output and eye-tracking capabilities within a single system. The processing module handles both media content rendering and gaze information analysis, allowing the display to serve as both an output device and an interaction sensor, thereby reducing overall system complexity while maintaining adaptability.
Solution Approach 2:
The patent introduces a processing module as an intermediary between the imaging component and the control logic. This module specialized in analyzing gaze information from images captured by the imaging device, separating the complex tasks of image capture, gaze detection, and interaction control into distinct functional blocks, making the overall system more manageable and less complex.
2Measurement precision
If multiple imaging devices are used to track gaze information in complex environments, then measurement precision and reliability are improved, but device complexity and cost increase
Solution Approach 1:
The imaging function is divided into two distinct components: a first imaging device for capturing the user's face and eye position, and a second imaging device for capturing the display content. This segmentation allows each device to be optimized for its specific function, improving measurement precision while keeping individual device complexity manageable.
Solution Approach 2:
The system transitions from traditional single-camera eye tracking to a multi-dimensional imaging approach using two imaging devices capturing different aspects (face/eyes and display content). This dimensional change enables more precise gaze measurement by correlating eye position with displayed content in a multi-dimensional space.
3Adaptability or versatility
If gaze tracking is implemented on portable electronic devices, then adaptability and user experience are improved, but device complexity and power consumption increase
Solution Approach 1:
The lighting component operates periodically rather than continuously, activating only when the shutter of the imaging device is open to capture images. This periodic operation significantly reduces power consumption while maintaining the necessary illumination for gaze tracking during actual measurement periods.
Solution Approach 2:
The system uses the display's existing backlight to illuminate the display content, eliminating the need for a separate high-power illumination source. The display itself serves the dual function of showing content and providing lighting for the eye-tracking function, reducing overall power requirements.
4Productivity
If real-time gaze analysis is performed on displayed content, then interaction accuracy and productivity are improved, but processing time and computational load increase
Solution Approach 1:
The system pre-processes and stores information about regions of interest in the displayed content, including their locations and characteristics. When gaze information is obtained, the system can quickly match it against pre-analyzed content regions, reducing real-time processing time while maintaining interaction accuracy.
Data Source
AI summary
A system and method are provided that use eye gaze as a pointing or selection tool, which enables hands-free operation of a display such as a television. wherein the use of eye gaze as an input can also lead to easier and faster interactions when compared to traditional remote controls. A system and method are also provided that use eye tracking on displays such as televisions to determine what content was viewed and, by association, what content was of most interest to the user. Systems and methods are also described that enable interaction with elements displayed in an augmented reality environment using gaze tracking and for controlling gaze tracking on a portable electronic device.