Gaze Tracking for Multi-Display Control Without Physical Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Retail enterprises face challenges in engaging customers, reducing transactional friction, enhancing shopping experiences, and driving business transformation due to rapidly changing consumer preferences and increasing competition.
Innovation Solution
Utilizing gaze tracking and gesture-based control systems to identify and interact with multiple displays, enabling seamless control of virtual environments through pupil detection and gaze direction analysis, combined with AI models and camera systems to enhance user interaction and reduce the need for physical devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gaze tracking and gesture-based control systems are implemented to enable seamless control of virtual environments, then user engagement and ease of operation are improved, but device complexity and system cost increase
Solution Approach 1:
The patent replaces traditional mechanical input devices (keyboards, mice, touchscreens) with gaze tracking and gesture-based control systems. Cameras capture eye movements and hand gestures, converting them into control signals that operate virtual environments, thereby eliminating the need for physical interaction devices and improving ease of operation.
Solution Approach 2:
The patent introduces cameras and computer vision algorithms as intermediary systems between the user and the virtual environment. These intermediaries capture gaze direction and gesture movements, process them through AI models, and translate them into meaningful control actions, bridging the gap between natural human behavior and digital system control.
2Measurement precision
If multiple cameras and AI models are used for accurate gaze tracking and display identification, then measurement precision and control accuracy are improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary actions by pre-calibrating camera positions, display geometries, and user eye characteristics before actual interaction. This pre-processing establishes baseline parameters and spatial relationships, enabling faster real-time gaze tracking and display identification during actual use without requiring complex calculations for each interaction.
Solution Approach 2:
The patent segments the gaze tracking process into distinct stages: eye detection, pupil localization, gaze direction calculation, and display identification. Each stage is handled by specialized algorithms and processing modules, allowing parallel processing and optimizing computational efficiency while maintaining high measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Facilitates immersive shopping experiences, reduces transactional friction, and improves business transformation by allowing users to control displays and interact with virtual environments using gaze and gestures, enhancing user engagement and operational efficiency.
Implementation Method 1
tracking a position of a pupil of an eye of a user
Data Source
AI summary
A method for enabling user control of a display screen. The example method includes tracking, by a camera, a position of a pupil of an eye of a human user who is positioned to be able to view multiple display screens, determining a location of the pupil within the eye, determining, as among the display screens, and based on the location of the pupil, which of the display screens is being looked at by the user, and enabling control, by the user, of the display screen that the user is looking at.