Eye Tracking Mouse Interface Using Webcam for Accessibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computer mouse technologies are difficult for physically disabled individuals to use due to high cost, low efficiency, unreliability, health risks, and the need for special hardware, particularly in handling small movements and changes in target position.
Innovation Solution
A system and method that uses a camera to detect eye movements, process gaze information, and map eye movements to mouse cursor movements and clicks without requiring additional sophisticated hardware, utilizing a processor with data acquisition, calibration, face detection, eye detection, and gaze mapping functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional computer mouse is used, then physical movement control is achieved, but it becomes difficult for physically disabled people to use
Solution Approach 1:
The patent replaces the mechanical mouse system with an optical-based eye tracking system. The camera captures eye movements and the processor translates these into cursor movements, eliminating the need for physical mouse manipulation while maintaining computer control functionality.
Solution Approach 2:
The patent introduces an intermediary system consisting of camera, processor, and software algorithms that translate eye movements into mouse cursor movements. This intermediary layer bridges the gap between the user's eye movements and the computer's response, enabling control without direct physical interaction.
2Adaptability or versatility
If sophisticated hardware is added to enable eye control, then accessibility for disabled users is improved, but device complexity and cost increase
Solution Approach 1:
The patent utilizes a webcam, which is a universal device already present in most computers, for eye tracking purposes. By making the camera serve multiple functions (both standard video conferencing and eye tracking), the system avoids adding specialized hardware while maintaining accessibility features.
Solution Approach 2:
The system leverages the computer's existing camera and processing capabilities to provide eye control functionality. The webcam and processor that are already part of the computer system are repurposed to enable accessibility features, eliminating the need for external specialized equipment.
3Ease of operation
If eye movement detection is implemented, then mouse control without physical movement is achieved, but handling small pupil movements and target position changes becomes unreliable
Solution Approach 1:
The patent implements a calibration phase before actual use, where the system learns the relationship between the user's eye movements and cursor movements. This preliminary action establishes baseline data and mapping parameters that improve the reliability of subsequent eye movement detection and interpretation.
Solution Approach 2:
The system continuously monitors eye movements and provides real-time cursor movement feedback on the display. This feedback loop allows the system to adjust and refine its interpretation of eye movements, improving reliability by comparing intended movements with actual cursor behavior and making corrections as needed.
Data Source
AI summary
A system, method, and device are provided that receive an image sequence from a camera, processes the image sequence, extract gaze information, map the user's eye movements to movement of the mouse cursor, and initiates mouse clicks based on user behavior.