Cursor Control via Head Tracking for Touchscreen Accessibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Individuals with upper limb disabilities face challenges in performing touch gestures on touch screens due to limited dexterity, making it difficult to accurately select coordinates and perform multiple touches.
Innovation Solution
A device with a communication unit to obtain user movement information, a display unit to move a cursor on the touch screen, and a controller to determine dwell start coordinates and generate touch events based on user input, allowing for touch event generation without direct screen contact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If touch gestures are used on a touch screen, then device portability and interface simplicity are improved, but accessibility for users with upper limb disabilities deteriorates
Solution Approach 1:
The patent introduces an intermediary system consisting of a camera and image processing algorithm that mediates between the user's head movements and the touch screen interface. The camera captures head position, the processor converts this to cursor position, and the system generates touch events without requiring direct hand contact with the screen, thus making the interface accessible to users with upper limb disabilities while maintaining device portability
Solution Approach 2:
The patent replaces the mechanical hand-finger-touch screen interaction system with an optical-mechanical system using camera-based head tracking. Instead of requiring manual dexterity to perform touch gestures, the system uses head movement detection through camera imaging and computational algorithms to generate equivalent touch events, substituting the mechanical operation requirement with an optical detection mechanism
2Measurement precision
If traditional touch gestures require precise finger control, then selection accuracy is improved, but usability for users with limited dexterity deteriorates
Solution Approach 1:
The patent changes the control parameter from hand/finger position to head position detected by camera imaging. By using head movements as the control input instead of finger movements, the system maintains coordinate selection accuracy while accommodating users with limited dexterity, as head control requires less fine motor skill precision
3Adaptability or versatility
If multiple touch locations need to be selected simultaneously, then interface functionality is improved, but operational complexity for disabled users increases
Solution Approach 1:
The patent employs periodic sampling of head position to detect when the cursor has stabilized at a target location. By continuously monitoring head position at regular intervals and detecting when the cursor remains within a threshold distance from the target for a predetermined time period, the system enables reliable touch event generation without requiring complex simultaneous multi-point control, thus maintaining interface functionality while reducing operational complexity
Data Source
AI summary
A device including a display such as a touch screen is provided. The device includes a communication unit configured to obtain movement information of a user, a display unit configured to move a cursor displayed on the display or touch screen in accordance with the movement information of the user, and a controller configured to determine coordinates where the cursor and/or moved cursor is located as dwell start coordinates and determine the dwell start coordinates as touch coordinates when the cursor is located within a reference distance from the dwell start coordinates during an entire reference time starting from a point in time when the cursor is moved to the dwell start coordinates.