Eye-Tracking Tactile Feedback for Blind Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current devices for blind or visually-impaired users, such as retinal implants and portable tactile image converters, face limitations in effectively providing spatial perception, especially when objects are mobile, leading to user fatigue due to the need for constant head or neck movement.
Innovation Solution
A device that uses eye-tracking technology to control mechanical actuators on the skin, converting digital image signals into tactile feedback, allowing users to focus attention on specific environmental areas by reproducing the direction of their gaze, potentially using piezoelectric or ultrasound actuators and a processing circuit to stimulate the skin with varying intensities and frequencies corresponding to image pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a portable device converts video images to tactile images on the user's skin, then environmental perception is improved, but user fatigue increases when objects are mobile due to constant head or neck movement required
Solution Approach 1:
The system uses eye-tracking to detect the user's gaze direction and dynamically adjusts the tactile image presentation accordingly. The processing circuit receives eye-tracking data and uses it to determine which area of the visual field should be converted to tactile feedback, creating a closed-loop system that adapts to user attention without requiring physical movement.
Solution Approach 2:
The invention replaces the mechanical system of head or neck movement with an eye-tracking based system. Instead of requiring the user to physically move their head to track mobile objects, the eye-tracking module detects gaze direction and the processing circuit automatically adjusts the tactile feedback to follow the user's visual attention, substituting mechanical movement with optical and computational mechanisms.
2Loss of information
If retinal implants are used to stimulate neurons for image reproduction, then visual perception is restored, but costs and implementation complexity increase significantly
Solution Approach 1:
The system uses the user's existing visual system (eyes and visual cortex) as an intermediary rather than bypassing it with direct retinal stimulation. The eye-tracking module leverages the natural visual pathway to detect gaze direction, and the tactile feedback system communicates environmental information through the skin, using the intact visual and somatosensory systems as mediators between the camera and the user's perception.
Solution Approach 2:
Instead of directly restoring visual images to the retina, the system creates a copy of the visual information and presents it through a different sensory modality (tactile feedback on the skin). The processing circuit converts visual data from the camera into tactile patterns that replicate the essential spatial and movement information, allowing the user to perceive environmental details through touch rather than sight.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances spatial perception by providing a three-dimensional representation of the environment through binocular eye-tracking and tactile feedback, reducing user fatigue and improving environmental awareness without the need for constant head movement.
Implementation Method 1
These may thus be piezoelectric elements designed for example to have: a displacement with an amplitude that is a function of the electrical signal that they receive
Implementation Method 2
an emission of focused ultrasound waves distributed over a plane matrix may be used for stimulating the skin of the user
Implementation Method 3
an electrode may be provided emitting electrical pulses felt as mini-electric shocks
Data Source
AI summary
A device for improving environmental perception for blind or visually impaired users, including a set of mechanical actuators intended to be in contact with the skin of a user, at least one digital camera designed to acquire a current digital image of an environment facing the user, a processing circuit connected to the camera for receiving pixel signals from the acquired digital image and converting at least one portion of the pixel signals into control signals, each of which powers a mechanical actuator of the set of actuators, an eye-tracking module for tracking each eye of the user to identify a gaze direction of the user. The processing circuit then selects, in the environment filmed by the camera, an area of acquired current image which is a function of the gaze direction and converts the pixel signals of said area into control signals, each of which powers an actuator of the set to stimulate the user's skin.