Asynchronous Tactile Sensory Substitution System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current sensory substitution systems for visually impaired individuals are bulky, energy-intensive, and require a long learning curve, failing to effectively provide tactile stimuli that mimic visual information due to their invasive nature and limited adaptability to individual needs.
Innovation Solution
A portable sensory substitution system comprising a matrix of exciters interacting with the skin, controlled by an asynchronous signal source that mimics the functioning of the eye, using neuromorphic cameras or signal synthesizers to deliver asynchronous visual information, reducing energy consumption and improving ergonomics and adaptability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If invasive retinal neuroprostheses are used to stimulate the brain, then visual information can be restored, but health risks and operational costs increase due to foreign body presence
Solution Approach 1:
The patent introduces an intermediary device (sensory substitution system with tactile exciters) that mediates between visual information and the user's nervous system, avoiding direct invasion of the eye or brain while still enabling visual information processing through tactile feedback pathways
Solution Approach 2:
The patent replaces the mechanical/invasive electrical stimulation of retinal cells with a non-invasive tactile stimulation system that uses mechanical exciters on the skin surface to convey visual information, substituting one sensory modality for another without physical invasion
2Ease of operation
If known sensory substitution devices are used, then some autonomy is restored, but the devices become bulky and energy-intensive
Solution Approach 1:
The patent changes the temporal parameters of information delivery by using asynchronous event-based signaling instead of continuous sampling, dramatically reducing the average energy consumption while maintaining the ability to convey visual information effectively
Solution Approach 2:
The patent replaces continuous periodic stimulation with event-driven asynchronous stimulation, where exciters are activated only when visual events occur, reducing overall energy consumption while maintaining information fidelity
3Loss of information
If traditional sensory substitution devices are used, then visual information is conveyed, but a very long training period is required
Solution Approach 1:
The patent changes the temporal resolution and synchronization parameters of the stimulation system to match human perceptual timing, using millisecond-scale asynchronous events that align with natural neural processing times, thereby reducing the cognitive load and training required
4Loss of information
If synchronous sampling methods are used for visual information, then complete image data is captured, but information processing requirements and energy consumption increase
Solution Approach 1:
The patent extracts only the essential visual events (changes in luminance) rather than processing complete continuous image frames, removing redundant information while retaining the critical visual data needed for effective tactile substitution
Solution Approach 2:
The patent replaces synchronous periodic sampling with asynchronous event-based detection, where the system responds only to changes in visual input rather than continuously sampling at fixed intervals, reducing processing complexity
Data Source
Figure 1~2C
Figure 3A~3B
Figure 4~5
AI summary
The sensory substitution system comprises a portable matrix of exciters (1) that can be worn by a user in such a way that the exciters (5) are placed against the skin of a user, as well as a control circuit (8) for the exciters of the matrix. An asynchronous signal source (10) provides the control circuit with an asynchronous signal representative of visual information organized according to a matrix of pixels. This asynchronous signal comprises, for each pixel, successive events associated in an asynchronous manner with said pixel.