Audiotactile Vision Substitution System for Blind Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vision substitution methods fail to effectively emulate the way sighted individuals perceive visual changes during different activities and struggle to accurately convey visual features, particularly shapes and colors, to blind and partially sighted individuals, often relying on expensive tactile displays that can be cumbersome and difficult to read.
Innovation Solution
A system that identifies lineal features and corners within visual representations, outputting moving audio and tactile effects to simulate the perception of shapes and colors, allowing users to rapidly switch between activity-specific parameters and using coded impulses for modest information transfer, enabling the user to focus on relevant features through audio and tactile modalities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If tactile displays are used to convey visual information, then information can be presented to blind and partially sighted individuals, but the displays become expensive and cumbersome
Solution Approach 1:
The patent replaces complex tactile display mechanisms with audio-based vision substitution. Instead of using mechanical tactile displays to convey visual information, the system uses audio signals to represent visual features such as edges, corners, and shapes, thereby eliminating the need for expensive and cumbersome tactile hardware while maintaining effective information transmission to blind and partially sighted users.
2Loss of information
If traditional vision substitution methods are used, then some visual information can be conveyed, but they fail to accurately represent shapes and colors
Solution Approach 1:
The patent segments visual information into distinct geometric features such as edges, corners, and shapes. By breaking down complex visual scenes into these fundamental components and representing each with specific audio characteristics, the system accurately conveys shape information without requiring complex tactile displays, thus resolving the contradiction between information completeness and accuracy.
3Loss of information
If detailed visual information is presented to all users, then complete information is provided, but blind users cannot process the vast amount of information
Solution Approach 1:
The patent extracts only the most salient visual features—edges, corners, and shapes—from complete visual scenes and represents them through audio signals. This selective extraction provides sufficient structural information for blind users to mentally reconstruct scenes without overwhelming them with excessive detail, thereby balancing information completeness with processing ease.
Data Source
AI summary
One embodiment a vision substitution system for communicating audio and tactile representations of features within visual representations includes selecting (1) activity-related parameters; obtaining (2) images or other visual representations according to the activity-related parameters; acquiring (3) features including shapes and corners related to the visual representations according to the activity-related parameters; and outputting (4) effects related to the features on audio and/or tactile displays according to the activity-related parameters. The corners of shapes and other lineal features are emphasized via special audio and tactile effects while apparently-moving effects trace out perimeters and/or shapes. Coded impulse effects communicate categorical visual information. Special speech and braille codes can communicate encoded categorical properties and the arrangements of properties.