Spatial Audio Text Localization for Visually Impaired Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Visually impaired users of electronic devices face challenges in understanding the layout and location of text being audibly rendered through text-to-speech technology, as the audio lacks indication of its corresponding display location, making it difficult to navigate and edit code or other text-based content.
Innovation Solution
A system that uses binaural sound to provide audio signals that appear to originate from specific locations on the display, allowing users to perceive the layout and position of text through sound localization, using processors and network adapters to execute instructions that modulate sound between speakers to simulate the origin from the text's display location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If text-to-speech technology is used to audibly render text on a display, then accessibility for visually impaired users is improved, but the user's understanding of text layout and location is degraded
Solution Approach 1:
The patent applies spatial audio dimensionality by mapping two-dimensional text positions on the display to three-dimensional sound sources in space. Each text element's screen coordinates (x, y) are transformed into spatial audio parameters (azimuth, elevation, distance), creating a virtual sound field that preserves layout information in an auditory dimension. This allows visually impaired users to perceive text position, distance from screen edges, and relative layout through sound direction and spatial location.
2Device complexity
If audio is provided without spatial indication, then device complexity is reduced, but user navigation and editing capability is degraded
Solution Approach 1:
The patent implements local quality by providing distinct spatial audio characteristics for different regions of the display. Text elements at different positions receive customized spatial parameters: elements near screen edges are positioned accordingly in the virtual sound field, while center elements maintain central positioning. This localized spatial mapping allows users to identify text location and navigate to specific areas through sound direction, enhancing navigation capability without requiring complex global audio processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables visually impaired users to better understand the layout and location of text on a display by providing audio that mimics its origin, enhancing navigation and editing capabilities by providing spatial awareness of text on the screen.
Implementation Method 1
A system that uses binaural sound to provide audio signals that appear to originate from specific locations on the display
Implementation Method 2
allowing users to perceive the layout and position of text through sound localization
Data Source
AI summary
In one aspect, a device includes a processor, a display accessible to the processor, and memory accessible to the processor. The memory bears instructions executable by the processor to provide sound corresponding to a portion of text presented on the display with at least one portion of the sound being provided as if originating at least substantially from a location on the display at which the portion of text is presented on the display.