AR Device Audio Feedback for Visually Impaired Graphical Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current educational systems lack adequate resources and technologies to effectively support visually impaired students, particularly in accessing and interacting with graphical content, as existing web accessibility techniques are manual, limited, and do not provide real-time feedback on image shapes and content layers.
Innovation Solution
An augmented reality system that captures images of visual content using a wearable device, processes them to generate descriptive content layers, and provides audio feedback to visually impaired users, allowing them to interact and understand graphical elements through spatial tracking and guidance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If manual alternative text descriptions are used for web accessibility, then visually impaired users can access digital content, but the process is not automated and cannot provide real-time feedback on image shapes and content layers
Solution Approach 1:
The patent replaces manual text description with an automated computer vision system that captures images, detects shapes and contours, and generates audio feedback. The system uses image processing algorithms to automatically identify visual content elements and convert them into descriptive audio narratives, eliminating the need for manual Alt-Text entry while preserving detailed shape and contour information through automated detection and audio output.
2Ease of operation
If existing web accessibility techniques are used, then some digital content becomes accessible, but they do not provide tools to determine and guide visually impaired persons on the actual shape and contour of images or associated content layers
Solution Approach 1:
The patent introduces an intermediary system between the visual content and the visually impaired user. This system includes image capture devices, processing algorithms, and audio output mechanisms that mediate the transmission of shape and contour information. The intermediary converts visual spatial information into audio spatial cues, allowing users to perceive image structures through sound rather than sight.
3Productivity
If manual text descriptions are entered for accessibility, then content can be read by browsers and eReaders, but the process is time-consuming and not scalable to large scale education services
Solution Approach 1:
The patent implements a self-service system where the accessibility description is generated automatically by the system itself without requiring human intervention for each content item. The computer vision system processes images autonomously, detecting shapes, contours, and content layers, then generates corresponding audio descriptions automatically. This self-service capability enables large-scale deployment across educational platforms without proportionally increasing manual workload.
4Adaptability or versatility
If content is presented in graphical format, then visual learning is enhanced, but visually impaired students cannot learn with graphical content or take tests that include such content without audio descriptions
Solution Approach 1:
The patent transitions information from the visual dimension to the auditory dimension. Graphical content that relies on visual perception is converted into audio-based representations through automated description generation. The system captures visual spatial relationships and transforms them into audio spatial cues, allowing visually impaired students to access graphical content through their sense of hearing rather than sight.
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for assisting a visually impaired user in interacting with a visual content entity are provided. One of the methods includes capturing, by an augmented reality device worn or held by the visually impaired user, a plurality of images of the visual content entity; notifying the visually impaired user of availability of the visual content entity and descriptive content associated with the visual content entity; receiving an indication from the visually impaired user to provide the descriptive content associated with the visual content entity; providing the descriptive content associated with the visual content entity and interactional guidance to the visually impaired user for interacting with the descriptive content; tracking one or more interactions by the visually impaired user with the descriptive content; and updating the interactional guidance provided to the visually impaired user based on the tracking.