Assistive Technology Audio Handoff for Screen Reader Interference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Interferences occur when multiple digital assistive technologies (ATs) operate simultaneously, leading to unintended actions and conversation loops, particularly between screen readers and virtual assistants.
Innovation Solution
A curated voice assistant inhibits the audio output of a first AT, such as a screen reader, when a second AT, like a virtual assistant, is active, guiding users through tasks without interference, and restores the audio output when the second AT transitions to an inactive state.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple digital assistive technologies operate simultaneously, then users can access multiple functions, but interference and conversation loops occur between them
Solution Approach 1:
The system introduces an intermediary mechanism that detects when multiple digital assistive technologies are active and mediates their interaction by pausing one technology (e.g., screen reader) when another (e.g., virtual assistant) is in use. This prevents direct interference between the technologies while allowing both to function when needed separately.
2Loss of information
If a screen reader continuously reads content, then users with visual impairments receive audio feedback, but the virtual assistant cannot distinguish user commands from screen reader output
Solution Approach 1:
The system implements periodic action by pausing the screen reader's audio output during periods when the virtual assistant is actively listening for commands, and resuming it when the virtual assistant is not in use. This periodic interruption ensures that audio feedback is provided when needed while preventing interference with command recognition.
3Ease of operation
If the screen reader audio output is paused during virtual assistant interaction, then command recognition is accurate, but users lose audio feedback about the interface
Solution Approach 1:
The system applies dynamics by making the screen reader's audio output state changeable - it dynamically pauses during virtual assistant command recognition and resumes when the virtual assistant is inactive. This dynamic adjustment optimizes both command recognition accuracy and audio feedback provision based on the current operational context.
Data Source
AI summary
A method of operating a computing device in support of improved accessibility includes displaying a user interface to an application on a display screen of the computing device, wherein the computing device includes an accessibility assistant that reads an audible description of an element of the user interface; initiating, on the computing device, a virtual assistant that conducts an audible conversation between a user and the virtual assistant through at least a microphone and a speaker associated with the computing device, wherein the virtual assistant is not integrated with an operating system of the computing device; inhibiting an ability of the accessibility assistant to read the audible description of the element of the user interface; and upon transition of the virtual assistant from an active state, enabling the ability of the accessibility assistant.