Audio Switching for Visually Impaired Conference Participants

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional online conference systems lack adequate accessibility options for participants with visual impairments, making it difficult for them to consume multimedia content in real-time, as they often rely on manual navigation between audio and visual streams, which can be confusing and frustrating.

Innovation Solution

A conferencing system that generates voice-over content from presentation materials, allowing seamless switching between a presenter's audio and voice-over audio descriptions of visual content, synchronized with presentation segments, using techniques like Job Access With Speech (JAWS) and NonVisual Desktop Access (NVDA), enabling participants to easily access and navigate multimedia content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual navigation between audio and visual streams is provided, then participants can access both audio content and visual content, but participants with visual impairments experience confusion and frustration due to lack of accessibility options

Engineering Contradiction:
ImproveAccessibility for visually impaired participantsVSAvoidUnderstanding of visual content
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces voice-over content as an intermediary that describes visual content in audio form. Screen reading techniques and systems (JAWS, NVDA) convert visual presentation content into spoken descriptions, allowing visually impaired participants to understand visual content through audio without directly accessing the visual stream themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent divides presentation content into discrete presentation segments and divides both audio content and voice-over content into corresponding segments. This segmentation allows participants to switch between audio and voice-over segments at meaningful boundaries (slides, topics, or time-based divisions), making navigation manageable and understandable rather than overwhelming.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If switching between audio segment and voice-over segment is enabled, then participants can cross-reference content and understand both presenter's speech and visual content descriptions, but system complexity increases

Engineering Contradiction:
ImproveAudio switching capabilityVSAvoidConferencing system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The conferencing system is designed to handle multiple content types (audio content, voice-over content, presentation segments) through a unified switching mechanism. The same infrastructure that manages audio-visual switching is extended to manage audio-voice-over switching, avoiding the need for separate complex systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Voice-over content is generated and segmented in advance alongside audio content and presentation content. All content is prepared and synchronized before the online conference begins, with segments pre-matched to corresponding presentation segments. This preliminary preparation reduces real-time processing complexity during the actual conference.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If voice-over content is generated from presentation content using screen reading techniques, then visually impaired participants can access visual content descriptions, but processing time and computational resources increase

Engineering Contradiction:
ImproveVisual content accessibilityVSAvoidContent processing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

Voice-over content is generated and segmented in advance alongside audio content and presentation content. All content is prepared and synchronized before the online conference begins, with segments pre-matched to corresponding presentation segments. This preliminary preparation reduces real-time processing complexity during the actual conference.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If presentation content is divided into segments and synchronized with audio and voice-over content, then participants can navigate content efficiently, but system complexity and processing requirements increase

Engineering Contradiction:
ImproveContent consumption efficiencyVSAvoidSegmentation and synchronization system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides presentation content into discrete presentation segments and divides both audio content and voice-over content into corresponding segments. This segmentation allows participants to switch between audio and voice-over segments at meaningful boundaries (slides, topics, or time-based divisions), making navigation manageable and understandable rather than overwhelming.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines presentation segments, audio segments, and voice-over segments into synchronized groups where each group contains corresponding content from all three sources. This merging creates unified content packages that can be switched as complete units, simplifying the switching mechanism rather than requiring independent control of multiple separate streams.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides an immersive and accessible experience for visually impaired participants, allowing them to seamlessly switch between audio and voice-over content, enhancing their ability to consume online conference material without additional costs or complexity for presenters, and aligns with disability regulations.

Implementation Method 1

The conferencing system generates voice-over content from the presentation content by converting text of the presentation content to audio

Methodology Applied
Scientific EffectText-to-speech conversion:

Data Source

PatentUS11064000B2Accessible audio switching for client devices in an online conference
Publication Date: 2021.07.13 ADOBE INC
  • US11064000B2 patent drawing
  • US11064000B2 patent drawing
  • US11064000B2 patent drawing

AI summary

Techniques and systems are described for accessible audio switching options during the online conference. For example, a conferencing system receives presentation content and audio content as part of the online conference from a client device. The conferencing system generates voice-over content from the presentation content by converting text of the presentation content to audio. The conferencing system then divides the presentation content into presentation segments. The conferencing system also divides the audio content into audio segments that correspond to respective presentation segments, and the voice-over content into voice-over segments that correspond to respective presentation segments. As the online conference is output, the conferencing system enables switching between a corresponding audio segment and voice-over segment during output of a respective presentation segment.