Virtual Conference Audio Alignment for Hybrid Event Listening Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing assistive listening systems for on-site participants with impaired hearing in hybrid events are limited by short range, radio interference, and require significant hardware investment, failing to provide high-quality audio outside the looped area.
Innovation Solution
A virtual conference application installed on personal devices dynamically aligns audio streams from both the virtual session and the on-site event, using latency adjustment and location-based alignment to ensure time-synchronized audio delivery to assistive listening devices via Bluetooth or wired connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If traditional inductive loop systems are used for assistive listening, then hearing assistance is provided within the looped area, but the range is limited and audio quality deteriorates outside the looped area
Solution Approach 1:
The patent replaces traditional hardware-based assistive listening systems (inductive loop systems, FM systems) with a software-based solution running on mobile devices. The virtual conference application uses the device's microphone to capture audio directly from the source, processes it through latency adjustment and noise filtering algorithms, and outputs to the device's speaker or connected headphones, eliminating the need for physical loop installations and expanding coverage to anywhere within audio range of the source.
Solution Approach 2:
The patent introduces a software intermediary (the virtual conference application) between the audio source and the hearing-impaired participant. This application acts as a mediator that captures audio via the device's microphone, processes it through latency adjustment and noise filtering, and delivers it to the participant's device, bridging the gap between the audio source and the participant without requiring traditional assistive listening infrastructure.
2Reliability
If FM systems are used for assistive listening, then audio transmission is achieved, but radio interference and interception occur
Solution Approach 1:
The patent replaces radio-based audio transmission (FM systems) with direct digital audio processing on the participant's device. Instead of transmitting audio signals through radio waves that are susceptible to interference and interception, the system captures audio locally via the device's microphone and processes it digitally, eliminating radio frequency vulnerabilities entirely.
3Reliability
If traditional assistive listening systems are deployed, then hearing assistance is provided, but significant hardware investment and installation are required
Solution Approach 1:
The patent enables each participant's personal device to serve itself as an assistive listening device. The virtual conference application utilizes the device's existing microphone, processor, and speaker/headphone output to capture, process, and deliver audio independently, without requiring external hardware infrastructure. This self-service approach eliminates the need for organization-sponsored hardware installations while providing reliable hearing assistance.
Solution Approach 2:
The patent transforms personal mobile devices into multi-functional tools that simultaneously serve as communication devices, recording devices, and assistive listening devices. The virtual conference application leverages the device's existing capabilities (microphone, processor, speaker) to provide hearing assistance, making the participant's personal device universally useful across multiple functions without requiring dedicated assistive listening hardware.
4Speed
If audio streams are delivered without latency adjustment, then real-time delivery is achieved, but audio from virtual session and on-site event become misaligned
Solution Approach 1:
The patent applies preliminary latency adjustment to the virtual session audio stream before delivering it to the participant. The system calculates the expected latency based on the participant's location and distance from the audio source, then pre-delays the virtual session audio by this calculated amount. This preliminary action ensures that both the on-site audio (captured in real-time) and virtual session audio arrive at the participant's ears simultaneously, maintaining synchronization without compromising real-time delivery.
Data Source
AI summary
Example methods and systems provide listening assistance via a virtual conference application for hybrid events. A client device joins a virtual session of an on-site event via the virtual conference application provided by a virtual conference provider. The virtual conference application receives a first audio signal of the virtual session and a second audio signal directly from the audio source at the on-site event. The virtual conference application determines the second audio signal has a latency in reference to the first audio signal satisfying a threshold value. The virtual conference application delays the first audio signal to create a delayed first audio signal to substantially align in time with the second audio signal at the client device. The client device then transmits the delayed first audio signal to an assistive listening device.