Locale-Based Audio Mixing for Full Duplex Conferencing Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional VoIP conferencing systems fail to support multiple active devices at the same physical location, leading to audio feedback, desynchronization of microphone signals, and ineffective Acoustic Echo Cancellation, resulting in a poor conference experience for participants both locally and remotely.

Innovation Solution

A cloud-based video/audio conferencing system employs an audio client aggregation node to synchronize and align microphone and speaker audio signals, allowing multiple devices at the same locale to connect by organizing full duplex media streams and eliminating feedback through locale-based audio mixing and synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple devices are allowed to be active at the same physical location, then the conference experience for participants is improved, but audio feedback occurs due to microphone signals being played back through speakers and captured again

Engineering Contradiction:
Improvenumber of active devices per localeVSAvoidaudio feedback
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The system segments audio processing by creating locale-based audio mixes that are separate from connection-based mixes. Each locale receives a customized audio mix that excludes microphone signals from other devices within the same locale, preventing feedback loops while maintaining audio quality for remote participants.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The conferencing system acts as an intermediary that identifies when multiple connections share the same physical locale and applies locale-based mixing rules. The system mediates between the need for multiple active devices and the prevention of audio feedback by selectively excluding certain microphone signals from specific speaker outputs based on locale information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If each participant uses their own device with individual microphone and speakers, then audio quality for each participant is improved, but Acoustic Echo Cancellation becomes ineffective due to desynchronized audio signals

Engineering Contradiction:
Improveaudio quality per participantVSAvoidAcoustic Echo Cancellation effectiveness
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The system merges microphone signals from multiple devices within the same locale into a single synchronized locale-based audio mix. By combining and synchronizing these signals at the locale level rather than maintaining separate connection-based streams, the system ensures that all devices in the locale receive synchronized audio, enabling effective Acoustic Echo Cancellation while maintaining individual device audio quality.

Inventive Principle:
Principle #5Merging (Combining)

3Device complexity

If conventional per-connection audio mixing is used, then system simplicity is maintained, but the conference experience degrades as more participants share the same physical location

Engineering Contradiction:
Improveaudio mixing system complexityVSAvoidconference experience quality
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system dynamically adjusts audio mixing behavior based on locale information. When multiple connections are detected in the same locale, the system automatically switches from conventional per-connection mixing to locale-based mixing that excludes local microphone signals. This dynamic adaptation allows the system to maintain simplicity for standard cases while providing enhanced experience quality when multiple devices are present in the same location.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10728394B1Dynamic locale based aggregation of full duplex media streams
Publication Date: 2020.07.28 AMAZON TECH INC
  • US10728394B1 patent drawing
  • US10728394B1 patent drawing
  • US10728394B1 patent drawing

AI summary

A cloud-based video/audio conferencing system and method performs locale based aggregation of a full duplex media stream to organize multiple connections to a conference call that originate from the same physical location or a shared locale. The cloud-based video/audio conferencing system performs synchronization of the microphone and speaker audio signals of the same-locale connections. In this manner, a conference call may be held with multiple user devices making connections from the same physical location. User experience is enhanced by allowing each user in the same location to use his/her own individual devices to connect to the same conference call.