Customized Audio Mixing for Virtual Conference Calls

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual conference calls, the audio mix becomes muddled when there are many participants, and different participants' audio data may have varying levels of importance to users, leading to an unsuitable audio experience.

Innovation Solution

A virtual conference system generates customized audio mixes for each user based on user profiles that include sound parameters such as volume adjustments, spatialization, and voice transformations, allowing users to control audio focus through user input or programmatically determined settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio data from all participants is mixed and transmitted to all users, then users can communicate naturally like being physically present, but the audio mix becomes muddled when there are many participants

Engineering Contradiction:
Improvenatural communication experienceVSAvoidaudio clarity
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system applies different audio processing parameters to different participants based on their spatial location and importance. Each participant's audio data is processed with customized parameters (volume, spatialization, panning) rather than uniform processing, allowing important speakers to be highlighted while maintaining natural communication for less critical participants.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The audio mix is segmented into multiple channels, each corresponding to a specific participant or group of participants. This allows independent processing and control of each participant's audio characteristics, enabling the system to maintain clarity by separating important audio sources from background noise.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If uniform audio mix is provided to all users, then system complexity is reduced, but different participants' audio data have different levels of importance to users which requires customized audio focus

Engineering Contradiction:
Improveaudio mixing systemVSAvoidaudio focus customization
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

Audio focus parameters are pre-configured in user profiles before the conference call begins. The system stores customized audio parameters for each participant in each user's profile, so when the call starts, the mixing system can immediately apply the appropriate parameters without real-time complex processing decisions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A server acts as an intermediary that manages user profiles and audio parameters. The server stores pre-configured audio focus settings for each user-participant combination and distributes the appropriate parameters to users during the conference, offloading the complexity from individual user devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If audio parameters are adjusted for each participant individually, then audio focus and clarity are improved, but processing time and computational resources increase

Engineering Contradiction:
Improveaudio mix qualityVSAvoidaudio processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Audio parameters for each participant are determined and stored in advance in user profiles. During the conference call, the system simply retrieves and applies these pre-determined parameters rather than calculating them in real-time, significantly reducing processing time while maintaining high audio mix quality.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11563855B1Customized audio mixing for users in virtual conference calls
Publication Date: 2023.01.24 META PLATFORMS TECHNOLOGIES LLC
  • US11563855B1 patent drawing
  • US11563855B1 patent drawing
  • US11563855B1 patent drawing

AI summary

A system controls the audio focus for a user in a virtual conference call. The system retrieves sound parameters associated with participants in the virtual conference call with the user from a user profile of the user. The sound parameters define volume adjustments to be applied to audio data received from the participants for generating an audio mix customized to the user. The system receives the audio data from client devices of the participants, and for each of the participants, adjusts the audio data of the participant using the associated sound parameter of the participant. The system adds the adjusted audio data of the participants to the audio mix for the user and provides the audio mix to a client device of the user.