Dominant Speaker Latency Reduction via Asynchronous Forwarding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Voice conferencing systems experience significant latency due to the transport of audio signals through central servers, leading to delays and inefficiencies in communication, especially when multiple parties are involved, which can exceed critical thresholds and impact the quality of communication.

Innovation Solution

A digital media system that identifies a dominant user and prioritizes their data for asynchronous forwarding, while mixing synchronous data from other users to create a real-time superposition effect, allowing for reduced latency by minimizing server hops and using intelligent packet routing based on network conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If digital data from all end points is handled synchronously through central servers, then bandwidth efficiency and system management are improved, but latency increases significantly

Engineering Contradiction:
ImprovelatencyVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system segments the handling of digital data by identifying a dominant endpoint and separating its data stream from other endpoint streams. The dominant endpoint's data is forwarded asynchronously through fewer server hops, while other endpoints' data continues to be mixed synchronously. This segmentation resolves the contradiction by reducing latency for critical data without completely reconfiguring the centralized mixing architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the handling of data streams based on real-time identification of the dominant endpoint. The server transitions from purely synchronous mixing to a hybrid mode where the dominant endpoint's data receives asynchronous fast-tracking. This dynamic adaptation allows the system to optimize latency performance without permanently increasing complexity.

Inventive Principle:
Principle #15Dynamics

2Loss of time

If asynchronous forwarding is used for dominant endpoint data, then latency is reduced, but system complexity and packet handling complexity increase

Engineering Contradiction:
Improvemouth-to-ear delayVSAvoidpacket handling complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system applies different quality levels of service to different data streams based on their source. The dominant endpoint's data receives preferential asynchronous handling with reduced server hops, while other endpoints' data maintains standard synchronous mixing. This local differentiation reduces overall latency without requiring complete system reconfiguration.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The server acts as an intermediary that intelligently routes data from the dominant endpoint through fewer server hops while maintaining the centralized mixing architecture for other endpoints. This intermediary function reduces latency for critical data without completely abandoning the centralized management model.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If more server hops are used for robustness to network jitter, then reliability is improved, but latency increases

Engineering Contradiction:
Improverobustness to network jitterVSAvoidsystem delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system applies partial asynchronous forwarding only to the dominant endpoint's data rather than all data streams. This partial action provides sufficient robustness for critical communication while minimizing the number of server hops and reducing latency. The dominant endpoint's data gets preferential treatment without requiring full redundancy for all streams.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9426087B2Reduced system latency for dominant speaker
Publication Date: 2016.08.23 DOLBY LABORATORIES LICENSING CORP
  • US9426087B2 patent drawing
  • US9426087B2 patent drawing
  • US9426087B2 patent drawing

AI summary

Digital media communication systems and methods are disclosed in which a set of end points and/or clients are in communication with a set of servers. The system is capable of determining which end point is a dominant user and/or speaker. When the system determines that an end point is dominant, then the digital data that emanates from dominant end point is preferred. Such preferred digital data may be forwarded asynchronously and possible ahead of digital data from other, non-dominant end points. Synchronous and/or substantially contemporaneous digital data from other end points may be mixed that such that, when rendered, gives substantially the same effect real life superposition of signals. The system may also toggle on or off between states of asynchronous forward and synchronous-only modes.