Speaker ID Echo Detection in Video Conferencing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video conferencing systems face challenges with acoustic echo effects, such as 'double join' and 'playback' echoes, due to interface constraints of networked devices, which are not effectively addressed by current echo cancellation solutions, leading to disrupted conference experiences and increased costs.

Innovation Solution

A method using talker ID values generated from audio speech signals to detect and mitigate acoustic echo effects by selectively muting audio devices at network devices where duplicate talker ID values are detected, employing a centralized or decentralized audio mixer architecture to identify and address 'double join' and 'playback' echo events.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing echo cancellation algorithms are used at each networked device, then some acoustic echo effects are mitigated, but the system fails to provide robust protection against 'double join' and 'playback' echo effects, and cannot diagnose echo canceller failures

Engineering Contradiction:
Improveecho cancellation effectivenessVSAvoidprotection against different echo types
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system segments the echo detection and cancellation function into two parts: (1) local echo cancellers at each networked device that handle basic playback echo, and (2) a centralized server-based detection system that identifies duplicate talker IDs across multiple devices to detect double-join and playback echo scenarios. This segmentation allows each component to specialize in specific echo types while the system as a whole provides comprehensive protection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary detection layer at the server level that monitors talker ID values from multiple networked devices. This intermediary detects duplicate talker IDs that indicate echo problems and coordinates appropriate responses, such as muting specific devices. This intermediary enables the system to handle complex echo scenarios that individual device-level echo cancellers cannot detect or resolve alone.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If manual intervention is required to diagnose and mitigate echo effects, then echo cancellation can be addressed, but user productivity is reduced and meeting flow is interrupted

Engineering Contradiction:
Improveecho effect mitigationVSAvoidmeeting flow continuity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system implements self-service automation where the server automatically detects duplicate talker IDs indicating echo problems, identifies the affected networked devices, and mutes them without requiring user intervention. The system can also automatically unmute devices when echo conditions resolve. This automation eliminates manual diagnosis and mitigation steps, maintaining meeting flow continuity while reliably addressing echo effects.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system establishes a feedback loop where the server continuously monitors talker ID values from all networked devices, detects duplicates that indicate echo, and automatically adjusts device muting status. This closed-loop feedback system enables real-time detection and response to echo conditions, eliminating the need for manual intervention and maintaining uninterrupted meeting flow.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If multiple networked devices are connected in a distributed network, then conferencing flexibility is improved, but acoustic echo effects are exacerbated due to separate microphones and loudspeakers at each device

Engineering Contradiction:
Improveconferencing system flexibilityVSAvoidacoustic echo effects
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The system implements a universal server-based detection mechanism that works across all networked devices regardless of their specific configurations. The server collects and analyzes talker ID values from any number of distributed devices, enabling consistent echo detection and mitigation across the entire distributed network. This universal approach allows the system to maintain flexibility in device connectivity while providing standardized protection against echo effects from any device combination.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12069113B2Speaker identification-based echo detection and solution
Publication Date: 2024.08.20 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US12069113B2 patent drawing
  • US12069113B2 patent drawing
  • US12069113B2 patent drawing

AI summary

A video conference call control system is provided with an audio mixer to receive an audio speech signal at one or more network devices connected to the video conference call; to generate first and second talker identification values from the audio speech signal; to compare the first and second talker identification values during a timing comparison window to determine if the first and second talker identification values are identical and received simultaneously or substantially contemporaneously; and to selectively mute one or more audio devices at the network device(s) if the first and second talker identification values are identical and received simultaneously or substantially contemporaneously so that microphone input signals to the audio mixer are muted to prevent “playback” echo effects and so that microphone input and audio loudspeaker output signals to the audio mixer are muted to prevent “double join” echo effects.