Multi-Device Hotword Detection Using Loudness-Based Response Delay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In a speech-enabled environment, distinguishing user utterances intended for the system from background noise and unintended speech directed at individuals present in the environment is challenging, necessitating a method to accurately identify and respond to hotwords.

Innovation Solution

A protocol using loudness scores and delay calculations among multiple computing devices to determine which device should process audio data following a detected hotword, ensuring only the nearest device responds, thereby reducing unnecessary processing and latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple computing devices monitor for hotwords simultaneously, then the system can respond from any location in the environment, but multiple devices may process the same utterance causing redundant processing and increased latency

Engineering Contradiction:
Improvespatial flexibilityVSAvoidprocessing latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

Each computing device calculates a delay value based on its loudness score before actually processing the hotword utterance. This preliminary delay calculation ensures that only the nearest device (with highest loudness score) will process the utterance first, while other devices are already delayed and will not process it. This resolves the contradiction by maintaining spatial flexibility through multiple monitoring devices while eliminating redundant processing and reducing latency through pre-calculated delays.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If all computing devices process every detected hotword, then no utterance is missed, but system resources are wasted on redundant processing

Engineering Contradiction:
Improveutterance detection reliabilityVSAvoidprocessing energy
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent implements local quality by making each computing device's processing behavior dependent on its local loudness score relative to other devices. The device with the highest loudness score (nearest to the user) processes the utterance, while other devices with lower scores are suppressed through delay mechanisms. This ensures reliable utterance detection by the most appropriate device while conserving energy by preventing redundant processing across all devices.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If the system uses a network of distributed microphones throughout the environment, then users can query from anywhere, but the system must distinguish intended utterances from background noise and unintended speech

Engineering Contradiction:
Improveenvironmental coverageVSAvoidutterance discrimination difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent changes the parameter of loudness score to discriminate between intended and unintended utterances. By calculating loudness scores for each device and using these scores to determine processing priority, the system can distinguish user-directed hotwords from background noise and unintended speech. The delay mechanism uses these parameter changes to ensure only the device with the highest loudness score processes the utterance, resolving the contradiction between environmental coverage and utterance discrimination.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250363991A1Hotword detection on multiple devices
Publication Date: 2025.11.27 GOOGLE LLC
  • US20250363991A1 patent drawing
  • US20250363991A1 patent drawing
  • US20250363991A1 patent drawing

AI summary

A method includes receiving an audio input that represents an utterance of a voice command that is preceded by a predefined hotword. The first computing device is configured to process voice commands that are preceded by the predefined hotword and is in proximity of a second computing device that is also configured to process voice commands that are preceded by the same, predefined hotword. The method also includes receiving a local area wireless signal from the second computing device. Based on receiving the local area wireless signal from the second computing device, the method also includes placing the first computing device into a sleep mode, bypassing further processing of the voice command, and bypassing outputting a visual indication that the first computing device is processing the voice command.