Virtual Assistant Arbitration for Multi-Device Voice Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multiple electronic devices with virtual assistants can simultaneously respond to a user input, leading to confusion and duplicative or conflicting operations due to insufficient information provided by the input for device identification and control.

Innovation Solution

A method and system that utilize a virtual assistant to identify a second user device and a media item based on an audio input, providing a command to the first user device to control the second user device and play the media item.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple electronic devices with virtual assistants concurrently respond to user inputs, then each device can independently process commands, but user confusion and duplicative operations occur

Engineering Contradiction:
Improvedevice independenceVSAvoiduser experience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a server as an intermediary between multiple electronic devices and the user. The server receives audio inputs, performs speech recognition, determines device intent, and routes commands to the appropriate device. This mediator coordinates device responses, preventing simultaneous activation and user confusion while maintaining device independence.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If user input contains insufficient information for device identification, then virtual assistant services cannot accurately control target devices, but requiring more information increases input complexity

Engineering Contradiction:
Improvedevice identification accuracyVSAvoidinput information requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by having each electronic device broadcast its identification information and capabilities before user input. The server collects this information in advance, creating a device registry. When a user provides minimal input, the server can match the input against the pre-collected device information to accurately identify the target device without requiring the user to provide detailed identification information.

Inventive Principle:
Principle #10Preliminary action

3Speed

If multiple devices simultaneously listen and prompt for additional input, then device responsiveness is high, but computational demand and battery power consumption increase

Engineering Contradiction:
Improvedevice responsivenessVSAvoidbattery power consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent extracts the speech recognition and device intent determination functions from individual electronic devices and relocates them to a centralized server. Electronic devices only need to perform lightweight audio capture and transmission, significantly reducing their computational demand and battery power consumption. The server handles the energy-intensive processing tasks, enabling fast responsiveness without draining device batteries.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP4113508B1Intelligent device arbitration and control
Publication Date: 2026.01.28 APPLE INC
  • EP4113508B1 patent drawingFigure 1
  • EP4113508B1 patent drawingFigure 2A
  • EP4113508B1 patent drawingFigure 2B

AI summary

This relates to systems and processes for using a virtual assistant to arbitrate among and/or control electronic devices. In one example process, a first electronic device samples an audio input using a microphone. The first electronic device broadcasts a first set of one or more values based on the sampled audio input. Furthermore, the first electronic device receives a second set of one or more values, which are based on the audio input, from a second electronic device. Based on the first set of one or more values and the second set of one or more values, the first electronic device determines whether to respond to the audio input or forego responding to the audio input.