Multi-tiered Voice Command Processing for Low Latency Safety

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Voice-activated audio processing systems face challenges in prioritizing and timely detection of commands, especially for safety-critical and complex robot functions, due to reliance on network connectivity and varying processing times for different command types.

Innovation Solution

Implementing a multi-tiered audio processing system that uses local hardware and speech models for base commands (e.g., safety features) and remote systems for core and application-specific commands, allowing for prioritization and efficient detection of voice commands with low latency for critical actions while enabling fine-tuning and extensibility through remote server systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system uses a single unified command processing approach relying on network services, then it can detect complex robot functions and application-specific commands, but it cannot guarantee timely detection of safety-critical commands and requires network connectivity

Engineering Contradiction:
Improvecommand detection reliabilityVSAvoidcommand detection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the command processing system into two distinct tiers: a local processing tier for safety-critical base commands and a remote processing tier for complex core commands. This segmentation allows safety commands to be processed locally with guaranteed low latency and high reliability, while complex commands utilize remote resources when appropriate.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a command routing intermediary that directs different types of commands to appropriate processing tiers. This intermediary layer manages the division of labor between local and remote systems, ensuring that safety-critical commands are always handled locally while allowing complex commands to leverage remote capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the system processes all commands through remote server systems, then it enables fine-tuning and extensibility, but it increases latency and reduces availability when network connectivity is lost

Engineering Contradiction:
Improvecommand recognition flexibilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent implements local quality by equipping the robot with a dedicated local speech recognition system optimized for base commands. This local processing capability ensures that safety-critical commands are recognized immediately without network dependency, while the system can still leverage remote servers for more complex recognition tasks when appropriate.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary action by pre-configuring the local speech recognition system with essential base command models before operation. This allows the system to immediately process safety-critical commands without needing to establish network connectivity or consult remote servers, ensuring rapid response times.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the system prioritizes safety commands over application commands, then it ensures timely safety response, but it may delay processing of application-specific commands

Engineering Contradiction:
Improvesafety command detectionVSAvoidapplication command processing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments command processing into priority-based tiers where base safety commands are handled by a dedicated local system with guaranteed response times, while application commands are processed separately. This segmentation ensures safety commands receive immediate attention without blocking application command processing channels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent maintains continuity of useful action by allowing both local and remote processing to operate concurrently and independently. While local processing ensures continuous safety monitoring, remote processing continues to handle application commands without interruption, maintaining overall system productivity.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10896675B1Multi-tiered command processing
Publication Date: 2021.01.19 GDM HOLDING LLC
  • US10896675B1 patent drawing
  • US10896675B1 patent drawing
  • US10896675B1 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs stored on computer storage devices, for multi-tiered command processing are disclosed. One of the methods includes operating an audio processing system to detect voice commands in a set of first commands controlling behavior of the robot and in a set of second commands controlling behavior of the robot, wherein the system detects commands in the set of first commands using a local recognition model that does not require communication over a network, and detects commands in the set of second commands with a server over a network; executing one or more applications to respond to commands in a set of application commands that include commands different from the first commands and second commands; and detecting and carrying out commands, according to a predetermined hierarchy that prioritizes detection of the first commands first, the second commands second, and the application commands third.