Industrial Voice Assistant for Asynchronous Machine Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing industrial machine interfaces do not allow users to input additional commands while a process is executing, requiring extensive training and manual effort, limiting the ability to control multiple machines simultaneously and monitor status information without visual attention.

Innovation Solution

An intelligent industrial assistant that receives natural language inputs to control industrial machines, allowing users to provide commands and queries asynchronously, with context-based responses and event-driven interruptions, enabling hands-free operation and universal control across different machines.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a physical interface (keyboard, keypad) is used to control industrial machines, then direct control of machine processes is achieved, but the controller cannot receive additional commands while a process is executing

Engineering Contradiction:
Improveability to input commandsVSAvoidability to handle multiple commands
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

A virtual assistant acts as an intermediary between the user and the industrial machine controller. The virtual assistant receives and processes natural language commands, then translates them into machine-executable instructions, allowing users to input commands asynchronously without blocking the controller's ability to execute ongoing processes

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical physical interfaces (keyboards, keypads) with a voice-based natural language interface. This substitution allows users to issue multiple commands through speech without physical manipulation, enabling concurrent command input while processes are executing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If traditional physical interfaces are used for machine control, then direct machine control is achieved, but extensive training time and manual effort are required

Engineering Contradiction:
Improveease of machine controlVSAvoidtraining time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces complex mechanical interface interactions (multiple key strokes, clicks) with natural language voice commands. This reduces the learning curve and training time required, as users can communicate with machines using everyday language rather than memorizing interface-specific commands

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The virtual assistant system handles command interpretation and translation automatically, reducing the manual effort required from users. The system adapts to user input patterns and provides contextual understanding, minimizing the need for extensive training on specific interface operations

Inventive Principle:
Principle #25Self-service

3Loss of information

If visual displays (screen, indicator lights) are used to show machine status, then status information is provided, but users cannot monitor status without visual attention

Engineering Contradiction:
Improveaccess to status informationVSAvoidability to monitor while doing other tasks
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent replaces visual display monitoring with voice-based queries. Users can ask the virtual assistant for machine status information through natural language questions, and receive verbal responses. This allows monitoring of multiple machines simultaneously without requiring visual attention or being physically present at each machine

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The virtual assistant serves as an intermediary that retrieves and communicates machine status information verbally. This allows users to obtain status updates from multiple machines through voice commands without needing to visually inspect each machine's display or indicator lights

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If users need to control multiple separate machines, then comprehensive control is achieved, but users must separately learn each machine's interface

Engineering Contradiction:
Improveability to control multiple machinesVSAvoidnumber of interfaces to learn
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The virtual assistant provides a universal interface that works across multiple different industrial machines. Instead of requiring users to learn each machine's specific physical interface, the single voice-based system handles commands for multiple machines using consistent natural language patterns, making the system adaptable to various machine types without increasing learning complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11651034B2Method, system, and computer program product for communication with an intelligent industrial assistant and industrial machine
Publication Date: 2023.05.16 IT SPEEX LLC
  • US11651034B2 patent drawing
  • US11651034B2 patent drawing
  • US11651034B2 patent drawing

AI summary

Provided is a method for communication with an intelligent industrial assistant and industrial machine. The method may include receiving a first natural language input from a user. The first natural language input may be associated with a first command for an industrial machine to perform a first process. The industrial machine may be instructed to perform the first process based on the first natural language input. A second natural language input may be received from the user while the industrial machine is performing the first process. A first response may be determined based on the second natural language input. Communication of the first response to the user may be initiated while the industrial machine is performing the first process. A system and computer program product are also disclosed.