Audio Command Recognition With Orientation for Remote Machine Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Industrial automation systems face limitations in controlling devices remotely and efficiently, particularly in ensuring robustness, reliability, and accuracy, especially when operators need to manage operations from a distance or in hazardous environments.

Innovation Solution

An audio device is integrated into the industrial automation system to detect audio data from users and machines, determining orientation and automation commands based on the audio data, allowing for remote control of machines and improved workplace safety through verbal commands, with features like beamforming and triangulation to accurately direct commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional automation control systems are used to manage devices, then basic control functions are achieved, but remote control capability and operational safety are limited

Engineering Contradiction:
Improveremote control capabilityVSAvoidoperational safety
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces traditional mechanical control interfaces (buttons, switches, physical panels) with voice-based acoustic control. The audio device captures verbal commands from operators, processes them through signal filtering and pattern recognition, and translates them into control signals for industrial machines. This substitution enables remote operation without physical contact with control panels, improving both ease of operation and safety in hazardous environments.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If audio-based control is implemented, then remote operation and safety are improved, but system complexity increases

Engineering Contradiction:
Improveremote operation capabilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an audio device as an intermediary component between the operator and the industrial control system. This intermediary captures voice commands, performs signal processing (bandpass filtering, noise reduction), and interfaces with the existing PLC or control system through standard communication protocols. By placing the complexity in a dedicated intermediary device rather than dispersing it throughout the control system, the overall system complexity is managed while maintaining remote operation capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The control system is segmented into distinct functional modules: audio capture module, signal processing module (with bandpass filters and noise reduction), command recognition module, and control signal generation module. This segmentation allows each component to be optimized independently and facilitates troubleshooting and maintenance without requiring system-wide changes.

Inventive Principle:
Principle #1Segmentation

3Productivity

If voice commands are used for control, then operational efficiency is improved, but command accuracy and reliability may deteriorate due to noise interference

Engineering Contradiction:
Improveoperational efficiencyVSAvoidcommand recognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies different signal processing qualities to different frequency ranges. Bandpass filters are configured with specific frequency ranges (e.g., 85-255 Hz for low frequencies, 255-510 Hz for mid frequencies, 510-1020 Hz for high frequencies) to selectively enhance voice command frequencies while attenuating industrial noise frequencies. This local quality adjustment ensures that voice commands are accurately recognized even in noisy industrial environments, maintaining both productivity and accuracy.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11360460B2Audio recognition-based industrial automation control
Publication Date: 2022.06.14 ROCKWELL AUTOMATION TECH INC
  • US11360460B2 patent drawing
  • US11360460B2 patent drawing
  • US11360460B2 patent drawing

AI summary

A system for performing industrial automation control may include an audio device that receives audio data from an element in an industrial automation system. The audio device may determine orientation data based on the audio data. In addition, the audio device may determine an automation command to control a machine in the industrial automation system based on the audio data and the orientation data. After determining the automation command, the audio device may implement a first control action for the machine based at least in part on the automation command, where the first control action causes the machine to adjust an operation.