Motion Recognition Control with Redundant Inputs for Industrial Safety

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional industrial automation systems are limited in safely controlling devices due to the lack of advanced monitoring and control capabilities, particularly in detecting and responding to human and object movements within the automation environment.

Innovation Solution

A range camera system integrated with a motion recognition system that detects positions and motions of persons and objects, computes confidence values, and sends control signals to industrial automation devices to ensure safe operation by interpreting detected movements and sending automation commands based on predefined libraries and secondary inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional automation control systems are used to manage device operations, then basic control functions are achieved, but safety monitoring and response capabilities are insufficient

Engineering Contradiction:
Improvesafety monitoring capabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces conventional mechanical control systems with a vision-based automated control system. A camera captures images of the control interface, and image processing algorithms automatically recognize buttons, sliders, and other controls, substituting mechanical operation with optical detection and digital processing to improve safety while maintaining control functionality

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary image processing system between the user and the automation devices. This intermediary layer captures visual information, processes it through recognition algorithms, and translates it into control commands, adding a safety monitoring layer without directly increasing the complexity of the core control system

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If automation control systems manage device operations, then operational control is achieved, but real-time motion detection and response capability is limited

Engineering Contradiction:
Improveresponse speedVSAvoidmotion detection capability
Core Design Contradiction:
SpeedVSDifficulty of detecting and measuring

Solution Approach 1:

The patent performs preliminary actions by continuously capturing images and pre-processing visual data in real-time. The system maintains a ready state where images are continuously acquired and pre-analyzed, so when motion or control actions occur, the system can respond immediately without delay for data acquisition or initial processing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes mechanical motion detection sensors with vision-based detection. The camera system captures visual information and uses image processing algorithms to detect motion, gestures, and control interactions, providing real-time detection capability without requiring physical contact or specialized mechanical sensors

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If traditional control interfaces are used, then basic operation is achieved, but safety precautions and hazard prevention are insufficient

Engineering Contradiction:
Improvesafety precaution capabilityVSAvoidcontrol system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements feedback by continuously monitoring the control interface through image capture and analysis. The system provides real-time feedback on control states, user actions, and potential hazards, allowing for dynamic safety adjustments and automated responses based on the current operational context

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent enables self-service safety monitoring where the control system automatically detects hazards, validates control actions, and prevents unsafe operations without requiring external safety systems. The image processing system autonomously analyzes the control interface and user actions to enforce safety protocols

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP2772812B1Recognition-based industrial automation control with redundant system input support
Publication Date: 2022.03.30 ROCKWELL AUTOMATION TECH INC
  • EP2772812B1 patent drawingFigure 1
  • EP2772812B1 patent drawingFigure 2
  • EP2772812B1 patent drawingFigure 3

AI summary

The present disclosure generally relates to a method for performing industrial automation control in an industrial automation system. The method may include detecting, via a sensor system, positions and/or motions of a human. The method may then determine a possible automation command corresponding to the detected positions and/or motions, receive an automation system signal from at least one additional control component, and implement a control and/or notification action based upon the determined possible automation command and the received automation system signal.