TOF Gesture HMI for Touchless Industrial Machine Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current industrial control systems rely on a master-slave human-machine collaboration, limiting active contribution from both humans and industrial equipment, and face challenges with touch screen interfaces in harsh environments due to grime buildup and incompatibility with gloves, as well as inadequate safety zone demarcation in industrial automation environments.
Innovation Solution
A system utilizing time-of-flight sensors to detect and interpret user body movements, allowing for touchless control of industrial machinery and dynamic safety zone demarcation, enabling effective human-machine collaboration and improved safety in industrial environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch screen monitors are used in industrial environments, then user interface functionality is provided, but sensitivity deteriorates over time due to grime and detritus buildup
Solution Approach 1:
The patent extracts the interaction interface from physical contact with the screen surface. Instead of requiring direct touch on the screen, the system uses cameras and image processing to detect hand gestures and body movements in the air space in front of the display, completely eliminating the grime buildup problem that affects traditional touch screens in industrial environments.
Solution Approach 2:
The patent introduces an intermediary layer between the user and the control system. A camera-based gesture recognition system acts as a mediator, translating physical hand movements and body gestures into digital commands without requiring contact with the screen surface, thereby maintaining reliability while preserving ease of operation.
2Ease of operation
If touch screens require physical contact for manipulation, then direct control is achieved, but usage becomes hazardous in chemically corrosive environments
Solution Approach 1:
The patent removes the requirement for physical contact with the screen entirely. By using camera-based gesture recognition, operators can control the system from a safe distance, eliminating exposure to chemically corrosive environments while maintaining direct control capability through real-time gesture response.
Solution Approach 2:
The patent replaces the mechanical contact-based touch screen interface with an optical system. Cameras capture hand gestures and body movements, and image processing algorithms translate these visual inputs into control commands, substituting mechanical interaction with optical field-based interaction that eliminates chemical exposure risks.
3Measurement precision
If stylus or scribing means are used to manipulate touch screens, then precise input is achieved, but the screen surface becomes scratched and etched
Solution Approach 1:
The patent extracts the input mechanism from physical contact with the screen surface. Hand gestures performed in the air space in front of the display are captured by cameras and translated into precise digital commands, eliminating the need for styluses or scribing tools that cause screen damage while maintaining input precision through gesture recognition algorithms.
4Reliability
If traditional safety zones are demarcated in industrial environments, then safety monitoring is provided, but the zones are static and inflexible
Solution Approach 1:
The patent transforms static safety zones into dynamic, adaptive zones. The system continuously tracks operator position and gestures in real-time, allowing safety boundaries to adjust automatically based on current operational context. This enables the safety system to respond flexibly to changing conditions while maintaining reliable monitoring through continuous camera-based detection.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and safe control of industrial machinery through touchless interfaces and dynamic safety zone management, enhancing collaboration and reducing the risk of accidents in industrial settings.
Implementation Method 1
employing a time-of-flight sensor to detect movement of a body part
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods are provided for controlling industrial equipment in the performance of various industrial activities based on the detected body movement of a user in an industrial automation environment. The method includes employing a time-of-flight sensor to detect movement of a body part of the user, ascertaining whether or not the movement of the body part conforms to a recognized movement of the body part, interpreting the recognized movement of the body part as a performable action, and thereafter actuating industrial machinery to perform the performable action.