Projected HMI with Fluid Motion Detection for Industrial Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Human-Machine Interface (HMI) systems require users to operate from a remote location and rely on physical input devices, limiting efficiency and convenience in industrial environments where machines produce status data that needs to be monitored and controlled.
Innovation Solution
A communication device projects an HMI system on a surface, allowing users to interact with machine systems using fluid motions in air, with the device detecting these inputs and transferring corresponding commands to the machines, while ensuring user authorization and proximity requirements are met.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a physical HMI device is used, then the interface provides stable control capability, but the user must operate from a remote location and use physical input devices which reduces convenience
Solution Approach 1:
The patent replaces physical mechanical input devices (mouse, keyboard, touch screen) with a fluid detection system that captures and interprets natural hand motions in air. The fluid camera detects three-dimensional fluid motions and converts them into control commands, eliminating the need for physical input devices while maintaining control functionality.
Solution Approach 2:
The patent introduces a fluid camera and processing system as an intermediary between the user's natural hand motions and the HMI control system. This intermediary captures fluid motions in the environment, processes them into meaningful commands, and transmits them to the HMI, enabling natural interaction without physical devices.
2Productivity
If a remote HMI system is used, then the interface can be accessed from distance, but the user cannot quickly access machine status and control functions at the machine location
Solution Approach 1:
The patent enables the HMI system to project its interface directly onto the machine surface, allowing users to access control functions at the machine location itself. The system serves itself by using the machine's own surface as the display medium, eliminating the need for separate remote monitoring stations and enabling immediate access to machine status and control.
Solution Approach 2:
The patent transitions the HMI from a traditional two-dimensional remote screen to a projected interface that can be displayed on the three-dimensional surface of the machine itself. This dimensional change allows the interface to be positioned exactly where the user needs it - directly on or near the machine - enabling quick access without remote equipment.
3Loss of time
If traditional HMI input methods are used, then precise command selection is achieved, but the interaction process becomes time-consuming and less efficient
Solution Approach 1:
The patent implements preliminary action by having the fluid camera continuously capture and track hand motions in advance of command selection. The system pre-processes fluid motion data and maintains readiness to interpret gestures, so when a user makes a selecting motion, the command can be immediately recognized and executed without delay for processing or device response.
Data Source
AI summary
A method of operating a communication device to interface with a machine system comprises projecting a human-machine interface (HMI) system for the machine system on a surface, wherein the HMI system comprises a plurality of commands associated with the machine system, detecting an input from a user, wherein the input comprises a fluid motion in air performed by the user corresponding to a selection of a command of the plurality of commands associated with the machine system, and transferring the selected command for delivery to the machine system.