Gesture-Based Power Controller HMI for Glove-Safe Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional touchscreen-based power control devices are inaccessible when users wear insulating gloves, and multi-device configurations make it difficult to quickly identify which devices are in a warning or alert state, requiring closer inspection and delaying response times.
Innovation Solution
The power controller device incorporates exterior lighting and visual sensors to indicate operating status, authenticate users through gestures, and allow command input via touchscreen or gesture recognition, enabling interaction without removing gloves and providing clear, at-a-glance status indication across multiple devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a capacitive touchscreen interface is used for power controller devices, then the device provides touch-sensitive control capability, but users wearing insulating gloves cannot interact with the touchscreen
Solution Approach 1:
The patent introduces an intermediary optical system consisting of cameras and gesture recognition software that mediates between the user and the device. Instead of direct capacitive contact, the system captures optical images of hand gestures and translates them into control commands, enabling glove-compatible interaction while maintaining touchscreen functionality for those who don't wear gloves
Solution Approach 2:
The patent replaces the mechanical/electrical capacitive touch system with an optical recognition system. Cameras capture visual information about hand gestures, and image processing algorithms convert these visual patterns into control signals, substituting the direct electrical contact mechanism with an optical field-based interaction method
2Reliability
If multiple power controller devices are deployed in a facility, then comprehensive power monitoring is achieved, but it becomes difficult to quickly identify which devices are in warning or alert states
Solution Approach 1:
The patent employs color-coded LED indicators that change color (e.g., green for normal, yellow for warning, red for alert) to provide immediate visual identification of device status. This allows operators to scan multiple devices and quickly locate critical ones without needing to read detailed displays or perform closer inspections, significantly reducing response time while maintaining comprehensive monitoring
3Loss of information
If conventional touchscreen interfaces are used, then device status can be displayed, but users must remove protective gloves to provide control input
Solution Approach 1:
The patent creates a universal control system that accepts multiple input modalities: traditional touchscreen input for bare-handed users, and gesture recognition for glove-wearing users. The system automatically detects the input method being used and processes both types of commands, making the interface universally accessible to all users regardless of whether they wear protective gloves
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to interact with power controller devices while wearing protective gloves and quickly identify critical devices, improving response times and accessibility by using gesture-based authentication and color-coded lighting for status indication.
Implementation Method 1
The device includes cameras and/or visual sensors for detecting when a user enters a proximity zone adjacent to or near the HMI
Implementation Method 2
Lighting elements in the exterior housing may illuminate based on the operating status (e.g., color-coded) and may blink while in sleep mode
Data Source
AI summary
An intelligent graphic human/machine interface unit (GHMI) for a power controller device detects, via visual sensors, a user proximate to the device and transitions from “sleep” to “command” mode. When in “command” mode, a user may authenticate themselves to the device, and provide (e.g., in “active” mode) control input for executing device functions, either via a touchscreen display of the GHMI unit or via unlock and command gestures manually performed by the user, detected by the visual sensors, and decoded by the GHMI controller. Command gestures may be mapped to specific control functions and/or command sequences commonly executed by the power controller device. By allowing a user to provide authentication and control input via signed gestures, a user wearing protective gloves or other protective gear precluding use of a capacitive touchscreen may interact with, monitor, or manage the power controller device normally.