3D Human-Machine Interface Gesture Command Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-machine interfaces (HMIs) with three-dimensional measurement capabilities are limited in their command selection methods, as they remain essentially two-dimensional, relying on plane-based detection methods such as mouse cursor movements for selecting objects, failing to fully utilize the three-dimensional aspect for interaction.
Innovation Solution
A method and device for selecting commands in a three-dimensional human-machine interface that utilizes distance and position data from sensors to determine the display mode of symbols, allowing for true three-dimensional interaction by varying the display based on capacitive interactions and light intensity measurements, enabling selection and execution of commands through gestures and proximity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If three-dimensional measurement capabilities are added to the interface, then the ability to detect objects remotely and measure position in space is improved, but the command selection method remains limited to two-dimensional plane-based detection
Solution Approach 1:
The patent applies dimensionality change by transitioning from two-dimensional plane-based cursor movement to three-dimensional gesture-based command selection. Sensors detect the position and movement of command objects in three-dimensional space, and this spatial information is mapped to select commands in a hierarchical structure, enabling true 3D interaction.
Solution Approach 2:
The patent replaces the mechanical system of plane-based cursor movement with a sensor-based detection system that measures position in space. Capacitive or optical sensors detect the three-dimensional position and movement of command objects, substituting physical cursor manipulation with field-based detection.
2Adaptability or versatility
If distance data is used to determine display mode, then true three-dimensional interaction is enabled, but the complexity of processing distance and position data increases
Solution Approach 1:
The patent introduces an intermediary processing layer that receives raw distance and position data from sensors, processes this information to determine appropriate display modes, and outputs command selections. This intermediary software layer manages the complexity of 3D data processing while maintaining the simplicity of the user interface.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables true three-dimensional browsing and selection of commands, allowing users to access hierarchical levels of commands by varying distance and position, enhancing user interaction and reducing ambiguity in command selection.
Implementation Method 1
The screen can be for example covered with a mesh of capacitive electrodes, and the position of the object is detected based on its Interactions, in the form of capacitive couplings, with the electrodes
Implementation Method 2
obtaining position data of at least one command object with respect to the command interface by means of the sensor(s)... varying the display based on capacitive interactions and light intensity measurements
Data Source
AI summary
A method is provided for selecting controls, which implement a control interface, a display, and at least one sensor capable of detecting at least one control, object, including a step (i) of obtaining information on the distance between the control object(s) and the control interface using the sensor(s), and a step (ii) of displaying, on the display, at least one symbol representing a control or set of controls according to a display mode, wherein the method further includes a step of using the distance information to determine the display mode of the symbol(s). A device is also provided for implementing the method and to an apparatus.