Virtual Hand Display for Vehicle Touch Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle control systems face a conflict in designing touch-sensitive control surfaces and display devices, where the control surface is often located out of the driver's direct line of sight, requiring complex and costly camera systems for hand detection and image analysis to maintain intuitive operation.
Innovation Solution
A method and device that detect the operator's hand using capacitive and resistive sensors, identify the operator's hand orientation, and display a virtual hand on a display device close to the driver's line of sight, allowing for intuitive operation without the need for complex image acquisition and analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the control surface is arranged in the lower area of the dashboard or in a center console for easy reach, then the ease of operation is improved, but the driver's line of sight to the control surface is blocked and visual feedback is lost
Solution Approach 1:
The patent creates a virtual copy of the operator's hand that is displayed on the display device. This virtual hand replicates the position and orientation of the actual hand on the control surface, providing visual feedback without requiring the driver to look down at the control surface. The virtual hand is generated based on detected hand position data and displayed in real-time to show which menu item is being operated.
2Measurement precision
If a camera system with image analysis is used to detect the operator's hand, then the visual feedback accuracy is improved, but the device complexity and cost increase
Solution Approach 1:
The patent replaces complex optical-mechanical camera systems with a simplified sensor-based detection system. Instead of using cameras to capture images and perform image analysis, the system uses sensors (such as capacitive, resistive, or inductive sensors) integrated into the control surface to directly detect the position and orientation of the operator's hand. This substitution of the detection mechanism significantly reduces system complexity while maintaining adequate measurement precision.
3Loss of time
If the display device is arranged close to the driver's line of sight, then the time for eye refocusing is reduced, but the control surface cannot be easily reached with one hand
Solution Approach 1:
The patent introduces a virtual hand as an intermediary element that mediates between the driver's actual hand on the control surface and the visual display. The virtual hand is displayed on the display device that is positioned in the driver's line of sight, allowing the driver to operate the control surface with one hand while visually monitoring the operation through the virtual hand representation. This intermediary virtual representation resolves the spatial conflict between control accessibility and display visibility.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables simple and intuitive operation of touch-sensitive control surfaces by displaying a virtual hand corresponding to the actual hand position, reducing eye movement and focusing effort, and eliminating the need for costly camera systems, thereby improving usability and reducing operational complexity.
Implementation Method 1
The touch is detected in a manner known per se, for example by a capacitive and/or resistive sensor system of a touchpad or a touchscreen
Implementation Method 2
the touch force can be detected by a resistive touch detection
Data Source
Figure 1~2
Figure 3~4
Figure 5a~5f
AI summary
The method involves detecting contact of a touch-sensitive control surface of a control element with a hand of an operator. A position of a contact point is determined, and the operator is identified by a seat occupancy sensor or by closing an electric circuit by the hand of the operator. Orientation of the hand is determined, and an image of an appropriately oriented virtual hands is displayed on a display device i.e. picture screen (4), such that a tip of a finger corresponds to the position of the contact point. The control surface is arranged in a center console (2) of a vehicle. An independent claim is also included for a device for displaying a hand of an operator of a control element on a display device of a vehicle.