Vehicle Display Gesture Feedback Using a Virtual Hand Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle display devices lack operational feedback, leading to discomfort and reduced convenience due to uncertainty in hand movements during gesture operations.
Innovation Solution
A vehicle display device that includes a movement detection unit to track operator movements and a design display unit to change virtual designs in conjunction with these movements, allowing intuitive operation of virtual objects on the display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If gesture operation is implemented without operational feedback, then automation is improved, but ease of operation deteriorates due to lack of operational feeling
Solution Approach 1:
The patent applies feedback by displaying a virtual hand that mirrors the operator's actual hand movements in real-time. The movement detection unit captures hand position and posture, and the design display unit renders a corresponding virtual hand representation on the display device, providing visual feedback that restores operational feeling during gesture-based control.
Solution Approach 2:
The patent creates a visual copy of the operator's hand by generating a virtual hand representation that replicates the actual hand's position, orientation, and gestures. This virtual copy is displayed on the head-up display device, allowing the operator to see a mirrored representation of their hand movements without physical contact with controls.
2Ease of operation
If virtual hand representation is displayed to provide operational feedback, then ease of operation is improved, but device complexity increases due to additional detection and rendering components
Solution Approach 1:
The patent integrates multiple functions into existing vehicle systems. The movement detection unit leverages existing sensors (cameras, depth sensors, or inertial measurement units) already present in modern vehicles for other purposes. The design display unit utilizes the head-up display infrastructure already implemented for navigation and vehicle information, avoiding the need for separate dedicated systems.
3Measurement precision
If hand movement detection is implemented, then operational precision is improved, but loss of information increases due to potential detection errors
Solution Approach 1:
The patent employs multiple detection methods and redundancy to cushion against potential detection errors. By using multiple sensors or detection algorithms to track hand position and posture, the system ensures that if one detection method fails or provides inaccurate data, other methods can compensate, maintaining reliable gesture recognition throughout operation.
Data Source
AI summary
A vehicle display device includes: a movement detection unit configured to detect a movement of a part of a body of an operator; and a design display unit configured to display, on an outside scene around a vehicle, a first design indicating a part of the body and a second design different from the first design. The design display unit changes the first design according to a detection result of the movement detection unit, and changes the second design such that the first design operates the second design.