Hand-Tracked Cursor Input for Intuitive In-Vehicle Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user input systems in vehicles require memorization of specific hand gestures, making intuitive input operations difficult.
Innovation Solution
A control apparatus that includes a display control unit to display selectable objects, a detection unit to analyze hand positions, and a specifying unit to associate hand movements with cursor positions on a display, allowing intuitive input operations without physical contact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If non-contact gestures are used for input, then contactless operation is achieved, but users must memorize specific hand shapes and movement patterns reducing intuitiveness
Solution Approach 1:
The patent replaces traditional mechanical input devices (buttons, touchscreens) with an optical detection system using cameras and image processing. The system captures hand images, detects hand positions and movements, and translates them into control commands, eliminating the need for physical contact while maintaining intuitive operation through natural hand gestures.
Solution Approach 2:
The system creates a virtual representation of the user's hand movements by capturing images and detecting hand positions. This copied information is then used to control the display apparatus, allowing the user's natural hand movements to be replicated as cursor movements on the screen without requiring memorization of specific gesture codes.
2Ease of operation
If hand position detection is used for control, then contactless input is enabled, but detection accuracy may be insufficient leading to unintended operations
Solution Approach 1:
The system provides visual feedback by displaying a cursor on the screen that corresponds to the detected hand position. This allows users to see where their hand movements are being registered, enabling real-time adjustment and confirmation of intended operations, thereby compensating for any detection imprecision.
Solution Approach 2:
The system performs preliminary detection and display of cursor position before executing the actual operation. This preliminary action allows users to verify that their hand movement corresponds to the intended target on the screen, preventing unintended operations while maintaining contactless input.
3Ease of operation
If cursor display is added to indicate hand position, then operation intuitiveness is improved, but device complexity increases
Solution Approach 1:
The system uses the existing display apparatus to show both the operational interface and the cursor position simultaneously. This multi-functional use of the display component avoids adding separate indication devices, maintaining ease of operation while minimizing increases in device complexity.
Data Source
AI summary
A control apparatus for providing a user interface to a user is provided. The apparatus comprises a display control unit configured to display a selectable object on a display apparatus, a detection unit configured to analyze an image of a hand of the user to detect a position of the hand, a specifying unit configured to specify an indicated position in the display apparatus based on the position of the hand, and a processing unit configured to, based on the indicated position overlapping the selectable object, execute processing associated with the selectable object. The display control unit further displays, in the display apparatus, a cursor that indicates the indicated position.