In-Vehicle Gesture Pointer Alignment for Comfortable Non-Contact Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing non-contact user interfaces require users to bring their fingers close to a display, which can lead to discomfort due to deviations in hand or finger movement not aligning with their subjective intention, and the estimation of action intentions may not accurately match user expectations.
Innovation Solution
A non-contact user interface system using a camera and image processing device that captures hand or finger actions, determines fingertip positions based on the subjective opinion of the user by setting a pointer between the ends of the thumb and index finger, and adjusts the pointer position to align with user preferences, utilizing machine learning algorithms for accurate shape recognition and detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user brings the finger close to the display for non-contact operation, then the interface can respond to hand gestures, but the user may feel uncomfortable due to the need to position the finger very close to the display surface
Solution Approach 1:
The system transitions from 2D finger position detection to 3D spatial detection by incorporating depth information through stereo imaging. This allows the detection area to extend beyond the display surface into the space in front of it, enabling users to perform gestures at a comfortable distance without needing to bring their fingers close to the display.
2Extent of automation
If the action intention is estimated based on finger gesture and position, then the system can interpret user input, but the estimation may deviate from the user's subjective opinion leading to inaccurate control
Solution Approach 1:
The system incorporates feedback mechanisms where the detected finger position and gesture are processed to determine action intention, which then controls the display output. This closed-loop approach allows the system to continuously adjust its interpretation based on the relationship between detected gestures and resulting control actions, improving accuracy over time.
Solution Approach 2:
The system changes the parameters used for gesture detection by incorporating depth information from stereo imaging in addition to 2D position data. This multi-parameter approach provides more comprehensive information about finger gesture and position, enabling more accurate estimation of user intention that better aligns with subjective opinion.
3Adaptability or versatility
If a camera is used to capture hand gestures for non-contact control, then the interface can recognize gestures without contact, but the system complexity increases compared to traditional contact interfaces
Solution Approach 1:
The imaging device serves multiple functions: it captures 2D images for visual display, detects finger position for control input, and provides depth information for 3D gesture recognition. By making the camera system multi-functional, the patent reduces the need for separate specialized sensors, thereby managing system complexity while maintaining versatile gesture recognition capabilities.
Data Source
AI summary
Provided are a recording medium, an image processing device, an image processing method, and an in-vehicle interface device capable of realizing a non-contact user interface matching a subjective opinion of a user.A computer readable non-transitory recording medium recording a computer program causes a computer to execute processes of acquiring an image in which a plurality of indicators is captured, and setting a pointer designating a position represented by ends of a first indicator and a second indicator at a position between the end of the first indicator and the end of the second indicator specified based on the acquired image.