Vehicle Terminal Gesture Recognition via Eye-Fingertip Line
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current vehicle terminals face challenges in user input recognition, including space consumption with hard keys, difficulty in reaching touch screens for drivers, misrecognition of voice commands, and limitations in gesture recognition, particularly for controlling multiple electronic devices.
Innovation Solution
A terminal with a first recognition unit for touch inputs and a second recognition unit using images of the user's eye and fingertip to determine button selection, allowing for separate areas for touch and gesture inputs, and adjusting display and lighting to enhance user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If hard keys are used for input, then button identification is improved, but device space consumption increases and manufacturing cost increases
Solution Approach 1:
The patent replaces mechanical hard keys with a touch screen interface that uses visual display elements (icons, text) instead of physical buttons. This substitution eliminates the need for mechanical components while maintaining button identification functionality through visual cues on the display surface.
Solution Approach 2:
The patent creates visual representations (copies) of button functions on the touch screen display, allowing users to identify and select functions through displayed icons and text rather than physical buttons. This copying approach preserves the identification function while eliminating the physical space requirement of hard keys.
2Area of stationary object
If touch screen is used for input, then device space consumption is reduced, but ease of operation deteriorates when driver cannot reach the screen
Solution Approach 1:
The patent introduces gesture recognition in three-dimensional space above the touch screen, allowing drivers to interact with the interface without physical contact. By adding the vertical dimension for hand gestures, the system extends the interaction zone beyond the screen surface, making it accessible to drivers who cannot reach the screen.
Solution Approach 2:
The patent uses camera-based gesture recognition as an intermediary between the driver and the touch screen. The camera captures hand gestures in the air space above the screen and translates them into touch input commands, serving as a mediator that bridges the gap between the driver's hand position and the screen interface.
3Ease of operation
If voice recognition is used for input, then ease of operation is improved, but measurement precision deteriorates due to misrecognition
Solution Approach 1:
The patent merges multiple input methods (touch screen, gesture recognition, voice recognition) into a unified interface system. Each method can be used independently or in combination, allowing the system to leverage the strengths of each while compensating for their individual weaknesses through sensor fusion and contextual analysis.
4Ease of operation
If gesture recognition is used for input, then ease of operation is improved, but measurement precision deteriorates due to misrecognition of hand motions
Solution Approach 1:
The patent implements feedback mechanisms where the system provides visual confirmation of detected gestures on the touch screen display. This feedback loop allows users to verify that their gestures were correctly recognized and provides opportunities for correction, thereby improving overall recognition accuracy through iterative validation.
Data Source
AI summary
A terminal is provided to recognize a touch input and a gesture input intended by a user. A vehicle includes the terminal configured to display buttons to be selected by a user, and receive a touch input as user input. An image input receives an image of the user for receiving a gesture input as the user input and a controller divides an area of the terminal into a first area and a second area. The controller determines a button selected by the user among buttons displayed in the first area based on the touch signal output by the touch input, and determines a button selected by the user among buttons displayed in the second area based on a finger image and an eye image in the image.