Non-Contact Vehicle Input Device Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current input devices in vehicles require physical contact, which can be inconvenient and may lead to incorrect operations, especially in dynamic environments like driving, where hands-free operation is desirable.

Innovation Solution

A non-contact input device using a combination of camera sensors and acoustic sensors to detect specific gestures, such as a 'shortcut' gesture where two fingertips touch and then move apart with intersecting paths, and verify the gesture through both visual and auditory signals to execute predefined functions like muting the radio or navigating.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical contact is required for input operations, then input accuracy can be confirmed, but user convenience and safety are reduced due to the need for hand movement away from the wheel

Engineering Contradiction:
Improveuser convenienceVSAvoidinput accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces the mechanical contact-based input system with an optical sensing system using a camera to detect finger positions and gestures in the air space in front of the steering wheel, eliminating the need for physical contact while maintaining input reliability through visual verification of gesture patterns

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system provides visual feedback by displaying detected finger positions and gesture patterns on a screen, allowing the user to verify that the system correctly recognizes their intended input, thus maintaining reliability without requiring physical contact

Inventive Principle:
Principle #23Feedback

2Ease of operation

If contact-free gesture detection is implemented, then user convenience is improved, but the risk of incorrect operations increases due to difficulty in confirming input recognition

Engineering Contradiction:
Improvehand-free operation capabilityVSAvoidinput confirmation
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system displays the detected finger positions and gesture patterns on a screen, providing visual feedback that allows the user to confirm whether their gesture was correctly recognized before execution, preventing incorrect operations

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system requires multiple fingers to be positioned at specific locations simultaneously, creating a multi-point gesture pattern that is less likely to be accidentally triggered while still simple enough for intentional use

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If multiple sensors are used for gesture verification, then input accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvegesture detection accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an image processing algorithm as an intermediary that translates camera images into finger position data and gesture pattern recognition, simplifying the overall system architecture while maintaining high detection accuracy through software-based analysis

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables quick and accurate execution of functions without physical contact, reducing the risk of incorrect operations by utilizing a snap gesture recognized through both visual and auditory verification, thus enhancing user convenience and safety while driving.

Implementation Method 1

which has a detection area in which a user can insert his hand, by means of which changes in position of at least one finger of the user's hand are detected

Methodology Applied
Scientific EffectVisual detection:

Implementation Method 2

which has at least one acoustic sensor by means of which snapping or smacking noises are detected

Methodology Applied
Scientific EffectAcoustic detection:

Data Source

PatentEP3234736B1Method for operating an input device, input device, motor vehicle
Publication Date: 2019.02.27 ROBERT BOSCH GMBH
  • EP3234736B1 patent drawingFigure 1~2

AI summary

The invention relates to a method for operating an input device (2), particularly an input device for a motor vehicle (1), comprising at least one sensor (3) for the touch-free detection of a position and/or change of position of at least one finger of a user's hand (6), wherein, as a function of a detected position and/or change of position, an input is captured and said input is executed. It is provided that the input is captured upon the detection of two fingertips (9, 10) which initially come into contact with each other and then move away from each other, their movement paths intersecting each other.