Vehicle Gesture Interface With Wrist-Aware Hand Region Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gesture recognition systems in vehicles face challenges such as non-intuitive recognition from the driver's perspective, errors due to overlapping fingers, and unnecessary resource consumption due to constant activation, leading to misrecognition and increased computational resources.

Innovation Solution

A user interface device that varies the reference area for determining the hand area in images based on the user's hand angle, activates gesture recognition with a specific change amount, and maintains or resets the recognition state based on set values, using a processor to divide images into regions and compare hand shapes and patterns with stored user information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If gesture recognition is always activated to recognize user gestures, then gesture recognition availability is improved, but computational resource consumption increases and misrecognition occurs due to unintended user motion

Engineering Contradiction:
Improvegesture recognition availabilityVSAvoidcomputational resource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system activates gesture recognition periodically or on-demand rather than continuously. A camera captures images at specific intervals or when triggered, and gesture recognition is performed only during these periodic activation periods, reducing computational resource consumption while maintaining recognition availability.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary actions such as capturing baseline images or detecting preliminary hand movement patterns before activating full gesture recognition. This preliminary detection prepares the system for upcoming gestures, allowing recognition to be activated only when necessary, thus reducing unnecessary computational resource usage.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If gesture recognition is always activated to recognize user gestures, then gesture recognition availability is improved, but misrecognition occurs due to unintended user motion

Engineering Contradiction:
Improvegesture recognition availabilityVSAvoidgesture recognition accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system applies different processing quality levels to different regions or contexts. For example, it focuses computational resources on specific hand regions or gesture-critical areas in the image, rather than uniformly processing the entire image, thereby improving recognition accuracy while reducing misrecognition of unintended motions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses feedback mechanisms where recognition results are evaluated and used to adjust subsequent recognition parameters. If misrecognition is detected, the system can adjust sensitivity thresholds or activation criteria based on feedback from previous recognition attempts, improving overall accuracy and reducing false positives.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If the number of fingers is recognized by obtaining an image of the user's hand to determine gestures, then gesture recognition capability is provided, but recognition errors occur due to overlapping fingers and non-intuitive recognition from driver's steering control perspective

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidgesture recognition accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts recognition parameters such as reference area size and shape based on the detected hand angle and gesture context. Instead of using a fixed reference area, the system adapts the reference area dynamically to match the hand's orientation and the specific gesture being performed, improving recognition accuracy for various finger configurations.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes recognition parameters such as the reference area for determining hand occupancy based on the hand angle. By adjusting parameters like reference area size, shape, or position according to the detected hand orientation, the system improves recognition accuracy for different gestures while reducing errors from overlapping fingers.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240013576A1User interface device, vehicle having the user interface device and method for controlling the vehicle
Publication Date: 2024.01.11 HYUNDAI MOTOR CO LTD
  • US20240013576A1 patent drawing
  • US20240013576A1 patent drawing
  • US20240013576A1 patent drawing

AI summary

A user interface device which receives a user instruction for controlling at least one electronic device, includes a camera configured to obtain an image of a user; and at least one processor configured to divide the obtained image into a plurality of regions, determine an area occupied by the user's hand in each of the divided regions, and recognize gesture of the user based on the area occupied by the user's hand, wherein the at least one processor may be further configured to determine a direction in which the user's wrist faces based on the obtained image, and divide the obtained image into the plurality of regions based on the direction of the user's wrist.