Vehicle Gesture Interface via Skeleton Projection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing vehicle user interfaces restrict the interior configuration for hardware, limiting user convenience and flexibility in operating various vehicle functions.

Innovation Solution

A user interface system that includes a camera, an image projector, and a controller to detect occupants, estimate their skeletons, and project interactive images in a space near the occupant, allowing for hand gesture recognition and command input without physical controls.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical hardware controls are installed in the vehicle interior, then user operation capability is ensured, but vehicle interior space is restricted and configuration flexibility is reduced

Engineering Contradiction:

Improveuser operation capabilityVSAvoidvehicle interior space

Core Design Contradiction:

Ease of operationVSVolume of moving object

Solution Approach 1:

The patent replaces physical mechanical controls with a vision-based interaction system. A camera captures hand gestures, the processor analyzes gesture sequences, and the output device provides feedback, substituting the mechanical control system with an optical sensing and computational system that requires no physical hardware in the cabin.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a virtual representation of the user's hand gestures through image capture and processing. The gesture recognition system generates digital copies of physical gestures, allowing interaction without physical controls. The output device may also display virtual interfaces that replicate traditional control functions.

Inventive Principle:

Principle #26Copying

2Adaptability or versatility

If traditional user interface hardware is configured in the vehicle, then control functionality is provided, but adaptability to different usage scenarios is limited

Engineering Contradiction:

Improveusage scenario flexibilityVSAvoidhardware configuration

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically adapts to different usage scenarios by recognizing various gesture types (single-hand, two-hand, sequential, simultaneous gestures) and adjusting the interaction mode accordingly. The processor can switch between different gesture recognition algorithms and output device modes based on the detected gesture pattern, providing versatility without hardware changes.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The vision-based gesture recognition system serves multiple functions: it can recognize various gesture types, work with different output devices (display screens, speakers, haptic feedback), and adapt to different usage scenarios (driving, navigation, entertainment control). This single system replaces multiple specialized hardware controls.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12282608B2User interface, control method thereof, and vehicle having user interface

Publication Date: 2025.04.22 HYUNDAI MOTOR CO LTD

AI summary

A control method of a user interface may include: detecting an occupant from an image input from a camera; estimating a skeleton of the occupant; estimating a relative position of a finger of the occupant based on the estimated skeleton; determining a projection position based on the relative position of the finger, and projecting a projection image on the projection position by an image projector and playing the projection image.