Gesture Detection Unit for In-Vehicle Display Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing in-vehicle device actuation systems, such as those using head-up displays (HUDs), can hinder driving operations due to constant menu displays and require dedicated devices, increasing costs and complexity, and voice-operated systems are cumbersome due to processing delays and driver distraction.

Innovation Solution

An information processing device with a gesture detection unit that recognizes user gestures to control the display of selection candidates, allowing for intuitive operation without diverting attention from driving, and integrates voice recognition and switch operation for flexible input methods, with a driving burden estimation unit to manage display and input based on driving conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a menu for actuation is always displayed upon the HUD, then the driver can perform actuation while looking at the display, but some hindrance to driving operation may be created

Engineering Contradiction:
Improveease of actuationVSAvoidhindrance to driving
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The menu display is activated periodically or on-demand based on gesture detection rather than being continuously displayed. When the driver performs a specific gesture (e.g., hand raising), the menu appears; when the gesture ceases, the menu disappears. This periodic activation reduces visual distraction while maintaining operational accessibility.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system automatically detects driver intent through gesture recognition and activates the menu without requiring the driver to manually interact with controls. The gesture detection unit monitors for specific hand movements, and upon detection, the output information control unit automatically displays the menu, allowing the driver to initiate the interaction process passively.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If a dedicated device for actuation is installed, then actuation can be performed, but the cost increases and installation constraints arise

Engineering Contradiction:
Improveactuation capabilityVSAvoidinstallation complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The gesture detection unit serves multiple functions: it detects hand raising to activate the menu, recognizes specific gestures for selection operations, and can potentially control other vehicle functions. This multi-functionality eliminates the need for dedicated actuation devices while maintaining comprehensive control capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces physical mechanical controls (buttons, switches, dedicated actuation devices) with a gesture recognition system that uses optical or sensor-based detection. The gesture detection unit captures hand movements and translates them into control signals, substituting mechanical interaction with non-contact sensing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If voice recognition is used for actuation, then hands-free operation is possible, but processing time is required for recognition and reading out, deteriorating ease of use

Engineering Contradiction:
Improvehands-free operationVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The gesture-based selection method allows the driver to quickly select menu items by performing simple hand gestures rather than waiting for voice processing. The gesture recognition provides immediate response, skipping the lengthy voice recognition and text-to-speech processing delays inherent in voice-based systems.

Inventive Principle:
Principle #21Skipping (Rushing through)

4Ease of operation

If the gesture detection unit detects hand raising, then the menu can be activated, but the driver's attention may be diverted

Engineering Contradiction:
Improveactivation capabilityVSAvoiddriver distraction
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The menu display is activated periodically or on-demand based on gesture detection rather than being continuously displayed. When the driver performs a specific gesture (e.g., hand raising), the menu appears; when the gesture ceases, the menu disappears. This periodic activation reduces visual distraction while maintaining operational accessibility.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11226719B2Information processing device
Publication Date: 2022.01.18 FAURECIA CLARION ELECTRONICS CO LTD
  • US11226719B2 patent drawing
  • US11226719B2 patent drawing
  • US11226719B2 patent drawing

AI summary

An information processing device, includes: a gesture detection unit that recognizes gestures by a user; an output information control unit that controls output information to a display unit; and a device control unit, wherein: if the gesture detection unit has detected that the user has raised a hand for a certain time period, then the output information control unit displays upon the display unit a plurality of candidates for selection in association with gestures for operation; and if the gesture detection unit has detected a predetermined gesture by the user, the device control unit considers that, among the candidates for selection displayed upon the display unit, a candidate corresponding to the gesture that has been detected has been selected.