Gesture-Based Autonomous Vehicle Control Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous driving systems lack a user-friendly interface for drivers to make minor adjustments to the vehicle's path without compromising the convenience of automatic operation.

Innovation Solution

A system using processing circuitry to interpret user gestures from input devices such as touchpads or trackballs, allowing drivers to control vehicle components like steering and acceleration through predefined gestures, enabling supervisory control over autonomous vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous driving systems operate without driver interaction, then automation level is improved, but ease of operation deteriorates because drivers cannot make minor adjustments

Engineering Contradiction:
Improveautonomous operationVSAvoiddriver control
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

A gesture recognition system serves as an intermediary between the driver and the autonomous vehicle system. The system includes sensors to detect gestures, processing circuitry to interpret them, and a controller to execute corresponding actions. This intermediary allows drivers to make minor adjustments to the autonomous driving system's planned actions through intuitive gestures without requiring full manual control, thus maintaining high automation while improving ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a user interface is added for driver supervision, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improvedriver controlVSAvoidsystem structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical or complex electronic control interfaces with a gesture recognition system. Instead of requiring physical buttons, levers, or complex control panels, the system uses sensors to detect and interpret driver gestures in air space. This substitution reduces the physical and structural complexity of the control interface while maintaining ease of operation, as drivers can naturally gesture without learning complex control mechanisms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If gesture recognition is implemented, then ease of operation is improved, but measurement precision deteriorates due to difficulty in detecting and measuring gestures

Engineering Contradiction:
Improvegesture controlVSAvoidgesture detection
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The gesture recognition system is designed to recognize multiple types of gestures (hand movements, arm movements, body movements) using a unified sensor array and processing framework. The sensors can detect various gesture types and the processing circuitry interprets them according to predefined criteria. This multi-functional approach allows the system to handle diverse gestures with a single detection mechanism, improving ease of operation while managing the complexity of gesture detection through a universal recognition framework.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10053110B2Systems and methodologies for controlling an autonomous vehicle
Publication Date: 2018.08.21 TOYOTA JIDOSHA KK
  • US10053110B2 patent drawing
  • US10053110B2 patent drawing
  • US10053110B2 patent drawing

AI summary

A system and associated methodology that controls a vehicle component as a function of a user input. The system stores a plurality of functions associated with a plurality of touching gestures, receives the user input, determines, based on the user input, a user gesture wherein the user gesture corresponds to one of the plurality of touching gestures, determines a function associated with the user gesture, determines a feature of the user gesture, determines an operational parameter of the function based on the feature. Then, the system controls the vehicle component associated with the function as a function of the operational parameter.