Vehicle Gesture Control System Using Camera-Based Motion Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle operating systems require direct button or screen interaction, leading to driver distraction and safety concerns when operating features like air-conditioning or multimedia systems while driving.

Innovation Solution

A vehicle operating system that uses camera devices to capture and interpret gestures from drivers and passengers, converting these actions into operating signals to control vehicle systems, allowing for safe and convenient operation without direct interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If direct button or screen interaction is used to control vehicle systems, then ease of operation is improved, but driver distraction and safety risks increase

Engineering Contradiction:
Improveease of operationVSAvoiddriving safety
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces mechanical button pressing and manual screen interaction with a gesture recognition system using camera devices and image processing algorithms. The system captures images of hand gestures, processes them to identify specific gestures, and converts them into operating signals to control vehicle systems, thereby eliminating the need for direct physical interaction with controls.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary gesture recognition system between the driver and vehicle controls. Instead of directly touching buttons or screens, the driver performs gestures in the air that are captured by camera devices, processed by a processing device, and translated into control commands, providing a safer intermediate interaction method.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If gesture recognition system is implemented, then driver distraction is reduced and safety is improved, but device complexity increases

Engineering Contradiction:
Improvedriving safetyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent employs camera devices that serve multiple functions: capturing driver monitoring images for safety assessment and capturing gesture images for control operations. The processing device performs multiple tasks including analyzing driver state, recognizing gestures, and generating control commands, thereby reducing overall system complexity through multi-functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the existing camera devices and processing capabilities already present in modern vehicles for driver monitoring purposes, repurposing them to also handle gesture recognition. This self-service approach leverages existing infrastructure to reduce the need for additional dedicated hardware components.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10281989B2Vehicle operating system using motion capture
Publication Date: 2019.05.07 THUNDER POWER NEW ENERGY VEHICLE DEV CO LTD
  • US10281989B2 patent drawing
  • US10281989B2 patent drawing
  • US10281989B2 patent drawing

AI summary

Vehicle operating systems for operating a vehicle having a driving seat for a vehicle driver and at least one passenger seat for passengers are described. The vehicle operating system may include one or more camera devices for shooting images of hand actions of the driver or images of hand actions of a passenger, and a storage device for storing operating signals corresponding to hand actions. A processing device may be configured to select the driver or the passengers as a gesture command operator, and to control the camera device to shoot hand action images of the selected gesture command operator. The command system may also be configured to convert the shot hand action images into corresponding operating signals according to hand action indicia stored in the storage device. The operating signals may be sent to execution devices, that execute the corresponding operations.