Gesture-Based Remote Vehicle Control Without Reboarding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle control systems require multiple operators, one on the ground and one on the vehicle, to perform actions, and frequent reboarding is necessary for changing perspectives, which is inefficient and often impractical.

Innovation Solution

A vehicle control system that allows a single remote operator to control vehicle actions using sensors to detect direct or indirect gestures, such as movements of the operator's anatomy or a handheld device, enabling control without physical access to the vehicle's input devices, with a processor and medium to interpret and respond to these gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single remote operator controls the vehicle without physical access to input devices, then operator safety and operational flexibility are improved, but control precision and reliability deteriorate

Engineering Contradiction:
Improveoperator safetyVSAvoidcontrol reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces gesture recognition technology as an intermediary between the remote operator and the vehicle control system. Sensors capture gestures from the operator, a processor interprets these gestures, and the system executes corresponding vehicle actions. This intermediary mechanism enables safe remote operation while maintaining control reliability through multiple layers of interpretation and validation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical control systems (steering wheels, pedals, levers) with a gesture-based control system. Instead of direct mechanical interaction with control devices, the operator uses body movements and hand gestures that are detected by sensors and translated into vehicle commands, eliminating the need for physical contact with the vehicle.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If multiple operators are required (one on ground, one on vehicle), then control reliability is improved, but operational efficiency and complexity worsen

Engineering Contradiction:
Improvecontrol reliabilityVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts the operator from the vehicle interior and relocates them to a remote position. The gesture recognition system and sensor array are integrated into the vehicle to replace the physical presence of an operator inside the vehicle, allowing a single operator to perform duties that previously required multiple people working in coordination.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If frequent reboarding is required for changing perspectives, then operational flexibility is improved, but time consumption and efficiency worsen

Engineering Contradiction:
Improveperspective flexibilityVSAvoidreboarding time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent uses sensor arrays and cameras to create multiple virtual perspectives of the vehicle environment. These visual copies allow the remote operator to view the scene from different angles and positions without physically moving or reboarding the vehicle, providing perspective flexibility while eliminating time loss.

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If gesture recognition system is implemented, then remote control capability is improved, but system complexity and cost worsen

Engineering Contradiction:
Improveremote control capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent designs the gesture recognition system to perform multiple functions: detecting operator gestures, determining operator position relative to the vehicle, recognizing specific control commands, and providing feedback to the operator. This multi-functional approach consolidates what would otherwise require separate systems into a single integrated solution, reducing overall complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12158753B2Vehicle control by a remote operator
Publication Date: 2024.12.03 CATERPILLAR INC
  • US12158753B2 patent drawing
  • US12158753B2 patent drawing
  • US12158753B2 patent drawing

AI summary

A vehicle is operable in a first mode in which vehicle actions are controlled in response to inputs received by an input device carried by the vehicle from an operator while being boarded on the vehicle and in a second mode in which vehicle actions are controlled in response to inputs received from the operator while the operator is proximate the vehicle, but no longer boarded on the vehicle. The vehicle carries a sensor configured to output a sensed input, as sensed by the sensor, from the operator proximate the vehicle, but not boarded on the vehicle. The sensed input is recognized and associated with a vehicle action and control signals are output to the vehicle based on the sensed input to cause the vehicle to carry out the vehicle action.