Trailer Backup Assist Using Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Reversing a vehicle while towing a trailer is challenging due to the need for opposite steering inputs and amplified steering errors, with existing systems requiring complex human-machine interfaces and failing to account for curved paths and jackknife conditions effectively.

Innovation Solution

A trailer backup assist system that uses a camera to detect user gestures and identify a target on the trailer, allowing for intuitive control of trailer path curvature through a simple interface, such as a knob or gestures, and automatically adjusts steering to prevent jackknife conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a complex human-machine interface is used to specify path, obstacles and goal, then the system can provide precise control, but the device complexity increases significantly

Engineering Contradiction:
Improveease of path specificationVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system uses the vehicle's existing camera and processor to automatically detect gestures and identify targets, eliminating the need for separate complex interface devices. The driver's natural gestures become the input mechanism, making the system self-sufficient using already-available components.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces complex mechanical or electronic interface devices with optical recognition (camera-based gesture detection). This substitution simplifies the physical interface while maintaining control precision through visual field analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If high-precision GPS and inertial navigation are used to determine path following accuracy, then the measurement precision improves, but the device complexity and cost increase

Engineering Contradiction:
Improvepath following accuracyVSAvoidnavigation system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of using expensive specialized navigation hardware, the system creates a visual copy of the desired path through camera imaging and processes this visual information to determine position and orientation. The camera feed serves as a substitute for dedicated GPS/inertial sensors.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The vehicle's existing camera system performs multiple functions: it captures the environment for gesture recognition, identifies targets on the trailer, and simultaneously provides path following data. This multi-functionality eliminates the need for separate navigation measurement devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If the system assumes a zero curvature path for backup, then the control logic is simplified, but the adaptability to real-world curved path requirements is reduced

Engineering Contradiction:
Improvecontrol logic complexityVSAvoidpath type adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system dynamically determines path curvature based on real-time camera imaging and gesture detection rather than assuming a fixed zero curvature path. The control parameters adapt automatically to the actual driving conditions and user intent, allowing smooth transitions between straight and curved backup paths.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes path parameters (curvature, orientation, position) based on detected gestures and visual feedback. Instead of maintaining fixed control parameters, the system continuously adjusts them according to the user's natural gestures and the actual trailer position, enabling adaptability to various path requirements.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9296421B2Vehicle target identification using human gesture recognition
Publication Date: 2016.03.29 FORD GLOBAL TECH LLC
  • US9296421B2 patent drawing
  • US9296421B2 patent drawing
  • US9296421B2 patent drawing

AI summary

A trailer target detection system includes a camera located on a vehicle and arranged to capture video images of a trailer towed by the vehicle. The system includes an image processor processing the video images to detect a gesture by a user indicative of position of target on the trailer and identifying location of the target based on the detected gesture. A vehicle trailer backup assist system includes a camera and an image processor for processing images to detect a gesture and determine a command based on the gesture. The processor controls backing of the trailer based on the command.