Object Warning System Using Radar and Vision Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object detection systems for large machines do not provide an integrated visual warning of proximate objects based on stopping distance, leading to potential collisions and reduced productivity in worksites.

Innovation Solution

An object warning system that includes a combination of radar and vision systems, along with an operator interface, to detect objects and provide visual and audible warnings based on the object's proximity to the machine, using a controller to process data from various sensors and display systems to represent warning levels as a function of the object's distance and the machine's status.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If an object detection system is implemented for large machines, then collision risk is reduced, but the system complexity and cost increase

Engineering Contradiction:
Improvecollision risk reductionVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple detection technologies (radar, vision systems, ultrasonic sensors) into a single integrated object detection and warning system. This merging approach consolidates multiple separate systems into one unified platform, reducing overall system complexity while maintaining comprehensive collision risk reduction capabilities through the synergistic operation of different sensing modalities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated detection system is designed to perform multiple functions simultaneously: detecting objects at various distances, classifying object types, calculating stopping distances, and providing both visual and audible warnings. This multi-functionality eliminates the need for separate specialized systems, thereby reducing device complexity while improving reliability through comprehensive monitoring and response capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If visual warning based on stopping distance is provided, then operator awareness is enhanced, but the device complexity increases

Engineering Contradiction:
Improveoperator awarenessVSAvoidcontroller processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The visual warning system provides differentiated information based on local conditions: it displays specific warning levels (such as colored indicators or graphical representations) that correspond to different stopping distance thresholds and object types. This localized, context-specific warning approach enhances operator awareness by presenting only the most relevant information for the current situation, rather than overwhelming the operator with undifferentiated data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The controller dynamically adjusts warning parameters (such as warning level intensity, color coding, or visual prominence) based on changing conditions including object distance, relative speed, and machine status. This adaptive parameter adjustment automates the complexity of decision-making, allowing the system to enhance operator awareness through context-appropriate warnings without requiring manual configuration or simple fixed-threshold algorithms.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If multiple detection systems (radar and vision) are integrated, then detection accuracy is improved, but the device complexity and cost increase

Engineering Contradiction:
Improvedetection accuracyVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent integrates radar systems and vision systems into a unified detection platform where data from both sensors is processed together. This merging allows the system to leverage the complementary strengths of each technology: radar provides reliable distance and speed measurements in various weather conditions, while vision systems offer detailed object classification and recognition. The integrated architecture reduces overall complexity by providing a single point of data fusion and decision-making.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated detection system employs feedback mechanisms where the output from one sensor type validates and refines the output from the other. For example, vision-based object classification can trigger more focused radar monitoring, while radar-detected moving objects can prompt the vision system to prioritize analysis in those regions. This cross-validation feedback loop enhances detection accuracy while managing complexity through intelligent data correlation rather than simple parallel processing.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively warns operators of proximate objects, reducing the risk of collisions by providing a visual and audible alert system that adapts to the object's distance, enhancing operator awareness and site productivity.

Implementation Method 1

The plurality of object detection systems may include near range, medium range, and/or far range radars being configured to detect objects

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

Other typical obstacle detection sensors (not shown) may be included without departing from the disclosed subject matter, such as, for example sonar systems, laser systems, optical systems, and infrared systems.

Methodology Applied
Scientific EffectOptical detection: Photography

Data Source

PatentUS9633563B2Integrated object detection and warning system
Publication Date: 2017.04.25 CATERPILLAR INC
  • US9633563B2 patent drawing
  • US9633563B2 patent drawing
  • US9633563B2 patent drawing

AI summary

In one aspect, an object warning system for a machine is disclosed. The object warning system includes an object detection system and an operator interface having a visual display, and a controller in communication with the object detection system and the operator interface. The controller is configured to control the display to represent a warning level as a function of a status of the machine and a distance of an object relative to the machine.