Vehicle Radar Upsampling With Thermal Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional systems for determining a vehicle's environment are often expensive and inaccurate, particularly in autonomous vehicle technology where quick and accurate environmental awareness is desirable.

Innovation Solution

The implementation of an object detection device combining a distance sensor and a thermal sensor to generate a three-dimensional representation of the environment, allowing for simultaneous data acquisition and processing to enhance object detection and classification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional systems for determining vehicle environment are used, then measurement precision may be improved, but device complexity and cost increase

Engineering Contradiction:
Improveenvironmental detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines radar distance data with thermal sensor data to create a unified environmental representation. The radar provides spatial information while the thermal sensor adds thermal signature data, merging two different sensing modalities to achieve more accurate object detection and classification without requiring complex traditional systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses a multi-functional approach where the same processing system handles both radar data and thermal data, generating a unified three-dimensional representation. This universal processing approach reduces overall system complexity while maintaining high measurement precision through the complementary strengths of both sensors

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If traditional environmental determination systems are used, then measurement precision may improve, but cost increases

Engineering Contradiction:
Improveobject detection accuracyVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent merges radar and thermal sensor data in a cost-effective manner, leveraging the complementary strengths of both sensors. The radar provides reliable distance measurement while the thermal sensor adds object identification capability, creating an affordable system that achieves high detection accuracy without requiring expensive traditional systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses an intermediary processing approach where the same computational system processes both radar and thermal data streams. This intermediary processing layer integrates the two data types efficiently, reducing overall system cost while maintaining high measurement precision through the synergistic combination of sensors

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If traditional systems are used, then accuracy may improve, but speed of environmental determination decreases

Engineering Contradiction:
Improveenvironmental awareness accuracyVSAvoidenvironmental determination speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The system continuously processes both radar and thermal data streams simultaneously, maintaining continuous environmental awareness. The parallel processing of multiple sensor types enables real-time environmental determination at high speed while preserving accuracy through the continuous integration of complementary data

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system performs preliminary processing of both radar and thermal data independently before integrating them into a unified representation. This preliminary action allows for efficient parallel processing, increasing the speed of environmental determination while maintaining accuracy through the subsequent integration of pre-processed data

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides a cost-effective and accurate method for environmental imaging and object detection, enabling improved autonomous vehicle navigation and operation by integrating distance and thermal data for enhanced spatial awareness.

Implementation Method 1

a first distance sensor configured to detect objects within a first distance area

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

a first thermal sensor configured to detect thermal signatures within a first thermal area

Methodology Applied
Scientific EffectThermal radiation: Thermal Radiation

Data Source

PatentUS10928512B2Vehicle based radar upsampling
Publication Date: 2021.02.23 TELEDYNE FLIR LLC
  • US10928512B2 patent drawing
  • US10928512B2 patent drawing
  • US10928512B2 patent drawing

AI summary

Various embodiments of the present disclosure may include one or more object detection devices. The object detection devices may include at least one distance sensor such as a radar, lidar, or other distance sensor and at least one thermal sensor such as a thermal imaging device. One or more object detection devices may be mounted to vehicles to provide enhanced representations of an area around the vehicles.