Thermal Sensor ROI Tuning for Low-Visibility Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in accurately detecting and predicting the behavior of objects in various environmental conditions, particularly at night, in heavy rain or snow, where thermal sensors provide clearer data but can be affected by factors like temperature ranges and urbanization, leading to reduced clarity and increased difficulty in object detection.

Innovation Solution

A parameter adjustment component that adjusts thermal sensor parameters, such as dynamic range, contrast, and gain settings, based on map data and environmental conditions, to improve object detection by identifying regions of interest and excluding areas like the sky, and using histogram analysis to optimize image clarity for specific regions like roadways.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If thermal sensor parameters are adjusted to improve clarity over the entire field of view, then overall image clarity improves, but processing time and computational resources increase

Engineering Contradiction:
Improvethermal sensor data clarityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The field of view is segmented into multiple regions of interest (ROIs) based on object detection results. Instead of processing the entire thermal image, the system identifies and processes only specific ROIs containing detected objects, significantly reducing computational load and processing time while maintaining detection accuracy for relevant areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different parameter adjustments are applied to different regions of interest based on their specific characteristics. The system analyzes thermal patterns within each ROI and applies localized parameter tuning (e.g., contrast enhancement, noise filtering) appropriate to that specific region, rather than applying uniform processing across the entire image.

Inventive Principle:
Principle #3Local quality

2Reliability

If thermal sensor parameters are adjusted to improve object detection in all conditions, then detection capability improves, but the system becomes more complex

Engineering Contradiction:
Improveobject detection capabilityVSAvoidparameter adjustment system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The parameter adjustment system is made dynamic and adaptive rather than static. The system continuously monitors thermal sensor data quality and automatically adjusts parameters based on current environmental conditions and detected object characteristics, eliminating the need for complex manual configuration while maintaining high detection reliability across varying conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs self-adjustment of thermal sensor parameters based on analysis of the incoming data and environmental context. The parameter adjustment component autonomously determines optimal settings by analyzing thermal patterns, object detection results, and environmental factors, reducing the need for external intervention or complex control mechanisms.

Inventive Principle:
Principle #25Self-service

3Area of stationary object

If the thermal sensor processes data from the entire field of view, then comprehensive coverage is achieved, but resource consumption increases

Engineering Contradiction:
Improvefield of view coverageVSAvoidcomputational resource consumption
Core Design Contradiction:
Area of stationary objectVSUse of energy by moving object

Solution Approach 1:

The system extracts and processes only the relevant portions of the thermal image corresponding to detected objects and their immediate surroundings. By excluding areas of the field of view that do not contain objects of interest, the system significantly reduces computational resource consumption while maintaining comprehensive monitoring capability for relevant targets.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11392134B1System for tuning parameters of a thermal sensor based on a region of interest
Publication Date: 2022.07.19 ZOOX INC
  • US11392134B1 patent drawing
  • US11392134B1 patent drawing
  • US11392134B1 patent drawing

AI summary

Techniques associated with generating or tuning parameters associated with long wave infrared sensor data to improve object detection associated with the captured images are discussed herein. The system may determine a region of interest associated with the sensor data and adjust or tune the parameters to improve detection(s) within the region of interest. Additionally, the system may adjust the parameters based on map data and/or environmental conditions, such as weather and temperature.