Radar-Assisted Optical Tracking for Target Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mission systems using electro-optical cameras struggle to track targets effectively in adverse weather conditions or when the field of view is obstructed, as existing radar tracking methods are complex, inefficient, and only assist late in the identification process, often focusing on non-interesting objects and failing to provide useful optical information.

Innovation Solution

A radar-assisted optical tracking method that integrates video images from electro-optical cameras with radar sensor data, converting radar plots into camera coordinates, adding graphic symbols to video images, and using estimation algorithms to maintain target tracking even when optical detection is lost, allowing the camera to be slaved to radar-estimated positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If radar tracking is performed for all detected objects, then target identification is improved, but processing complexity and time consumption increase significantly

Engineering Contradiction:
Improvetarget identification accuracyVSAvoidradar tracking process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and processes only the most relevant radar data for optical tracking assistance. Instead of processing all radar-detected objects, the system selectively processes plots that are most likely to be of interest to the operator, thereby reducing processing complexity while maintaining identification accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary processing of radar plots by converting them to camera coordinates and pre-filtering relevant targets before the optical tracking phase. This preliminary action reduces the workload during real-time optical tracking and identification.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If radar and optical data fusion is implemented, then target tracking capability in adverse conditions is improved, but system complexity increases

Engineering Contradiction:
Improvetarget tracking reliability in adverse weatherVSAvoiddata fusion system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses coordinate transformation as an intermediary process to bridge radar and optical data systems. By converting radar plots to camera coordinates, the system creates a common reference frame that simplifies data fusion while maintaining tracking reliability in adverse weather conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the data fusion process into distinct modules: radar plot acquisition, coordinate transformation, plot correction, and overlay display. This segmentation allows each module to be optimized independently while maintaining overall system reliability.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If electro-optical camera is used for target detection, then image quality is improved, but detection capability deteriorates in cloudy or obstructed conditions

Engineering Contradiction:
Improvetarget detection precision in clear conditionsVSAvoidweather conditions and obstruction sensitivity
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent merges radar detection capabilities with electro-optical camera detection. Radar provides all-weather detection capability while the camera provides high-quality images in clear conditions, creating a complementary system that overcomes the limitations of either sensor alone.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent prepares backup radar tracking data in advance so that when optical detection fails due to weather or obstruction, the system can immediately switch to radar-assisted tracking without interruption, cushioning against detection failures.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

4Measurement precision

If camera is pointed at radar targets, then target observation is improved, but operator needs to wait for lengthy radar tracking process

Engineering Contradiction:
Improvetarget observation accuracyVSAvoidtime delay in target identification
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary coordinate transformations and plot corrections in advance, so that when the operator wants to observe a radar target, the camera can be quickly pointed at the correct position without waiting for the full radar tracking process to complete.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent performs only the essential partial actions needed for rapid target acquisition (coordinate transformation and basic plot correction) rather than waiting for complete radar tracking processing, reducing time delay while maintaining observation accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3241035B1Radar-assisted optical tracking method and mission system for implementation of this method
Publication Date: 2019.01.30 THALES SA
  • EP3241035B1 patent drawingFigure 1
  • EP3241035B1 patent drawingFigure 2~3

AI summary

The invention relates to a method implemented within a mission system comprising an electro-optical camera which generates video images, detects movable objects, and tracks a target object, and a radar sensor which generates signals and detects points, said method involving: acquiring (110) a video image provided by the camera and points provided by the radar sensor at the time of generation of the acquired video image; converting (120) the geographic position of each acquired point, expressed in a first reference mark associated with the radar sensor, into a geographic position expressed in a second reference mark associated with an aiming direction of the electro-optical camera at the time of generation of the video image, correcting (130) the geographic position of each point in the second reference mark, according to the characteristics of the camera, such as to obtain a position in the image.