Steerable Optical-Radar Sensing for Wide-FOV Target Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile platforms face a trade-off between achieving a wide field of view and high angular resolution with existing imaging sensors, which limits their ability to effectively detect and track moving and non-moving objects in real-time.

Innovation Solution

A system and method utilizing a steerable optical sensor and a steerable radar unit, where the optical sensor and radar unit are operatively connected to control the device, allowing for high angular resolution at a wide field of view by scanning specific regions of interest and fusing image and radar data to determine target location and velocity, enabling real-time control of the device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a wide field of view is achieved with imaging sensors, then the coverage area is improved, but the angular resolution deteriorates

Engineering Contradiction:
Improvefield of view coverageVSAvoidangular resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system segments the sensing task by using multiple sensors (optical sensor and radar unit) with different capabilities. The optical sensor provides high-resolution imaging while the radar unit provides wide-area detection, dividing the overall sensing function to overcome the trade-off between field of view and angular resolution

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges data from the optical sensor and radar unit through data fusion in the controller. This combination allows the system to achieve both wide field of view coverage (from radar) and high angular resolution (from optical sensor) simultaneously, resolving the technical contradiction

Inventive Principle:
Principle #5Merging (Combining)

2Speed

If real-time detection and tracking is implemented, then the response speed is improved, but the computational complexity increases

Engineering Contradiction:
Improvedetection and tracking speedVSAvoidsystem complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system performs preliminary detection using the radar unit to identify regions of interest before the optical sensor conducts detailed imaging. This preliminary action reduces the computational burden on the optical sensor by limiting its operation to specific areas, enabling real-time processing while managing system complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the sensing strategy based on detected targets. When targets are detected by radar, the optical sensor is steered to those specific regions for detailed imaging. This dynamic adaptation allows real-time response while optimizing computational resources and managing system complexity

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system enhances the detection and tracking capabilities of mobile platforms by achieving high angular resolution over a wide field of view, allowing for precise control of the device, such as automatic braking or lane changes, based on target location and velocity data.

Implementation Method 1

The radar unit has a steerable radar field of view controllable to scan the respective portions of a full radar field of view

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

The optical sensor has a steerable optical field of view controllable to scan respective portions of a full optical field of view

Methodology Applied
Scientific EffectOptical detection: Reflection

Data Source

PatentUS11035945B2System and method of controlling operation of a device with a steerable optical sensor and a steerable radar unit
Publication Date: 2021.06.15 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US11035945B2 patent drawing
  • US11035945B2 patent drawing
  • US11035945B2 patent drawing

AI summary

System and method of controlling operation of a device in real-time. The system includes an optical sensor having a steerable optical field of view for obtaining image data and a radar unit having a steerable radar field of view for obtaining radar data. A controller may be configured to steer a first one of the optical sensor and the radar unit to a first region of interest and a second one of the optical sensor and the radar unit to the second region of interest. The controller may be configured to steer both the optical sensor and the radar unit to the first region of interest. The radar data and the image data are fused to obtain a target location and a target velocity. The controller is configured to control operation of the device based in part on at least one of the target location and the target velocity.