Hybrid Camera and Doppler Radar Tracking for Sports Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current camera and radar systems for tracking sports objects face challenges such as difficulty in detecting and measuring objects due to contrast and ambient light conditions, limited tracking distance, and inaccuracies in angular and height measurements, especially at low elevations.

Innovation Solution

A method combining 3D Doppler radar with a camera to track sports objects, synchronizing their measurements to improve tracking accuracy, extend tracking distance, and provide precise angular and height measurements by calibrating the camera and radar perspectives and combining their data for enhanced object tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If camera-based image processing is used to track sports objects, then trajectory visualization can be provided, but detection accuracy deteriorates due to contrast and ambient light conditions

Engineering Contradiction:
Improvetrajectory data availabilityVSAvoidobject detection accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent combines radar tracking data with camera image processing to create a hybrid system. The radar provides reliable detection and measurement data independent of lighting conditions, while the camera provides visual context and trajectory visualization. The system merges these data sources to compensate for the weaknesses of each individual modality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces radar as an intermediary measurement system that bridges the gap between visual detection and precise measurement. The radar serves as a mediator that provides accurate position and velocity data when camera-based detection fails due to poor contrast or lighting, enabling continuous tracking.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Length of stationary object

If radar-based systems are used to track sports objects, then tracking distance is extended, but measurement accuracy deteriorates due to multipath effects at low elevations

Engineering Contradiction:
Improvetracking distanceVSAvoidangular and height measurement accuracy
Core Design Contradiction:
Length of stationary objectVSMeasurement precision

Solution Approach 1:

The patent merges radar and camera measurement systems to compensate for radar's multipath effects. The camera provides independent angular position measurements that are not susceptible to radar's multipath interference, especially at low elevations. By combining both measurement sources, the system achieves accurate angular and height measurements while maintaining extended tracking distance.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If camera tracking is used to provide trajectory visualization, then visual feedback is improved, but tracking reliability deteriorates due to temporary loss of track

Engineering Contradiction:
Improvetrajectory visualization qualityVSAvoidcontinuous tracking capability
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where radar tracking data continuously monitors and supplements camera-based tracking. When the camera temporarily loses track of the object, the radar maintains tracking and provides position data. The system uses radar feedback to recover and continue trajectory visualization without interruption, ensuring continuous and reliable tracking.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This combination enhances the accuracy and reliability of tracking sports objects by minimizing offsets between camera and radar measurements, providing accurate trajectory data, and overcoming limitations of individual systems, such as temporary loss of track and distance constraints.

Implementation Method 1

Doppler radar for simultaneous tracking of the moving sports object

Methodology Applied
Scientific EffectDoppler effect: Doppler Effect

Data Source

PatentUS11016188B2Systems to track a moving sports object
Publication Date: 2021.05.25 EDH US LLC
  • US11016188B2 patent drawing
  • US11016188B2 patent drawing
  • US11016188B2 patent drawing

AI summary

Systems, methods and computer-readable media are provided for tracking a moving sports object. In one example, a method of tracking a moving sports object includes calibrating a perspective of an image of a camera to a perspective of a Doppler radar for simultaneous tracking of the moving sports object, and tracking the moving sports object simultaneously with the camera and Doppler radar. The method may further comprise removing offsets or minimizing differences between simultaneous camera measurements and Doppler radar measurements of the moving sports object. The method may also include combining a camera measurement of an angular position of the moving sports object with a simultaneous Doppler measurement of a radial distance, speed or other measurement of the moving sports object.