Target Tracking via Sensor-Image Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for tracking targets in images, such as in sports or crime prevention, face accuracy issues due to concentration of targets, occlusion, and insufficient image resolution, leading to erroneous detection and tracking.

Innovation Solution

An information processing apparatus that combines image data from an imaging device with sensor information from sensors attached to targets, using interpolation and identification techniques to improve tracking accuracy by distinguishing and following targets even in complex scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If target tracking is performed solely based on captured images, then the system structure remains simple, but tracking accuracy deteriorates due to target concentration and occlusion

Engineering Contradiction:
Improvetracking accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines image data from imaging devices with sensor data from sensors attached to targets. The information processing apparatus integrates multiple data sources (image data and sensor data) to perform target tracking, thereby improving tracking accuracy while managing system complexity through unified processing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces sensor data as an intermediary element that bridges the gap between image-based tracking and actual target position. Sensors attached to targets provide auxiliary information that mediates the tracking process, enabling more accurate position determination even when visual tracking fails due to occlusion or target concentration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If only image data is used for target identification, then the system remains simple, but identification accuracy deteriorates in complex scenarios

Engineering Contradiction:
Improveidentification accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges image data and sensor data in the information processing apparatus. The processing unit integrates both data types to identify targets, combining the visual information from imaging devices with the positional and motion information from sensors, thereby achieving more accurate identification in complex scenarios.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds another dimension of information by incorporating sensor data alongside image data. This multi-dimensional approach allows the system to identify targets more accurately by considering both visual characteristics and sensor-measured parameters such as position and motion, enabling differentiation of targets in complex scenarios.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If manual corrections are applied to correct erroneous tracking, then tracking accuracy improves, but processing time increases

Engineering Contradiction:
Improvetracking accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by continuously collecting and processing both image data and sensor data before tracking errors occur. The information processing apparatus proactively integrates multiple data sources to maintain accurate tracking, preventing erroneous detection rather than correcting it later, thereby reducing the need for time-consuming manual corrections.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms by continuously comparing image-based tracking results with sensor-based position information. This feedback loop enables the system to automatically detect and correct potential tracking errors in real-time, maintaining high accuracy without requiring manual intervention and minimizing processing time delays.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11721026B2Information processing apparatus, information processing method, and information processing system
Publication Date: 2023.08.08 SONY GROUP CORP
  • US11721026B2 patent drawing
  • US11721026B2 patent drawing
  • US11721026B2 patent drawing

AI summary

There is provided an information processing apparatus including a processing unit that tracks a target on the basis of a captured image that has been captured by an imaging device and sensor information obtained by communication from a sensor that senses the target.