Imaging Object Tracking via 2D-3D Coordinate Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging object tracking systems require multiple cameras to capture three-dimensional coordinates of an imaging object, leading to the need for a large number of cameras in surveillance areas.

Innovation Solution

An imaging object tracking system that uses an entrance/exit detection camera, an entrance/exit detection upper sensor, and upper sensors to estimate initial positions and generate motion paths, allowing for tracking with a smaller number of cameras by associating two-dimensional image coordinates with three-dimensional coordinate information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are used to capture three-dimensional coordinates of an imaging object, then the accuracy of position estimation is improved, but the number of cameras required increases

Engineering Contradiction:
Improveposition estimation accuracyVSAvoidnumber of cameras
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent transitions from two-dimensional image coordinates to three-dimensional coordinate estimation by introducing height information from upper sensors. The initial position estimation unit calculates three-dimensional coordinates (x, y, z) by combining two-dimensional position data from entrance/exit cameras with height data from upper sensors, enabling accurate 3D tracking with fewer cameras

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces upper sensors as intermediary devices that provide height information to bridge the gap between 2D camera images and 3D position estimation. These sensors act as mediators that supply critical vertical dimension data, allowing the system to achieve three-dimensional tracking accuracy without requiring multiple cameras at every level

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a large number of cameras are arranged in the surveillance area, then the coverage and tracking capability are improved, but the system complexity and cost increase

Engineering Contradiction:
Improvetracking capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the surveillance system into functionally distinct segments: entrance/exit detection cameras for horizontal position tracking, upper sensors for height detection, and overlapping detection areas for transition zones. This segmentation allows each component to perform its specialized function efficiently, reducing overall system complexity while maintaining comprehensive tracking capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The upper sensors serve multiple functions: they detect the height of imaging objects, provide three-dimensional coordinate information, and enable the system to track objects in areas where entrance/exit cameras alone would be insufficient. This multi-functionality reduces the need for additional dedicated cameras, simplifying the overall system

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11004211B2Imaging object tracking system and imaging object tracking method
Publication Date: 2021.05.11 MITSUBISHI ELECTRIC CORP
  • US11004211B2 patent drawing
  • US11004211B2 patent drawing
  • US11004211B2 patent drawing

AI summary

An imaging object tracking system includes an entrance/exit detection camera to take an image of an entrance/exit detection area where an imaging object enters and exits, an entrance/exit detection upper sensor to detect the imaging object being imaged by the entrance/exit detection camera, at least one upper sensor disposed so as to overlap a part of the detection area for detecting the imaging object with an area where the entrance/exit detection upper sensor detects the imaging object, an initial position estimation unit to estimate an initial position of the imaging object on the basis of positional coordinates of the imaging object in a two-dimensional image taken by the entrance/exit detection camera and three-dimensional coordinate information of the entrance/exit detection area, an upper position detection unit to detect a position of the imaging object seen from an upper side thereof, an initial motion path generation unit to generate an initial motion path, and a tracking unit to generate a following motion path by adding a position of the imaging object to the initial motion path.