3D Camera Object Left Behind Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for detecting objects left behind in busy environments, such as airports and retail locations, are inefficient due to confusion between objects and their owners, especially when the object's color matches the background, leading to high false positives and low detection accuracy.

Innovation Solution

The use of three-dimensional (3D) cameras mounted top-down or in corners to segment new objects from the background by calculating depth differences and employing person tracking algorithms like Kalman filtering or Conditional Density Propagation to determine if an object has been abandoned, with alerts triggered based on time thresholds and exclusion zones.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional computer vision methods are used to detect objects left behind, then the system can operate with simple hardware, but the detection accuracy deteriorates due to confusion between objects and their owners in crowded scenes

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transitions from 2D image analysis to 3D depth information analysis. By using depth cameras to capture three-dimensional spatial data, the system can distinguish objects from their owners based on depth differences, even when they occupy the same 2D image space. This dimensional transition resolves the detection accuracy problem in crowded scenes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces depth information as an intermediary parameter between the camera and the detection algorithm. Instead of directly analyzing 2D images, the system uses depth maps to create a three-dimensional representation of the scene, which serves as an intermediate representation that facilitates accurate object-owner separation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If traditional methods are used, then the system structure remains simple, but false positives increase when object color matches the background

Engineering Contradiction:
Improvefalse positive rateVSAvoiddetection system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

By adding the depth dimension to the detection process, the system can identify objects regardless of their color similarity to the background. The depth information provides an additional discrimination criterion that is independent of color, thereby reducing false positives caused by color matching.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If 3D cameras and person tracking are used to improve detection accuracy, then detection precision improves, but the device complexity increases

Engineering Contradiction:
Improveobject separation accuracyVSAvoidcamera and processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs 3D depth cameras to capture spatial information, enabling the system to separate objects from their owners based on depth differences. This dimensional enhancement directly improves object separation accuracy by providing three-dimensional spatial context that distinguishes between closely positioned entities.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Measurement precision

If 3D depth information is used to differentiate objects from owners, then detection accuracy improves in crowded conditions, but processing complexity increases

Engineering Contradiction:
Improvedetection accuracy in crowded scenesVSAvoidprocessing algorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent utilizes 3D depth information to enhance detection accuracy in crowded scenes by providing spatial separation data. The depth dimension allows the system to distinguish between objects and owners even when they are close together in the 2D image plane, thereby improving detection accuracy despite the increased processing complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11600072B2Object left behind detection
Publication Date: 2023.03.07 MOTOROLA SOLUTIONS INC
  • US11600072B2 patent drawing
  • US11600072B2 patent drawing
  • US11600072B2 patent drawing

AI summary

Techniques for automatically detecting objects left behind. An example method includes receiving video frames of a scene from a three-dimensional (3D) camera and establishing, based on 3D depths associated with the video frames, a background of the scene. The method also includes detecting, in the frames, a foreground blob in the scene based on the foreground blob having a 3D depth that is different from the background. The method further includes detecting that the foreground blob has separated into a blob corresponding to a person and a second blob corresponding to an object, based on the person having a 3D depth that is different from the object. The method additionally includes determining that the person has been separated from the object for a threshold, and responsive to determining that the person has been separated from the object for the threshold, generating an alert indicating that the object is left behind.