Stereo Height-Map Traffic Sensing for Building Energy Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current object detection and tracking systems for human objects in facilities face challenges such as background clutter, occlusion, lighting conditions, and the inability to distinguish between incoming and outgoing traffic, as well as between different heights, leading to unreliable and costly maintenance requirements.

Innovation Solution

A computer-implemented system using stereo cameras to capture images, convert them into height maps, and track human objects by detecting local maxima in the height maps, allowing for precise counting and differentiation between moving and static objects, while also integrating RFID technology to separately track employees and customers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If monocular video streams are used for object detection and tracking, then the system is simpler and cheaper, but the system becomes unreliable under adverse lighting conditions and background clutter

Engineering Contradiction:
Improvesystem complexityVSAvoiddetection reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent transitions from monocular 2D intensity images to stereo 3D range/height maps, adding a depth dimension. This dimensional change allows the system to detect objects based on their spatial position and height rather than intensity, making it immune to lighting conditions, shadows, and background clutter that plague monocular systems.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If stereo systems are used for robust detection, then reliability improves under adverse conditions, but the system complexity and cost increase

Engineering Contradiction:
Improvedetection reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts and utilizes only the height map information from stereo images, discarding the intensity information that causes problems with lighting and background clutter. By focusing on the essential height dimension and applying background differencing only to height maps, the system achieves robustness without requiring complex processing of all image data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different processing strategies to different types of information: intensity images are used for initial object detection, while height maps are used for robust tracking and background differencing. Each data type is processed according to its strengths, with height maps handling the demanding task of reliable detection under varying lighting conditions.

Inventive Principle:
Principle #3Local quality

3Ease of operation

If background differencing is used in monocular systems, then object detection is simplified, but the system becomes susceptible to background clutter and lighting changes

Engineering Contradiction:
Improvedetection simplicityVSAvoidbackground clutter sensitivity
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent applies background differencing not to intensity images but to height maps derived from stereo vision. Since height information is unaffected by lighting conditions and background clutter, the background differencing operation becomes robust while maintaining its simplicity. Objects are detected by finding regions where the height map differs from the background height map.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Adaptability or versatility

If adaptive template matching is used for object detection, then detection can adapt to changing conditions, but detections drift from true locations and are prone to occlusion

Engineering Contradiction:
Improvedetection adaptabilityVSAvoiddetection accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent performs template matching and object recognition in the height map domain rather than intensity domain. Height maps provide accurate spatial information that is not affected by lighting variations, allowing templates to be matched precisely to object locations even when occluded or when lighting conditions change. The height dimension provides a stable reference for accurate localization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10915131B2System and method for managing energy
Publication Date: 2021.02.09 SHOPPERTRAK RCT LLC
  • US10915131B2 patent drawing
  • US10915131B2 patent drawing
  • US10915131B2 patent drawing

AI summary

A method of managing energy consumption in an enclosed spaced includes the step of providing temperature and foot traffic data to a plan generator. The method further includes the steps of generating an energy plan based on the temperature and foot traffic data and controlling one or more energy consuming devices based on the energy plan.