Human Presence Detection via Aggregate Confidence Heatmaps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current object detection systems in electronic devices are limited by their inability to effectively handle overlapping regions of interest, leading to reduced accuracy in human presence detection and localization, as they only consider the region with the highest confidence value while ignoring aggregate confidence scores from multiple overlapping regions.

Innovation Solution

The system generates aggregate confidence scores by summing confidence values from overlapping regions of interest and uses these scores to create a heatmap, identifying the strongest cluster of pixels and determining a bounding box through a mean shift clustering algorithm and Gaussian kernel application to improve detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the system only considers the region with the highest confidence value, then the processing complexity is reduced, but the detection accuracy deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoiddetection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent merges multiple overlapping regions of interest by aggregating their confidence scores. Instead of selecting only the single highest confidence region, the system combines confidence values from all overlapping regions to create a composite confidence score, thereby improving detection accuracy while managing processing complexity through efficient aggregation algorithms.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements a universal confidence aggregation mechanism that handles multiple overlapping regions simultaneously. This multi-functional approach allows the same processing framework to evaluate and combine confidence scores from any number of overlapping regions, making the system adaptable to varying detection scenarios without requiring separate processing paths.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If the system aggregates confidence scores from all overlapping regions, then the detection accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the confidence aggregation process into distinct stages: identifying overlapping regions, calculating individual confidence scores, aggregating scores from overlapping regions, and generating final detection results. This segmentation allows the system to manage processing complexity by breaking down the computationally intensive aggregation task into smaller, more manageable operations that can be executed efficiently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial aggregation by focusing computational resources on regions where overlaps actually occur, rather than processing the entire image uniformly. By identifying and aggregating only the relevant overlapping regions of interest, the system achieves improved detection accuracy without unnecessarily increasing processing complexity across the entire image data.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If the system uses aggregate confidence scores to generate heatmaps, then the localization precision is improved, but the computational requirements increase

Engineering Contradiction:
Improvelocalization precisionVSAvoidcomputational requirements
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary aggregation of confidence scores before generating heatmaps. By pre-computing the aggregate confidence values for all overlapping regions and storing them in an optimized data structure, the system prepares the data in advance for heatmap generation. This preliminary action reduces the computational burden during the actual heatmap creation process, as the aggregation work has already been completed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses the aggregated confidence scores to automatically generate heatmaps without requiring additional manual processing or intervention. The heatmap generation process leverages the pre-computed aggregate scores directly, allowing the system to serve its own localization needs efficiently. This self-service approach minimizes additional computational requirements by reusing already-processed data.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10380853B1Presence detection and detection localization
Publication Date: 2019.08.13 AMAZON TECH INC
  • US10380853B1 patent drawing
  • US10380853B1 patent drawing
  • US10380853B1 patent drawing

AI summary

A system configured to improve human presence detection and/or localization by generating aggregate confidence values. The system may aggregate confidence values corresponding to overlapping regions of interest. The system may perform human presence detection by comparing the aggregate confidence values to a universal threshold, with aggregate confidence values above the universal threshold indicating that human presence is detected. The system may use the aggregate confidence values to generate a heatmap, may identify a strongest cluster of pixels in the heatmap and determine a bounding box surrounding the strongest cluster. To distinguish the strongest cluster from a second strongest cluster of pixels, the system may apply a Gaussian kernel with varying threshold values. The system may store the threshold value at which the strongest cluster separates from the second strongest cluster and may use the threshold value to generate the bounding box.