Automated Object Tracking on Resource-Constrained Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current automated systems for tracking and counting objects are resource-intensive, requiring significant computational resources and often resulting in high false positives/negatives, making them inefficient on resource-constrained devices.

Innovation Solution

A computer device with a processor and memory configured to selectively process image frames based on timing rules, allowing for efficient object detection, tracking, and classification, balancing resource utilization by performing resource-intensive operations only when necessary, using a combination of machine vision and machine learning techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If machine learning approaches are used for detecting objects, then classification accuracy is improved, but computational resource consumption increases significantly

Engineering Contradiction:
Improveclassification accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the image processing pipeline into distinct stages: object detection using simple blob tracking, object tracking through frames, and classification using machine learning only when timing rules are satisfied. This segmentation allows the system to use computationally inexpensive methods for routine tasks while reserving resource-intensive machine learning for specific moments, thereby resolving the contradiction between accuracy and resource consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements periodic classification by introducing timing rules that determine when machine learning-based classification should be performed. Instead of classifying every detected object in every frame, the system periodically applies classification based on timing conditions, reducing overall computational resource consumption while maintaining acceptable classification accuracy for the subset of objects processed.

Inventive Principle:
Principle #19Periodic action

2Measurement precision

If complex computer vision approaches are used for tracking objects, then tracking accuracy is improved, but processing speed decreases due to high computational resource demands

Engineering Contradiction:
Improvetracking accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the tracking and classification functions into separate processing stages. Simple blob tracking is used for continuous object localization across frames, while complex classification is applied periodically to selected frames based on timing rules. This segmentation maintains tracking accuracy through continuous simple tracking while improving processing speed by limiting expensive operations to periodic intervals.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by performing classification only on a subset of detected objects and only when timing rules are satisfied, rather than classifying every object in every frame. This partial application of complex vision algorithms maintains adequate tracking accuracy for monitored objects while significantly improving overall processing speed and resource efficiency.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If simple blob tracking is used for object detection, then processing speed is improved, but classification accuracy deteriorates due to lack of sophisticated analysis

Engineering Contradiction:
Improveprocessing speedVSAvoidclassification accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments detection and classification into separate stages performed by different methods. Simple blob tracking handles the detection and tracking functions with high processing speed, while machine learning-based classification is applied periodically to selected frames to provide accurate object type identification. This segmentation allows each method to excel at its designated task, resolving the contradiction between speed and accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses periodic classification based on timing rules to apply sophisticated machine learning analysis at intervals rather than continuously. This periodic application of accurate classification methods compensates for the limited accuracy of simple blob tracking while maintaining high processing speed during the intervals when only simple tracking is performed.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS10769808B2Apparatus and methods of automated tracking and counting of objects on a resource-constrained device
Publication Date: 2020.09.08 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10769808B2 patent drawing
  • US10769808B2 patent drawing

AI summary

The present disclosure provides apparatus and methods for automated tracking and counting of objects in a set of image frames using a resource-constrained device based on analysis of a selected subset of image frames, and based on selectively timing when resource-intensive operations are performed.