Shelf Barrier Detection Using Frequency Analysis for Empty-Space Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In retail and warehousing environments, structural barriers on shelves cause artifacts in image and depth data captured by mobile automation systems, leading to inaccurate product detection and status information.

Innovation Solution

A method involving frequency-based processing to detect and correct for physical barriers by extracting frequency components from images, identifying barrier regions, and detecting empty sub-regions within these regions to improve object detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If mobile automation systems capture images and depth data to detect product status information, then inventory management capability is improved, but structural barriers on shelves create artifacts in the captured data leading to inaccurate product detections

Engineering Contradiction:
Improveproduct detection accuracyVSAvoidartifacts in captured data
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent segments the shelf structure into barrier regions and non-barrier regions by analyzing frequency components of captured images. The barrier detection system divides the image data into distinct segments, identifying portions corresponding to structural barriers versus product areas, thereby preventing artifacts from contaminating product detection in non-barrier regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary barrier detection and correction process between image capture and product status detection. This intermediary system analyzes frequency components to identify barrier regions, then uses this information to correct artifacts in the captured data before final product detection, acting as a mediator that eliminates the harmful effect of barriers.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If frequency-based processing is applied to identify barrier regions, then artifact reduction is improved, but computational complexity increases

Engineering Contradiction:
Improveproduct status information accuracyVSAvoidcomputational processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies frequency-based processing selectively rather than to the entire image dataset. The system identifies barrier regions using frequency analysis only where necessary, then applies correction primarily to affected areas, reducing overall computational complexity while maintaining reliability in product status detection.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20220130050A1Barrier Detection for Support Structures
Publication Date: 2022.04.28 ZEBRA TECHNOLOGIES CORP
  • US20220130050A1 patent drawing
  • US20220130050A1 patent drawing
  • US20220130050A1 patent drawing

AI summary

A method of barrier detection in an imaging controller includes: obtaining an image of a support structure configured to support a plurality of items on a support surface extending between a shelf edge and a shelf back; extracting frequency components representing pixels of the image; based on the extracted frequency components, identifying a barrier region of the image, the barrier region containing a barrier adjacent to the shelf edge; and detecting at least one empty sub-region within the barrier region, wherein the empty sub-region is free of items between the barrier and the shelf back.