Shelf Product Detection Using Binarized Region Widths

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing product detection systems face challenges in accurately detecting stockout and display disturbances on product shelves due to variations in shelf configurations between stores, leading to false recognition and decreased detection accuracy.

Innovation Solution

A product detection device and system that acquires images of shelves, binarizes product and non-product regions, and detects display states based on the widths of these regions and adjacent gaps, using a model learned for each shelf shape to improve accuracy and reduce unnecessary notifications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If a learned model is used to detect product stockout and display disturbance, then detection automation is improved, but detection precision deteriorates due to false recognition caused by varying shelf intervals between stores

Engineering Contradiction:
Improvedetection automationVSAvoiddetection precision
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent applies local quality by creating store-specific detection conditions that adapt to each store's unique shelf characteristics. The system learns the appropriate gap interval for each individual store based on their specific shelf configuration, rather than using a universal detection threshold. This allows the automated detection system to maintain high precision by accounting for local variations in shelf intervals across different stores.

Inventive Principle:
Principle #3Local quality

2Device complexity

If detection conditions are not adjusted for each store's shelf configuration, then device complexity is reduced, but false recognition increases leading to degraded detection accuracy

Engineering Contradiction:
Improvedetection system complexityVSAvoiddetection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent implements preliminary action by pre-learning and storing the appropriate gap intervals for each store before actual product detection begins. The system performs this learning phase in advance to establish store-specific detection parameters, so that during routine operation, the system can efficiently compare actual shelf gaps against these pre-established standards without complex real-time adjustments, thereby maintaining both simplicity and accuracy.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If store-specific detection conditions are implemented, then detection precision is improved, but loss of time increases due to additional learning and configuration requirements

Engineering Contradiction:
Improvedetection precisionVSAvoidconfiguration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies self-service by enabling the system to automatically learn and determine the appropriate gap intervals for each store through image analysis, without requiring manual measurement or configuration by staff. The detection system autonomously captures shelf images, analyzes the actual product spacing, and establishes detection thresholds independently, thereby achieving store-specific precision while minimizing the time investment required from human operators.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20230290105A1Product detection device, product detection system, product detection method, and recording medium
Publication Date: 2023.09.14 NEC CORP
  • US20230290105A1 patent drawing
  • US20230290105A1 patent drawing
  • US20230290105A1 patent drawing

AI summary

A product detection device is provided with: an image acquisition unit; a binarization unit; and a detection unit. The image acquisition unit acquires an image of shelves for displaying products. The binarization unit binarizes a region in the image into a product region where products are imaged and a non-product region where things other than the products are imaged. The detection unit detects the display state of products displayed on the shelves in accordance with the width of the binarized product region and the width of a gap region adjacent to the products.