Planogram Compliance Detection Using Shelf Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing retail product storage management systems, including planograms, face challenges in accurately monitoring and maintaining compliance with product placement over time, as customer interactions and employee activities can disrupt the intended arrangement, leading to inefficiencies in inventory management and sales optimization.

Innovation Solution

A method and system utilizing data processing hardware to receive planogram data and images from an imaging device capturing the display shelf, determining product placement compliance by comparing actual placement to the representative placement defined in the planogram, and communicating compliance status to a network, which also accounts for product quantity and stocking status.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual monitoring of product placement is used, then implementation simplicity is maintained, but measurement precision and reliability of compliance monitoring deteriorate

Engineering Contradiction:
Improveproduct placement compliance accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual visual inspection and physical measurement methods with an automated imaging system using cameras and computer vision algorithms. The system captures images of display shelves and uses image processing to automatically detect product positions, compare them against planogram specifications, and generate compliance reports, thereby substituting mechanical human monitoring with an automated optical system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates digital copies (images) of the physical display shelf and product arrangements. These image copies are then processed through algorithms that extract positional information without requiring physical measurement tools or manual intervention, enabling accurate compliance assessment through digital replication and analysis.

Inventive Principle:
Principle #26Copying

2Reliability

If frequent compliance checks are performed, then reliability of product placement monitoring is improved, but loss of time and productivity deteriorate

Engineering Contradiction:
Improvecompliance monitoring consistencyVSAvoidtime for compliance checking
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements continuous or periodic automated imaging and analysis operations that continuously monitor product placement compliance without interrupting retail operations. The system can capture images at scheduled intervals or trigger-based events, maintaining constant surveillance of shelf compliance while allowing uninterrupted customer service and restocking activities.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system performs self-assessment by automatically capturing images, processing them through compliance algorithms, and generating reports without requiring external auditor intervention. This self-monitoring capability enables the retail environment to continuously evaluate its own compliance status, eliminating the need for external time-consuming inspection processes.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If detailed product placement verification is implemented, then measurement precision improves, but device complexity and difficulty of detecting and measuring increase

Engineering Contradiction:
Improveproduct position accuracyVSAvoidproduct placement detection complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces an intermediary layer of image processing algorithms and computer vision software that acts as a mediator between the captured images and the compliance assessment. This intermediary processing layer automatically extracts product positions, identifies products, and compares them against planogram data, thereby simplifying the detection process while maintaining high measurement precision through automated image analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3602436B1Determining product placement compliance
Publication Date: 2023.06.21 KELLANOVA
  • EP3602436B1 patent drawingFigure 1
  • EP3602436B1 patent drawingFigure 2
  • EP3602436B1 patent drawingFigure 3A~3B

AI summary

A method (600) for product compliance includes receiving a planogram (500) defining a representative placement (PR) of a product (12) on a display shelf (200) and receiving at least one image (310) from an imaging device (300) having a field of view (Fv) arranged to capture a top surface (212) of the display shelf. The method also includes determining whether the product is disposed on the display shelf based on the at least one image. When the product is disposed on the display shelf, the method includes determining an actual placement (PA) of the product and comparing the actual placement of the product to the representative placement of the product defined by the planogram. The method further includes determining a planogram compliance (620) based on the comparison of the actual placement of the product to the representative placement of the product and communicating the planogram compliance to a network (150).