Planogram Image Verification With Visual Discrepancy Indicators

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current layout systems are unable to verify the correspondence between deployed layouts and expected layouts, leading to potential discrepancies.

Innovation Solution

A system utilizing image processing to compare actual layouts with expected layouts, employing image processing engines to annotate and identify items, and generate user interfaces with graphical indicators based on the comparison.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual processes are used to implement layouts, then flexibility in implementation is maintained, but verification of correspondence between deployed and expected layouts cannot be performed

Engineering Contradiction:
Improvelayout correspondence verificationVSAvoidlayout verification automation
Core Design Contradiction:
ReliabilityVSExtent of automation

Solution Approach 1:

The patent replaces manual verification processes with an automated image processing system that captures images of physical displays, processes them through computer vision algorithms, and automatically compares them against expected planogram data. This substitution of mechanical/manual verification with automated digital processing enables reliable correspondence verification while maintaining implementation flexibility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If automated image processing is implemented to verify layouts, then layout correspondence can be verified, but system complexity increases

Engineering Contradiction:
Improvelayout verification accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent employs a multi-functional system where a single image processing platform performs multiple tasks: capturing display images, processing images through various algorithms, comparing against multiple planograms, generating compliance reports, and providing user interfaces. This universal system handles diverse verification needs across different retail environments, reducing overall system complexity through consolidation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary image processing engine that acts as a mediator between the physical display environment and the verification system. This intermediary component captures and processes visual data, translating physical layouts into comparable digital formats without requiring direct complex interactions between all system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If detailed image processing is performed to identify items, then measurement precision of item identification improves, but processing time increases

Engineering Contradiction:
Improveitem identification accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial action by selectively processing only the portions of images that contain items requiring verification, rather than analyzing every pixel uniformly. The system identifies item locations, extracts only relevant regions for detailed analysis, and compares them against planogram data, thereby achieving high identification accuracy while minimizing overall processing time.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12572877B2Systems and methods for end-to-end modular intelligence
Publication Date: 2026.03.10 WALMART APOLLO LLC
  • US12572877B2 patent drawing
  • US12572877B2 patent drawing
  • US12572877B2 patent drawing

AI summary

Systems and methods for analyzing computer-readable image data to determine deviations from planogram data are disclosed. Image data of at least one physical display unit is obtained. The image data is annotated by an image processing engine to identify at least one item within the image data. Planogram data of a planogram corresponding to the at least one physical display unit is obtained and the at least one item within the image data is compared to an expected aspect of the at least one item within the planogram data. A user interface is generated including the image data and at least one interface indicator at least partially overlapping with the at least one item in the image data. At least one graphical aspect of the interface indicator is selected based on the comparison between the item within the image data and the item within the planogram data.