Product Image Recognition for Shelf Label Alignment Checks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to maintain consistency in the number and positional relationship between shelf labels and products due to errors in arrangement, such as misplacement or omission, leading to customer confusion.

Innovation Solution

An information processing apparatus with a product recognition unit, shelf label recognition unit, and determination unit to identify and correct inconsistencies in the number and positional relationship between products and shelf labels using image analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If manual arrangement of shelf labels is performed, then flexibility in product lineup changes is improved, but consistency between shelf labels and products deteriorates

Engineering Contradiction:
Improveflexibility in product lineup changesVSAvoidconsistency between shelf labels and products
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system captures images of products and shelf labels, automatically recognizes and compares their positions and relationships, then provides feedback by identifying inconsistencies. This closed-loop feedback mechanism ensures that manual arrangements maintain consistency without requiring constant human verification.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces manual visual inspection and verification of shelf label arrangements with an automated image recognition system. The mechanical process of checking consistency is substituted by computer-based image processing and pattern recognition algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If automated image recognition is used to check shelf label arrangement, then consistency between shelf labels and products is improved, but system complexity increases

Engineering Contradiction:
Improveconsistency between shelf labels and productsVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The image recognition system is designed to perform multiple functions: capturing images, recognizing products, identifying shelf labels, determining their relationships, and detecting inconsistencies. This multi-functional approach consolidates what would otherwise require multiple separate systems into a single integrated solution.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs self-verification by automatically comparing the recognized positions and relationships of products and shelf labels without requiring external manual inspection. The apparatus serves itself by providing automated consistency checking that would otherwise need human operators.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If frequent manual verification of shelf label positions is performed, then arrangement accuracy is improved, but time consumption increases

Engineering Contradiction:
Improvearrangement accuracyVSAvoidtime consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system enables continuous or periodic automatic verification of shelf label arrangements without interrupting store operations. Multiple images can be captured and processed sequentially, maintaining constant monitoring of product-shelf label relationships without requiring manual verification at each change.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system can perform preliminary verification before inconsistencies become problematic by continuously monitoring arrangements. Early detection of misplaced shelf labels allows for prompt correction, preventing accumulation of errors that would require more extensive verification later.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12373780B2Information processing apparatus, control method, and program
Publication Date: 2025.07.29 NEC CORP
  • US12373780B2 patent drawing
  • US12373780B2 patent drawing
  • US12373780B2 patent drawing

AI summary

An information processing apparatus (2000) includes a product recognition unit (2020), a shelf label recognition unit (2040), and a determination unit (2060). The product recognition unit (2020) recognizes the number of types of products or positions of each type of products from a target image. The shelf label recognition unit (2040) recognizes the number or positions of shelf labels indicating information of the products from the target image. The determination unit (2060) determines whether or not there is an error in a relationship between the recognized number of types of products and the recognized number of shelf labels or in a relationship between the recognized positions of each type of products and the recognized positions of the shelf labels.