Image-Based Product and Shelf Label Alignment Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to maintain the consistency between the number and positional relationship of shelf labels and products on store shelves, leading to customer confusion due to misalignment or missing labels.

Innovation Solution

An information processing apparatus with a product recognition unit, shelf label recognition unit, and determination unit to identify and correct errors in the number and positional relationship between products and shelf labels using image analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If manual arrangement of shelf labels is performed, then flexibility in product lineup changes is achieved, but consistency between shelf labels and products cannot be ensured

Engineering Contradiction:
Improveflexibility in product lineup changesVSAvoidconsistency between shelf labels and products
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system captures images of shelf labels and products, automatically compares their positions and numbers, and provides feedback when inconsistencies are detected. This closed-loop feedback mechanism ensures that manual arrangements maintain consistency without requiring complex manual verification procedures.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces manual verification mechanisms with an automated image processing and comparison system. The computer automatically analyzes images to detect positional relationships and consistency, substituting human manual checking with automated optical and computational systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If automated image recognition is implemented, then detection accuracy of shelf label positions is improved, but system complexity increases

Engineering Contradiction:
Improvedetection accuracy of shelf label positionsVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image processing system performs multiple functions: capturing images, recognizing shelf label positions, identifying products, and comparing relationships. By making the system universal and multi-functional, the patent reduces the need for separate specialized devices, thereby managing complexity while maintaining high detection accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12380402B2Information processing apparatus, control method, and program
Publication Date: 2025.08.05 NEC CORP
  • US12380402B2 patent drawing
  • US12380402B2 patent drawing
  • US12380402B2 patent drawing

AI summary

An information processing apparatus (2000) includes a product recognition unit (2020), a shelf label recognition unit (2040), and a determination unit (2060). The product recognition unit (2020) recognizes the number of types of products or positions of each type of products from a target image. The shelf label recognition unit (2040) recognizes the number or positions of shelf labels indicating information of the products from the target image. The determination unit (2060) determines whether or not there is an error in a relationship between the recognized number of types of products and the recognized number of shelf labels or in a relationship between the recognized positions of each type of products and the recognized positions of the shelf labels.