Information processing apparatus, information processing system, control method, and program

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In retail environments, manually checking the correctness of product displays on shelves is labor-intensive and prone to human error, as workers visually verify if products are correctly positioned and faced according to prescriptions.

Innovation Solution

An information processing system that captures images of product shelves, performs image analysis to generate actual display information, compares it with reference display information, and generates comparison information to identify mismatches, reducing human error and workload by providing a visual representation of correct and incorrect placements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visual inspection by workers is performed to verify product display correctness, then display accuracy can be confirmed, but work load increases significantly

Engineering Contradiction:
Improvedisplay verification accuracyVSAvoidworker burden
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical visual inspection system with an automated image processing system. The system captures images of product shelves using imaging devices, processes these images to identify product positions and orientations, and automatically verifies whether products are displayed according to prescriptions. This substitution eliminates the need for manual visual inspection while maintaining verification accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-verification of product display correctness through automated image capture and processing. The imaging devices and processing units work autonomously to detect product positions, compare them against display prescriptions, and generate verification results without requiring worker intervention. This self-service mechanism resolves the contradiction by providing reliable verification while eliminating worker burden.

Inventive Principle:
Principle #25Self-service

2Reliability

If manual visual checking is used to verify product display, then correctness can be confirmed, but time consumption increases

Engineering Contradiction:
Improveverification correctnessVSAvoidchecking time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces time-consuming manual visual checking with automated image processing. The system captures multiple images of product shelves simultaneously, processes them using automated algorithms to identify product positions and orientations, and rapidly compares results against display prescriptions. This mechanical-to-automated substitution dramatically reduces verification time while maintaining or improving correctness through systematic image analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables continuous verification operations by automatically capturing images and processing them without interruption. Multiple imaging devices can operate simultaneously, and the processing unit continuously analyzes images to verify product display correctness. This continuous automated operation eliminates the time loss associated with manual checking while maintaining reliable verification through uninterrupted systematic analysis.

Inventive Principle:
Principle #20Continuity of useful action

3Ease of operation

If automated image processing is implemented to verify product display, then work load is reduced, but system complexity increases

Engineering Contradiction:
Improveoperational simplicityVSAvoidsystem structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent employs imaging devices and processing units that serve multiple functions within the verification system. The imaging devices capture images for analysis, while the processing units perform image processing, product identification, position verification, and result generation. This multi-functionality reduces the need for separate specialized components, thereby managing system complexity while providing comprehensive automated verification capabilities that simplify operations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses image data as an intermediary between the physical product display and the verification process. Instead of directly monitoring physical product positions, the system captures images that serve as intermediaries, processes these image representations to extract product information, and uses this processed information for verification. This intermediary approach manages system complexity by working with standardized image data rather than directly manipulating complex physical monitoring mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If comprehensive product display verification is performed, then accuracy is improved, but processing time increases

Engineering Contradiction:
Improvedisplay verification precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the product shelf into multiple segments or regions, with imaging devices capturing images of different segments simultaneously or in rapid sequence. The processing unit then analyzes each segment independently to identify product positions and orientations within that specific region. This segmentation allows comprehensive verification of the entire shelf while reducing processing time by distributing the analysis workload across multiple parallel processing streams rather than analyzing the entire shelf as a single unit.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs verification on representative samples or key product positions rather than exhaustively checking every single product position in detail. The image processing focuses on identifying critical verification points such as product orientations, prominent display positions, and prescription-compliance markers. This partial action approach maintains high measurement precision for critical elements while significantly reducing overall processing time by avoiding exhaustive analysis of every detail.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11531960B2Information processing apparatus, information processing system, control method, and program
Publication Date: 2022.12.20 NEC CORP
  • US11531960B2 patent drawing
  • US11531960B2 patent drawing
  • US11531960B2 patent drawing

AI summary

An information processing apparatus (2000) acquires a shelf rack image (12) in which a product shelf rack on which a product is displayed is imaged. The information processing apparatus (2000) performs image analysis on the shelf rack image (12), and generates information (actual display information) relevant to a display situation of the product on a product shelf rack (20). The information processing apparatus (2000) acquires reference display information representing a reference for display of the product on the product shelf rack (20). The information processing apparatus (2000) compares the actual display information generated by performing the image analysis on the shelf rack image (12) with the acquired reference display information, and generates comparison information representing a result.