Image Recognition Device Detecting Product Misplacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing merchandise monitoring systems cannot detect when a product is returned to a different place from its original arrangement, leading to inefficiencies in inventory management and potential loss of sales opportunities.

Innovation Solution

An image processing device equipped with a change detecting unit and a display detecting unit that analyzes captured images to identify changes in product display status and detects when a product is returned to a different location based on these changes and the presence of individuals in the image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a monitoring device only detects display disorder or display shortage of merchandise, then the device can identify basic inventory issues, but it cannot detect when a customer returns a product to a different place from its originally arranged place

Engineering Contradiction:
Improvedetection accuracyVSAvoiddetection scope
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments the detection process into distinct functional units: a change detecting unit that identifies changes in product display status, a person detecting unit that identifies customers in the captured images, and a returning unit that determines whether a product was returned to a different place. This segmentation allows each unit to specialize in specific detection tasks, improving overall detection accuracy while maintaining system versatility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional two-dimensional image analysis to three-dimensional spatial analysis by capturing images at multiple positions (above and beside the shelf) and analyzing the spatial coordinates of products before and after customer interaction. This dimensional expansion enables the system to detect whether a product was returned to a different location on the shelf, not just whether it was moved.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If the device uses basic image processing to detect product changes, then the system remains simple, but it cannot determine whether a customer has returned a product to a shelf before settlement or placed it in an incorrect location

Engineering Contradiction:
Improvesystem simplicityVSAvoidproduct placement information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent captures images at multiple predetermined positions (above the shelf and beside the shelf) before and during customer interaction with products. This preliminary capture of spatial information from multiple angles allows the system to later determine whether a product was returned to the correct location or placed incorrectly, without requiring complex real-time analysis during the customer's action.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical tracking systems with optical image processing. By using cameras to capture images at multiple positions and analyzing the spatial coordinates of products in these images, the system can track product movement and determine placement accuracy without requiring physical sensors or mechanical tracking devices on each product.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If the monitoring system only tracks product quantity changes, then the system remains straightforward, but it cannot identify misplacement of products or provide timely merchandise management notifications

Engineering Contradiction:
Improveinventory management efficiencyVSAvoidinventory accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the image processing device continuously monitors product display status, detects changes in product placement, and provides notifications to store personnel. The system compares the current product positions with the expected positions and feeds back information about misplacements, enabling timely corrective action and improving overall inventory management reliability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11475673B2Image recognition device for detecting a change of an object, image recognition method for detecting a change of an object, and image recognition system for detecting a change of an object
Publication Date: 2022.10.18 NEC CORP
  • US11475673B2 patent drawing
  • US11475673B2 patent drawing
  • US11475673B2 patent drawing

AI summary

An image processing device has: a change detecting unit configured to, based on a captured image in which an product to be monitored is shown, detect a change in display status of the product; and a display detecting unit configured to detect that the product is returned to a different place from a place where the product has been picked up based on the change in display status of the product detected by the change detecting unit and on a person included in the captured image.