Automated Shelf Auditing via Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Prior shelf auditing techniques rely on human auditors for identifying items on store shelves, which are labor-intensive, prone to errors, and inefficient, as they require manual processing of photographs to register items displayed in stores.

Innovation Solution

An image processing system that automates shelf auditing by comparing input images of store shelves to a database of reference images, using image signatures and difference detection to identify items and modify audit results, thereby reducing human intervention and increasing accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual auditing by human personnel is used, then item identification can be performed, but the process becomes labor-intensive and inefficient

Engineering Contradiction:
Improveauditing efficiencyVSAvoidmanual processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical manual auditing system with an automated image processing system that uses optical recognition and computer algorithms to identify and register items on shelves, eliminating the need for human auditors to manually examine and record each item

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service auditing where the image processing system automatically captures shelf images, identifies items through pattern recognition, and registers them in the database without requiring human intervention for routine auditing tasks

Inventive Principle:
Principle #25Self-service

2Measurement precision

If human auditors manually process photographs, then items can be registered, but errors increase and accuracy decreases

Engineering Contradiction:
Improveitem identification accuracyVSAvoidauditing consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent replaces human visual inspection with automated optical recognition systems that use computer vision algorithms to consistently identify items, eliminating human errors and variations in judgment while maintaining high accuracy through programmable recognition criteria

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of time

If photographs are sent to central location for manual auditing, then item registration can be completed, but time consumption increases

Engineering Contradiction:
Improveauditing timeVSAvoidprocessing speed
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent replaces the time-consuming manual processing workflow with automated image processing systems that can analyze multiple shelf images simultaneously and rapidly register items, reducing auditing time from days to minutes while increasing processing throughput

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary automated analysis of shelf images immediately upon capture, pre-identifying items and preparing registration data before final database insertion, thereby accelerating the overall auditing process and reducing time loss

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8908903B2Image recognition to support shelf auditing for consumer research
Publication Date: 2014.12.09 THE NIELSEN CO (US) LLC
  • US8908903B2 patent drawing
  • US8908903B2 patent drawing
  • US8908903B2 patent drawing

AI summary

Image recognition methods, apparatus and articles or manufacture to support shelf auditing for consumer research are disclosed herein. An example method disclosed herein comprises comparing an input image depicting a shelf to be audited with a set of reference images depicting reference shelves displaying respective sets of reference items, identifying a first reference image from the set of reference images that has been determined to match the input image, and determining an initial audit result for the shelf depicted in the input image based on a first set of reference items associated with the first reference image.