AR Shelf Space Detection and Product Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems fail to effectively utilize empty shelf space by not providing adequate solutions for displaying alternative products when a sold-out item is removed, leading to wasted space.

Innovation Solution

An augmented reality system that includes an information processing terminal and apparatus capable of determining empty shelf space and recommending products of matching size from a database, overlaying product information onto the display for optimal placement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If a product is sold out and the shelf space becomes empty, then the product display is simplified, but the shelf space is wasted and cannot be effectively utilized

Engineering Contradiction:
Improvewaste of shelf spaceVSAvoidcomprehension of alternative products for display
Core Design Contradiction:
Loss of substanceVSEase of operation

Solution Approach 1:

The patent introduces an augmented reality display as an intermediary between the empty shelf and the clerk. The AR display shows virtual images of alternative products that can be placed in the empty shelf space, mediating the information gap and enabling effective space utilization without directly modifying the physical shelf or product inventory system

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates virtual copies of products through augmented reality imagery. These virtual product images are superimposed on the AR display to represent alternative products that could occupy the empty shelf space, allowing clerks to visualize placement options without physically moving or handling actual products

Inventive Principle:
Principle #26Copying

2Loss of information

If the system displays all possible alternative products in the empty space, then the comprehensiveness of product recommendations is improved, but the complexity of the display and information processing increases

Engineering Contradiction:
Improveinformation about alternative productsVSAvoidcomplexity of AR display system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies local quality by providing targeted product recommendations specific to each empty shelf space rather than a generic comprehensive list. The AR display shows virtual images of alternative products tailored to the specific dimensions, location, and context of each empty space, making the information locally relevant and reducing overall system complexity

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the shelf space analysis into discrete units, evaluating each empty space independently based on its specific characteristics (size, location, adjacent products). This segmentation allows the system to process information in manageable portions rather than handling all shelf spaces simultaneously, reducing computational and display complexity

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2472475B1Augmented reality providing system, information processing terminal, information processing apparatus, augmented reality providing method, information processing method, and program
Publication Date: 2016.10.05 NS SOLUTIONS CORPORATION
  • EP2472475B1 patent drawingFigure 1
  • EP2472475B1 patent drawingFigure 2~3
  • EP2472475B1 patent drawingFigure 4A~4D

AI summary

An AR providing apparatus (100) sends to a server apparatus (200) a request, including image information of contents of imaging in an imaging device (135), for obtaining product information indicating a product which can be displayed on a shelf which can be determined from the image information, and displays product information included in a reply sent from the server apparatus (200) in response to the request on a display device (120) in a manner of overlaying on image information imaged by the imaging device (135). The server apparatus (200) determines a shelf from the image information included in the request and determining a size of an empty space of the shelf, selects product information of products smaller than the size of the empty space of the determined shelf, from a storage device (210) storing plural sets of product information indicating a product and size information indicating a size of the product in association with each other, and sends a reply including the selected product information to the AR providing apparatus (100).