Mixed Reality Product Overlay for In-Store Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In-store shoppers lack the ability to visualize products in their preferred locations, making it difficult to assess fit and aesthetics, unlike online shoppers, and rely on printed labels and signage for information, which is insufficient for decision-making.

Innovation Solution

A mixed reality-based system that uses a processor to detect products viewed through a mixed reality device, identifies preferred environments from user profiles, generates depictions of these environments, and allows users to purchase products by overlaying them virtually, with feedback improvement using reinforcement learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If shoppers rely on printed labels and signage for product information, then the information is readily available, but the information is insufficient for decision-making

Engineering Contradiction:
Improveproduct information completenessVSAvoidinformation presentation system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces a mixed reality device as an intermediary between the shopper and the product information. The device captures images of products and overlays augmented reality content, serving as a mediator that delivers comprehensive product information including virtual try-ons, detailed specifications, and placement visualizations without requiring complex physical signage or label systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates virtual copies of products through augmented reality overlays. Instead of relying on printed representations, the system projects digital twins or virtual models of products directly into the shopper's field of view, allowing them to examine products from all angles, see them in different colors, and visualize them in their intended environment without physical manipulation.

Inventive Principle:
Principle #26Copying

2Ease of operation

If online shoppers can visualize products in their locations, then purchasing decisions are easier, but in-store shoppers lack this ability

Engineering Contradiction:
Improveproduct visualization capabilityVSAvoidshopping decision efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent adds a digital dimension to the physical shopping experience by overlaying virtual product representations onto the real-world environment through mixed reality. This allows in-store shoppers to visualize products in their home environments directly through the device, combining the tactile advantage of physical store shopping with the visualization benefit of online shopping.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces the mechanical action of physically transporting products home for trial with a digital visualization system. The mixed reality device renders virtual products in the shopper's environment, eliminating the need for physical movement and setup while providing the same decision-making information.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If mixed reality devices overlay virtual information, then product information is enhanced, but the system complexity increases

Engineering Contradiction:
Improveproduct information deliveryVSAvoidmixed reality system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent designs the mixed reality device to perform multiple functions: capturing product images, accessing product databases, rendering augmented reality overlays, and providing navigation assistance. By consolidating these functions into a single device, the system avoids the complexity of multiple separate systems while delivering comprehensive product information.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system enables shoppers to independently access and interact with product information without requiring store staff assistance. The mixed reality device automatically captures product images, retrieves relevant information, and presents it through augmented reality, allowing shoppers to serve themselves with comprehensive product data.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20230093331A1Shopper-based commerce driven presentation of required-but-missing product related information
Publication Date: 2023.03.23 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20230093331A1 patent drawing
  • US20230093331A1 patent drawing
  • US20230093331A1 patent drawing

AI summary

In an approach for a shopper-based commerce driven presentation of required-but-missing product related information, a processor detects a user viewing a physical product via a mixed reality device. A processor identifies a preferred environment for the physical product from a personal shopper profile of the user. A processor generates via the mixed reality device a depiction of the preferred environment. A processor determines whether the physical product can be overlaid in the preferred environment. A processor enables the user to purchase a product based on the determination.