AR Product Recommendation System Using Environmental Style Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional web-based marketing techniques fail to provide accurate product recommendations as they do not consider the environment in which a product will be used, leading to recommendations that may not fit the user's surroundings or color scheme.

Innovation Solution

A product recommendation system using augmented reality that determines a viewpoint by overlaying a candidate product in a user's surroundings, evaluating style and color compatibility to create personalized recommendation images, ensuring the product fits the intended environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If web-based marketing techniques use browsing history data to provide product recommendations, then the recommendation process is simple and fast, but the recommendations do not account for the environment in which the user will use the product

Engineering Contradiction:
Improveenvironmental adaptability of product recommendationsVSAvoidcomplexity of recommendation system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by capturing images of the user's environment and performing style analysis before product recommendations are generated. This allows the system to pre-understand the environmental context (color schemes, existing furniture styles, room layout) so that when product recommendations are needed, they can be quickly matched to the pre-analyzed environmental characteristics, resolving the contradiction between environmental adaptability and system complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a digital representation (copy) of the user's physical environment by capturing images and extracting style attributes. This copied environmental model is then used to evaluate and select products that match the environment, avoiding the need for complex real-time analysis of the physical space while still achieving environmental adaptability in recommendations.

Inventive Principle:
Principle #26Copying

2Measurement precision

If product recommendations are based on limited browsing history information, then the system is simple to implement, but the accuracy of recommendations is insufficient

Engineering Contradiction:
Improveprecision of product recommendationVSAvoidinformation completeness about user environment
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system transitions from one-dimensional browsing history data to multi-dimensional environmental information by capturing images of the user's physical environment. This adds new dimensions (visual appearance, color scheme, existing furniture styles, spatial layout) to the data available for recommendations, significantly improving recommendation precision without requiring complex additional information collection processes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system changes the parameters used for recommendations from basic browsing metadata to detailed environmental parameters extracted from images, such as dominant colors, furniture styles, room lighting conditions, and spatial relationships. This parameter transformation enables more precise matching of recommended products to the user's actual environment.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the system captures and analyzes the user's environment using augmented reality, then product fit to environment is improved, but the time and computational resources required increase

Engineering Contradiction:
Improvereliability of product-environment fitVSAvoidtime for environment analysis
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs environment capture and style analysis as preliminary actions that can be done once when the user first uses the system or when their environment changes. The extracted environmental characteristics are stored and reused for subsequent product recommendations, avoiding repeated analysis and significantly reducing the time required for each recommendation while maintaining reliable product-environment fit.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system automatically captures environmental images and performs style analysis without requiring manual user input or configuration. This self-service approach eliminates the time users would spend providing detailed environmental information while still achieving reliable environmental matching through automated image processing and style extraction.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10475103B2Method, medium, and system for product recommendations based on augmented reality viewpoints
Publication Date: 2019.11.12 ADOBE INC
  • US10475103B2 patent drawing
  • US10475103B2 patent drawing
  • US10475103B2 patent drawing

AI summary

Provided are methods and techniques for providing a product recommendation to a user using augmented reality. A product recommendation system determines a user viewpoint, the viewpoint including an augmented product positioned in a camera image of the user's surroundings. Based on the viewpoint, the product recommendation system determines the position of the augmented product in the viewpoint and the similarity between the augmented product and other candidate products that are similar to the augmented product. The product recommendation system then creates a set of recommendation images, each recommendation image including an image of the candidate product that is substituted for the augmented product in the viewpoint. The product recommendation system can then evaluate the recommendation images based on overall color compatibility. Based on the evaluation, for example, the product recommendation system selects a recommendation image that is provided to the user.