Visual Image Analysis for Context-Aware E-Commerce Recommendations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulty in visualizing how items, such as furniture, would look in a specific setting within electronic commerce systems, as current systems lack the ability to effectively integrate items into digital images of rooms based on their characteristics and user preferences.

Innovation Solution

An electronic commerce system communicates with image processing services to analyze digital images of settings, identify characteristics, and recommend items that can be virtually inserted into empty regions, using an image modification engine to generate modified images showing the items in context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional search engines and item taxonomy navigation are used, then users can find items through systematic browsing, but users cannot visualize how items look in specific settings

Engineering Contradiction:
ImproveVisualization capabilityVSAvoidSystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system creates a digital copy of the user's physical setting by analyzing an uploaded image. This digital representation is then used to virtually place items into the setting, allowing users to visualize how furniture or decor would look in their actual space without physically moving items or visiting multiple product pages.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

An image analysis engine acts as an intermediary between the user's photo and the recommendation system. This engine extracts spatial, color, and contextual information from the image, which then feeds into the item recommendation algorithm, enabling context-aware suggestions that match the user's existing decor and space characteristics.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If users manually browse through extensive item taxonomies, then they can find specific items, but it requires significant time and effort

Engineering Contradiction:
ImproveItem discovery efficiencyVSAvoidTime spent browsing
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs automated analysis of the user's setting image to generate item recommendations without requiring manual browsing. The image analysis engine automatically extracts relevant features such as room type, existing furniture styles, color schemes, and spatial characteristics, then the recommendation service autonomously selects and ranks appropriate items based on these extracted features.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-processes and analyzes the user's setting image upfront, extracting all relevant contextual information before item recommendations are generated. This preliminary analysis of the physical space characteristics enables the system to quickly provide targeted recommendations without requiring users to navigate through extensive taxonomies during the shopping process.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If item pages display detailed descriptions and images, then product information is comprehensive, but users still cannot perceive how the item looks in their specific setting

Engineering Contradiction:
ImproveContextual visualizationVSAvoidUser interaction simplicity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system transitions from two-dimensional product images on item pages to a three-dimensional contextual visualization by placing virtual items into the user's actual room photo. This dimensional transformation allows users to perceive depth, scale, and spatial relationships, providing a realistic view of how items will look in their specific setting rather than isolated product shots.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9639957B2Recommendations utilizing visual image analysis
Publication Date: 2017.05.02 AMAZON TECH INC
  • US9639957B2 patent drawing
  • US9639957B2 patent drawing
  • US9639957B2 patent drawing

AI summary

Disclosed are various embodiments for generating recommendations utilizing visual image analysis. A digital image provided by a client device is analyzed to identify an empty region in a setting embodied in the digital image. A recommended item, available for consumption via an electronic commerce system, may be identified based on characteristics of the setting embodied in the digital image and historical data associated with a user. A modified form of the digital image is generated comprising the recommended item in the empty region.