Visual Search System for E-Commerce Clothing Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing e-commerce search systems rely on keyword-based searches, which can be cumbersome for users trying to find specific products, especially in fashion, as they require accurate descriptions of items, and lack efficiency in providing relevant results.

Innovation Solution

A visual search system that allows users to upload images of clothing items or outfits, using image recognition to identify and highlight items, and then searches a repository for similar products, providing users with visually similar items without the need for keyword input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If keyword-based search is used, then the search system can process simple queries, but it requires accurate descriptions and is cumbersome for users

Engineering Contradiction:
Improveease of product searchVSAvoidaccuracy of search results
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent replaces the mechanical keyboard input system with an optical image-based search system. Users capture images of clothing items with their mobile devices, and the system processes these images to identify and search for similar products. This substitution eliminates the need for users to manually describe items through keywords, making the search process more intuitive and accurate while maintaining ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If image recognition is implemented, then search accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveaccuracy of item identificationVSAvoidcomplexity of search system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary image processing layer between the user's image input and the product database search. The system first processes the captured image to identify clothing items, extract visual features, and generate search queries automatically. This intermediary layer handles the complexity of image recognition and feature extraction, allowing the rest of the system to operate with standard search mechanisms while maintaining high accuracy in item identification.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If visual search is performed on multiple clothing items, then comprehensive results are provided, but processing time increases

Engineering Contradiction:
Improvenumber of similar items foundVSAvoidsearch processing time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent segments the visual search process into distinct stages: image capture, item identification, feature extraction, and result generation. By dividing the search into multiple manageable steps and processing each clothing item independently through these segments, the system can efficiently handle multiple items without overwhelming the processing capacity at any single stage, thus reducing overall processing time while maintaining comprehensive results.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11195227B2Visual search, discovery and attribution method, system, and computer program product
Publication Date: 2021.12.07 SAP SE
  • US11195227B2 patent drawing
  • US11195227B2 patent drawing
  • US11195227B2 patent drawing

AI summary

The present disclosure involves systems, software, and computer implemented methods for visual search, discovery, and attribution in e-commerce systems. One example method includes receiving an image to be used as a basis for a visual search. At least one clothing item in the image and a determined clothing type for each clothing item are identified. A highlighted image is generated that includes highlights of the identified at least one clothing item and determined clothing types. The highlighted image is provided. A selection of a selected clothing item on the highlighted image is received. In response to receiving the selection of the selected clothing item, a visual search is performed that includes searching a clothing item repository to find similar clothing items that are visually similar to the selected clothing item. Information for the similar clothing items is provided in response to the selection of the selected clothing item.