Image Search Indexing via User Annotation Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image search engines primarily rely on filename-based indexing, which limits the search capabilities to image information and fails to provide comprehensive search related to the image's content.

Innovation Solution

A method and apparatus that allow users to upload and annotate images, with the annotation content being stored and used as a search index, enabling more detailed searches and facilitating business transactions by providing additional information about merchandise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If filename-based indexing is used for image search, then the search system is simple to implement, but the search capability is limited to image information only

Engineering Contradiction:
Improvesearch system complexityVSAvoidsearch capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by pre-processing images to extract visual features and pre-generating visual indexes before actual search queries are submitted. The server performs feature extraction and index building in advance, so that when users submit search images, the system can quickly compare against pre-computed visual features rather than analyzing images in real-time during search operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces visual features as an intermediary between the image data and the search query mechanism. Instead of directly comparing filenames or performing complex image analysis during search, the system uses extracted visual features (color histograms, texture descriptors, shape features) as intermediate representations that enable efficient similarity comparison and expand search capabilities beyond simple filename matching.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If annotation content is collected and stored for each image, then more comprehensive search information is provided, but the system complexity increases

Engineering Contradiction:
Improveimage information completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies universality by designing the visual index structure to serve multiple functions simultaneously. The same visual feature extraction and indexing mechanism supports both image similarity search and annotation-based search. The index can be queried using either visual features from upload images or annotation content, making the system multi-functional without requiring separate processing pipelines for each search type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent segments the image data processing into distinct components: visual feature extraction, annotation content processing, and index generation. Each component handles specific aspects of image information independently, allowing the system to manage complexity by dividing the overall processing task into manageable segments that can be optimized and maintained separately.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9563706B2Image search apparatus and methods thereof
Publication Date: 2017.02.07 ALIBABA GROUP HOLDING LTD
  • US9563706B2 patent drawing
  • US9563706B2 patent drawing
  • US9563706B2 patent drawing

AI summary

Embodiments of a method and apparatus of image search are provided. An exemplary method of image search includes: receiving a request and returning a web page, where the returned web page allows uploading an image and adding annotation content for the image; receiving and storing the image and the annotation content for the image; and providing the annotation content for the image as a search index to an image search engine. Using the disclosed method and server, more searches related to information in an image can be provided. Moreover, because more information related to merchandise in an image can be provided to a viewer, it is believed that more online transactions can be facilitated.