Reverse Image Search Using SIFT Feature Points and Hierarchical K-Means

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current reverse image search methods suffer from slow search speeds and high error rates due to inefficient retrieval of similar images from large datasets.

Innovation Solution

A reverse image search method that extracts feature points from a search image using the SIFT algorithm, classifies them using a hierarchical integer K-means model, and searches an image classification index table to find matching images with the largest number of identical feature points, improving search efficiency by sorting and filtering results based on similarity thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If traditional reverse image search methods are used to retrieve similar images from large datasets, then comprehensive image matching is achieved, but search speed becomes slow

Engineering Contradiction:
Improvesearch speedVSAvoiddataset size
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent segments the large image dataset into multiple classes based on feature point characteristics. By dividing the dataset into smaller class-specific subsets, the search process can operate on smaller data portions rather than the entire dataset, thereby improving search speed while maintaining matching comprehensiveness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary classification of images into different classes before the actual search operation. This pre-processing step organizes the dataset in advance, allowing the search algorithm to quickly locate relevant classes and retrieve similar images without scanning the entire dataset, thus resolving the speed-dataset size contradiction.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If traditional reverse image search methods are used to retrieve similar images, then comprehensive matching is achieved, but error rate in search results becomes high

Engineering Contradiction:
Improvesearch accuracyVSAvoidmatching precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by using SIFT feature points to capture distinctive local characteristics of images. By focusing on specific feature points rather than global image properties, the method achieves more precise and reliable matching, reducing errors in search results while maintaining comprehensive coverage.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the parameter space by transforming images into feature point representations and organizing them in a classification index table. This parameter transformation enables more accurate comparison and matching operations, improving both reliability and precision of search results.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If feature points are extracted and classified using hierarchical integer K-means model, then matching precision is improved, but computational complexity increases

Engineering Contradiction:
Improvematching precisionVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The hierarchical integer K-means model segments the feature space into multiple levels of clustering. This hierarchical segmentation reduces computational complexity by breaking down the complex classification task into smaller, more manageable sub-tasks at different levels, while still achieving high matching precision.

Inventive Principle:
Principle #1Segmentation

4Productivity

If image classification index table is created and searched, then search efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvesearch efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The image classification index table is created in advance as a pre-processing step. This preliminary action organizes images into a structured index system before search operations begin, enabling efficient retrieval without requiring complex real-time processing during actual searches, thus improving productivity while managing system complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11481432B2Reverse image search method, apparatus and application system
Publication Date: 2022.10.25 BEIJING BOE TECH DEV CO LTD
  • US11481432B2 patent drawing
  • US11481432B2 patent drawing
  • US11481432B2 patent drawing

AI summary

The present disclosure relates to a reverse image search method. The reverse image search method may include receiving a search image; extracting feature points of the search image; finding classes corresponding to the feature points of the search image respectively in an image classification index table, the classes comprising images in an image library; and searching the classes corresponding to the feature points of the search image in the image classification index table to obtain a target image having the largest number of identical feature points of the search image.