Image Clustering via Embedding Vectors for Search Ambiguity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image retrieval systems face challenges in accurately identifying the specific image of interest due to keyword ambiguity and the presentation of diverse, irrelevant search results, making it difficult for users to find desired multimedia files amidst numerous search results.

Innovation Solution

A computer image clustering system that organizes multimedia documents tagged by keywords into a hierarchy using an initial occurrence matrix, media file activation scores, inverse media file frequency values, and descriptive term frequency matrices to categorize media files into high and low activation score categories, facilitating easier navigation and filtering of search results.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If keyword-based image search is used, then search speed is improved, but search accuracy deteriorates due to keyword ambiguity

Engineering Contradiction:
Improvesearch speedVSAvoidsearch accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent introduces image embeddings as an intermediary representation between keywords and images. Instead of directly matching keywords to images (which causes ambiguity), the system converts both keywords and images into embedding vectors in a shared semantic space, where similarity is measured through vector distance. This intermediary embedding layer resolves the contradiction by enabling fast retrieval while maintaining accuracy through semantic similarity rather than exact keyword matching.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the parameter space from discrete keyword matching to continuous embedding vector comparison. By transforming images and keywords into continuous vector representations with varying dimensions and similarity thresholds, the system can adjust the balance between speed and accuracy by modifying embedding dimensions, similarity thresholds, and retrieval parameters without fundamentally changing the search mechanism.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If diverse search results are displayed, then the probability of displaying the desired media file is improved, but user navigation difficulty increases

Engineering Contradiction:
Improveprobability of displaying desired fileVSAvoiduser navigation ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments diverse search results into multiple organized clusters based on embedding similarity. Instead of presenting a flat list of diverse results that are hard to navigate, the system groups results into thematic clusters (e.g., different interpretations of a ambiguous query) and presents them as organized categories. This segmentation maintains diversity while improving navigability by allowing users to explore different result groups systematically.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system adds a new dimension to result presentation by organizing diverse images along the embedding similarity dimension. Rather than displaying diverse results in a single flat dimension (list view), the patent uses the embedding space to create hierarchical or multi-dimensional organization, allowing users to navigate results by similarity thresholds or cluster groupings, thus making diversity manageable and navigable.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If image clustering is implemented, then result organization is improved, but system complexity increases

Engineering Contradiction:
Improveresult organizationVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-computing image embeddings and organizing them into clusters before actual search queries are executed. During query processing, the system only needs to perform lightweight operations like vector similarity calculations and cluster traversals rather than building complex structures from scratch. This preliminary organization of images into embedding-based clusters reduces the complexity of real-time search operations while maintaining good result organization.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10754887B1Systems and methods for multimedia image clustering
Publication Date: 2020.08.25 SHUTTERSTOCK
  • US10754887B1 patent drawing
  • US10754887B1 patent drawing
  • US10754887B1 patent drawing

AI summary

Computer image clustering systems and methods for conducting effective media searches by grouping multimedia documents tagged by keywords into a hierarchy of images configured to: (1) maintain a first database, (2) maintain an initial occurrence matrix, (3) maintain an occurrence matrix, (4) maintain a media file activation score for each media file in the first database, (5) generate a log version of the occurrence matrix, (6) maintain an inverse media file frequency value for each descriptive term in the first database, (7) generate a descriptive term frequency matrix and generate a list of document vectors in multidimensional space (list), and (8) organize and process each media file in the list into a high activation score category and a low activation score category.