Contextual Tagging for Image Search Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional photo search methods rely on visual content and metadata, leading to inaccurate and inefficient tagging, as they fail to assign important tags to photos, especially when the feature of interest is not visibly present, resulting in missed tags and inconsistent results.

Innovation Solution

The implementation of contextual tags, which are assigned based on a contextual analysis of associated images captured in the same environment, allowing for the identification of images related to a feature of interest even if it is not visibly present, by clustering images based on location and time, and classifying content tags into categories like location and event categories.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional photo search methods use only visual content and metadata for tagging, then the tagging process is simple and fast, but the tagging accuracy is low and important tags are missed

Engineering Contradiction:
Improvetagging accuracyVSAvoidsearch system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by clustering images based on location and time before conducting the actual search. This pre-processing groups related images together, enabling more accurate contextual tagging without significantly increasing search complexity. The clustering is done once and reused for multiple searches.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces contextual tags as an intermediary layer between visual content and search queries. These contextual tags are derived from clustered image relationships and serve as mediators that connect images to search terms even when the feature is not visually present, improving tagging accuracy without requiring direct visual analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If contextual analysis of associated images is performed to generate contextual tags, then search accuracy improves for images not visually containing the feature, but the processing time and computational resources increase

Engineering Contradiction:
Improvesearch result reliabilityVSAvoidimage processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs contextual analysis and clustering in advance, before actual search operations. By pre-processing images to establish contextual relationships and generate contextual tags upfront, the system reduces processing time during actual searches while maintaining high reliability in search results.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent merges multiple images into clusters based on shared characteristics like location and time. By combining information from multiple related images, the system generates more reliable contextual tags that improve search accuracy while distributing the processing workload across the cluster rather than analyzing each image individually.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If images are clustered based on location and time to generate contextual tags, then the ability to retrieve relevant images improves, but the complexity of the tagging system increases

Engineering Contradiction:
Improveimage retrieval efficiencyVSAvoidtagging system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the image database into distinct clusters based on location and time characteristics. This segmentation organizes images into manageable groups, improving retrieval efficiency by allowing searches to focus on relevant clusters rather than the entire database, while keeping the complexity manageable through structured organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The contextual tagging system serves multiple functions: it improves search accuracy, enables retrieval of images not visually containing search features, and organizes images by contextual relationships. This multi-functionality justifies the increased complexity by providing comprehensive benefits across different search scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11816147B2Enhanced image-search using contextual tags
Publication Date: 2023.11.14 ADOBE INC
  • US11816147B2 patent drawing
  • US11816147B2 patent drawing
  • US11816147B2 patent drawing

AI summary

Embodiments of the present invention are directed towards providing contextual tags for an image based on a contextual analysis of associated images captured in the same environment as the image. To determine contextual tags, content tags can be determined for images. The determined content tags can be associated with categories based on a contextual classification of the content tags. These associated content tags can then be designated as contextual tags for a respective category. To associate these contextual tags with the images, the images can be iterated through based on how the images relate to the contextual tags. For instance, when an image is associated with a category, the contextual tags classified into that category can be assigned to that image.