Context-Based Tag Recommendation for Stock Photography

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tag recommenders for stock photography are purely text-based and fail to capture non-textual similarities between images, such as context, color, texture, and content, leading to suboptimal annotation recommendations.

Innovation Solution

A context-based tag recommendation system that utilizes a combination of tag co-occurrence and similar image context information to provide more accurate and relevant annotations, incorporating attributes like image type, color, and behavioral data to enhance the tagging process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional text-based tag recommenders are used, then the system is simple to implement, but the annotation quality and precision deteriorate due to inability to capture non-textual similarities

Engineering Contradiction:
Improveannotation qualityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges text-based tag co-occurrence analysis with non-textual image similarity analysis (color, texture, content) into a unified recommendation system. This combination allows the system to leverage both textual metadata and visual features, thereby improving annotation precision while maintaining reasonable system complexity through modular integration of multiple analysis components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from purely text-based one-dimensional analysis to multi-dimensional analysis by incorporating non-textual image attributes such as color, texture, and content. This dimensional expansion enables the system to capture similarities that text alone cannot represent, significantly enhancing annotation quality through comprehensive multi-attribute comparison.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple databases and analysis methods are integrated, then the precision of tag recommendations improves, but the device complexity increases

Engineering Contradiction:
Improvetag recommendation precisionVSAvoiddatabase structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the recommendation system into distinct functional modules: a tag co-occurrence database for textual analysis, an image similarity database for non-textual analysis, and a recommendation engine that integrates both. This segmentation allows each component to specialize in specific tasks, improving overall precision while managing complexity through clear separation of concerns and modular architecture.

Inventive Principle:
Principle #1Segmentation

3Reliability

If non-textual image attributes are considered, then the relevance of recommended tags improves, but the computational requirements and processing time increase

Engineering Contradiction:
Improvetag relevanceVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary extraction and storage of non-textual image attributes (color, texture, content) during image upload, pre-computing similarity metrics and storing them in an image similarity database. This preliminary action enables the recommendation system to retrieve pre-processed features during tag recommendation, significantly reducing real-time processing time while maintaining high tag relevance through comprehensive attribute analysis.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9678993B2Context based systems and methods for presenting media file annotation recommendations
Publication Date: 2017.06.13 SHUTTERSTOCK
  • US9678993B2 patent drawing
  • US9678993B2 patent drawing
  • US9678993B2 patent drawing

AI summary

A context based tag recommendation system for annotating stock photography media files, the system configured to: maintain a first database comprising a set of media files and a set of annotations associated with the media file set, maintain a second database comprising a second set of records, each record comprising an annotation, at least one co-occurring annotation, and a count, receive at least one media file tag input (input), query the second database using the input to identify a ranked set of co-occurring annotations and a count associated with each annotation in the ranked set of co-occurring annotations, query the first database to identify a selected set of similar media files, by iteratively retrieving image files associated a selective group of annotations from the ranked set of co-occurring annotations, present a list of recommended annotations based on the ranked set of co-occurring annotations and the selected set of similar media files.