Web Image Annotation via Cross-Page Metadata Derivation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Images on websites often lack associated information, limiting opportunities for enhancement and engagement, as they may not provide enough context for users.

Innovation Solution

An image on a web page can be annotated by deriving metadata from multiple web pages that display the same or similar image, allowing additional content such as hyperlinks to be added and displayed as annotations, enhancing user interaction and information access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If images are displayed on web pages with minimal associated information, then the web page structure remains simple and loading is fast, but the user experience and information accessibility are limited

Engineering Contradiction:
Improveimage informationVSAvoidweb page structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

A search system acts as an intermediary between the web page and the user. When a user views an image, the search system retrieves additional information from other web pages containing the same or similar images and presents it through annotations. This mediator approach enriches information without requiring the original web page to be complex.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds information in a separate dimensional layer through annotations that overlay on top of the original image. Instead of integrating information into the web page structure itself, the system creates a new informational layer that coexists with the original image, thus enriching content without complicating the base web page structure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If additional content and annotations are added to images, then user engagement and information access improve, but the processing time and system resources increase

Engineering Contradiction:
Improveinformation retrieval efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The search system performs preliminary actions by pre-processing and indexing web pages and images before the user views them. Metadata about images and their associated content is extracted and stored in advance, so when a user views an image, the system can quickly retrieve relevant annotations without performing complex analysis in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of processing the entire original web page content, the system creates and uses copies or representations of the image data and metadata. The search system works with image fingerprints, hashes, and extracted features rather than the full original content, enabling faster retrieval and processing of information.

Inventive Principle:
Principle #26Copying

3Ease of operation

If images are annotated with hyperlinks and additional content, then user interaction opportunities increase, but the visual clarity and simplicity of the image may be compromised

Engineering Contradiction:
Improveuser interactionVSAvoidimage visual clarity
Core Design Contradiction:
Ease of operationVSShape

Solution Approach 1:

Annotations are placed at specific local positions on the image based on the content and context. Rather than uniformly distributing information, the system identifies meaningful locations (such as objects, text regions, or areas of interest) and places links or information there, preserving the overall visual clarity while providing targeted interaction opportunities.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The annotation system segments the image into different regions or layers, separating the original image content from the added informational elements. This segmentation allows the original image to maintain its visual integrity while annotations are overlaid as distinct, non-intrusive elements that can be interacted with independently.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8838432B2Image annotations on web pages
Publication Date: 2014.09.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8838432B2 patent drawing
  • US8838432B2 patent drawing
  • US8838432B2 patent drawing

AI summary

An image in a web page may be annotated after deriving information about an image when the image may be displayed on multiple web pages. The web pages that show the image may be analyzed in light of each other to determine metadata about the image, then various additional content may be added to the image. The additional content may be hyperlinks to other webpages. The additional content may be displayed as annotations on top of the images and in other manners. Many embodiments may perform searching, analysis, and classification of images prior to the web page being served.