Entity Metadata Visualization Panel for Multimedia Disambiguation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in disambiguating mentions of entities in multimedia documents and retrieving relevant information, due to name ambiguity and difficulties in searching social media, which leads to inefficient user experiences when seeking additional information about entities mentioned in documents.

Innovation Solution

A method that analyzes an initial electronic document to identify mentions, generates mention descriptors based on context, maps them to disambiguation identifiers in a knowledge base, and associates these identifiers with entity metadata visualization panels, allowing for the retrieval and display of related content on a user interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional search methods are used to find information about entities in multimedia documents, then users can retrieve some information, but the search process becomes complex and inefficient due to name ambiguity

Engineering Contradiction:
Improveinformation retrieval efficiencyVSAvoidsearch query complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary system that includes a knowledge base and disambiguation module. This intermediary automatically resolves entity mentions by mapping them to unique identifiers in the knowledge base, eliminating the need for users to construct complex search queries. The system acts as a mediator between the user's information need and the data sources, handling the complexity of disambiguation and search internally.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary disambiguation and entity resolution before the user initiates a search. By pre-processing the entity mentions and mapping them to knowledge base identifiers in advance, the system prepares the information in a ready-to-retrieve format, significantly improving retrieval efficiency without requiring users to engage in complex query formulation.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If users manually search for additional information about entities, then they can find some relevant content, but the process requires unwieldy search queries and multiple steps

Engineering Contradiction:
Improveuser interaction simplicityVSAvoidtime to retrieve information
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system enables self-service information retrieval by automatically performing entity disambiguation, search query generation, and result aggregation without user intervention. Once a user selects an entity mention, the system autonomously retrieves and displays related information from multiple sources, eliminating the need for users to manually construct and execute search queries.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent merges multiple information sources and retrieval operations into a single unified display. Instead of requiring users to search multiple sources separately, the system combines results from knowledge bases, social media, and other data sources into one integrated visualization panel, reducing the number of steps users must take.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If the system displays detailed entity information immediately, then users get comprehensive information, but the interface becomes cluttered and harder to navigate

Engineering Contradiction:
Improveinformation completenessVSAvoidinterface navigability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments entity information into distinct categories and sources within the visualization panel. Related content is organized by type (e.g., knowledge base entries, social media posts, news articles) and source, allowing users to access comprehensive information while maintaining a structured, navigable interface. Each segment can be independently explored without overwhelming the user.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10009297B2Entity metadata attached to multi-media surface forms
Publication Date: 2018.06.26 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10009297B2 patent drawing
  • US10009297B2 patent drawing
  • US10009297B2 patent drawing

AI summary

A method, system, and/or computer program product displays related content on a user interface. An initial electronic document is analyzed to identify a mention in the initial electronic document. A mention descriptor of the mention in the initial electronic document is generated according to a context of the initial electronic document. The mention descriptor is mapped to a disambiguation identifier from a knowledge base that contains an entity related to the mention, where the disambiguation identifier identifies the entity within the knowledge base. The disambiguation identifier is associated with the initial electronic document, and is also associated with an entity metadata visualization panel. The disambiguation identifier is associated with the entity metadata visualization panel by mapping the entity metadata visualization panel to the disambiguation identifier. The entity metadata visualization panel is retrieved and displayed, on the user interface, as content related to the mention in the initial electronic document.