Multimodal Presentation System with Natural Language Content Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current presentation systems require users to manually sort through existing content, making it time-consuming to find and incorporate specific segments into new presentations, as they lack efficient content-based retrieval capabilities.

Innovation Solution

A multimodal system and method for creating electronic slide presentations that enables content-based information retrieval using natural language searchability, allowing users to request and select segments based on their content, and automatically add them to a new presentation deck.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users manually sort through existing presentation content to find specific segments, then they can locate and reuse content from old presentations, but the process becomes time-consuming and inefficient

Engineering Contradiction:
Improvepresentation creation speedVSAvoidtime to find and retrieve content
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary indexing of presentation content by extracting and storing text from slides, images, and other media segments into a searchable database structure before the user needs to search. This preprocessing enables rapid retrieval without manual sorting through presentations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary search interface that mediates between the user and the stored presentation content. Users interact with this interface to submit search queries, and the system translates these queries into database searches, returning relevant segments without requiring users to manually browse through presentations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If users manually research and gather information for presentations, then they can ensure accurate and relevant content, but the research process becomes time-consuming

Engineering Contradiction:
Improvecontent accuracyVSAvoidresearch time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary organization and indexing of information from multiple sources during the initial content ingestion phase. Information is structured, tagged, and stored in a searchable format, enabling users to quickly retrieve accurate content without conducting manual research for each presentation topic.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The search system provides universal access to multiple types of content (slides, images, text, video segments) from various presentations through a single interface. This multi-functional search capability allows users to retrieve different types of content for different presentation needs without requiring separate research processes for each content type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If presentation systems provide basic slide navigation controls, then users can move between slides, but they lack the ability to efficiently find and incorporate specific content segments from existing presentations

Engineering Contradiction:
Improvecontent retrieval easeVSAvoidsystem functionality
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a search interface as an intermediary layer between the user and the presentation content. This interface accepts natural language or keyword-based queries and translates them into database searches, returning relevant segments. The intermediary handles the complexity of content retrieval, presenting a simple search-based interaction model to users.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces manual mechanical sorting and browsing through presentations with an automated electronic search mechanism. Instead of users physically navigating through slides and presentations to find content, the system uses automated text extraction, database searching, and result ranking to retrieve relevant segments, substituting mechanical user actions with automated computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9959260B2System and method for creating a presentation using natural language
Publication Date: 2018.05.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9959260B2 patent drawing
  • US9959260B2 patent drawing
  • US9959260B2 patent drawing

AI summary

The invention provides for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. The method embodiment of the invention is a method for the retrieval of information on the basis of its content for incorporation into an electronic presentation. The method comprises receiving from a user a content-based request for at least one segment from a first plurality of segments within a media presentation preprocessed to enable natural language content searchability; in response to the request, presenting a subset of the first plurality of segments to the user; receiving a selection indication from the user associated with at least one segment of the subset of the first plurality of segments and adding the selected at least one segment to a deck for use in a presentation.