Interactive Transcript Search Interface for Audio Video Relevance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing search engines do not allow for quick determination of relevance within search results for audio/video content, requiring significant context switching and not enabling inline browsing of underlying documents within search results.

Innovation Solution

A system and method for interactive searching of audio/visual data files that provides a user interface for inline browsing of search results, allowing users to review media and documents without leaving the search results page, by integrating transcript excerpts with timestamp data for seamless playback of corresponding audio/video segments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If traditional search engines are used to search audio/video content, then search results can be obtained, but users cannot quickly determine relevance and must switch between multiple pages/documents

Engineering Contradiction:
Improvetime to determine relevanceVSAvoidcontext switching
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The patent combines transcript text, audio playback, and video playback into a single integrated search results interface. Users can view transcript excerpts with timestamp data and directly play corresponding audio/video segments without leaving the search results page, eliminating the need to switch between multiple pages or documents.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces timestamp data as an intermediary element that links transcript text to specific audio/video segments. This timestamp data acts as a mediator that enables direct navigation and playback of relevant content within the search results interface, reducing the need for context switching.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If transcript excerpts with timestamp data are integrated into search results, then users can browse underlying documents inline, but data transmission increases

Engineering Contradiction:
Improveinline browsing capabilityVSAvoiddata transmission volume
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary portions of the transcript (relevant excerpts with timestamp data) and integrates them into the search results, rather than transmitting entire documents. This selective extraction approach enables inline browsing while minimizing data transmission volume.

Inventive Principle:
Principle #2Taking out (Extraction)

3Loss of information

If full audio/video files are transmitted for each search result, then complete content is available, but transmission time and processing load increase significantly

Engineering Contradiction:
Improvecontent completenessVSAvoidsearch result delivery speed
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent segments the audio/video content by associating transcript excerpts with specific timestamp ranges, allowing users to access only the relevant segments rather than complete files. This segmentation enables faster delivery of search results while maintaining content completeness for the relevant portions.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10860638B2System and method for interactive searching of transcripts and associated audio/visual/textual/other data files
Publication Date: 2020.12.08 GORREPATI UDAY
  • US10860638B2 patent drawing
  • US10860638B2 patent drawing
  • US10860638B2 patent drawing

AI summary

A system and method for processing digital multimedia files to provide searchable results includes the steps of converting a digital multimedia file to a plain text data format, annotating each word in the file with an indicator such as a time stamp to indicate where the word appears in the file, converting each indicator to an encoded indicator using characters that are not indexed by search software, indexing the converted, annotated file, storing the converted, annotated file and a file location of the converted, annotated file, receiving a query from a user's computer, and returning search results to the user's computer that include search snippets comprising unindexed portions of one or more files considered responsive to the query and the file location of those files.