Collaborative Web Session Graphical Content Transcription

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current web-hosted services cannot capture and transcribe graphical content from web conferences, limiting the availability of session information and undermining the utility of conference archiving.

Innovation Solution

An improved technique that captures graphical content during collaborative web sessions using image analysis and optical character recognition (OCR) to generate text output, which is then applied to text application services for association, searching, and enhancing speech-to-text processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If transcripts include only spoken content, then speech-to-text processing is simple, but graphical content information is lost

Engineering Contradiction:
Improvegraphical content informationVSAvoidtranscript processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges spoken content transcripts with graphical content transcripts into a unified transcript structure. The system combines text from speech-to-text processing with text extracted from graphical content (via OCR and other extraction methods), creating a single integrated transcript that contains both spoken and visual information from the collaborative web session.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary processing layer that sits between the raw graphical content and the final transcript. This layer includes components that detect graphical content, extract text from images/screenshots, and integrate this extracted text with the speech-to-text output, thereby mediating the complexity while preserving information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If manual video scrubbing is used to locate content, then no additional processing is needed, but time consumption increases

Engineering Contradiction:
Improvecontent retrieval efficiencyVSAvoidtime to locate content
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent performs preliminary processing of graphical content during or immediately after the collaborative web session. Text is extracted from screenshots, whiteboards, and shared content in advance, and this extracted text is indexed and made searchable before the user needs to retrieve information, eliminating the need for manual video scrubbing later.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical process of manual video scrubbing with an automated information retrieval system. Instead of manually scrolling through video content, users can search the extracted and indexed text from graphical content, allowing rapid location of specific information through text-based search rather than time-consuming visual inspection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If graphical content is captured and converted to text, then searchability improves, but processing complexity increases

Engineering Contradiction:
Improvesearch capabilityVSAvoidimage analysis complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the graphical content processing into distinct, manageable components: detection of graphical content regions, extraction of text from those regions using OCR and other methods, and integration of extracted text with the transcript. This segmentation allows each component to be optimized independently and simplifies the overall processing pipeline.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the inclusion of graphical content in session records, making it searchable and enhancing the effectiveness of speech-to-text processing, thereby increasing the utility of conference archiving and retrieval.

Implementation Method 1

translating a set of portions of the graphical content into text output... translating the graphical content into text

Methodology Applied
Scientific EffectOptical character recognition: Image Processing

Data Source

PatentUS11514913B2Collaborative content management
Publication Date: 2022.11.29 GOTO GRP INC
  • US11514913B2 patent drawing
  • US11514913B2 patent drawing
  • US11514913B2 patent drawing

AI summary

A technique manages collaborative web sessions (CWS). The technique receives graphical content of a CWS. The technique translates a set of portions of the graphical content into text output. The technique provides the text output to a set of text application services. The set of text application services associate the text output with the CWS.