Hybrid Extractive-Abstractive Summarization for Multi-Party Transcripts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing summarization systems struggle to automatically generate comprehensive and coherent summaries of multi-party interactions without human intervention, often missing contextual information and incorporating hallucinated content.

Innovation Solution

The proposed solution combines extractive and abstractive summarization techniques in a unique processing pipeline to generate a contextual summary of a multi-party interaction. This involves identifying key sentences using an extractive model, generating a contextual summary based on interaction utterances, and refining it using machine-learning models to remove irrelevant content and hallucinations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If abstractive summarization is used to generate comprehensive summaries, then the summary coverage and context capture are improved, but hallucinated content and accuracy deteriorate

Engineering Contradiction:
Improvecontext captureVSAvoidhallucinated content
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent combines extractive summarization (which selects verbatim sentences from the source) with abstractive summarization (which generates new sentences) in a hybrid pipeline. The extractive component ensures factual accuracy by selecting only sentences that exist in the source text, while the abstractive component improves coherence and context capture. This merging resolves the contradiction by leveraging the strengths of both approaches: extractive methods prevent hallucinations while abstractive methods enhance context understanding.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary verification step where a separate model evaluates the output of the abstractive summarization component for hallucinated content. This intermediary layer acts as a filter that identifies and removes fabricated information while preserving the contextual benefits of abstractive methods. The verification model serves as a mediator between the creative abstractive process and the final output, ensuring reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If extractive summarization is used to ensure accuracy, then hallucinated content is reduced, but contextual information and coherence deteriorate

Engineering Contradiction:
ImproveaccuracyVSAvoidcontextual information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The hybrid summarization system merges extractive and abstractive methods, where the extractive component selects accurate verbatim sentences and the abstractive component generates coherent connecting text. This combination allows the system to maintain the accuracy benefits of extractive methods while adding the contextual coherence benefits of abstractive methods, resolving the contradiction between accuracy and contextual information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the summarization task into distinct components: an extractive summarization module that handles accuracy-critical sentence selection, and an abstractive summarization module that handles coherence and context. By dividing the task into segments with specialized functions, each component can optimize for its strength while the integrated system achieves both accuracy and contextual richness.

Inventive Principle:
Principle #1Segmentation

3Productivity

If multi-party interaction transcripts are summarized automatically, then productivity is improved, but complexity of processing increases

Engineering Contradiction:
Improveautomation efficiencyVSAvoidprocessing pipeline complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The complex task of summarizing multi-party interactions is segmented into multiple specialized processing stages: utterance segmentation, speaker identification, extractive summarization, abstractive summarization, and verification. Each segment handles a specific aspect of the problem, making the overall complex task manageable and automatable. This segmentation enables high productivity by allowing parallel processing of different aspects while maintaining systematic control over the complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs universal machine learning models that can handle multiple functions within the summarization pipeline. For example, the same transformer-based architecture is used for both extractive and abstractive components, and the verification model serves multiple purposes including hallucination detection and coherence checking. This multi-functionality reduces the overall system complexity by reusing proven models across different tasks rather than requiring specialized models for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Loss of information

If detailed contextual summaries are generated, then information completeness is improved, but redundancy and processing time increase

Engineering Contradiction:
Improveinformation completenessVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts only the most relevant and non-redundant information from multi-party interactions using the extractive summarization component. By selecting key sentences that capture essential information while automatically filtering out redundant content, the system achieves information completeness without proportionally increasing processing time. The extraction process inherently eliminates redundancy by selecting only the most important sentences.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies partial abstractive summarization rather than complete transformation of all content. The abstractive component processes only the extractive summary output and focuses on adding contextual connections where needed, rather than completely regenerating the entire summary. This partial action approach maintains information completeness while significantly reducing processing time compared to full abstractive summarization.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12217013B2Machine-learning based transcript summarization
Publication Date: 2025.02.04 UNITEDHEALTH GROUP INC
  • US12217013B2 patent drawing
  • US12217013B2 patent drawing
  • US12217013B2 patent drawing

AI summary

There is a need for more effective and efficient predictive natural language summarization. This need is addressed by applying hybrid extractive and abstractive summarization techniques in a unique processing pipeline to generate a cohesive and comprehensive summary of a multi-party interaction. A method for generating the summary of a multi-party interaction includes receiving a multi-party interaction transcript data object comprising a plurality of interaction utterances from at least two participants; using an extractive summarization model to identify a key sentence of the multi-party interaction transcript data object; identifying an interaction utterance from the multi-party interaction transcript data object that corresponds to the key sentence; generating a contextual summary for the multi-party interaction transcript data object based at least in part on the interaction utterance; and generating a reported contextual summary for the multi-party interaction transcript data object based at least in part on the contextual summary.