Hybrid Extractive-Abstractive Summarization for Multi-Party Transcripts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing summarization systems struggle to automatically generate comprehensive and coherent summaries of multi-party interactions without human intervention, often missing contextual information and incorporating hallucinated content.
Innovation Solution
The proposed solution combines extractive and abstractive summarization techniques in a unique processing pipeline to generate a contextual summary of a multi-party interaction. This involves identifying key sentences using an extractive model, generating a contextual summary based on interaction utterances, and refining it using machine-learning models to remove irrelevant content and hallucinations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If abstractive summarization is used to generate comprehensive summaries, then the summary coverage and context capture are improved, but hallucinated content and accuracy deteriorate
Solution Approach 1:
The patent combines extractive summarization (which selects verbatim sentences from the source) with abstractive summarization (which generates new sentences) in a hybrid pipeline. The extractive component ensures factual accuracy by selecting only sentences that exist in the source text, while the abstractive component improves coherence and context capture. This merging resolves the contradiction by leveraging the strengths of both approaches: extractive methods prevent hallucinations while abstractive methods enhance context understanding.
Solution Approach 2:
The patent introduces an intermediary verification step where a separate model evaluates the output of the abstractive summarization component for hallucinated content. This intermediary layer acts as a filter that identifies and removes fabricated information while preserving the contextual benefits of abstractive methods. The verification model serves as a mediator between the creative abstractive process and the final output, ensuring reliability.
2Reliability
If extractive summarization is used to ensure accuracy, then hallucinated content is reduced, but contextual information and coherence deteriorate
Solution Approach 1:
The hybrid summarization system merges extractive and abstractive methods, where the extractive component selects accurate verbatim sentences and the abstractive component generates coherent connecting text. This combination allows the system to maintain the accuracy benefits of extractive methods while adding the contextual coherence benefits of abstractive methods, resolving the contradiction between accuracy and contextual information.
Solution Approach 2:
The patent segments the summarization task into distinct components: an extractive summarization module that handles accuracy-critical sentence selection, and an abstractive summarization module that handles coherence and context. By dividing the task into segments with specialized functions, each component can optimize for its strength while the integrated system achieves both accuracy and contextual richness.
3Productivity
If multi-party interaction transcripts are summarized automatically, then productivity is improved, but complexity of processing increases
Solution Approach 1:
The complex task of summarizing multi-party interactions is segmented into multiple specialized processing stages: utterance segmentation, speaker identification, extractive summarization, abstractive summarization, and verification. Each segment handles a specific aspect of the problem, making the overall complex task manageable and automatable. This segmentation enables high productivity by allowing parallel processing of different aspects while maintaining systematic control over the complexity.
Solution Approach 2:
The patent employs universal machine learning models that can handle multiple functions within the summarization pipeline. For example, the same transformer-based architecture is used for both extractive and abstractive components, and the verification model serves multiple purposes including hallucination detection and coherence checking. This multi-functionality reduces the overall system complexity by reusing proven models across different tasks rather than requiring specialized models for each function.
4Loss of information
If detailed contextual summaries are generated, then information completeness is improved, but redundancy and processing time increase
Solution Approach 1:
The patent extracts only the most relevant and non-redundant information from multi-party interactions using the extractive summarization component. By selecting key sentences that capture essential information while automatically filtering out redundant content, the system achieves information completeness without proportionally increasing processing time. The extraction process inherently eliminates redundancy by selecting only the most important sentences.
Solution Approach 2:
The system applies partial abstractive summarization rather than complete transformation of all content. The abstractive component processes only the extractive summary output and focuses on adding contextual connections where needed, rather than completely regenerating the entire summary. This partial action approach maintains information completeness while significantly reducing processing time compared to full abstractive summarization.
Data Source
AI summary
There is a need for more effective and efficient predictive natural language summarization. This need is addressed by applying hybrid extractive and abstractive summarization techniques in a unique processing pipeline to generate a cohesive and comprehensive summary of a multi-party interaction. A method for generating the summary of a multi-party interaction includes receiving a multi-party interaction transcript data object comprising a plurality of interaction utterances from at least two participants; using an extractive summarization model to identify a key sentence of the multi-party interaction transcript data object; identifying an interaction utterance from the multi-party interaction transcript data object that corresponds to the key sentence; generating a contextual summary for the multi-party interaction transcript data object based at least in part on the interaction utterance; and generating a reported contextual summary for the multi-party interaction transcript data object based at least in part on the contextual summary.


