LSTM-Based Contextual Document Summarization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional text summarization methods fail to effectively capture contextually sensitive information in documents, leading to inefficient computational requirements and varying summarization outputs across different document types.

Innovation Solution

A computer-implemented method using long short-term memory (LSTM) networks to identify and prioritize contextually relevant sections within a document, generating summaries by aggregating prioritized sections, which reduces computational demands and improves relevance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional text summarization methods are used to process entire documents, then comprehensive coverage is achieved, but computational requirements increase and relevance accuracy decreases

Engineering Contradiction:
Improvesummarization relevance accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent divides the document into multiple sections and uses LSTM networks to identify and prioritize contextually relevant sections. By segmenting the document and selectively processing only relevant portions, the system achieves accurate summarization while reducing computational resources compared to processing entire documents.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing quality to different parts of the document by generating relevancy levels for each section. Contextually sensitive sections receive higher processing priority and more detailed analysis, while less relevant sections are processed with lower computational effort, optimizing both accuracy and resource usage.

Inventive Principle:
Principle #3Local quality

2Reliability

If traditional text summarization methods process entire documents, then all information is considered, but computational requirements and processing time increase

Engineering Contradiction:
Improvesummarization completenessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary processing by vectorizing the document corpus and training LSTM networks to identify contextually relevant sections before generating final summaries. This preliminary action of pre-processing and relevance detection enables faster summary generation while maintaining completeness by ensuring all relevant information is captured.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuity of useful action by using LSTM networks that preserve contextual information across sequential sections. The network continuously processes sections in order, maintaining relevance context throughout the document, ensuring comprehensive coverage without redundant processing.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If contextually sensitive sections are identified and prioritized, then computational resources are reduced, but system complexity increases

Engineering Contradiction:
Improvesummarization efficiencyVSAvoidmodel complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces LSTM networks as intermediary components between the raw document and the summarization process. These networks serve as mediators that automatically identify and prioritize contextually relevant sections, reducing the need for manual feature engineering and simplifying the overall system architecture while improving efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If traditional summarization methods are used, then implementation is simpler, but summarization output varies across different document types

Engineering Contradiction:
Improvedocument type adaptabilityVSAvoidmodel architecture
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs LSTM networks that can be trained on diverse document corpora and adapted to different document types through the vectorization process. The same core architecture handles various document types by learning document-specific patterns during training, providing universal summarization capability across news articles, technical documents, and other formats without requiring separate specialized systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11436267B2Contextually sensitive document summarization based on long short-term memory networks
Publication Date: 2022.09.06 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11436267B2 patent drawing
  • US11436267B2 patent drawing
  • US11436267B2 patent drawing

AI summary

In an approach to summarizing contextually sensitive text documents based on long short-term memory networks, one or more computer processors create a model based on a vectorized document corpus. The one or more computer processors determine one or more contextually relevant sections utilizing the created model. The one or more computer processors generate a relevancy level for each of the one or more respective determined sections. The one or more computer processors prioritize each of the one or more determined sections based on the respective relevancy level. The one or more computer processors generate one or more textual summaries based on the prioritized sections, wherein the generated one or more textual summaries are aggregated into a document.