Graph-Embedding Paragraph Vector Models for Document Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing predictive structural analysis solutions face efficiency and reliability shortcomings, particularly in handling hierarchical document data objects, which require improved computational and storage efficiency for effective processing.

Innovation Solution

The use of graph-embedding-based paragraph vector machine learning models that generate document and relational representations by optimizing textual-relational outputs, integrating graph-based inferences without extensive computational or storage costs, allowing for efficient predictive data analysis on hierarchical document data objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional predictive structural analysis methods are used on hierarchical document data objects, then analysis can be performed, but computational efficiency and storage efficiency are poor

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent pre-computes and stores document embeddings and relational representations in advance using graph-embedding-based paragraph vector models. These pre-computed representations are stored for rapid retrieval during predictive analysis, eliminating the need to re-process the entire document hierarchy during each analysis operation. This preliminary action significantly reduces computational efficiency while maintaining analysis accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates vector representations (embeddings) as simplified copies of complex hierarchical document structures. Instead of processing the actual hierarchical documents during analysis, the system uses these compact vector copies that capture the essential semantic and relational information. This copying approach dramatically improves computational efficiency and reduces processing time while preserving the necessary analytical capabilities.

Inventive Principle:
Principle #26Copying

2Productivity

If traditional predictive structural analysis methods are used on hierarchical document data objects, then analysis can be performed, but storage efficiency is poor

Engineering Contradiction:
Improvestorage efficiencyVSAvoidstorage space
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent replaces large hierarchical document structures with compact vector embeddings and relational representations. These vector copies occupy minimal storage space compared to the original documents while preserving the essential information needed for predictive analysis. The graph-embedding-based models create condensed representations that capture semantic meaning and relationships in a space-efficient manner.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms hierarchical document data into fixed-dimensional vector representations with specific parameter constraints. By converting variable-size hierarchical structures into standardized vector formats with defined dimensions, the system achieves efficient storage utilization. The graph-embedding models optimize these parameter representations to minimize storage requirements while maintaining analytical fidelity.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If graph-embedding-based paragraph vector models are used, then computational efficiency improves, but model complexity increases

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidmodel complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs the complex graph-embedding computations and model training in advance as a preliminary step. Once the embeddings are computed, the actual predictive analysis operations become simple vector lookups and computations. This separates the complex model construction phase from the efficient inference phase, making the overall system computationally efficient despite the initial model complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces pre-computed document embeddings and relational representations as intermediary data structures between the complex graph-embedding model and the predictive analysis tasks. These intermediaries simplify subsequent operations by providing ready-to-use feature representations, reducing the computational burden during actual analysis while leveraging the power of the complex graph-embedding model.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11698934B2Graph-embedding-based paragraph vector machine learning models
Publication Date: 2023.07.11 OPTUM INC
  • US11698934B2 patent drawing
  • US11698934B2 patent drawing
  • US11698934B2 patent drawing

AI summary

Various embodiments of the present invention provide methods, apparatus, systems, computing devices, computing entities, and/or the like for performing predictive structural analysis on document data objects that are associated with an ontology graph. Certain embodiments of the present invention utilize systems, methods, and computer program products that perform predictive data analysis operations on document data objects that are associated with an ontology graph using document embeddings that are generated by graph-embedding-based paragraph vector machine learning models.