Multipurpose Graph Node Embeddings for Machine Learning Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems require separate node embeddings for each machine learning task, which is inefficient in terms of computing resources and may miss essential features, leading to suboptimal performance.

Innovation Solution

Generating 'multipurpose' node embeddings that can be aggregated and used across various machine learning tasks, allowing machine learning models to select appropriate feature subsets for specific tasks, thereby increasing efficiency and performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If separate node embeddings are generated for each machine learning task, then task-specific performance may be optimized, but computing resource efficiency deteriorates due to redundant generation

Engineering Contradiction:
Improvetask-specific performanceVSAvoidcomputing resource efficiency
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent creates a universal node embedding representation that can be applied across multiple machine learning tasks. Instead of generating separate embeddings for each task, the system produces a single set of node embeddings that serve multiple purposes, thereby reducing redundant computing while maintaining task-specific performance through flexible feature selection and model configuration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If separate node embeddings are generated for each machine learning task, then task-specific features may be optimized, but system complexity increases due to multiple embedding generation processes

Engineering Contradiction:
Improvetask-specific feature optimizationVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements a universal embedding generation framework that handles multiple tasks through a single process. The complexity is managed by allowing different machine learning models to select and utilize relevant features from the unified embedding space, rather than requiring separate embedding generation processes for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent segments the feature utilization process at the model level, where each machine learning model can select specific features from the aggregated node embeddings relevant to its task. This allows task-specific feature optimization without requiring separate embedding generation, as each model independently chooses the features it needs from the comprehensive embedding set.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If task-specific node embeddings are created, then embedding accuracy for that task may be improved, but feature completeness deteriorates due to exclusion of other useful features

Engineering Contradiction:
Improveembedding accuracyVSAvoidfeature completeness
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent merges multiple task-specific embedding perspectives into a single aggregated node embedding structure. By combining embeddings from different tasks and perspectives, the system achieves comprehensive feature completeness while maintaining task-specific accuracy through the ability of individual models to select and weight relevant features from the merged representation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240054356A1Systems and methods for generating multipurpose graph node embeddings for machine learning
Publication Date: 2024.02.15 CAPITAL ONE SERVICES LLC
  • US20240054356A1 patent drawing
  • US20240054356A1 patent drawing
  • US20240054356A1 patent drawing

AI summary

In some aspects, a computing system may create different node embeddings (e.g., different instances of the same graph) and aggregate the node embeddings to form “multipurpose” node embeddings. As an example, the different node embeddings may include node embeddings generated using unsupervised machine learning and node embeddings generated using supervised machine learning. In this way, for example, a variety of machine learning models may use the aggregated node embeddings without the need for each machine learning model to generate separate node embeddings each time a machine learning task is performed. A machine learning model may use all or a portion of the features in the aggregated node embeddings as appropriate for the task the model is performing.