Invariant Network Learning via Knowledge Transfer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Learning a reliable invariant network in a new environment is challenging due to the dynamic and complex nature of real-world information systems, requiring extensive data collection and analysis, and existing methods struggle with domain variety issues, leading to inefficient and unreliable network construction.

Innovation Solution

The TINET model employs a multi-relational entity estimation model to filter irrelevant entities and a dependency construction model to build unbiased dependencies, facilitating the transfer of knowledge from a source domain to a target domain, thereby accelerating invariant network learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If invariant network learning is performed in a new environment without knowledge transfer, then the network can be trained on fresh data, but the training time required extends to several weeks or months

Engineering Contradiction:
Improvereliability of invariant networkVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-training an invariant network model in a source domain environment before deployment to the target domain. The pre-trained model contains learned entity representations and dependency structures that can be transferred to accelerate learning in the new environment, eliminating the need to start from scratch and reducing training time from weeks/months to days while maintaining reliability through the transfer of proven knowledge

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements copying by replicating the invariant network structure, entity embeddings, and dependency relationships from the source domain to the target domain. The pre-trained model serves as a template that is copied and adapted to the new environment, allowing the target domain to inherit the learned patterns and relationships, thereby significantly reducing the time required to build a reliable network from scratch

Inventive Principle:
Principle #26Copying

2Reliability

If invariant network learning is performed in a new environment without knowledge transfer, then the network is trained on domain-specific data, but the learning process requires continuous data collection and analysis for several weeks or months

Engineering Contradiction:
Improvereliability of invariant networkVSAvoidlearning efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by performing extensive invariant network learning in the source domain before target domain deployment. The source domain model undergoes continuous data collection and analysis to achieve high reliability, and this pre-computed knowledge is then transferred to the target domain, transforming the productivity problem by shifting the intensive learning work to a preliminary phase rather than requiring weeks/months of continuous learning in the target domain

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements copying by duplicating the learned invariant network structure, entity representations, and dependency models from the source domain to the target domain. This copying mechanism allows the target domain to benefit from the source domain's extensive learning process, achieving high reliability without requiring equivalent time investment, thereby dramatically improving learning efficiency

Inventive Principle:
Principle #26Copying

3Loss of time

If knowledge transfer is applied from source domain to target domain, then the training time is reduced to days, but there is a risk of transferring irrelevant entities due to domain variety

Engineering Contradiction:
Improvetraining timeVSAvoidaccuracy of entity transfer
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent applies local quality by selectively transferring only the relevant entities and relationships from the source domain to the target domain, rather than copying everything uniformly. The system evaluates each entity's relevance to the target domain context and applies different transfer strategies to different entities, ensuring that only locally appropriate knowledge is transferred, thereby maintaining high accuracy while benefiting from reduced training time

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements parameter changes by adjusting the entity transfer thresholds and selection criteria based on domain similarity metrics. The system dynamically modifies the parameters controlling which entities are transferred, adapting to the specific characteristics of the target domain. This allows the system to optimize the balance between transferring enough knowledge to reduce training time while filtering out irrelevant entities to maintain transfer accuracy

Inventive Principle:
Principle #35Parameter changes

4Reliability

If domain variety is considered in knowledge transfer, then irrelevant entities can be filtered, but the complexity of determining domain differences increases

Engineering Contradiction:
Improveaccuracy of entity transferVSAvoidcomplexity of reference construction model
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by breaking down the complex task of domain difference determination into smaller, manageable components. The reference construction model is divided into separate modules that handle different aspects of domain comparison independently, such as entity type matching, relationship pattern analysis, and contextual similarity assessment. This segmentation reduces the overall complexity by making each sub-task more tractable while maintaining comprehensive domain variety consideration

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements an intermediary approach by introducing a reference construction model that acts as a mediator between the source and target domains. This intermediary model systematically analyzes domain differences and determines entity relevance without requiring direct complex comparisons between all source entities and target contexts. The reference model serves as a filtering layer that simplifies the transfer process while ensuring accurate domain adaptation

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10511613B2Knowledge transfer system for accelerating invariant network learning
Publication Date: 2019.12.17 CLOUD BYTE LLC
  • US10511613B2 patent drawing
  • US10511613B2 patent drawing
  • US10511613B2 patent drawing

AI summary

A computer-implemented method for implementing a knowledge transfer based model for accelerating invariant network learning is presented. The computer-implemented method includes generating an invariant network from data streams, the invariant network representing an enterprise information network including a plurality of nodes representing entities, employing a multi-relational based entity estimation model for transferring the entities from a source domain graph to a target domain graph by filtering irrelevant entities from the source domain graph, employing a reference construction model for determining differences between the source and target domain graphs, and constructing unbiased dependencies between the entities to generate a target invariant network, and outputting the generated target invariant network on a user interface of a computing device.