Knowledge Infusion for Robust Machine Learning Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine learning applications in IoT scenarios face challenges due to the scarcity and expense of supervision knowledge, as well as the dependence on specific input data and environment contexts, leading to poor robustness and transferability of models across different locations, times, and data qualities.

Innovation Solution

The method involves using adaptive and programmable knowledge functions, comprising strong and weak functions, to generate a knowledge model that can be used to train machine learning models, enabling automated knowledge infusion for robust and transferable machine learning. This system corrects wrong outputs and determines when re-training is needed based on uncertainty calculations, adapting to new contexts without user intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional machine learning models are trained with大量labeled data, then model accuracy is improved, but training cost and time are excessively high

Engineering Contradiction:
Improvemodel accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-training a teacher model on large-scale data before deployment. This teacher model is then used to generate synthetic training data for student models, eliminating the need for students to undergo lengthy training from scratch. The knowledge gained from the teacher model's preliminary training is transferred to student models through generated training examples, significantly reducing their training time while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements copying by using the teacher model to generate synthetic training data that replicates the knowledge and patterns learned from extensive training. Instead of requiring student models to relearn from raw data, the teacher model creates copied training examples that encapsulate essential knowledge, allowing student models to achieve comparable performance with minimal training time.

Inventive Principle:
Principle #26Copying

2Measurement precision

If machine learning models are trained for specific contexts, then model accuracy for that context is improved, but transferability to new contexts deteriorates

Engineering Contradiction:
Improvemodel accuracyVSAvoidtransferability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies universality by designing a multi-context training framework where student models are trained on synthetic data generated from multiple different contexts and scenarios. The teacher model generates training examples that encompass diverse situations, enabling student models to learn universal patterns that generalize across different contexts rather than overfitting to a single context, thus improving transferability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamics by making the training process adaptive to different contexts. The teacher model dynamically generates synthetic training data tailored to various contexts, and student models are trained on this diverse data distribution. This dynamic approach allows models to adapt to new contexts encountered during deployment without requiring retraining, enhancing transferability.

Inventive Principle:
Principle #15Dynamics

3Productivity

If reinforcement learning agents explore extensively, then learning performance is improved, but system safety and cost deteriorate due to wrong actions in real systems

Engineering Contradiction:
Improvelearning performanceVSAvoidsystem safety
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies the intermediary principle by introducing a teacher model as a mediator between the learning process and the real system. The teacher model, trained on extensive data, generates synthetic training environments and guidance for student reinforcement learning agents. This intermediary allows agents to learn through simulated interactions rather than direct real-world exploration, preventing harmful actions while maintaining learning effectiveness.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements preliminary action by having the teacher model pre-generate safe training environments and guidance policies before student agents begin exploration. This preliminary preparation ensures that when student agents do explore, they do so within safe boundaries defined by the teacher model, preventing harmful actions while still allowing sufficient exploration for effective learning.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If manual annotation is performed for supervised learning, then data quality is improved, but labor cost and time consumption increase

Engineering Contradiction:
Improvedata qualityVSAvoidlabor cost
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent implements copying by using the teacher model to generate synthetic labeled training data that replicates the quality of manually annotated data. Instead of requiring human annotators to manually label training examples, the teacher model creates copied labeled data with consistent quality, eliminating labor costs while maintaining the data quality necessary for effective supervised learning.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent applies self-service by enabling the system to generate its own training data through the teacher model without external human intervention. The teacher model autonomously creates labeled training examples, allowing the system to self-generate the data it needs for training student models, thereby eliminating dependence on manual annotation labor.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12061961B2Automated knowledge infusion for robust and transferable machine learning
Publication Date: 2024.08.13 NEC CORP
  • US12061961B2 patent drawing
  • US12061961B2 patent drawing
  • US12061961B2 patent drawing

AI summary

A method for using knowledge infusion for robust and transferable machine learning models includes receiving a plurality of adaptive and programmable knowledge functions comprising a plurality of strong functions and a plurality of weak functions. A knowledge model is generated based on the plurality of strong functions and the plurality of weak functions. A machine learning model is trained based on the generated knowledge model.