Meta Learner Autoencoder for New Signal Type Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current model training techniques cannot leverage metadata representations, specifically knowledge graphs, to train models for predicting values of new signal types not represented within the knowledge graph.

Innovation Solution

A system and method that utilize a meta learner autoencoder to map signal sequences and metadata representations into meta representation vectors, allowing for the training of a new task model to predict labels for unlabeled signal sequences of new signal types by incorporating knowledge graph embeddings and adding new nodes and edges to the knowledge graph.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If current model training techniques are used, then models can be trained for known signal types represented in the knowledge graph, but models cannot be trained for new signal types not represented in the knowledge graph

Engineering Contradiction:
Improvemodel training capability for new signal typesVSAvoidmetadata knowledge utilization
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system performs preliminary actions by training a meta-learner autoencoder on known signal types and their metadata representations before encountering new signal types. This pre-trained meta-learner encodes the relationships between signal characteristics and metadata, enabling it to generate predicted metadata representations for new signal types without requiring prior explicit training on those specific types.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a meta-learner autoencoder as an intermediary component that bridges the gap between known signal types in the knowledge graph and new signal types. This intermediary learns the underlying patterns and relationships in the metadata representations, allowing it to infer and generate metadata for new signal types that are not directly represented in the knowledge graph, thus enabling transfer of knowledge from known to new signal types.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If metadata representations are leveraged for model training, then knowledge graph information can be utilized, but the system complexity increases due to meta learner autoencoder implementation

Engineering Contradiction:
Improveprediction accuracy for new signal typesVSAvoidsystem architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The meta-learner autoencoder is designed as a universal model that can handle multiple signal types through a unified architecture. Rather than creating separate models for each signal type, the single meta-learner performs multiple functions: encoding signal sequences, processing metadata representations, generating predicted metadata, and enabling predictions for both known and new signal types. This multi-functionality reduces the need for multiple specialized components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system manages complexity by dynamically adjusting parameters rather than changing architectural structures. The meta-learner autoencoder modifies its internal parameters (weights and biases) during training on known signal types, allowing it to adapt to different signal characteristics. For new signal types, the same architecture with updated parameters generated from the knowledge graph enables predictions without requiring structural modifications.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230351160A1System and method for model training for a new signal based on metadata representations of known signals
Publication Date: 2023.11.02 SAFERIDE TECH LTD
  • US20230351160A1 patent drawing
  • US20230351160A1 patent drawing
  • US20230351160A1 patent drawing

AI summary

A system comprising a processing circuitry configured to: obtain: (a) one or more metadata representations, each representing metadata relating to a signal type of one or more signal types; (b) one or more signal sequences, each signal sequence is an ordered sequence of values associated with a given signal type of the one or more signal types; and (c) at least one new signal sequence, being a new ordered sequence of values, each associated with a label, the at least one new signal sequence is associated with corresponding at least one new signal type, not included in the one or more signal types; train a meta learner autoencoder, capable of mapping at least one given signal sequence and at least one respective metadata representation, being the metadata representation representing the signal type of the given signal sequence into a meta representation vector, wherein the trained meta learner autoencoder comprises a meta learner encoder and a meta learner decoder; determine, based on the metadata representations, a predicted metadata representation representing the at least one new signal type; and train, by utilizing the meta representation vector mapped by the meta learner encoder from the at least one new signal sequence and the predicted metadata representation, a new task model, capable of receiving one or more unlabeled signal sequences associated with the at least one new signal type, and predicting, utilizing the predicted metadata representation and the meta learner encoder, for each of the unlabeled signal sequences, a corresponding label.