Meta Learner Autoencoder for New Signal Type Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current model training techniques cannot leverage metadata representations, specifically knowledge graphs, to train models for predicting values of new signal types not represented within the knowledge graph.
Innovation Solution
A system and method that utilize a meta learner autoencoder to map signal sequences and metadata representations into meta representation vectors, allowing for the training of a new task model to predict labels for unlabeled signal sequences of new signal types by incorporating knowledge graph embeddings and adding new nodes and edges to the knowledge graph.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current model training techniques are used, then models can be trained for known signal types represented in the knowledge graph, but models cannot be trained for new signal types not represented in the knowledge graph
Solution Approach 1:
The system performs preliminary actions by training a meta-learner autoencoder on known signal types and their metadata representations before encountering new signal types. This pre-trained meta-learner encodes the relationships between signal characteristics and metadata, enabling it to generate predicted metadata representations for new signal types without requiring prior explicit training on those specific types.
Solution Approach 2:
The patent introduces a meta-learner autoencoder as an intermediary component that bridges the gap between known signal types in the knowledge graph and new signal types. This intermediary learns the underlying patterns and relationships in the metadata representations, allowing it to infer and generate metadata for new signal types that are not directly represented in the knowledge graph, thus enabling transfer of knowledge from known to new signal types.
2Reliability
If metadata representations are leveraged for model training, then knowledge graph information can be utilized, but the system complexity increases due to meta learner autoencoder implementation
Solution Approach 1:
The meta-learner autoencoder is designed as a universal model that can handle multiple signal types through a unified architecture. Rather than creating separate models for each signal type, the single meta-learner performs multiple functions: encoding signal sequences, processing metadata representations, generating predicted metadata, and enabling predictions for both known and new signal types. This multi-functionality reduces the need for multiple specialized components.
Solution Approach 2:
The system manages complexity by dynamically adjusting parameters rather than changing architectural structures. The meta-learner autoencoder modifies its internal parameters (weights and biases) during training on known signal types, allowing it to adapt to different signal characteristics. For new signal types, the same architecture with updated parameters generated from the knowledge graph enables predictions without requiring structural modifications.
Data Source
AI summary
A system comprising a processing circuitry configured to: obtain: (a) one or more metadata representations, each representing metadata relating to a signal type of one or more signal types; (b) one or more signal sequences, each signal sequence is an ordered sequence of values associated with a given signal type of the one or more signal types; and (c) at least one new signal sequence, being a new ordered sequence of values, each associated with a label, the at least one new signal sequence is associated with corresponding at least one new signal type, not included in the one or more signal types; train a meta learner autoencoder, capable of mapping at least one given signal sequence and at least one respective metadata representation, being the metadata representation representing the signal type of the given signal sequence into a meta representation vector, wherein the trained meta learner autoencoder comprises a meta learner encoder and a meta learner decoder; determine, based on the metadata representations, a predicted metadata representation representing the at least one new signal type; and train, by utilizing the meta representation vector mapped by the meta learner encoder from the at least one new signal sequence and the predicted metadata representation, a new task model, capable of receiving one or more unlabeled signal sequences associated with the at least one new signal type, and predicting, utilizing the predicted metadata representation and the meta learner encoder, for each of the unlabeled signal sequences, a corresponding label.


