Parametric Curve Encoding for Anomaly Detection Model Architecture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for determining machine learning model architectures for anomaly detection in sensor signals are iterative and lack efficiency, requiring multiple iterations to achieve accurate results, especially in complex industrial data sets like those from Micro Electro Mechanical Systems (MEMS) angular rate sensors.
Innovation Solution
A method using evolutionary algorithms to generate and optimize machine learning model architectures by encoding them as parametrically modeled curves, specifically quadratic Bézier curves, which represent relationships between neurons and layers, and incorporating autoencoders for dimensionality reduction and anomaly detection, with error values accounting for accuracy and complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If iterative modeling process is used to find the right machine learning architecture, then detection accuracy is improved, but time consumption and computational resources increase significantly
Solution Approach 1:
The patent applies preliminary action by using parametrically modeled curves (such as quadratic Bézier curves) to pre-define and constrain the search space of possible model architectures. Instead of iteratively testing arbitrary architectures, the method generates candidate architectures that lie on predefined curves in the architecture space, thereby preparing and narrowing down potential solutions before the actual optimization process begins. This reduces the number of iterations needed to find accurate models.
2Measurement precision
If complex machine learning architectures with more layers and neurons are used, then anomaly detection accuracy is improved, but model complexity increases
Solution Approach 1:
The patent applies parameter changes by representing model architectures through parametric curves where a small number of parameters (control points of the Bézier curve) define the entire architecture structure. By optimizing these curve parameters instead of individually tuning each layer and neuron, the method achieves accurate anomaly detection while maintaining manageable model complexity. The parametric representation allows continuous adjustment of architecture parameters to find the optimal balance between accuracy and complexity.
3Measurement precision
If multiple iterations are performed to optimize model architecture, then detection accuracy is improved, but computational resources and processing time increase
Solution Approach 1:
The patent applies dimensionality change by transforming the discrete, high-dimensional search space of model architectures into a continuous, lower-dimensional curve space. Instead of searching through discrete combinations of layers and neurons, the method represents architectures as points on continuous parametric curves, reducing the search dimensionality. This transformation enables more efficient optimization with fewer iterations, improving productivity while maintaining detection accuracy.
Data Source
AI summary
A method for determining a machine learning model architecture for detecting anomalies in sensor signals includes generating a population for an evolutionary algorithm, each individual of the population is a machine learning model obtained based on an encoding of the machine learning model using a parametrically modeled curve. The respective parametrically modeled curve represents a relationship between a number of neurons and a number of layers of the respective machine learning model. The method further includes performing detection of anomalies by each individual using a training data set to determine and assign an error value of each individual to the individual. The error value determines an accuracy of detection of anomalies of the respective individual based on a complexity of the respective individual. The method also includes performing a modification of the individuals according to the evolutionary algorithm.


