Parametric Curve Encoding for Anomaly Detection Model Architecture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for determining machine learning model architectures for anomaly detection in sensor signals are iterative and lack efficiency, requiring multiple iterations to achieve accurate results, especially in complex industrial data sets like those from Micro Electro Mechanical Systems (MEMS) angular rate sensors.

Innovation Solution

A method using evolutionary algorithms to generate and optimize machine learning model architectures by encoding them as parametrically modeled curves, specifically quadratic Bézier curves, which represent relationships between neurons and layers, and incorporating autoencoders for dimensionality reduction and anomaly detection, with error values accounting for accuracy and complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If iterative modeling process is used to find the right machine learning architecture, then detection accuracy is improved, but time consumption and computational resources increase significantly

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoidmodel development time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using parametrically modeled curves (such as quadratic Bézier curves) to pre-define and constrain the search space of possible model architectures. Instead of iteratively testing arbitrary architectures, the method generates candidate architectures that lie on predefined curves in the architecture space, thereby preparing and narrowing down potential solutions before the actual optimization process begins. This reduces the number of iterations needed to find accurate models.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If complex machine learning architectures with more layers and neurons are used, then anomaly detection accuracy is improved, but model complexity increases

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoidmodel architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by representing model architectures through parametric curves where a small number of parameters (control points of the Bézier curve) define the entire architecture structure. By optimizing these curve parameters instead of individually tuning each layer and neuron, the method achieves accurate anomaly detection while maintaining manageable model complexity. The parametric representation allows continuous adjustment of architecture parameters to find the optimal balance between accuracy and complexity.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If multiple iterations are performed to optimize model architecture, then detection accuracy is improved, but computational resources and processing time increase

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoidmodel optimization efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies dimensionality change by transforming the discrete, high-dimensional search space of model architectures into a continuous, lower-dimensional curve space. Instead of searching through discrete combinations of layers and neurons, the method represents architectures as points on continuous parametric curves, reducing the search dimensionality. This transformation enables more efficient optimization with fewer iterations, improving productivity while maintaining detection accuracy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20240394599A1Method for Determining a Machine Learning Model Architecture for Detecting Anomalies in Sensor Signals
Publication Date: 2024.11.28 ROBERT BOSCH GMBH
  • US20240394599A1 patent drawing
  • US20240394599A1 patent drawing
  • US20240394599A1 patent drawing

AI summary

A method for determining a machine learning model architecture for detecting anomalies in sensor signals includes generating a population for an evolutionary algorithm, each individual of the population is a machine learning model obtained based on an encoding of the machine learning model using a parametrically modeled curve. The respective parametrically modeled curve represents a relationship between a number of neurons and a number of layers of the respective machine learning model. The method further includes performing detection of anomalies by each individual using a training data set to determine and assign an error value of each individual to the individual. The error value determines an accuracy of detection of anomalies of the respective individual based on a complexity of the respective individual. The method also includes performing a modification of the individuals according to the evolutionary algorithm.