Adversarial Training for Noisy Time Series Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine learning systems processing sensor signals are often degraded by noise, particularly in time series data, leading to reduced predictive accuracy, and existing methods fail to effectively enhance robustness against noise.

Innovation Solution

A computer-implemented machine learning system is trained using adversarial training methods by introducing a worst possible noise signal, calculated based on expected noise patterns, to adapt its parameters and improve robustness against noise interference.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If adversarial training with worst possible noise signal is applied, then robustness to noise is improved, but training complexity and computational resources increase

Engineering Contradiction:
Improverobustness to noiseVSAvoidtraining complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The method applies preliminary action by pre-calculating the worst possible noise signal based on expected noise patterns before actual training. This allows the system to prepare adversarial examples in advance, reducing the need for complex real-time noise generation during training while maintaining robustness improvement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The method changes parameters by transforming the training approach from standard clean data training to adversarial training with controlled noise parameters. By adjusting the noise signal parameters (magnitude, frequency, type) to create worst-case scenarios, the system improves robustness without requiring fundamental changes to the neural network architecture.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If standard training methods are used, then training speed is maintained, but predictive accuracy degrades under noise interference

Engineering Contradiction:
Improvetraining speedVSAvoidpredictive accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The method converts harm into benefit by taking the harmful noise signal and transforming it into a beneficial training element. By deliberately introducing worst possible noise patterns during training, the system learns to withstand and accurately process noisy sensor data, thereby improving predictive accuracy under noise interference while maintaining training throughput.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Reliability

If noise robustness is enhanced through traditional methods, then reliability improves, but the system becomes more sensitive to adversarial examples

Engineering Contradiction:
Improvenoise robustnessVSAvoidadversarial example sensitivity
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The method applies preliminary anti-action by proactively defending against adversarial examples through adversarial training. By exposing the neural network to worst possible noise signals and adversarial perturbations during training, the system develops immunity to these harmful inputs before deployment, simultaneously improving noise robustness and reducing sensitivity to adversarial attacks.

Inventive Principle:
Principle #9Preliminary anti-action

Data Source

PatentUS20230419179A1Device for a robust classification and regression of time series
Publication Date: 2023.12.28 ROBERT BOSCH GMBH
  • US20230419179A1 patent drawing
  • US20230419179A1 patent drawing
  • US20230419179A1 patent drawing

AI summary

A computer-implemented machine learning system configured to ascertain an output signal based on a time series of input signals of a technical system. The output signal characterizes a classification and/or a regression result of at least one first operating state and/or at least one first operating variable of the technical system. The training of the machine learning system includes: ascertaining a first training time series of input signals from a plurality of training time series and a desired training output signal which corresponds to the first training time series; ascertaining a worst possible training time series which characterizes an overlap of the first training time series with an ascertained first noise signal; ascertaining a training output signal based on the worst possible training time series using the machine learning system; and adapting at least one parameter of the machine learning system according to a gradient of a loss value.