Federated Learning for Industrial Anomaly Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing machine learning solutions for predicting maintenance needs in industrial machines face challenges due to the large volume of sensor data and privacy concerns, leading to less robust models when hosted remotely, and the need for ultra-reliable, low-latency communications.

Innovation Solution

A federated learning approach where a central server maintains a master machine learning model and shares updated parameters with edge nodes, allowing local training without sharing raw sensor data, enabling the aggregation of learning across nodes without accessing local data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If machine learning models are hosted remotely in the cloud, then data privacy is protected, but model robustness and accuracy deteriorate due to limited training data

Engineering Contradiction:
Improvemodel robustnessVSAvoidtraining data availability
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system segments the machine learning training process into distributed edge nodes, where each node trains locally on its own data while contributing to a global model through federated learning. This allows each organization to keep their data locally (protecting privacy) while still benefiting from aggregated learning across multiple nodes, thereby improving model robustness without centralizing data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A central server acts as an intermediary that coordinates the federated learning process, aggregating model updates from multiple edge nodes without accessing the actual training data. This intermediary enables collaborative model improvement while maintaining data privacy, as the server only receives and processes model parameters rather than raw sensor data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If large volumes of sensor data are transmitted to remote servers for processing, then centralized model training can be achieved, but communication latency and network requirements increase

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoidcommunication latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system divides the data processing workload by deploying machine learning models to edge nodes that process sensor data locally. This segmentation eliminates the need to transmit large volumes of raw sensor data to remote servers, reducing communication latency while maintaining anomaly detection accuracy through distributed processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Machine learning models are pre-trained and deployed to edge nodes before actual anomaly detection occurs. This preliminary action enables local processing of sensor data without requiring real-time communication with remote servers, thereby reducing latency while maintaining detection precision.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If raw sensor data is shared across multiple organizations for model training, then model accuracy improves, but data privacy and security concerns arise

Engineering Contradiction:
Improvemodel accuracyVSAvoiddata privacy risks
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The central server serves as an intermediary that facilitates collaborative model training by aggregating model updates from multiple edge nodes without ever accessing the raw sensor data. This intermediary mechanism enables model accuracy improvement through federated learning while eliminating data privacy risks associated with sharing raw sensor data across organizations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Instead of sharing raw sensor data, the system shares copies of model parameters and gradients between edge nodes through the central server. This copying approach enables collaborative learning and model accuracy improvement while protecting data privacy, as only anonymized model updates are transmitted rather than the actual sensitive sensor data.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11848027B2Federated learning with sound to detect anomalies in the industrial equipment
Publication Date: 2023.12.19 SAP SE
  • US11848027B2 patent drawing
  • US11848027B2 patent drawing
  • US11848027B2 patent drawing

AI summary

In some example embodiments, there may be provided a method that includes receiving a machine learning model provided by a central server configured to provide federated learning; receiving first audio data obtained from at least one audio sensor monitoring at least one machine located at the first edge node; training, based on the first audio data, the machine learning model; providing parameter information to the central server in order to enable the federated learning among a plurality of edge nodes; receiving an aggregate machine learning model provided by the central server; detecting an anomalous state of the at least one machine. Related systems, methods, and articles of manufacture are also described.