Anomaly Detection Model Training with Semi-Supervised Labeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing anomaly detection methods in communication networks face challenges due to the scarcity of labeled training data and the difficulty in distinguishing between problematic and non-problematic anomalies, leading to inaccurate and time-consuming manual analysis.

Innovation Solution

A three-step approach involving unsupervised, semi-supervised, and supervised machine learning models, with expert-in-the-loop validation, to enhance anomaly detection accuracy by iteratively refining labels and improving model performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual analysis is used to distinguish problematic and non-problematic anomalies, then detection accuracy may be improved, but time consumption and operational complexity increase significantly

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent introduces a semi-supervised machine learning model as an intermediary between unsupervised anomaly detection and final supervised classification. This intermediate model pre-labels anomalies using uncertainty sampling, reducing the burden on manual analysis while maintaining accuracy. The semi-supervised model acts as a mediator that processes anomalies before they reach the supervised classification stage, thereby reducing time consumption without sacrificing detection precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the anomaly detection process into three distinct stages: unsupervised detection, semi-supervised pre-labeling, and supervised classification. By dividing the workflow into these segments, each handling specific aspects of anomaly processing, the system achieves high accuracy while reducing manual intervention time. The segmentation allows automated processing to handle routine tasks while human experts focus only on critical cases.

Inventive Principle:
Principle #1Segmentation

2Productivity

If supervised machine learning models are trained with limited labeled data, then model training speed improves, but detection accuracy deteriorates due to insufficient training samples

Engineering Contradiction:
Improvemodel training speedVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by using unsupervised models to detect anomalies and semi-supervised models to pre-label them before supervised training. This preparatory work creates a enriched labeled dataset that can be used for efficient supervised model training. The preliminary detection and labeling stages ensure that when supervised training begins, the model receives high-quality labeled data, improving detection accuracy without requiring extensive manual labeling that would slow down the process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The semi-supervised machine learning model serves as an intermediary that generates additional labeled training data from unlabeled anomalies. This intermediate labeling process expands the training dataset without requiring proportional increases in manual labeling effort, enabling faster supervised training while maintaining or improving detection accuracy through the use of uncertainty sampling and expert-in-the-loop validation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If all detected anomalies are manually labeled for training, then model accuracy improves, but operational complexity and resource requirements increase

Engineering Contradiction:
Improvemodel accuracyVSAvoidoperational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies partial action by having human experts label only a subset of anomalies - specifically those with high uncertainty or critical importance - rather than all detected anomalies. The semi-supervised model handles the labeling of remaining anomalies automatically. This partial manual intervention maintains model accuracy while significantly reducing operational complexity and resource requirements compared to complete manual labeling.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The semi-supervised machine learning model performs self-service by automatically generating labels for anomalies using uncertainty sampling and existing labeled data. This self-labeling capability reduces dependency on manual expert intervention, simplifying operations while maintaining accuracy. The model serves itself by identifying its own knowledge gaps and selectively seeking human input only when necessary.

Inventive Principle:
Principle #25Self-service

4Extent of automation

If unsupervised machine learning models are used for anomaly detection, then operational automation improves, but detection accuracy worsens due to inability to distinguish problematic from non-problematic anomalies

Engineering Contradiction:
Improveoperational automationVSAvoidanomaly detection accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent segments the detection system into unsupervised and supervised components, each handling different aspects of anomaly detection. The unsupervised model provides automated initial detection, while the supervised model provides accurate classification. This segmentation allows the system to maintain high automation levels through the unsupervised component while achieving high accuracy through the supervised component, resolving the contradiction between automation and precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The semi-supervised machine learning model acts as an intermediary that bridges the gap between unsupervised detection and supervised classification. It takes the automatically detected anomalies from the unsupervised model and prepares them for supervised processing by pre-labeling based on uncertainty sampling. This intermediate step enables the system to maintain high automation while improving accuracy, as the semi-supervised model enhances the unsupervised detections without requiring full manual intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP4602779B1Training a supervised machine learning model for anomaly detection
Publication Date: 2025.12.03 ELISA OYJ
  • EP4602779B1 patent drawingFigure 1~2
  • EP4602779B1 patent drawingFigure 3
  • EP4602779B1 patent drawingFigure 4~5

AI summary

Example embodiments may relate to training of a supervised machine learning model for anomaly detection in a communication network. A computer-implemented method may comprise: detecting, by an unsupervised machine learning model, a plurality of anomalies in performance indicator data of a communication network; receiving labels for a first subset of the plurality of anomalies and labelling the first subset of the plurality of anomalies with the labels; training, based on the labelled first subset of the plurality of anomalies, a semi-supervised machine learning model for labelling anomalies; labelling, by the semi-supervised machine learning model, a second subset of the plurality of anomalies; and training, based on the labelled first and second subsets of the plurality of anomalies, a supervised machine learning model for detecting and/or classifying anomalies in the performance indicator data.