Model Training Logical Function Accuracy Monitoring in 5G Core

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current network data analytics functions in 5G core networks face challenges in accurately monitoring and improving the accuracy of analytics, particularly due to the lack of comparison with actual outcomes and the computational and storage requirements for re-training models, which existing lightweight logical functions cannot fulfill.

Innovation Solution

The proposed solution involves shifting the monitoring task from the Analytics Logical Function (AnLF) to the Model Training Logical Function (MTLF), leveraging the Analytics Data Repository Function (ADRF) to store necessary analytics and data for accuracy computation, allowing MTLF to execute model performance monitoring and determine the need for re-training, thereby enhancing accuracy reporting and model refinement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the Analytics Logical Function (AnLF) performs model training and accuracy monitoring, then analytics accuracy can be improved, but the computational and storage requirements exceed the capabilities of lightweight logical functions

Engineering Contradiction:
Improveanalytics accuracyVSAvoidcomputational and storage requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the NWDAF into two separate logical functions: AnLF for analytics inference and MTLF for model training and accuracy monitoring. This segmentation allows MTLF, which has greater computational and storage capabilities, to handle model retraining and accuracy monitoring tasks that would be too complex for the lightweight AnLF.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism where MTLF acts as a supporting function for AnLF. MTLF receives requests from AnLF for model retraining and accuracy monitoring, processes these requests using its greater computational resources, and returns results to AnLF. This intermediary relationship allows AnLF to benefit from enhanced accuracy capabilities without bearing the computational burden.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If analytics accuracy monitoring is implemented by comparing predictions with actual outcomes, then measurement precision improves, but the system complexity and data storage requirements increase

Engineering Contradiction:
Improveanalytics accuracy monitoringVSAvoidsystem complexity and data storage
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the accuracy monitoring and comparison functionality from the core AnLF and places it within MTLF. MTLF is responsible for retrieving actual outcomes, comparing them with predictions, calculating accuracy metrics, and determining when retraining is needed. This extraction reduces the complexity burden on AnLF while maintaining comprehensive accuracy monitoring capabilities.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements a feedback mechanism where MTLF continuously monitors analytics accuracy by comparing predictions with actual outcomes. When accuracy falls below thresholds or retraining intervals are reached, MTLF triggers model retraining and provides updated models to AnLF. This closed-loop feedback system enables continuous accuracy improvement without requiring AnLF to directly implement complex monitoring logic.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240056365A1Method to monitor accuracy of analytics in a mobile communication system
Publication Date: 2024.02.15 NOKIA TECHNOLOGIES OY
  • US20240056365A1 patent drawing
  • US20240056365A1 patent drawing
  • US20240056365A1 patent drawing

AI summary

An apparatus, in a model training related network element, is provided, the apparatus comprising: at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform: receiving a monitoring correlation identifier, subscribing to analytics related information provided by an analytics network element from a storage network element based on the received monitoring correlation identifier, retrieving the analytics related information provided by the analytics network element from the storage network element, and calculating the accuracy of the analytics based on the retrieved analytics related information.