Edge ML Model Selection via Network Quality Metrics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mechanisms for training machine learning models in edge computing environments face challenges due to poor data quality caused by wireless network conditions, leading to inefficient resource usage and incorrect results, especially when dealing with large models and high data transfer requirements.

Innovation Solution

An optimization system that selects a suitable machine learning model and training images based on network data such as SINR, BER, and packet loss, and image quality metrics, to conserve computing and networking resources by providing high-quality data for training, thereby reducing the size and improving the accuracy of the models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If machine learning models are trained using data transmitted over wireless networks in edge computing environments, then model training can be performed at the edge, but data quality deteriorates due to wireless interference, congestion, packet loss, and frame loss

Engineering Contradiction:
Improvemodel training efficiencyVSAvoiddata quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary assessment of network conditions (signal-to-interference-plus-noise ratio, bit error rate, packet loss, frame loss) and image quality (inference confidence scores) before selecting training images. This preliminary evaluation allows the system to proactively avoid using poor-quality data that would result from anticipated transmission issues, thereby resolving the contradiction between edge training efficiency and data quality reliability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by continuously monitoring network performance metrics and image quality indicators, then using this feedback to dynamically adjust training image selection. The feedback loop enables the system to adapt to changing wireless conditions in real-time, ensuring high-quality data is selected for training while maintaining efficient edge computing operations.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If large machine learning models are used to improve processing capabilities, then model accuracy increases, but computing resources and data transfer requirements increase

Engineering Contradiction:
Improvemodel accuracyVSAvoidcomputing resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system changes the parameter of training data quality by selectively choosing images with high inference confidence scores and good network transmission conditions. This parameter change allows the system to train larger, more accurate models while consuming fewer computing resources, because high-quality training data reduces the need for extensive model iterations and retraining, thereby resolving the contradiction between model accuracy and resource consumption.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If frequent data transfer occurs between cloud and edge devices for model training, then model updates can be performed, but networking costs and data transmission overhead increase

Engineering Contradiction:
Improvemodel update capabilityVSAvoidnetworking cost
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The system performs preliminary evaluation of network conditions and image quality before initiating data transfer for model training. By assessing signal-to-interference-plus-noise ratio, bit error rate, packet loss, and inference confidence scores in advance, the system can determine whether current conditions are suitable for training, thereby avoiding unnecessary data transfers and reducing networking costs while maintaining model update capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service at the edge by autonomously selecting appropriate training images based on local assessments of network conditions and image quality. This self-service capability reduces the need for frequent cloud-edge data transfers, allowing the system to perform model updates independently when conditions permit, thereby reducing networking costs while maintaining adaptability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12009993B2Systems and methods for selecting a machine learning model and training images for the machine learning model
Publication Date: 2024.06.11 VERIZON PATENT & LICENSING INC
  • US12009993B2 patent drawing
  • US12009993B2 patent drawing
  • US12009993B2 patent drawing

AI summary

A device may receive network data identifying at least one of a signal-to-interference-plus-noise ratio (SINR), a bit error rate (BER), a packet loss, or a frame loss associated with a radio access network (RAN), and may receive model data associated with a plurality of machine learning models. The device may receive inference confidence scores associated with the plurality of machine learning models, and may process the network data, the model data, and the inference confidence scores, with a model, to select a machine learning model from the plurality of machine learning models. The device may cause the selected machine learning model to be implemented in connection with processing images.