Network-Side Model Performance Fetching for Analytics Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The accuracy of data analytics results in communication networks is often low due to variations in model performance between training and actual use stages, leading to incorrect policy decisions by network devices.
Innovation Solution
A method and apparatus for fetching model performance information by requesting a second network side device to determine the performance of a target model using target data and attribute information, allowing for accurate assessment of data analytics results in the actual use stage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a model is trained using training data and then directly used in the actual use stage, then the model can be deployed quickly, but the accuracy of data analytics results becomes low due to model performance variation between training and actual use stages
Solution Approach 1:
The patent applies preliminary action by determining model performance information before the model is deployed for actual data analytics. The system evaluates the model's performance characteristics in advance using the same or similar data distribution conditions, allowing the model to be deployed quickly while ensuring accuracy requirements are met. This pre-evaluation step resolves the contradiction by preparing the model assessment beforehand, avoiding the need for slow post-deployment validation.
Solution Approach 2:
The patent implements feedback by using the determined model performance information to guide subsequent model deployment decisions. The system feeds back the performance metrics to the model selection and deployment process, allowing for adjustments to be made based on actual performance characteristics. This feedback loop ensures that only models meeting accuracy thresholds are deployed, resolving the contradiction between quick deployment and accuracy assurance.
2Device complexity
If model performance information is not determined before deployment, then the deployment process is simple and fast, but incorrect policy decisions are made due to low accuracy data analytics results
Solution Approach 1:
The patent applies preliminary action by determining model performance information before deployment, ensuring that reliability requirements are met upfront. This pre-assessment step, while adding some complexity to the deployment process, prevents incorrect policy decisions by filtering out unsuitable models before they are used for critical analytics tasks.
Solution Approach 2:
The patent applies partial action by determining only the essential model performance information needed for reliable deployment decisions, rather than conducting exhaustive testing. This selective approach maintains reasonable process complexity while ensuring sufficient reliability for policy-making purposes.
3Measurement precision
If the accuracy of data analytics results is prioritized by determining model performance information, then correct policy decisions can be made, but the deployment process becomes more complex and time-consuming
Solution Approach 1:
The patent resolves this contradiction by performing model performance determination as a preliminary step before deployment. This structured pre-assessment approach ensures high accuracy by evaluating models under relevant conditions, while managing complexity through a systematic process that can be automated and standardized.
Solution Approach 2:
The patent applies parameter changes by adjusting the performance evaluation parameters to match the actual use conditions as closely as possible. By changing the evaluation parameters to reflect real-world scenarios, the system achieves high accuracy without excessive complexity, as the evaluation becomes more relevant and efficient.
Data Source
AI summary
The disclosure discloses a method and apparatus for fetching information, a network side device, and a storage medium, and belongs to the technical field of communication. The method for fetching information according to an embodiment of the disclosure includes: sending, by a first network side device, first request information to a second network side device, where the first request information is used for requesting the second network side device to determine model performance information of a target model; and receiving, by the first network side device, the model performance information of the target model sent by the second network side device, where the first request information includes target data and/or attribute information of the target data, the target data is used for determining the model performance information of the target model, and the attribute information of the target data is used for fetching the target data.


