Network Change Validation via Candidate Device Metrics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computer networking systems often experience performance degradation in end devices after changes, such as software updates, due to lack of validation of the impact on connected devices, leading to limited performance and unrecognized negative effects.
Innovation Solution
A method and system where a network management system identifies candidate devices based on candidacy criteria, collects and compares metrics before and after a change, and validates the change by determining if a predetermined threshold of candidate devices reconnect and maintain performance levels, allowing for successful or unsuccessful change validation and reversal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If changes are made to improve networking system performance, then system performance is improved, but end device performance may degrade and negative effects go unrecognized
Solution Approach 1:
The patent applies preliminary action by identifying candidate end devices and collecting their metrics before the change is implemented. This allows the system to establish a baseline performance state and compare it against post-change metrics to detect any negative effects on end devices, thereby resolving the contradiction between improving system performance and maintaining end device reliability.
Solution Approach 2:
The patent implements feedback by continuously monitoring end device metrics before, during, and after changes are made to the networking system. The system compares pre-change and post-change metrics to determine whether the change had a negative effect on end devices, providing closed-loop feedback that allows for validation or reversal of changes based on their impact on end device performance.
2Ease of operation
If metrics from the networking system are used to validate changes, then change validation is simple, but end device performance degradation is not detected
Solution Approach 1:
The patent applies segmentation by separating the validation process into two distinct metric collection paths: one for networking system devices and another for end devices. This segmentation ensures that both system-level and end-device-level performance data are collected and analyzed, preventing loss of critical end device performance information while maintaining an organized and manageable validation process.
Solution Approach 2:
The patent uses the network management system as an intermediary that collects and compares metrics from both the networking system and end devices. This intermediary role allows the system to aggregate information from multiple sources, validate changes comprehensively, and maintain ease of operation by centralizing the validation logic while preventing information loss about end device performance.
3Reliability
If all end devices are monitored for change validation, then comprehensive validation is achieved, but system complexity increases
Solution Approach 1:
The patent reduces system complexity by applying preliminary action to identify and select only those end devices that are candidates for monitoring based on specific criteria. This pre-selection process filters the end device population to a manageable subset that is most relevant to the change validation, achieving comprehensive validation where needed while avoiding the unnecessary complexity of monitoring all end devices uniformly.
Solution Approach 2:
The patent applies local quality by implementing different monitoring strategies for different end devices based on their characteristics and relevance to the change. Instead of a uniform monitoring approach across all end devices, the system tailors the validation process to local conditions, monitoring only those devices that meet candidacy criteria, thereby achieving effective validation without excessive system complexity.
Data Source
AI summary
Embodiments of methods and a system to validate a change in a computer networking system are disclosed. In an embodiment, a method to validate a change in a computer networking system includes identifying, at a network management system, at least one candidate device, where a candidate device has a network connection to a device that is a target of the change in the computer networking system, collecting, at the network management system, metrics related to the at least one candidate device, triggering, by the network management system, the change at a target device, and validating, at the network management system, the change in the computer networking system using the metrics of the at least one candidate device.