Network Controller Maintenance Mode Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Performing maintenance mode operations, such as software upgrades, on network devices in data centers is often time-consuming and disrupts network traffic, leading to packet loss and service disruptions, especially when multiple devices are upgraded simultaneously.
Innovation Solution
A network controller is configured to selectively initiate maintenance mode operations on network devices in an ordered manner, verifying that traffic is diverted to other devices before and after the operations, using metadata tags and topology information to manage the process, and injecting configurations to enable hitless upgrades without relying on vendor-specific procedures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If maintenance mode operations are performed on network devices, then device functionality is improved, but network traffic is disrupted causing packet loss
Solution Approach 1:
The system performs preliminary actions by injecting maintenance mode configurations into network devices before actual maintenance operations begin. These pre-configured maintenance mode paths are kept inactive initially, allowing traffic to be diverted to alternative active paths during maintenance, thereby preventing packet loss while enabling device upgrades
Solution Approach 2:
The system introduces an intermediary mechanism using alternative network paths and configured maintenance mode routes. When a device enters maintenance mode, traffic is automatically redirected through these intermediary paths, allowing the device to be maintained without causing packet loss to end users
2Productivity
If multiple network devices are upgraded simultaneously, then productivity is improved, but network stability deteriorates
Solution Approach 1:
The system segments the maintenance operations across multiple devices by dividing them into different maintenance modes (first maintenance mode and second maintenance mode). Devices are upgraded in staggered batches rather than simultaneously, with each batch operating in a specific maintenance mode. This segmentation allows parallel processing while maintaining network stability through controlled phasing
Solution Approach 2:
The system implements periodic action by cycling through different maintenance modes in a structured sequence. Network devices are upgraded in periodic batches, alternating between first and second maintenance modes. This periodic approach enables high productivity through parallel batch processing while maintaining stability by ensuring not all devices are upgraded at the exact same time
3Adaptability or versatility
If manual configuration tasks are performed on network devices, then adaptability is improved, but time consumption increases
Solution Approach 1:
The system enables self-service by implementing automated maintenance mode operations where the network controller automatically manages configuration changes, traffic diversion, and restoration processes. The system uses automated configuration injection and metadata tag-based identification to eliminate manual intervention, thereby reducing maintenance time while preserving adaptability through programmable configuration management
Data Source
AI summary
An example method includes identifying, based on a received indication, at least a first network device that is to be placed in the maintenance mode, determining device information for the first network device, sending, to the first network device, first configuration information included in the device information to cause the first network device to switch into a maintenance mode and enable diversion of network traffic from the first network device to a second network device, responsive to verifying that the first network device has diverted the traffic, initiating maintenance procedures on the first network device while the first network device is in the maintenance mode, and sending, to the first network device, second configuration information included in the device information to cause the first network device to switch out of the maintenance mode and enable reversion of network traffic from the second device to the first network device.