Hitless Data Pipeline Reconfiguration via Standby Memory
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing data processing pipelines in hardware are fixed during manufacturing, making it impossible to add, delete, or modify functionalities after deployment, limiting flexibility and adaptability to changing network requirements.
Innovation Solution
A method and apparatus for a network element that allows hitless reconfiguration of the data processing pipeline by preparing a new image, putting the pipeline into a non-forwarding mode, writing the new image into memory, and then switching back to forwarding mode, enabling the addition, deletion, or modification of functionalities without downtime.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a fixed ASIC data processing pipeline is used, then manufacturing precision and reliability are improved, but adaptability and flexibility are worsened
Solution Approach 1:
The data processing pipeline is segmented into multiple functional stages (ingress interface, parse, lookup, egress interface) that can be independently configured and modified. Each stage can be programmed with different functionalities while maintaining the overall pipeline structure, enabling flexibility without compromising the stability of the hardware architecture.
Solution Approach 2:
The pipeline transitions from a static fixed configuration to a dynamic reconfigurable system. The pipeline can be dynamically programmed with new images that modify its functionality at runtime, allowing it to adapt to changing network requirements while maintaining operational stability through controlled state transitions.
2Adaptability or versatility
If the data processing pipeline is reconfigured by writing a new image into memory, then adaptability is improved, but network availability is worsened due to downtime
Solution Approach 1:
The system performs preliminary actions by preparing the pipeline for reconfiguration through state transitions to non-forwarding mode before writing the new image. This preliminary preparation ensures that network traffic is properly handled during the transition, preventing data loss while enabling functionality changes.
Solution Approach 2:
The reconfiguration process maintains continuity of useful action by transitioning the pipeline through controlled states (non-forwarding mode) that preserve network connectivity. The pipeline remains in a functional state throughout the reconfiguration process, ensuring continuous network availability without complete downtime.
3Adaptability or versatility
If the pipeline is put into non-forwarding mode for reconfiguration, then functionality modification is enabled, but productivity is worsened due to operational interruption
Solution Approach 1:
The reconfiguration process uses periodic state transitions, alternating between forwarding and non-forwarding modes. This periodic action allows the pipeline to be reconfigured in controlled intervals rather than continuous interruption, minimizing the impact on overall network productivity while enabling necessary functionality modifications.
Data Source
AI summary
A method and apparatus of a network element that processes data using a data processing pipeline with standby memory is described. In one embodiment, the network element prepares a new image for the data processing pipeline of the network element, where the data processing pipeline processes incoming network data received by the network element and the new image modifies a current set of functionalities of the data processing pipeline. The network element further writes the new image into a standby memory of the data processing pipeline, where the network element includes an active memory that programs the current set of functionalities of the data processing pipeline. In addition, the network element programs the data processing pipeline using the new image. The network element additionally processes the incoming network data received by using the data processing pipeline using modified current set of functionalities.


