Network Forwarding Element Key-Value Processing Data Plane
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network deployments fail to effectively utilize the increased processing power of network forwarding elements, leading to untapped computational resources and inefficient data compute operations.
Innovation Solution
Implementing network forwarding elements with data plane message-processing pipelines that incorporate key-value processing circuits, allowing these elements to perform key-value services previously handled by data compute nodes, and caching commonly used key-value pairs to supplement distributed key-value servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data compute operations are performed on data compute servers, then computational resources are utilized, but processing speed is limited compared to network forwarding elements
Solution Approach 1:
The patent merges key-value processing functionality into the network forwarding element's data plane pipeline, combining network forwarding and data compute operations into a single integrated system. This allows the forwarding element to perform both packet forwarding and key-value services at line rate, eliminating the speed limitation of separate data compute servers while managing complexity through unified architecture.
Solution Approach 2:
The network forwarding element is designed with multi-functionality, serving both as a network forwarding device and a data compute node for key-value services. The data plane pipeline is configured to handle multiple types of operations including packet forwarding, key-value lookups, and other data compute tasks, making the device universal and eliminating the need for separate specialized servers.
2Loss of time
If key-value services are performed by data compute nodes, then computational tasks are completed, but access times for frequently used key-value pairs are slow
Solution Approach 1:
The patent implements caching of frequently accessed key-value pairs in the network forwarding element before they are needed. The data plane pipeline pre-loads and stores hot key-value pairs in local memory, so when access is required, the operation can be completed immediately at line rate without waiting for remote data compute servers, thus reducing access time while maintaining high productivity.
3Productivity
If network forwarding elements use their full processing power, then data compute operations can be accelerated, but existing deployments leave processing power untapped
Solution Approach 1:
The patent implements dynamic configuration of the data plane pipeline, where the forwarding element can adapt its functionality based on workload requirements. The pipeline can be dynamically programmed to handle different types of data compute operations including key-value services, custom computations, and other specialized tasks, allowing the device to maximize productivity while maintaining versatility through reconfigurable logic.
Data Source
AI summary
Some embodiments of the invention provide a forwarding element (e.g., a switch, a router, etc.) that has one or more data plane, message-processing pipelines with key-value processing circuits. The forwarding element's data plane key-value circuits allow the forwarding element to perform key-value services that would otherwise have to be performed by data compute nodes connected by the network fabric that includes the forwarding element. In some embodiments, the key-value (KV) services of the forwarding element and other similar forwarding elements supplement the key-value services of a distributed set of key-value servers by caching a subset of the most commonly used key-value pairs in the forwarding elements that connect the set of key-value servers with their client applications. In some embodiments, the key-value circuits of the forwarding element perform the key-value service operations at message-processing line rates at which the forwarding element forwards messages to the data compute nodes and/or to other network forwarding elements in the network fabric.