Loosely Coupled PCIe Service Proxy Over IP Network

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current data center networking relies heavily on expensive and power-hungry smartNICs, which can be costly and inefficient, and existing replication chains for database applications lack scalability and consistency.

Innovation Solution

Implementing a network architecture that uses purpose-built PCIe devices and smart switches with service nodes configured in a circular replication chain, enabling virtualized offloads and providing high availability and scalability through chain replication of service state information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If smartNICs are used to provide network services, then service functionality is improved, but capital expense and operating expense increase

Engineering Contradiction:

Improveservice functionalityVSAvoidcapital expense

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent extracts the service processing functionality from the smartNIC and relocates it to the TOR switch. The smartNIC is reduced to a simple PCIe device that only handles basic packet forwarding, while the service nodes in the TOR switch perform the complex service processing. This extraction eliminates the need for expensive smartNICs while maintaining service functionality.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The TOR switch is enhanced with service nodes that can perform multiple service functions (firewall, NAT, load balancing, etc.) for multiple PCIe devices. This multi-functionality consolidates what previously required multiple specialized smartNICs into a single universal platform, reducing capital expenses.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If smartNICs are used to provide network services, then service functionality is improved, but power consumption increases

Engineering Contradiction:

Improveservice functionalityVSAvoidpower consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by stationary object

Solution Approach 1:

The power-intensive service processing functions are extracted from the smartNIC and moved to the TOR switch's service nodes. The smartNIC is left with only minimal packet forwarding functionality, dramatically reducing its power consumption while the TOR switch handles the computational workload.

Inventive Principle:

Principle #2Taking out (Extraction)

3Reliability

If traditional replication chains are used for database applications, then data consistency is improved, but scalability deteriorates

Engineering Contradiction:

Improvedata consistencyVSAvoidscalability

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent segments the service nodes into independent, modular units that can be dynamically added or removed from the replication chain. Each service node is an independent entity that maintains consistent state through the replication mechanism, allowing the system to scale by simply adding more segmented nodes to the chain.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The replication chain is designed to be dynamic, allowing service nodes to be added, removed, or reconfigured without taking the entire system offline. This dynamic architecture enables scalability while maintaining data consistency through the replication protocol that adapts to changing chain configurations.

Inventive Principle:

Principle #15Dynamics

4Reliability

If service nodes are configured in a circular replication chain, then high availability is improved, but system complexity increases

Engineering Contradiction:

Improvehigh availabilityVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the replication chain functionality directly into the TOR switch fabric, combining the service nodes and replication infrastructure into a single integrated system. This eliminates the need for separate replication network infrastructure and simplifies the overall system architecture while maintaining high availability.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11593294B2Methods and systems for loosely coupled PCIe service proxy over an IP network

Publication Date: 2023.02.28 PENSANDO SYSTEMS INC

AI summary

PCIe devices installed in host computers communicating with service nodes can provide virtualized and high availability PCIe functions to host computer workloads. The PCIe device can receive a PCIe TLP encapsulated in a PCIe DLLP via a PCIe bus. The TLP includes a TLP address value, a TLP requester identifier, and a TLP type. The PCIe device can terminate the PCIe transaction by sending a DLLP ACK message to the host computer in response to receiving the TLP. The TLP packet can be used to create a workload request capsule that includes a request type indicator, an address offset, and a workload request identifier. A workload request packet that includes the workload request capsule can be sent to a virtualized service endpoint. The service node, implementing the virtualized service endpoint, receives a workload response packet that includes the workload request identifier and a workload response payload.