PCIe Fabric Disaggregation for Storage Density
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-density networked storage and remote computing systems face physical limitations such as space constraints and device capacity issues, particularly in networked, cloud, and enterprise environments, where higher capacity, redundancy, and reliability are required.
Innovation Solution
A disaggregated computing architecture using a PCIe fabric to communicatively couple physical computing components, allowing for flexible configuration and logical partitioning of compute units, enabling dynamic allocation of resources and increased density through PCIe switches and management processors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If networked storage systems and remote computing systems are increased in density, then storage capacity and computing resources are improved, but physical space requirements and environmental control space are worsened
Solution Approach 1:
The system segments storage and computing resources into independent PCIe devices that can be individually managed and allocated. Storage devices, computing devices, and network interface cards are separated as distinct components connected through a PCIe fabric, allowing dense packing while maintaining individual control and reducing overall space requirements through efficient resource sharing.
2Quantity of substance
If the number of storage devices per host is increased, then storage capacity and redundancy are improved, but device complexity and host capacity limitations are worsened
Solution Approach 1:
A management processor acts as an intermediary between hosts and multiple PCIe storage devices. The management processor handles device configuration, resource allocation, and coordination, freeing hosts from direct management complexity. This intermediary layer enables numerous storage devices to be connected and managed without proportionally increasing host complexity or capacity requirements.
3Adaptability or versatility
If PCIe devices are dynamically allocated and configured, then resource flexibility and adaptability are improved, but system complexity and configuration management are worsened
Solution Approach 1:
The system implements dynamic resource allocation where PCIe devices can be programmatically assigned and reassigned between different hosts and compute units through software control. The PCIe fabric and switches enable runtime reconfiguration of device connections, allowing resources to adapt to changing workload requirements without physical reconfiguration, managed through automated software orchestration.
Data Source
AI summary
Disaggregated computing architectures, platforms, and systems are provided herein. In one example, a method of operating a data processing system is provided. The method includes instructing a PCIe fabric communicatively coupling a plurality of physical computing components including PCIe devices and one or more PCIe switches to establish a first PCIe communication path between the management processor and a target PCIe device. The method also includes directing at least configuration data to the target PCIe device using the first PCIe communication path and instructing the PCIe fabric to remove the first PCIe communication path between the management processor and the target PCIe device. The method also includes instructing the PCIe fabric to establish a second PCIe communication path between a selected PCIe device and the target PCIe device configured according to the configuration data.