Removable Sensor Storage Modules Using DCPS and RDMA
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing sensor systems face challenges in providing high-performance computing fabric and Ethernet fabric integration, supporting removable solid-state non-volatile memory, and meeting data rate and environmental requirements in rugged and mobile environments, particularly for real-time data recording and storage of sensor data.
Innovation Solution
A sensor storage system comprising removable non-volatile memory storage modules interconnected via a network fabric, utilizing Data Centric Publish Subscribe (DCPS) mechanisms and Remote Direct Memory Access (RDMA) transfers, with integrated processors for data processing and distribution across multiple storage modules, supporting scalable capacity and data rates through PCIe fabric connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If hard drives or solid-state drives in RAID configurations are used on conventional storage interfaces, then aggregate data rates and capacities can be achieved, but the system complexity and inability to support removable media increase
Solution Approach 1:
The storage system is divided into multiple independent storage modules that can be individually connected to the network fabric. Each module operates autonomously, allowing the system to scale by adding or removing individual modules without reconfiguring the entire system, thus maintaining high data rates while reducing overall system complexity.
Solution Approach 2:
The network fabric interface serves multiple functions: it provides high-speed data transfer for RAID-like performance, supports removable media through standardized connectors, and enables dynamic configuration. This universal interface replaces multiple specialized connections, reducing system complexity while maintaining productivity.
2Reliability
If rugged solutions are implemented, then environmental requirements are met, but connectivity, capacity, and supported data rates are limited
Solution Approach 1:
The system moves from traditional direct-attached storage to network-attached storage over a high-speed fabric, adding a network dimension to the storage architecture. This allows ruggedized modules to communicate at high speeds through the network fabric, overcoming the data rate limitations of conventional rugged interfaces while maintaining environmental robustness.
3Productivity
If high performance computing fabric and Ethernet fabric integration are implemented, then RDMA methods are supported, but the ability to support removable media and meet evolving power needs is compromised
Solution Approach 1:
The system employs dynamic configuration capabilities where storage modules can be hot-plugged and hot-swapped without shutting down the system. The network fabric dynamically reconfigures routing paths when modules are added or removed, maintaining RDMA performance while supporting removable media through standardized, interchangeable connectors.
4Quantity of substance
If storage capacity is increased to meet extended recording periods, then data storage capability improves, but the data rate capabilities may be compromised
Solution Approach 1:
Multiple storage modules are merged into a unified network-attached storage system. Each module maintains its own high-speed interface to the network fabric, so the aggregate system provides both increased capacity through multiple modules and maintained high data rates through parallel data paths across the fabric.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A storage system for sensor data includes a plurality of storage modules coupled together via a network fabric, each storage module including a plurality of form factor non-volatile memory (NVMe) storage units. The system also includes an integrated processor coupled to the network fabric and storage modules. The integrated processor is configured for control functions and data processing. The integrated processor configuration includes instructions such that the plurality of storage devices receive data via a data centric publish subscribe (DCPS) notification followed by a remote direct memory access (RDMA) transfer.