Solid State Blade Data Access Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Supercomputers face bottlenecks in accessing data from disk arrays due to physical characteristics of spinning disk drives and InfiniBand switch fabric, leading to limited bandwidth and high latency.

Innovation Solution

Implementing low power computing complexes with System on Chip (SoC) and Package on Package DRAM memory, interconnected via a high-performance network fabric, closely coupling processing to non-volatile solid state memory, such as NAND Flash, to achieve faster data access and storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If traditional spinning disk drives and InfiniBand switch fabric are used for data storage and access, then system compatibility and ease of manufacture are maintained, but bandwidth is limited and latency is high

Engineering Contradiction:
Improvedata access bandwidthVSAvoidstorage system complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent merges storage and processing functions by integrating solid state memory directly with computing complexes. Each computing complex includes both processing units and embedded solid state memory, eliminating the need for separate storage devices and reducing data access latency. This integration resolves the contradiction by achieving high bandwidth through direct memory access while managing complexity through modular, self-contained computing nodes.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from traditional two-dimensional disk storage to three-dimensional stacked solid state memory architecture. By vertically stacking memory layers and using Package on Package (PoP) configurations, the system achieves higher bandwidth and capacity density without proportionally increasing footprint area, thus improving speed while managing device complexity through spatial optimization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of time

If spinning disk drives are used for data storage, then manufacturing simplicity is maintained, but access latency is high

Engineering Contradiction:
Improvedata access latencyVSAvoidstorage device manufacturing
Core Design Contradiction:
Loss of timeVSEase of manufacture

Solution Approach 1:

The patent replaces mechanical spinning disk drives with solid state memory that has no moving parts. This substitution eliminates mechanical latency and wear issues, achieving microsecond-level access times. The solid state memory uses electronic storage mechanisms rather than mechanical rotation, fundamentally changing how data is stored and accessed while maintaining ease of manufacture through standardized semiconductor fabrication processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the fundamental storage parameter from mechanical rotation-based access to electronic flash memory access. This parameter change transforms access latency from millisecond range to microsecond range. The solid state memory uses NAND flash technology with parallel read/write capabilities, changing the physical state and access mechanism to achieve dramatically lower latency while maintaining manufacturing simplicity through established semiconductor industry processes.

Inventive Principle:
Principle #35Parameter changes

3Speed

If InfiniBand switch fabric is used to interconnect storage and computing nodes, then network connectivity is established, but bandwidth bottleneck is created

Engineering Contradiction:
Improvedata transfer bandwidthVSAvoidnetwork fabric complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent segments the storage network by placing solid state memory locally within each computing complex rather than relying on a centralized storage system connected through the InfiniBand fabric. This segmentation eliminates the bandwidth bottleneck by allowing data to be accessed directly from local memory without traversing the network fabric, reducing dependency on InfiniBand connectivity while maintaining system scalability through modular computing nodes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces solid state memory as an intermediary between processing units and external storage systems. This intermediary layer caches frequently accessed data locally, reducing the need for high-speed network transfers through the InfiniBand fabric. The solid state memory acts as a buffer that mediates data access, providing high bandwidth locally while the network fabric handles only necessary inter-node communication, thus reducing overall network complexity and bandwidth requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11194707B2Systems and methods for rapid processing and storage of data
Publication Date: 2021.12.07 CALIFORNIA INST OF TECH
  • US11194707B2 patent drawing
  • US11194707B2 patent drawing

AI summary

Systems and methods of building massively parallel computing systems using low power computing complexes in accordance with embodiments of the invention are disclosed. A massively parallel computing system in accordance with one embodiment of the invention includes at least one Solid State Blade configured to communicate via a high performance network fabric. In addition, each Solid State Blade includes a processor configured to communicate with a plurality of low power computing complexes interconnected by a router, and each low power computing complex includes at least one general processing core, an accelerator, an I/O interface, and cache memory and is configured to communicate with non-volatile solid state memory.