Hardware Router for Object Memory Fabric Data Transfer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current commodity hardware and software solutions are inadequate for meeting the demands of Cloud Computing and Big Data environments due to their complexity, inefficiency in managing processing, memory, and storage, which leads to limitations in performance and economic scaling.

Innovation Solution

The implementation of an object memory fabric with hardware-based processing nodes that utilize a stream application programming interface (API) to manage memory objects natively, allowing for efficient communication and operation across multiple nodes without traditional I/O instructions, and the use of routers to facilitate data transfer between different memory types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional software management is used for processing, memory, and storage, then system flexibility and programmability are maintained, but system complexity increases and performance efficiency decreases

Engineering Contradiction:
Improveperformance efficiencyVSAvoidsoftware management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces software-based memory management with a hardware-based memory fabric system. The memory fabric uses physical routing structures and dedicated communication pathways to manage data transfer between processing nodes, eliminating the need for complex software memory managers and improving performance through hardware-level optimization.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a memory fabric as an intermediary layer between processing nodes and memory resources. This memory fabric acts as a dedicated communication infrastructure that mediates data access and transfer, reducing the complexity of direct software management while improving access efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If processing, memory, and storage are managed separately by software, then system modularity is maintained, but data access latency increases and efficiency decreases

Engineering Contradiction:
Improvedata access efficiencyVSAvoiddata access latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent merges processing, memory, and storage management into a unified hardware-based memory fabric system. By combining these functions at the hardware level, the system eliminates multiple software management layers and enables faster, more efficient data access through integrated hardware pathways.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If physical network infrastructure is used to connect nodes, then system scalability is maintained, but communication overhead increases and efficiency decreases

Engineering Contradiction:
Improvecommunication efficiencyVSAvoidnetwork infrastructure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts the communication function from the general-purpose physical network infrastructure and creates a dedicated memory fabric communication layer. This specialized infrastructure handles data transfer between memory nodes with minimal overhead, separating communication tasks from general network operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11733904B2Infinite memory fabric hardware implementation with router
Publication Date: 2023.08.22 ULTRATA LLC
  • US11733904B2 patent drawing
  • US11733904B2 patent drawing
  • US11733904B2 patent drawing

AI summary

Embodiments of the invention provide systems and methods for managing processing, memory, storage, network, and cloud computing to significantly improve the efficiency and performance of processing nodes. More specifically, embodiments of the present invention are directed to a hardware-based processing node of an object memory fabric. The processing node may include a memory module storing and managing one or more memory objects, the one or more memory objects each include at least a first memory and a second memory, wherein: each memory object is created natively within the memory module, and each memory object is accessed using a single memory reference instruction without Input/Output (I/O) instructions; and a router configured to interface between a processor on the memory module and the one or more memory objects; wherein a set of data is stored within the first memory of the memory module; wherein the memory module dynamically determines that at least a portion of the set of data will be transferred from the first memory to the second memory; and wherein, in response to the determination that at least a portion of the set of data will be transferred from the first memory to the second memory, the router is configured to identify the portion to be transferred and to facilitate execution of the transfer.