Optical Switch Memory Pool Expansion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current resource-centric data center structures, based on PCIe interfaces, face limitations in increasing the distance between network resources and shared memory capacity, leading to suboptimal utilization of memory resources, especially in service-centric environments where asymmetric resource utilization is prevalent.

Innovation Solution

A method and processing system that expand memory resources by generating a device memory resource request, transmitting it to a network manager, and using an optical link frame to connect available memory nodes with host nodes via an optical switch, enabling communication using light signals compliant with the CXL protocol, thereby increasing shared memory capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If PCIe interface is used for resource-centric data center structure, then network resources can be classified and connected, but the distance between network resources and shared memory capacity is limited

Engineering Contradiction:
Improvenetwork resource classification and connectionVSAvoiddistance between network resources and memory
Core Design Contradiction:
Adaptability or versatilityVSLength of stationary object

Solution Approach 1:

The patent replaces the traditional PCIe electrical interface with an optical communication system. Optical switches and light signals are used to transmit memory access requests and data between host nodes and memory nodes, substituting the mechanical/electrical PCIe connection with an optical communication infrastructure that supports longer distances and higher bandwidth.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces optical switches as intermediary devices between host nodes and memory nodes. These optical switches act as mediators that receive memory access requests from host nodes, route them to appropriate memory nodes, and facilitate the transmission of data using light signals, thereby extending the effective distance and capacity of the memory subsystem.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If PCIe interface is used for resource-centric data center structure, then network resources can be classified and connected, but shared memory capacity cannot be significantly increased

Engineering Contradiction:
Improvenetwork resource classification and connectionVSAvoidshared memory capacity
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent creates a universal memory pool that can be dynamically allocated to multiple host nodes based on service requirements. The optical switching fabric enables any host node to access any memory node, creating a universal, shared memory resource pool that significantly increases the total accessible memory capacity beyond what individual nodes could provide.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent transitions from a traditional one-to-one or limited many-to-one memory attachment model to a many-to-many memory access architecture enabled by optical switching. This dimensional change in the access topology allows multiple host nodes to simultaneously access multiple memory nodes, dramatically expanding the effective shared memory capacity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If service-centric environment with asymmetric resource utilization is used, then specific services can consume most computing resources, but memory resources remain underutilized

Engineering Contradiction:
Improvecomputing resource utilizationVSAvoidmemory resource utilization
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent implements a dynamic memory allocation system where the optical switching fabric and memory pool can be reconfigured in real-time based on service requirements. When computing resources are heavily utilized by specific services, the system dynamically allocates additional memory resources from the shared pool to those services, ensuring both computing and memory resources are optimally utilized according to actual service demands.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively increases memory resources in data centers, allowing for improved network resource utilization and expanded memory capacity, enabling better accommodation of diverse service demands within data centers.

Implementation Method 1

communicating, by the host node and the memory node of which memory resources are available, with each other using a light signal corresponding to the optical link frame

Methodology Applied
Scientific EffectOptical signal transmission: Optical Fibre

Data Source

PatentUS20240303116A1Apparatus and method for memory resource expansion
Publication Date: 2024.09.12 ELECTRONICS & TELECOMM RES INST
  • US20240303116A1 patent drawing
  • US20240303116A1 patent drawing
  • US20240303116A1 patent drawing

AI summary

Provided are a processing system and method for increasing memory resources. The method includes generating, by a host node, a device memory resource request and transmitting the device memory resource request to a network manager, providing, by the network manager, memory node information and connection information to the host node in response to the memory resource request, generating, by the host node, an optical link frame corresponding to the request, connecting, by the network manager, a memory node whose memory resources are available and the host node by controlling an optical switch, and communicating, by the host node and the memory node of which memory resources are available, with each other using a light signal corresponding to the optical link frame.