Supercharge Your Innovation With Domain-Expert AI Agents!

Remote memory access optimization method and system under separated combinable architecture

A memory access and combined technology, applied in inter-program communication, instruments, multi-program devices, etc., can solve problems that have not considered the parallel potential of upper-layer application memory access characteristics

Active Publication Date: 2021-05-18
SHANGHAI JIAO TONG UNIV
View PDF14 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing application-aware remote memory access solution replaces the backend of the Linux page swapping mechanism with RDMA to transparently perform remote memory access, which cannot avoid the additional overhead caused by the introduction of the kernel, and has not considered the memory access characteristics of the upper layer application. parallel potential

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote memory access optimization method and system under separated combinable architecture
  • Remote memory access optimization method and system under separated combinable architecture
  • Remote memory access optimization method and system under separated combinable architecture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In this embodiment, the graph computing application is taken as an example, and RDMA is used as the remote memory medium. The system environment is as follows: two 20-core Intel(R) Xeon(R) Gold 6148 CPUs, 256GB memory, 21TB hard disk and a dual Channel Mellanox ConnectX-5RDMA network card. One of the servers is used as a computing node, and the other is used as a remote memory access node (remote node).

[0044] Such as figure 1 As shown, it is a remote memory access optimization system under a separate and composable architecture related to this embodiment, including: at least one local computing node and at least one remote memory node, both of which are connected through their respective RDMA network cards and wired methods And exchanging data, wherein: each node includes a memory area, the memory area is composed of a local area and a remote area, and the CPU of the local computing node exchanges data with the memory area through a cache.

[0045] Such as image ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a remote memory access optimization method and system under a separated combinable architecture, and the method comprises the steps: firstly deploying a writable working set at a local calculation node according to the memory read-write frequency of an application, and deploying a read-only working set at a remote memory node; in the data transmission process, selecting a proper default data block size according to hardware resource characteristics, and realizing transparent dispersion and integration of the data blocks by setting indexes for the data blocks and combining dynamic blocking in the RDMA transmission process; realizing a bidirectional unilateral operation mechanism matched with local application reading and writing by utilizing unilateral reading and writing and a queue-based RDMA mechanism; and setting a buffer area by using an asynchronous read-write mechanism based on event notification to realize asynchronous parallel processing of local calculation and RDMA data read-write. According to the method, the performance potential of an application layer computing task using RDMA to access the remote memory can be fully mined.

Description

technical field [0001] The present invention relates to a technology in the field of distributed data processing, in particular to a far memory access optimization method and system under a separable and composable architecture. Background technique [0002] Under the existing separate and combinable memory architecture where memory resources are scarce, people use high-speed networks such as RDMA protocols to realize remote memory reading and writing. The existing application-aware remote memory access solution replaces the backend of the Linux page swapping mechanism with RDMA to transparently perform remote memory access, which cannot avoid the additional overhead caused by the introduction of the kernel, and has not considered the memory access characteristics of the upper layer application. coming parallel potential. Contents of the invention [0003] Aiming at the above-mentioned deficiencies in the prior art, the present invention proposes a far memory access optim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F13/28G06F9/54
CPCG06F9/542G06F9/544G06F9/546G06F13/28G06F2209/544G06F2209/548
Inventor 李超王靖汪陶磊过敏意
Owner SHANGHAI JIAO TONG UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com