20 results about "Remote memory" patented technology

Embodiments of the present disclosure provide a data transmission method, a device, a storage medium, and a program product. The embodiments of the present disclosure provide a software-implemented RDMA memory page fault solution: when acquiring data from a remote memory, a remote end maps a page-faulted virtual memory into a specific physical memory region, allows for the occurrence of a memory page fault in an RDMA process, and adds a memory page fault processing flow between a local end and the remote end to implement memory page fault processing; and when writing data into the remote memory, the remote end provides a shared virtual memory and a private virtual memory and exposes the shared virtual memory to the local end, the local end writes data into the shared virtual memory, and then a remote control object migrates the data to the private virtual memory, wherein memory page faults are allowed to occur and be processed during the migration. Since memory page faults are allowed to occur and page fault processing is supported, dynamic allocation of physical memory resources is supported during the RDMA process, thereby improving the utilization of memory resources while leveraging the advantages of RDMA.

The embodiment of the invention discloses a memory access optimization method and device, electronic equipment, a storage medium and a program.The method comprises the steps that memory access data of an application program are dynamically monitored in real time, and remote memory access data of the application program are determined according to the memory access data of the application program; under the condition of determining that the remote memory access data of the application program meets the memory exchange condition, determining a target exchange local memory from local memories; determining a target exchange remote memory according to the remote memory access data of the application program; and performing memory exchange processing on the target exchange local memory and the target exchange remote memory. According to the technical scheme provided by the embodiment of the invention, efficient management of the memory can be realized in a high-memory-demand use scene, and memory access delay is reduced, so that the memory access efficiency is improved, and the overall performance of the system is improved.

The application discloses an inter-node communication method and an electronic device, relates to the technical field of inter-node communication, and comprises the following steps: when a first node is initialized, a first completion queue group and a first queue pair group are created to form a first resource pool, and a first memory pool is applied as a unified storage area; when the first node joins a cluster, a node announcement message is sent to other nodes in the cluster; in response to the first node receiving a communication task pointing to a second node, a first queue pair is selected from available queue pairs, and a first memory area is divided from the first memory pool; the second queue pair number and the second remote access key of the second node are obtained from a preset connection table; and based on the first queue pair and the first memory area, a remote memory direct access operation is initiated to access the opposite end identified by the second queue pair number with the second remote access key, thereby solving the technical problem of long inter-node communication delay in the prior art, and improving the efficiency and reliability of inter-node communication.

A method of data storage is disclosed comprising: adding a hash to a Merkle mountain range (MMR) stored in a local memory, wherein the MMR is persisted to a second MMR stored in a remote memory, the remote memory also comprising cryptographic information; copying the second MMR and the cryptographic information to the local memory and obtaining a version identifier identifying the copied data; determining a total storage size of the data added to the MMR; determining whether a portion of the remote memory has capacity for the data; and if the portion has capacity: writing the second MMR with the hash back to the remote memory and providing the version identifier; or if the portion has insufficient capacity: writing the hash, the cryptographic information, and further cryptographic information to a new portion of the remote memory; and transmitting the version identifier. A corresponding device is also disclosed.

This invention discloses a method and system for exchanging local and remote memory objects in a single-copy mode. First, the invention constructs a logical address space and deploys it on memory nodes, establishing a unified correspondence between spatial addresses and virtual memory addresses. A memory management unit then translates virtual memory addresses into physical addresses. Second, a unique-copy mode is used to trigger object swapping operations, and an asynchronous garbage collection mechanism balances memory release efficiency with operational stability. Finally, a dedicated memory allocator improves memory management efficiency, including a split memory layout, a kernel offloading mechanism, and multi-partition load balancing. This invention avoids inter-process address switching overhead through a unified address space; eliminates data redundancy and multi-copy synchronization overhead through a unique-copy mode; and improves memory allocation efficiency through a split memory layout, kernel offloading, and multi-partition management mechanisms, achieving efficient utilization of remote memory resources and high-performance scheduling in multi-process shared scenarios.

Systems and methods for updating remote memory side caches in a multi-GPU configuration are disclosed herein. In one embodiment, a graphics processor for a multi-tile architecture includes a first graphics processing unit (GPU) having a first memory, a first memory side cache memory, a first communication fabric, and a first memory management unit (MMU). The graphics processor includes a second graphics processing unit (GPU) having a second memory, a second memory side cache memory, a second memory management unit (MMU), and a second communication fabric that is communicatively coupled to the first communication fabric. The first MMU is configured to control memory requests for the first memory, to update content in the first memory, to update content in the first memory side cache memory, and to determine whether to update the content in the second memory side cache memory.

The invention relates to a separate memory architecture-oriented swap space cache optimization system and method, and the method comprises the steps: receiving a page swap request sent by a host memory space, and converting the page swap request into a swap space memory access request; a cardinal number tree cache index is generated according to the logic block number in the exchange space memory access request, searching is conducted according to the index, and if searching succeeds, a data block is obtained from a cache space and sent to a host memory space; if the search is not successful, adopting an asynchronous active cache replacement strategy to select a data block from the original cache region, writing the data block back to the remote memory pool, and meanwhile, adopting a dynamic pre-fetching strategy based on historical access to read pre-fetching data from the remote memory, and storing the pre-fetching data into a pre-fetching cache region. On the premise that an existing switching mechanism of an operating system is not changed, the access efficiency of the switching space of the separated memory is improved, the access frequency of the remote memory is reduced, and therefore the memory access time delay of the whole system is reduced, and the I / O performance of the system is improved.

The application relates to the technical field of distributed computing and memory management, and discloses a memory dynamic resource allocation and scheduling method for big data system integration, which comprises the following steps: analyzing a distributed computing job to establish a mapping of a data block logical address to a local page table entry; generating an event notification when a downstream operator completes reading of the data block; writing data in a local physical page frame into a registered memory area of a remote computing node through RDMA, and constructing a remote memory index table in a kernel state; writing a remote redirection mark and an integer index, and releasing the corresponding local physical page frame; when a target page table entry triggers a page fault exception and contains the redirection mark, the system acquires a remote data address according to the integer index by querying the index table, pulls the remote data to update the page table entry, and restores process execution. The application effectively releases local memory resources, realizes on-demand recovery of remote data through a page fault exception mechanism of an operating system, and reduces system recalculation overhead.

The invention relates to the technical field of edge computing architectures, in particular to an edge computing method and system capable of achieving direct exchange of remote memory data, in an FPGA of a heterogeneous processing unit, a hardware RoCE v2 RDMA engine, a high-speed memory pool, a reconfigurable calculator, a flow control and congestion manager and other key components are creatively integrated, and by means of a QDMA IP core, the RDMA engine, the high-speed memory pool, the reconfigurable calculator, the flow control and congestion manager and other key components are integrated. A high-speed PCIe data channel is constructed with an edge reasoning module containing a CPU, a GPU and an AI accelerator, the defects that a traditional RDMA scheme is low in system integration degree and heavy in hardware dependence are overcome, efficient cooperation of calculation acceleration and the RDMA function is achieved, meanwhile, the problem that on-chip resources are limited in a large-scale connection scene can be solved, stable and efficient data transmission is guaranteed, preprocessing is supported during data flowing, and the data flow speed is increased. The method is deeply fused with AI reasoning, a calculation and communication separation pattern is broken, and the flow control and scheduling capability is strong.

The present disclosure relates to methods and systems for shared memory access APIs in distributed systems. A system allocates, in a distributed system comprising a plurality of nodes, a plurality of memory portions comprising shared remote memory content. The system registers the allocated portions with an operating system for access via RDMA. The system accesses, by a first node, the allocated portions to obtain a local copy. The system performs, via a library structured atomic application programming interface call, an atomic operation on one or more bits of the shared remote memory content by one or more of: updating the one or more bits based on a new value and an offset; fetching, from the shared remote memory content, a current value of the one or more bits prior to the update based on the offset; and performing an action on the shared remote memory content based on a comparison of the fetched current value to an expected value in the local copy.

The embodiment of the present specification provides a memory allocation method and device, the method comprises: in the case of determining to perform page table page allocation for a target page table of a target process, acquiring a resource binding mechanism corresponding to the target process; according to a memory node binding constraint in the resource binding mechanism, determining a target memory node corresponding to the target process, and allocating a page table page for the target page table in the target memory node; in the case that local memory of the target memory node is insufficient to cause the page table page allocation to fail, migrating a target physical page in the local memory to a first remote memory node, and continuing to perform the step of allocating a page table page for the target page table in the target memory node until the page table page allocation succeeds. By such a forced allocation of a page table page in a target memory node and in combination with an intelligent memory migration mechanism, performance loss caused by remote access of a page table is fundamentally eliminated.

The invention belongs to the related technical field of key value storage in a separated memory environment, and particularly relates to a key value storage method based on a key value separation log structure merge tree in a separated memory, which comprises the following steps: organizing value data into a value data table capable of being remotely and directly accessed and operated by the memory, and adopting a fine-grained garbage collection mode to store the value data into a value data table; the positions of all key value pair data are not moved, and a remote memory space where each piece of failure value data is located is recognized and recycled through compression operation on the SST; designing a space, and writing the value data into the recovered fragmented memory space by using a writing strategy to improve the space utilization rate and avoid the serialization process of the value data, and constructing an invalid data space collector to manage and record a value data table written in the MN end; a fragment space reorganizer is used for collecting fragment space of a value data table and reorganizing the fragment space into a plurality of sets to receive value data of a CN end, and the fragment space of the value data table is effectively utilized through splitting and flashing operation.

A system with an interface for remote memory. In some embodiments, the system includes: an interface circuit having: a first interface, configured to be connected to a processing circuit; and a second interface, configured to be connected to memory, the first interface including a cache coherent interface, and the second interface being different from the first interface.

The embodiment of the present application provides a data recovery method, a computing device and a storage medium. In the embodiment of the present application, data is written to a local memory node, record information for recording a write operation corresponding to the written data is generated and stored according to the write operation; the written data in the local memory node is written to a remote memory node; first positioning information is generated and stored, and the first positioning information is used for positioning the written data that has been written to the remote memory node; in the case that the computing node is abnormal, the written data in the local memory node that has not been written to the remote memory node is recovered according to the first positioning information and the record information. Therefore, the written data in the remote memory node is retained, and the life cycle of the remote memory node is maintained. The life cycle of the remote memory node is effectively utilized, and the data recovery amount is reduced.

Unused memory registrations in a remote memory system are proactively identified and freed. A memory server maintains a list of resource tracking entries for its outstanding memory registrations. The memory server continually monitors its list of resource tracking entities. When the memory server finds an unused memory registration in its list, it unregisters the corresponding shared memory region. The monitoring may be performed in the background of the memory server by, e.g., a monitor thread. As a result, unused memory registrations may be quickly released.

A present invention embodiment provides trace-base analysis and memory migration. A trace is performed on a process that is executing one or more preconfigured tasks to collect trace data comprising memory access addresses of the process and function calls of the process. The trace data is analyzed to identify one or more metadata memory regions based on frequent memory accesses and a content memory region based on infrequent memory accesses during the trace. It is determined that a portion of content addresses of the content memory region can be migrated to a remote memory without disrupting execution of the process. The portion of content addresses is migrated to the remote memory. The process is patched to insert remote logic that redirects access operations to the portion of the content addresses to the migrated portion of content addresses in the remote memory. The process is executed.

The application discloses a process scheduling method and a computing device. The method is executed in an operating system of the computing device, the computing device comprises a plurality of nodes connected in communication, each node comprises one or more processors and an internal memory, each processor is adapted to run a process, the internal memory of the node where the process is located comprises a virtual memory area of the process, the virtual memory area comprises a memory page, the method comprises the steps that in response to a request of the process accessing the memory page, it is judged whether the memory page is a shared memory page; if yes, it is judged whether the number of times of continuous access of the process to the memory page is greater than a first threshold; if yes, a processor whose load satisfies a predetermined condition is selected as a target processor from the node where the memory page is located or the nearest node, and the process is migrated to the target processor. According to the technical scheme of the application, the process can avoid accessing a remote memory far away, and the speed of the process accessing the shared memory is improved.

Efficient task and data assignment is provided in multi-chiplet processors including one or more advanced processing chiplets (APCs). A graphics processing unit (GPU) assigns data for use by one or more tasks to memories associated with a plurality of APCs and one or more CPCs. A scheduler or other controller within or otherwise associated with the GPU assigns tasks, which utilize the assigned data, to the APCs. The GPU ensures efficient data assignment by adjustably interleaving data across memories associated with the APCs in order to limit off-chiplet remote memory traffic. Similarly, the scheduler ensures efficient task assignment by adjustably assigning tasks to the APCs, typically in the same order as or in a similar order to the placement order in which the data is assigned to the memories, in order to limit off-chiplet remote memory traffic.

The application relates to a remote memory reading and writing method and device based on an RDMA transmission protocol; the method comprises the following steps: creating a virtual character device based on memory information transmitted by a remote node, and mapping the memory information to a local virtual device; when a page fault interrupt is triggered, allocating physical memory, initiating an RDMA reading request, reading target memory data of the remote node to the physical memory, and performing write protection on the target memory data; when a process in a user state modifies the target memory data, marking the target memory data with a dirty mark; periodically detecting the local physical memory according to a preset time interval; when the target memory data carrying the dirty mark is detected, initiating an RDMA writing request, and writing back the target memory data carrying the dirty mark to the remote node; and when the physical memory is detected to be overdue, recycling the physical memory; the method can accelerate the data synchronization performance between the local node and the remote node, and improve the memory utilization efficiency.

The present application relates to a remote memory read-write method based on an RDMA transmission protocol, comprising: creating a virtual character device on the basis of memory information transmitted by a remote node, and mapping the memory information to the virtual character device; when a page fault interrupt is triggered, allocating physical memory and initiating an RDMA read request, reading target memory data from the remote node into the physical memory; performing write protection on the target memory data, when the target memory data is modified by a user-space process, marking the target memory data with a dirty flag, performing periodic detection on local physical memory at preset time intervals, and when the target memory data carrying the dirty flag is detected, initiating an RDMA write request, and writing back the target memory data carrying the dirty flag to the remote node; and reclaiming the physical memory upon detecting a timeout condition of the physical memory.