9 results about "Remote memory" patented technology

Embodiments of the present disclosure provide a data transmission method, a device, a storage medium, and a program product. The embodiments of the present disclosure provide a software-implemented RDMA memory page fault solution: when acquiring data from a remote memory, a remote end maps a page-faulted virtual memory into a specific physical memory region, allows for the occurrence of a memory page fault in an RDMA process, and adds a memory page fault processing flow between a local end and the remote end to implement memory page fault processing; and when writing data into the remote memory, the remote end provides a shared virtual memory and a private virtual memory and exposes the shared virtual memory to the local end, the local end writes data into the shared virtual memory, and then a remote control object migrates the data to the private virtual memory, wherein memory page faults are allowed to occur and be processed during the migration. Since memory page faults are allowed to occur and page fault processing is supported, dynamic allocation of physical memory resources is supported during the RDMA process, thereby improving the utilization of memory resources while leveraging the advantages of RDMA.

The application discloses an inter-node communication method and an electronic device, relates to the technical field of inter-node communication, and comprises the following steps: when a first node is initialized, a first completion queue group and a first queue pair group are created to form a first resource pool, and a first memory pool is applied as a unified storage area; when the first node joins a cluster, a node announcement message is sent to other nodes in the cluster; in response to the first node receiving a communication task pointing to a second node, a first queue pair is selected from available queue pairs, and a first memory area is divided from the first memory pool; the second queue pair number and the second remote access key of the second node are obtained from a preset connection table; and based on the first queue pair and the first memory area, a remote memory direct access operation is initiated to access the opposite end identified by the second queue pair number with the second remote access key, thereby solving the technical problem of long inter-node communication delay in the prior art, and improving the efficiency and reliability of inter-node communication.

This invention discloses a method and system for exchanging local and remote memory objects in a single-copy mode. First, the invention constructs a logical address space and deploys it on memory nodes, establishing a unified correspondence between spatial addresses and virtual memory addresses. A memory management unit then translates virtual memory addresses into physical addresses. Second, a unique-copy mode is used to trigger object swapping operations, and an asynchronous garbage collection mechanism balances memory release efficiency with operational stability. Finally, a dedicated memory allocator improves memory management efficiency, including a split memory layout, a kernel offloading mechanism, and multi-partition load balancing. This invention avoids inter-process address switching overhead through a unified address space; eliminates data redundancy and multi-copy synchronization overhead through a unique-copy mode; and improves memory allocation efficiency through a split memory layout, kernel offloading, and multi-partition management mechanisms, achieving efficient utilization of remote memory resources and high-performance scheduling in multi-process shared scenarios.

The invention relates to a separate memory architecture-oriented swap space cache optimization system and method, and the method comprises the steps: receiving a page swap request sent by a host memory space, and converting the page swap request into a swap space memory access request; a cardinal number tree cache index is generated according to the logic block number in the exchange space memory access request, searching is conducted according to the index, and if searching succeeds, a data block is obtained from a cache space and sent to a host memory space; if the search is not successful, adopting an asynchronous active cache replacement strategy to select a data block from the original cache region, writing the data block back to the remote memory pool, and meanwhile, adopting a dynamic pre-fetching strategy based on historical access to read pre-fetching data from the remote memory, and storing the pre-fetching data into a pre-fetching cache region. On the premise that an existing switching mechanism of an operating system is not changed, the access efficiency of the switching space of the separated memory is improved, the access frequency of the remote memory is reduced, and therefore the memory access time delay of the whole system is reduced, and the I / O performance of the system is improved.

The embodiment of the present specification provides a memory allocation method and device, the method comprises: in the case of determining to perform page table page allocation for a target page table of a target process, acquiring a resource binding mechanism corresponding to the target process; according to a memory node binding constraint in the resource binding mechanism, determining a target memory node corresponding to the target process, and allocating a page table page for the target page table in the target memory node; in the case that local memory of the target memory node is insufficient to cause the page table page allocation to fail, migrating a target physical page in the local memory to a first remote memory node, and continuing to perform the step of allocating a page table page for the target page table in the target memory node until the page table page allocation succeeds. By such a forced allocation of a page table page in a target memory node and in combination with an intelligent memory migration mechanism, performance loss caused by remote access of a page table is fundamentally eliminated.

The invention belongs to the related technical field of key value storage in a separated memory environment, and particularly relates to a key value storage method based on a key value separation log structure merge tree in a separated memory, which comprises the following steps: organizing value data into a value data table capable of being remotely and directly accessed and operated by the memory, and adopting a fine-grained garbage collection mode to store the value data into a value data table; the positions of all key value pair data are not moved, and a remote memory space where each piece of failure value data is located is recognized and recycled through compression operation on the SST; designing a space, and writing the value data into the recovered fragmented memory space by using a writing strategy to improve the space utilization rate and avoid the serialization process of the value data, and constructing an invalid data space collector to manage and record a value data table written in the MN end; a fragment space reorganizer is used for collecting fragment space of a value data table and reorganizing the fragment space into a plurality of sets to receive value data of a CN end, and the fragment space of the value data table is effectively utilized through splitting and flashing operation.

A system with an interface for remote memory. In some embodiments, the system includes: an interface circuit having: a first interface, configured to be connected to a processing circuit; and a second interface, configured to be connected to memory, the first interface including a cache coherent interface, and the second interface being different from the first interface.

The embodiment of the present application provides a data recovery method, a computing device and a storage medium. In the embodiment of the present application, data is written to a local memory node, record information for recording a write operation corresponding to the written data is generated and stored according to the write operation; the written data in the local memory node is written to a remote memory node; first positioning information is generated and stored, and the first positioning information is used for positioning the written data that has been written to the remote memory node; in the case that the computing node is abnormal, the written data in the local memory node that has not been written to the remote memory node is recovered according to the first positioning information and the record information. Therefore, the written data in the remote memory node is retained, and the life cycle of the remote memory node is maintained. The life cycle of the remote memory node is effectively utilized, and the data recovery amount is reduced.

The application discloses a process scheduling method and a computing device. The method is executed in an operating system of the computing device, the computing device comprises a plurality of nodes connected in communication, each node comprises one or more processors and an internal memory, each processor is adapted to run a process, the internal memory of the node where the process is located comprises a virtual memory area of the process, the virtual memory area comprises a memory page, the method comprises the steps that in response to a request of the process accessing the memory page, it is judged whether the memory page is a shared memory page; if yes, it is judged whether the number of times of continuous access of the process to the memory page is greater than a first threshold; if yes, a processor whose load satisfies a predetermined condition is selected as a target processor from the node where the memory page is located or the nearest node, and the process is migrated to the target processor. According to the technical scheme of the application, the process can avoid accessing a remote memory far away, and the speed of the process accessing the shared memory is improved.