8 results about "Remote memory access" patented technology

The application provides a NUMA system page cache copy management method and system. The application first generates a read-only copy page in the local memory of an access node through the linkage of target file page cache identification, access subject NUMA node information acquisition and policy copy judgment, thereby avoiding cross-node remote memory access. Then, in combination with local copy priority mapping and page fault triggered by unmapping when process node scheduling is changed, the dynamic adaptation of process scheduling behavior and page mapping relationship is realized. Finally, in the read page fault interrupt process, the page mapping update is completed based on the copy strategy, and the association relationship between the node and the access task is recorded. Without damaging the file page cache semantics, the remote access overhead of the multi-NUMA node system file page cache can be greatly reduced, the problem of continuous remote access caused by process node drift can be solved, and the overall file access performance and running stability in the concurrent scenario can be significantly improved.

The application relates to a method and system for improving the speed of writing shared main memory critical resources in parallel by a new generation Shenwei many-core processor, which comprises the following steps: a slave core applies for a data space on its private local data memory; critical resource data in the main memory is copied to the respective private local data memory; each slave core performs read-write operation; each slave core initiates a reduction operation through a remote memory access (RMA) channel, wherein the reduction operation refers to performing certain aggregation function operation on the critical resource data in the private local data memory of the plurality of slave cores to obtain a final result; and the critical resource data in the private local data memory after the reduction operation is written back to the main memory through a direct memory access (DMA) channel. The method can effectively improve the speed of reading and writing the shared main memory critical resources by the slave core of the Shenwei many-core processor, and improve the performance and efficiency of the supercomputer.

The invention discloses a server-free remote memory access performance optimization method based on cross-process memory tracking, and belongs to the technical field of computer memory management. The method comprises the following steps: designing a memory state table as a unified perception layer for remote memory access of homologous server-free containers, and realizing cross-process tracking of memory page states among different containers; a memory state table query process is embedded into hardware page table traversal, page state query is completed by hardware acceleration, and extra overhead on a memory access key path is eliminated; the remote memory access is merged and optimized based on the memory state table, cached local memory pages are reused in the container creation stage, the same remote memory access requests are merged in the operation stage, and the page missing exception frequency and the network bandwidth contention are reduced. According to the method, extra overhead caused by remote memory access in a server-free environment is effectively reduced, page missing abnormity and network bandwidth contention in a concurrent scene are greatly reduced, and the running performance and the system expandability of memory-intensive server-free applications are remarkably improved.

The present disclosure relates to aggregating small remote memory access requests. A network interface card (NIC) receives a stream of commands, respective commands including memory operation requests, each request associated with a destination NIC. The NIC asynchronously buffers the requests into queues based on the destination NIC, each queue specific to a corresponding destination NIC. When a first queue of requests reaches a threshold, the NIC aggregates the first queue of requests into a first packet and sends the first packet to the destination NIC. The NIC receives a plurality of packets, a second packet including memory operation requests, each request associated with a same destination NIC and a destination core. The NIC asynchronously buffers the requests of the second packet into queues based on the destination core, each queue specific to a corresponding destination core. When a second queue of requests reaches a threshold, the NIC aggregates the second queue of requests into a third packet and sends the third packet to the destination core.

This invention relates to the field of electronic digital data processing technology and discloses an AI-based intelligent computing operating system for energy and carbon data. The system includes an energy and carbon tensor management module, a bypass scheduling module, and a mapping processing module. The energy and carbon tensor management module allocates a non-paged, continuous physical space in memory to store time-series energy consumption data streams. The bypass scheduling module acquires the server's memory access topology graph and identifies the local memory nodes corresponding to different cores. The mapping processing module extracts topology boundary nodes based on the computational topology correlation matrix and generates kernel-state topology boundary cut sets. The operating system implements physical mirror multi-projection mapping based on the topology graph and cut sets, establishing redirection paths to convert remote memory access into local addressing access. This invention eliminates hardware cache consistency probe signals through a mirroring mechanism, solving the memory access latency bottleneck in large-scale graph computation and ensuring computational determinism.

This invention discloses a network interface instruction processing method and apparatus for multi-path remote memory access, belonging to the field of high-performance computing. The method includes state maintenance of a multi-path instruction queue, read request scheduling of the multi-path instruction queue, on-chip caching of the multi-path instructions, and network transmission request scheduling of the multi-path instruction queue. The apparatus includes a state maintenance controller, a read request scheduler, an on-chip cache device, a network transmission request scheduler, and a computer-readable storage medium. This invention can meet the high-speed processing requirements of thousands of multi-path remote memory access instructions, ensuring fair scheduling and efficient response for all remote memory accesses. It aims to solve the technical problems of low throughput, high latency, uneven cache resource allocation, poor scheduling fairness, and insufficient quality of service in large-scale node interconnection scenarios when network interfaces process massive numbers of multi-path remote memory access instructions.

This invention relates to the fields of distributed computing and edge computing technology, providing a dynamic resource awareness and adaptive computing task scheduling method and system for heterogeneous edge computing devices. The method collects node runtime hardware status parameters through a sliding time window, including storage resource access conflict indicators, storage resource residency status, computing unit operating status, and data transmission link status. Based on these parameters, it performs node availability determination, excluding nodes from the scheduling candidate set when there is a risk of resource conflict or transmission bottleneck. A distributed scheduling structure is constructed based on the candidate node set, and tasks are adaptively partitioned and matched according to node resource status. When system load increases, a constraint control mechanism reduces the task allocation ratio of high-resource nodes and limits their upper limit, while increasing the participation of low-load nodes to control task distribution across multiple nodes. When a node malfunctions, intermediate state data is extracted and migrated to other nodes for continued execution. Furthermore, under network conditions that meet bandwidth and latency requirements, a remote memory access mechanism enables collaborative use of cross-node storage resources, thereby expanding computing resource capabilities.

This application provides a method and system for managing page cache replicas in a NUMA system. First, by linking target file page cache identification, NUMA node information acquisition of the accessing entity, and policy-based replica judgment, a read-only replica page is generated in the local memory of the accessing node, avoiding cross-node remote memory access. Then, by combining local replica priority mapping and page fault triggering during process node scheduling changes, dynamic adaptation between process scheduling behavior and page mapping relationships is achieved. Finally, during the read page fault interruption process, page mapping is updated based on the replica strategy, and the association between nodes and access tasks is recorded. This significantly reduces the overhead of remote access to file page caches in multi-NUMA node systems without disrupting the semantics of file page caches, while simultaneously solving the problem of continuous remote access caused by process node drift, significantly improving the overall file access performance and operational stability in concurrent scenarios.