480 results about "Remote direct memory access" patented technology

Apparatus for data communication includes a network interface for connection to a packet data network and a host interface for connection to a host computer, which includes a central processing unit (CPU) and a host memory. Packet processing circuitry receives, via the host interface, from a kernel running on the CPU, associations between multiple remote direct memory access (RDMA) sessions and multiple different User Datagram Protocol (UDP) 5-tuple, which are assigned respectively to the RDMA sessions, and receives from an application running on the CPU a request to send an RDMA message, using a selected group of one or more of the RDMA sessions, to a peer application over the packet data network, and in response to the request, transmits, via the network interface, one or more data packets using a UDP 5-tuple that is assigned to one of the RDMA sessions in the selected group.

Multipathing for session-based remote direct memory access (SRDMA) may be used for congestion management. A given SRDMA session group may be associated with multiple SRDMA sessions, each having its own unique 5-tuple. A queue pair (QP) associated with the SRDMA session group may provide a packet for transmission using the SRDMA session group. The SRDMA session group may enable the packet to be transmitted using any of the associated SRDMA sessions. Congestion levels for each of the SRDMA sessions may be monitored and weighted. Therefore, when a packet is received, an SRDMA session may be selected based, at least, on the weight to enable routing of packets to reduce latency and improve overall system efficiency.

The invention provides an RDMA (Remote Direct Memory Access) message aggregation processing method and a network card device, which belong to the technical field of data communication, and comprise the following steps: S1, an RDMA message analysis step which comprises the links of hardware-level message capture, BTH header analysis and message classification and metadata generation; s2, an RDMA (Remote Direct Memory Access) caching step, wherein the step comprises a message descriptor recording link and a caching strategy link; s3, an RDMA message aggregation step, wherein the step comprises a context table aggregation step, an aggregation process step, a new aggregation process step and an existing context aggregation process step; s4, a zero-copy aggregation step, wherein the step comprises the links of metadata transmission, DMA delay processing and host memory writing; in order to solve the problem that stateless aggregation processing is not tried to be carried out on RDMA messages when an existing network card processes the RDMA messages, a plurality of received RDMA messages are aggregated into a larger RDMA message, and the larger RDMA message is sent to a downstream module for processing, so that the number of messages processed by a rear-stage module is reduced, and the bandwidth of the network card for processing the RDMA messages is improved.

The embodiment of the invention provides a network card equipment switching method and device based on a bonding mode, and relates to the technical field of network card equipment. The method comprises the following steps: in response to a switching operation of network card equipment based on a bonding mode, generating a switching operation message, and transmitting the switching operation message to a preset callback interface; calling a switching operation message from a preset callback interface based on the remote direct memory access driving module; and based on the remote direct memory access driving module, switching the current data information of the first network card device to the second network card device through the shared memory according to the switching operation message, and executing the current data information in the second network card device. By adopting the technical scheme, when one network card device has only one port, a communication mode of remote direct memory access with other devices can be carried out, so that the stability of data transmission is improved.

The invention belongs to the technical field of distributed data access, discloses an RDMA (Remote Direct Memory Access) distributed data transmission method supporting high-concurrency message transmission, and aims to improve system performance in a high-concurrency message transmission environment. The method comprises the following core steps: 1) peer-to-peer server design: each device is an independent server, and connection is established by a connection channel monitored at any time; 2) establishing a connection resource pool in advance; 3) creating and registering an RPC message; 4) transmitting the RDMA to a memory mailbox pool of a target server; 5) the client and the server perform high-concurrency processing; 6) dynamically polling the server; (7) zero-copy transmission of data is achieved through the RDMA technology. According to the invention, the dynamic expansion capability of the architecture is improved by adopting a connection resource decoupling mode, QP jitter can be reduced and the stability of the system can be enhanced by registering a memory of a continuous large page at one time, and the message transmission efficiency under the distributed network architecture is effectively improved by adopting a combined sending strategy.

The invention provides a stream computing resource scheduling method and system based on a dynamic time window, and relates to the field of stream computing resource scheduling, and the method comprises the following steps: constructing a master-slave event time monitoring network to obtain a task feature vector, and establishing an adaptive time window scheduling mechanism to dynamically adjust the window size; and constructing a multi-level task priority queue, carrying out state transition by adopting a remote direct memory access mechanism of incremental transmission, and finally coordinating computing nodes through a distributed task arrangement protocol to complete resource switching. According to the method, computing resource competition can be effectively reduced, the flow computing task processing efficiency is improved, dynamic optimal configuration of resources is realized, and the system throughput is enhanced.

The invention relates to a request device and a response device based on RDMA (Remote Direct Memory Access). The request device comprises a sending processor and a receiving processor; the sending processor is used for receiving a work queue element issued by a driving program, and if the work queue element is an RDMA read operation, the RDMA read operation is converted to obtain a request side write request; the sending processor is also used for sending the request side write request to the response device; and the receiving processor is used for receiving and analyzing a response side write request sent by the response device to obtain target data and a destination address corresponding to the RDMA read operation, and writing the target data into a storage space corresponding to the destination address. Through the application, the QPC data structure domain segment and the design difficulty are reduced, the message disorder processing complexity is reduced, and the consumption of a large amount of host memory and cache resources is avoided.

The invention is suitable for the technical field of network scheduling, and provides a network scheduling method and system for hybrid service transmission based on RDMA, and the method comprises the steps: receiving a to-be-transmitted service demand instruction, and determining a corresponding service type according to a service quality parameter in the service demand instruction; matching a corresponding virtual transmission channel for the service demand instruction according to the service type, wherein the virtual transmission channel is used for isolating hardware-level resources of different types of traffic; selecting an optimal transmission path for the flow of each virtual transmission channel according to a preset path evaluation model; analyzing the congestion risk of the optimal transmission path by adopting a prediction model; and dynamically adjusting a flow transmission path according to a congestion risk analysis result, and ensuring the transmission quality of the highest priority service through a hardware-level scheduling strategy. According to the invention, the optimal balance between the service quality and the resource efficiency can be realized in a complex mixed service environment.

The invention provides a DPU (Data Processing Unit)-based RDMA (Remote Direct Memory Access) virtualized memory address conversion and data transmission method and a DPU-based RDMA virtualized memory address conversion and data transmission system. The method comprises the following steps that: a user process specifies a client virtual address and a corresponding memory The virtual machine kernel generates a first memory conversion table, and the first memory conversion table records conversion from the client virtual address to the client physical address. When the drive program of the remote direct memory access device obtains the first memory conversion table, a preset instruction is triggered to enable the execution control right to be switched to the virtual machine supervision program from the virtual machine kernel. The customer physical address is converted into the host virtual address in the switching process. The virtual machine supervision program obtains mapping from the host virtual address to the host physical address through the host system information, and a second memory conversion table containing the conversion relation from the client virtual address to the host physical address is obtained. The execution control right is switched back to the kernel of the virtual machine, and the second memory conversion table is configured to the remote direct memory access device DPU. According to the method, address conversion can be simplified, hardware dependence is reduced, and RDMA performance is improved.

The invention provides an RDMA data transmission method, network equipment and a system, and relates to the technical field of communication, in particular to the technical fields of chip processors, computing power clusters, ensemble communication operation, large models and the like. The method is applied to a network device comprising an xPU and an RNIC, the xPU comprises a first engine, and the RNIC comprises a second engine communicating with the first engine, a WQE Buffer and an RDMA engine communicating with the second engine. The method comprises the steps that a first engine assembles a WE based on a hardware unloading asynchronous copy instruction set and transmits the WE to a second engine; the second engine stores the WE in a WQE Buffer and transmits the WE to the RDMA engine; the RDMA engine executes data processing based on the WE, wherein the data processing comprises data transmission, memory access and queue management; the first engine receives feedback of data processing transmitted via the second engine. The RDMA data transmission task is directly unloaded to the special engine through the hardware asynchronous instruction set, decoupling of the RDMA data transmission task and computing resources of the system is achieved, and an efficient and low-delay RDMA data transmission solution which does not depend on CPU / GPU resources is provided for data transmission intensive scenes such as an MoE model.

A computer-implemented method for replicating a log to a remote computer system is disclosed. The method involves identifying a log comprising a data portion and a metadata portion for replication. The data portion is sent to the remote computer system using a Remote Direct Memory Access (RDMA) write operation, while the metadata portion is sent using a first RDMA send operation after the data portion has been sent. The method further includes identifying a second RDMA send operation received from the remote computer system, which indicates the completion of the first RDMA send operation. Based on identifying the second RDMA send operation, the method determines the completion of log replication to the remote computer system. This method enables efficient and reliable replication of logs in a computer system.

The invention relates to the technical field of computers and provides a data transmission method based on remote direct memory access, computer equipment and a medium. The method comprises the following steps: when a sending side sends a plurality of request messages associated with a remote direct memory access transmission request, respectively writing a queue index value of a first queue at a receiving side into respective extension heads of the request messages; on the receiving side, based on the queue index value of the first queue in the extension header of the received request message, the message content is written into the position corresponding to the queue index value in the first queue, and the effective identifier of the corresponding position is set to be effective; and on the receiving side, when the effective identifier of the first position in the first queue is effective, reading contents in the positions with the effective identifiers being effective in the first queue one by one according to the sequence of the first queue, so as to generate a plurality of response messages. Therefore, the problem of out-of-order receiving is solved, and resources are saved.

The invention provides a remote direct memory access system, equipment and a cluster. The system comprises the following steps: a remote direct memory access device sends a first address conversion request to a host under the condition that a first physical address corresponding to a first virtual address does not exist; the host queries a first physical address corresponding to the first virtual address in a memory of the host according to the first address translation request, and returns a translation failure response to the remote direct memory access device under the condition that the first physical address corresponding to the first virtual address cannot be queried; the remote direct memory access device sends a page request to the host based on the conversion failure response; the host migrates data corresponding to the first virtual address from a hard disk of the host based on the page request and locks the data in a memory of the host, and returns a page request response; and the remote direct memory access device stores the corresponding relationship between the first virtual address and the first physical address into an address translation list based on the page request response.

In an aspect, systems and methods of connected nodes, including electronic control units (ECUs) in a vehicle, integrate remote direct memory access (RDMA) capabilities with time-sensitive networking (TSN) traffic shaper configurations in a manner that guarantees lossless, bounded-latency critical traffic (CT) streams, while also allowing for different classes of traffic to flow through the connected nodes. In another aspect, mechanisms are introduced to enable an automotive software framework (e.g., classic AUTOSAR) to support RDMA communications.

The invention provides an RDMA (Remote Direct Memory Access) network transmission packet loss recovery method and system. The method comprises the following steps: a sending end determines that a data stream to be transmitted is a larger or smaller data stream based on a multiple of a bandwidth delay product of an RDMA network; performing redundant coding and code marking on the smaller data stream, generating a data stream carrying a code mark and a redundant data packet, and transmitting the data stream to a receiving end; dividing a larger data stream into a non-tail BDP part and a tail BDP part based on the multiple of the bandwidth delay product, performing redundant coding and coding marking on the tail BDP part, and generating the tail BDP part carrying a coding mark and a redundant data packet; and transmitting a data stream formed by the non-tail BDP part and the tail BDP part carrying the coding mark and the redundant data packet to a receiving end, so that the receiving end carries out packet loss and coding mark detection on the received data stream, and if the packet loss and the coding mark exist, the lost data packet is recovered based on the carried redundant data packet. And if there is packet loss and there is no coding mark, requesting the sending end to select to retransmit and recover the lost data packet.

The present specification provides a method and an apparatus for creating a shared remote direct memory access link, which are applied to a local terminal. The method includes: receiving a first creating request for a first shareable remote direct memory access RDMA link initiated by a first application process on the local terminal, where an associated memory address indicated by the first creating request for the first shareable RDMA link is a shared memory address of the first application process and a second application process on the local terminal; creating the first shareable RDMA link between the local terminal and an opposite terminal according to the first creating request, so that the shared memory address is registered to an RDMA device on the local terminal as the associated memory address of the first shareable RDMA link.

The invention discloses a system, a server, a method, a medium and a program product for sharing a memory resource pool, and relates to the field of artificial intelligence, a plurality of switching components of a switch are connected with processors of a plurality of computer devices and the memory resource pool, and the plurality of computer devices share memory resources of the memory resource pool through the switch, different memory capacities are allocated according to the requirements of the computer equipment, dynamic allocation and efficient sharing of memory resources are achieved, the memory utilization rate of a whole machine system is improved, the memory access delay of the computer equipment is reduced, the memory sharing consistency of multiple pieces of computer equipment is ensured, and the requirements of multiple computing scenes are met. Therefore, the technical problems that in the prior art, a server cooperative computing method based on the remote direct memory access (RDMA) technology is large in transmission delay, the requirements of various computing scenes cannot be met, the consistency of shared memories of multiple computer devices cannot be guaranteed, and the resource utilization rate is low are solved.

The invention relates to the technical field of remote direct memory access, in particular to an RDMA shared receiving queue optimization method and device, equipment, a medium and a product. A shared receiving queue is divided into multiple containers, and the multiple containers are connected in series through a logic linked list; when the RDMA data of the queue pair arrives, if the container is not bound, distributing a container for the queue pair; monitoring the release state of the shared receiving queue entry; and when the receiving side software monitors that the target container is in the completely idle state, re-linking the target container into the logic linked list for distribution independent of the states of other containers in the plurality of containers. According to the method disclosed by the invention, dynamic reuse of resources can be realized through resource monitoring taking the container as granularity and an out-of-order recovery mechanism independent of other container states. After all the SRQEs in any container are released, the SRQEs can be immediately put into redistribution, so that the problem of waste of tail idle resources caused by occupation of head resources in a traditional linear queue can be thoroughly avoided.

The invention belongs to the field of computer systems, and provides a low-latency RDMA (Remote Direct Memory Access) acceleration system based on memory registration, which comprises the following steps of: registering a memory region applied by an application program by utilizing a memory pin technology in a kernel; receiving a remote direct memory access (RDMA) work request initiated by an application program, and packaging information comprising a source virtual address and a target virtual address in the request to form a work queue element; the assembly line is used for processing data receiving from a remote system and sending of local data, and hardware logic used for table look-up, QoS detection and message processing is embedded in the assembly line; the server manages the working queue, the data transmission state and the abnormal information processing in a unified manner, and is used for adjusting the transmission parameters of the RDMA acceleration system in real time according to the received context signal; a standardized software calling interface is provided, and cooperative control between software and hardware is achieved.

A method for performing a remote direct memory access (RDMA) read command includes reserving a memory space in a buffer to receive data associated with an address range, sending a RDMA read instruction to a remote module to request the data, and receiving the data from the remote module. A method for performing a RDMA write command includes receiving from a remote module a request to send command requesting to send data associated with an address range, reserving a memory space in a buffer to receive data associated with the address range, sending a RDMA read instruction to the remote module, and receiving the data from the remote module.

The embodiment of the invention relates to a data processing method and device based on a key value database, equipment, a storage medium and a key value database system.The method comprises the steps that after it is determined that to-be-cached key value data exists in a video memory of a graphic processing unit, a data storage request for the to-be-cached key value data is sent to a key value database server side, the data storage request carries storage address information and storage length information of value data of to-be-cached key value data in a video memory; receiving a data reading request which is sent by a key value database server and carries storage address information, and controlling the first network card supporting the remote direct memory access protocol to read value data of the key value data to be cached from the video memory according to the storage address information, sending the value data to the key value database server side, and writing the value data through the second network card supporting the remote direct memory access protocol. Visibly, according to the embodiment of the invention, the key value data in the GPU video memory can be stored without a memory copying process, and the processing efficiency of the key value data is improved.

The invention discloses a distributed file system metadata index optimization method based on remote direct memory access, which comprises directory metadata index based on path name hash: defining a plurality of layers of directories in a directory tree as key directories, and regarding the path as a character string. After calculation of the hash function, determining the storage position of the data in the memory of the metadata server of the distributed file system; and optimizing the memory position of the file metadata based on the popularity, namely placing the file metadata which is frequently accessed at a position adjacent to the key directory metadata to which the file metadata belongs. A metadata management module in a metadata server of the distributed file system regularly checks the popularity of the file and carries out cold and hot migration according to the situation; and client cache optimization oriented to key directory metadata: a metadata cache of a distributed file system client caches the metadata and directory entries of the key directory. Optimally assuming that the metadata and directory entries of the key directory in the cache are not invalid, and updating the cache according to the result of the next-level metadata search. According to the method, the remote reading performance of the metadata index of the distributed file system is optimized by fully utilizing the characteristic of remote direct memory access, the network transmission frequency is reduced, and the load of the metadata server is effectively reduced.

The invention provides a message sending and processing method and system based on RDMA (Remote Direct Memory Access) and electronic equipment. The message sending method comprises the steps that a first message is sent to a receiving end, the first message carries indication information and identification information of a message to which the first message belongs, and the indication information is used for indicating whether disordered receiving between messages is allowed or not. The sending end carries the identification information of the message and the indication information used for indicating whether to allow the out-of-order receiving between the messages in the first message, so that for a receiving end, under the condition that the indication information carried in the first message indicates that the out-of-order receiving between the messages is allowed, the receiving end only needs to preserve the order of the messages in the message, and the receiving end does not need to perform the out-of-order receiving between the messages. According to the technical scheme of the invention, the method does not need to carry out order preservation between messages, that is, a receiving end can trigger retransmission only under the condition that packet loss or disorder occurs to the messages in the messages without triggering retransmission under the condition that the messages are out of order, so that the retransmission range can be reduced (that is, the retransmission range is limited in the messages), and the transmission efficiency of the network is improved.

Examples described herein relate to a network interface that includes an initiator device to determine a storage node associated with an access command based on an association between an address in the command and a storage node. The network interface can include a redirector to update the association based on messages from one or more remote storage nodes. The association can be based on a look-up table associating a namespace identifier with prefix string and object size. In some examples, the access command is compatible with NVMe over Fabrics. The initiator device can determine a remote direct memory access (RDMA) queue-pair (QP) lookup for use to perform the access command.

The embodiment of the invention provides a network flow control method of an RDMA network card and a related device, and relates to the technical field of communication. The method comprises the steps of obtaining at least one transmission window and a sub-window baseline of a sub-transmission window of each transmission window according to transmission parameters of data to be transmitted, generating transmission permission information of the sub-transmission windows, and when the transmission permission information indicates that the sub-transmission windows are in a sending state, sending the data to be transmitted. And packaging at least one information message based on the sub-window baseline and transmitting the information message to the receiver, and obtaining a transmission state and a transmission distance according to a feedback message so as to update the sub-window baseline of the next sub-transmission window. Flow control is carried out in a two-stage window mode, a sub transmission window is used for window updating, and a transmission window is used for overall control. And updating the next sub-window baseline in real time based on the transmission state and the transmission distance to adapt to the actual transmission flow. The end-to-end flow control of the RDMA network card is realized, and the influence of the intermediate switch on the transmission flow is reduced.

The invention discloses an RDMA Chain-based LSM Tree key value type database access method. The method comprises the following steps: a database client sends a request containing a version number, a key and an operation type to a database server main node; the server main node analyzes the request and processes the request according to the operation type; during write operation, a new serial number is generated, and data is inserted into a skip list of a memory table MemTable; when reading operation is carried out and the version number is smaller than 0, whether a key exists or not is checked through a Bloom filter, if yes, query is carried out at a secondary node through the RDMA technology, and if not, an SSTable file in a disk is directly accessed; and when the reading operation is performed and the version number is greater than or equal to 0, preferentially searching the data of the corresponding version in the MemTable, and if the data of the corresponding version fails, querying the SSTable. Through the RDMA technology, CPU occupation and network round-trip time are reduced, and the response speed and concurrent processing capacity of the system are improved.

The invention discloses a multi-node communication architecture based on RDMA (Remote Direct Memory Access), which comprises the following modules on a network card: a PCIe (Peripheral Component Interconnect Express) function module which supports PCIe x16, is downwards compatible, is used for data interaction between a master control on a local node and an RDMA function module, and supports high-speed transceiving; the MAC module is used for supporting high-speed data transceiving between the RDMA functional module and an external node by using a high-bandwidth MAC; and the RDMA function module is used for realizing a standard RoCEv2 protocol, supporting unicast and multicast, supporting reliable connection service and unreliable datagram service, supporting bilateral send / recv operation, and supporting unilateral write and read operation. The architecture can be used for a multi-core CPU heterogeneous airborne embedded supercomputing platform, realizes lossless Ethernet communication, has the characteristics of low delay, low CPU load and the like, and is used for meeting the application requirements of future airborne comprehensive processing platforms.

An integrated circuit formed on (i) a single semiconductor die or (ii) a plurality semiconductor dies that are integrated into a single package. The integrated circuit may include a communication interface including a serializer / deserializer (SerDes) interface; a fabric adapter communicatively coupled to the communication interface; a plurality of inference engine clusters, each inference engine cluster including a respective memory element and / or memory interface; and a data interconnect communicatively coupling each respective memory element and / or memory interfaces of the plurality of inference engine clusters to the fabric adapter. The fabric adapter may be configured to facilitate remote direct memory access (RDMA) read and write services and / or datagram communication over a cell-based switch fabric to and from the respective memory elements and / or memory interfaces of the plurality of inference engine clusters via the data interconnect.

The invention relates to intra-network computing operations using encrypted communications. Examples described herein relate to an interface and a circuit module coupled to the interface. The circuitry module may provide an endpoint for transport layer security (TLS) over a remote direct memory access (RDMA) connection with a first network interface device, provide an endpoint for TLS over an RDMA connection with a second network interface device, provide a transport layer endpoint for packets received from the first network interface device, and provide a transport layer endpoint for packets received from the second network interface device. And providing a transport layer endpoint for a packet received from the second network interface device.

The embodiment of the invention provides a remote direct memory access method and equipment in a virtualization scene. The method comprises the following steps: acquiring a remote direct memory access RDMA request of a first virtual machine to a second virtual machine memory; calling a first virtualization RDMA device in an emulator of a host machine to which the first virtual machine belongs through a first preset drive in the first virtual machine, and converting the RDMA request into an Ethernet message; and transmitting the Ethernet message to a second virtual network card associated with a second virtualization RDMA device in an emulator of a host machine to which a second virtual machine belongs through a first virtual network card associated with the first virtualization RDMA device, so that the second virtualization RDMA device converts the Ethernet message into an RDMA request and transmits the RDMA request to a second virtual machine memory. According to the embodiment of the invention, the RDMA technology is realized in a virtual scene in a software mode, the method does not depend on whether a physical network card of a host machine has the RDMA capability or not, is not limited by resources by queues, and can support the live migration of the virtual machine.