Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1189 results about "Direct memory access" patented technology

Direct memory access (DMA) is a feature of computer systems that allows certain hardware subsystems to access main system memory (random-access memory), independent of the central processing unit (CPU).

Complex scene-oriented AI large model lightweight deployment method

The invention provides a complex scene-oriented AI large model lightweight deployment method, and relates to the technical field of edge computing, and the method comprises the steps: carrying out the structured pruning of a pre-trained Transform network based on the attention head importance score, carrying out the dynamic sparsification of the activation state of a feedforward network according to the input tensor entropy value, employing the dynamic mixing precision quantization, and carrying out the reconstruction of an AI large model. Obtaining network parameters after pruning quantization; deploying the pruned and quantized network parameters to an edge computing device, distributing a feature extraction operator to a neural network processor through a heterogeneous computing scheduler, and unloading a classification operator to a multi-core central processing unit; and managing an on-chip memory in combination with a virtual memory paging mechanism, realizing zero-copy data transmission by utilizing a direct memory access controller, and outputting a reasoning result tensor. According to the method, efficient and reliable operation of the large model at the resource-constrained edge node is realized.
Owner:XIAN XINGXUN INTELLIGENT COMM TECH CO LTD

Address mapping method in DPU local storage virtualization

The invention discloses an address mapping method in DPU local storage virtualization, which comprises the following steps: a virtual machine calls a system call interface provided by an address mapping configuration management module on a host side to perform mapping configuration of a virtual machine physical address and a host physical address, and issues the virtual machine physical address and length to a virtual address mapping module of a DPU; the virtual address mapping module manages global direct memory access address resources, firstly allocates a global direct memory access address on a host side, then maps a virtual machine physical address to the allocated global direct memory access address in a mapping page table of the DPU, and returns the virtual machine physical address to the address mapping configuration management module; and the address mapping configuration management module obtains the distributed global direct memory access address, and maps the distributed global direct memory access address to a host physical address in the IOMMU. According to the method, by optimizing address mapping, the efficient and flexible local storage virtualization service can be realized while the data reliability is ensured.
Owner:ZHEJIANG UNIV

Vehicle-mounted edge computing data recording system and method based on protocol adaptive analysis

The invention relates to the technical field of network communication, and discloses a vehicle-mounted edge computing data recording system and method based on protocol adaptive analysis, and the system comprises a multi-protocol network access controller which is used for capturing an original data frame and extracting a physical feature triple; the identification analysis engine is used for executing hash operation on the triple to generate a physical feature code and retrieving a physical logic address mapping table; the direct memory access controller is used for responding to a target memory address pointer hit by retrieval and directly writing a data load into an input buffer area of the functional operation module, and by constructing a direct addressing mechanism based on Hash mapping, thorough decoupling of vehicle-mounted heterogeneous network physical topology and edge computing logic is achieved.
Owner:SHANGHAI JUPO TECH CO LTD

Two-level context caching and eviction for scatter-gather DMA

One aspect of the instant disclosure may provide a system and method for processing scatter-gather direct memory access (S-G DMA) instructions. During operation, the system may receive an S-G DMA instruction associated with a message and gather instruction context for the S-G DMA instruction. An S-G DMA processor may process the S-G DMA instruction based on the gathered instruction context and determine whether there exists a pending S-G DMA instruction associated with the message. In response to the presence of the pending S-G DMA instruction, the system stores the instruction context in a hot context cache at an address corresponding to the pending S-G DMA instruction. In response to the absence of the pending S-G DMA instruction, the system stores the instruction context in a cold context cache.
Owner:HEWLETT PACKARD ENTERPRISE DEV LP

Page-based remote memory access using system memory interface network device

Examples described herein and includes at least one processor and a direct memory access (DMA) device. In some examples, the DMA device is to: access a command from a memory region allocated to receive commands for execution by the DMA device, wherein the command is to access content from a local memory device or remote memory node. In some examples, the DMA device is to: determine if the content is stored in a local memory device or a remote memory node based on a configuration that indicates whether a source address refers to a memory address associated with the local memory device or the remote memory node and whether a destination address refers to a memory address associated with the local memory device or the remote memory node. In some examples, the DMA device is to: copy the content from a local memory device or copy the content to the local memory device using a memory interface.
Owner:INTEL CORP

Direct memory access (DMA) engine with network interface capabilities

Examples described herein include one or more processors; a network interface; and a direct memory access (DMA) engine communicatively coupled to the one or more processors. In some examples, the DMA engine is to receive a DMA data access request and based on an address in the DMA data access request corresponding to a remote memory device, the DMA engine is to cause the network interface to generate at least one packet for transmission to the remote memory device. In some examples, if the source address corresponds to a local memory device and the destination address corresponds to a remote memory device, the DMA engine is to cause the network interface to generate at least one packet for transmission to the remote memory device.
Owner:INTEL CORP

Accelerator for accelerating reasoning process of unstructured sparse large language model

The invention discloses an accelerator for accelerating the reasoning process of an unstructured sparse large language model and an operation method of the accelerator. The accelerator comprises a processor module, a direct memory access module, a memory controller module, a DDR memory module, an interconnection bus module, a calculation core module and a router module. The interconnection bus module is connected with the direct memory access module, the memory controller module and the computing core module; the processor module is connected with the direct memory access module; the DDR memory module is connected with the memory controller module; the router module is connected with the computing core module and the adjacent router module; and the calculation core module obtains to-be-calculated data from the off-chip DDR memory module through the interconnection bus module. According to the method, the limit that data reuse is carried out only along a single row or a single column on a traditional systolic array is broken through, cross-row and cross-column data reuse is achieved, the pressure of hardware equipment is relieved, the positions of non-zero elements are coded through bit masks, and the calculation efficiency is improved.
Owner:NINGBO ORIENTAL UNIV OF TECH (TEMPORARY NAME)

Multi-thread high-throughput data flow channel separation method and system based on zero copy

The invention belongs to the technical field of data transmission and processing, and discloses a zero-copy-based multi-thread high-throughput data stream channel separation method and system, and the method comprises the steps: directly writing a mixed data stream into a front-end buffer region configured as an annular structure through a data receiving module by adopting direct memory access; then, a multi-thread processing module dynamically allocates a plurality of processing threads from a thread pool to separate channel data in parallel, each thread adopts a zero copy algorithm based on pointer offset, positions the channel data in a memory, creates pointer reference and associates the channel data to a corresponding rear-end buffer area, and logic separation is achieved without physical copy; and finally, the data storage module efficiently writes the separated data into persistent storage in an asynchronous I / O mode. According to the method, zero-copy, multi-thread parallel and two-stage dynamic buffering strategies are combined, the data separation efficiency is remarkably improved, CPU occupation and memory bandwidth are greatly reduced, and the real-time performance and stability of high-throughput data processing are guaranteed.
Owner:CHINA JILIANG UNIV

Data transmission method, device, equipment and medium

The invention discloses a data transmission method and device, equipment and a medium, and relates to the technical field of computers. By adopting a redundancy architecture of multiple direct memory access channels and combining a channel transmission mode based on a trigger condition and a target screening strategy, the data transmission efficiency is improved. The appropriate target direct memory access channel is selected from the multiple direct memory access channels to execute the data transmission task, so that when a certain direct memory access channel has an error, the system can be automatically switched to other direct memory access channels to continue to execute the data transmission task; overall interruption of the non-transparent bridge link caused by a single direct memory access channel fault is avoided, meanwhile, for the direct memory access fault, the fault channel can be accurately repaired by adopting a fault-level-based hierarchical repair strategy, the whole non-transparent bridge link and all devices do not need to be reinitialized, and the fault channel repair efficiency is improved. The fault processing time is greatly shortened, the fault recovery efficiency is effectively improved, and the continuity of cross-storage node data transmission is guaranteed.
Owner:LANGCHAO ELECTRONIC INFORMATION IND CO LTD

Direct memory access architecture, system and method, electronic device, and medium

Provided is a direct memory access architecture, including: a direct memory access control component, a read data moving component, a write data moving component and a data storage component; wherein the direct memory access control component includes a control register, a read descriptor storage component, a write descriptor storage component, a read command transfer component and a write command transfer component; the control register is configured to obtain descriptor address information; the read descriptor storage component is configured to store a read descriptor obtained by using the control register; the write descriptor storage component is configured to store a write descriptor obtained by using the control register; the read command transfer component is configured to send, to the read data moving component, a read command; the write command transfer component is configured to send, to the write data moving component, a write command.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Strong ordered transaction for DMA transfers

A technique for processing strong ordered transactions in a direct memory access engine may include retrieving a memory descriptor to perform a strong ordered transaction, and delaying the strong ordered transaction until pending write transactions associated with previous memory descriptors retrieved prior to the memory descriptor are complete. Subsequent transactions associated with memory descriptors following the memory descriptor are allowed to be issued while waiting for the pending write transactions to complete. Upon completion of the pending write transactions, the strong ordered transaction is performed.
Owner:AMAZON TECH INC

Data interaction method and device based on shared memory, virtual electronic equipment and storage medium

The invention provides a data interaction method and device based on a shared memory, virtual electronic equipment and a storage medium, and the method comprises the steps: responding to a detected packet sending request of a first application for a first protocol stack of first virtual network equipment, and calling a first packet sending function; encapsulating the to-be-sent data into a first data packet based on the first packet sending function; obtaining a storage address of the first data packet, and mapping the storage address in a mode of directly accessing a mapping interface by a memory to obtain a mapped physical address; and filling the physical address into a corresponding position of the descriptor of the first virtual network equipment, and updating the position of a tail pointer of the descriptor. The RC and the EP are registered as the virtual network card through the network driving technology, so that the communication function can be realized through the PCIE slot and by means of the PCIE connecting line, data message transmission can be realized without the aid of peripheral equipment such as the network card, the stability of data transmission is improved, and the configuration cost of hardware is saved.
Owner:PHYTIUM TECH CO LTD

Memory resource access method and device, address translation method and device, equipment and medium

The invention provides a memory resource access method and device, an address translation method and device, electronic equipment and a storage medium. According to the embodiment of the invention, a virtual machine management component can be used for firstly obtaining a direct memory access request of external equipment to a memory resource mounted under a virtual machine; and searching a target physical address corresponding to the target virtual address of the target memory resource from the data processing unit, so that the external equipment accesses the target memory resource by accessing the target physical address. Wherein a physical address translated by the virtual machine management component for the virtual address of the memory resource in advance is stored in the data processing unit, and the data processing unit performs data communication with the virtual machine management component through a communication drive simulated in the virtual machine management component. By adopting the scheme, the congestion of the shared memory resource (IOTLB) of the memory management unit possibly caused by excessive address query can be avoided, the consumption of the shared memory resource is reduced, and the utilization rate of the shared memory resource is improved.
Owner:HANGZHOU ALICLOUD FEITIAN INFORMATION TECH CO LTD

Multi-thread transmission device and method

The invention relates to the field of data transmission, in particular to a multi-thread transmission device and method. Comprising a serializer, a deserializer, an interface controller, a logic manager and a direct memory access controller, deserializing the received physical layer message into a transaction layer message, inputting the transaction layer message into the interface controller, serializing the transaction layer message generated by the interface controller into a physical layer code stream, and outputting the physical layer code stream to the CPU; the interface controller processes a transaction layer message input by the serializer / deserializer or the logic manager; the logic manager generates a chip access message in a specified format from the transaction layer message, and outputs the chip access message to a direct memory access controller in a pipeline form; and the direct memory access controller receives the chip access message. The method can be suitable for a super-large-scale chip and a scene with a complex address space, and can realize rapid and efficient register and table item access.
Owner:WUHAN BINARY SEMICON CO LTD

Multi-host and multi-client direct memory access system having a read scheduler

A direct memory access (DMA) system includes a read request circuit configured to receive read requests from a plurality of client circuits. The DMA system includes a response reassembly circuit configured to reorder read completion data received from a plurality of different hosts in response to the read requests. The DMA system includes a read scheduler circuit configured to schedule conveyance of the read completion data from the response reassembly circuit to the plurality of client circuits. The DMA system includes a data pipeline circuit implementing a plurality of data paths coupled to respective ones of the plurality of client circuits for conveying the read completion data as scheduled by the read scheduler circuit.
Owner:XILINX INC

User mode direct data access to non-volatile memory express device via kernel-managed queue pair

Systems and methods are disclosed for implementing a Non-Volatile Memory Express (NVMe) driver in a computer system. The method involves mapping a memory buffer into a user mode address space to facilitate data transfer with an NVMe device via direct memory access (DMA). Additionally, a first NVMe queue pair, including a submission queue (SQ) and a completion queue (CQ), is mapped into the user mode address space, allowing a user mode component to submit commands to the NVMe device. The method further enables the user mode component to ring a doorbell at the NVMe device. Finally, an NVMe command is processed in kernel mode using a second NVMe queue pair comprising a second SQ and a second CQ.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Memory resource management method and electronic equipment

The invention provides a memory resource management method and electronic equipment, relates to the technical field of electronics, and is used for reducing memory resource waste caused by memory occupied by an application running in a background. The method is applied to the electronic equipment, a target application is installed in the electronic equipment, and the electronic equipment comprises a memory, a graphics processing unit (GPU) driver and a direct memory access cache (DMABUF) driver. The method comprises the following steps: in response to a first operation of switching a target application from a foreground to a background, obtaining an initial preset memory page applied by the target application from a memory; wherein the initial preset memory page comprises a memory page applied by the target application through the GPU driver and / or the DMABUF driver. And compressing the initial preset memory page to obtain a compressed preset memory page, and storing the compressed preset memory page to a virtual disk of the memory. And releasing the initial preset memory page in the memory.
Owner:HONOR DEVICE CO LTD

Communication method, system and device of computer system, product and storage medium

The invention discloses a communication method and system of a computer system, equipment, a product and a storage medium, relates to the field of computers, and aims to solve the problem that a single-channel architecture can become a bottleneck of system performance, the method comprises the following steps: identifying a plurality of direct memory access controllers and a plurality of non-transparent bridging equipment in a first computer system; determining a current target non-transparent bridging device corresponding to each direct memory access controller in the plurality of non-transparent bridging devices; and for each direct memory access controller, carrying out binding operation on the direct memory access controller and the corresponding current target non-transparent bridging equipment, so that the direct memory access controller accesses the second computer system through the corresponding current target non-transparent bridging equipment. According to the invention, the data transmission load can be dispersed to a plurality of communication links, and all data are prevented from being transmitted through the same communication link, so that the throughput of the system is improved, the possibility of bottleneck is reduced, and the data processing capability and performance of the whole system are improved.
Owner:LANGCHAO ELECTRONIC INFORMATION IND CO LTD

Systems, methods, and media for unordered input / output direct memory access operations

Mechanisms for unordered input / output direct memory access operations are provided, including: issuing using a hardware processor a back invalidate snoop request to a cache coherency control unit of a host processor; and issuing an unordered input / output direct memory access operation request to a Compute Express Link memory device. In some of these mechanisms, the unordered input / output direct memory access operation request is for a read operation. In some of these mechanisms, the mechanisms further comprise receiving a response to the unordered input / output direct memory access operation request including data from the Compute Express Link memory device. In some of these mechanisms, the data was updated in response to the back invalidate snoop request. In some of these mechanisms, the unordered input / output direct memory access operation request is for a write operation.
Owner:SK HYNIX NAND PRODUCT SOLUTIONS CORP

Neural network accelerator, method and electronic chip

The invention discloses a neural network accelerator, a method and an electronic chip, and the neural network accelerator comprises a direct memory access module, a global control module, an operation module and an on-chip storage module. The direct memory access module is used for loading feature data, weight data and instruction data; the direct memory access module reads the feature data and the weight data from the on-chip storage module, distributes the feature data and the weight data to the operation module, and writes an operation result back to the on-chip storage module; the global control module is used for distributing stored instruction data to the operation module to perform control information configuration on the operation module when a work starting instruction is received; the operation module is used for controlling and executing neural network operation based on a Winograd algorithm according to the instruction data distributed by the global control module; and the on-chip storage module is used for storing the loaded feature data, the weight data, the operation intermediate data and the operation result data. The method is suitable for efficiency improvement and power consumption reduction of neural network operation.
Owner:PEKING UNIV +1

Data integrity verification in direct memory access (DMA) transfer

In an example, a method includes copying data between a source device and a destination device to form first copied data. The method also includes, responsive to completion of the copying, performing a verify-read operation. The verify-read operation includes determining a first checksum of the first copied data, copying the data between the source device and the destination device to form second copied data, determining a second checksum of the second copied data, comparing the first checksum to the second checksum to determine a comparison result, and determining a data integrity validation result based on the comparison result.
Owner:TEXAS INSTRUMENTS INC

Method for quickly forwarding message from PCIE interface to WIA interface

The invention relates to the technical field of industrial communication networks, in particular to a method for quickly forwarding messages from a PCIE (Peripheral Component Interface Express) interface to a WIA (Wireless Interface Architecture) interface, which comprises the following steps of: simultaneously receiving PCIE messages and WIA-FA protocol messages through a hardware logic circuit; analyzing the message in a data link layer to obtain an analysis result comprising data load and address information; packaging the analysis result according to a pre-configuration rule to generate a data frame conforming to a target protocol; and constructing a sending descriptor for the generated data frame, and sending the data frame from a corresponding interface through a direct memory access mechanism. According to the method, parallel analysis and protocol conversion of messages are achieved through a hardware logic circuit, fast address conversion is achieved through a pre-configured address mapping table, and zero-copy data transmission is achieved through a direct memory access mechanism. According to the invention, software protocol stack processing is replaced by a hardware processing flow, so that communication delay and CPU resource consumption are effectively reduced.
Owner:BONCHREE (SHANGHAI) COMMUNICATION CO LTD

Data transmission method and device and storage medium

The embodiment of the invention provides a data transmission method and device and a storage medium. In the embodiment of the invention, a new direct memory access interface is provided, in implementation, an agent module is provided for network card equipment, and a task management queue and a memory management queue are provided between the agent module and an application as a direct memory access channel between the agent module and the application; in the data transmission process of the two ends, on one hand, the two ends can adopt a bypass kernel and zero copy technology to improve the data transmission efficiency based on the respective task management queues, and on the other hand, the two ends actively implement memory management for data storage based on the respective memory management queues, and interaction of memory management with the opposite end is not needed; the interactive operation of the two ends in the data transmission process can be reduced, and the transmission delay can be further reduced on the basis of achieving direct memory access.
Owner:HANGZHOU ALICLOUD FEITIAN INFORMATION TECH CO LTD

Overhead reduction using address translation in direct memory accesses

Techniques to reduce direct memory access (DMA) overhead may include retrieving an address translation descriptor from a descriptor queue of a DMA engine, and updating an address translation table in the DMA engine with address translation information obtained from the location indicated by the address translation descriptor. A set of memory descriptors is then obtained from the descriptor queue. The set of memory descriptors can be processed by determining that the addresses in the set of memory descriptors are to be translated using the address translation table, and performing memory access operations by using the address translation table to translate the addresses in the set of memory descriptors.
Owner:AMAZON TECH INC

Page request interface support in handling direct memory access with caching host memory address translation data

A method includes buffering, in a descriptor queue, descriptors associated with translation units of an LBA-based, direct memory access (DMA) read command of a host system, each descriptor to be linked with a pointer including a physical destination for data associated with a respective translation unit. The method includes sending address translation requests to an address translation circuit for the pointers of respective translation units and detecting an address translation request miss at a cache of the address translation circuit for a first pointer of a first translation unit linked to a first descriptor of the plurality of descriptors. The method includes causing a translation miss message to be sent to a page request interface (PRI) handler, the translation miss message containing a virtual address of the first pointer and to trigger the PRI handler to send a page miss request to a translation agent of the host system.
Owner:MICRON TECHNOLOGY INC

Pointer sharing in QDMA transactions

A Queue Direct Memory Access (QDMA) system includes circuitry configured to store N pointers in a contiguous block of memory in the QDMA system, wherein N is an integer greater than 1 and there are N queues in the QDMA system with each pointer of the N pointers being associated with a queue of the N queues, receive a pointer packet from a host device connected to a chip device that includes the QDMA system, wherein the pointer packet includes all of the N pointers, and perform a write of contents of the pointer packet over the contiguous block of memory, such that the N pointers are written in one update.
Owner:CIENA CORP

Power converter MCU synchronization

A power converter controlled by a micro-controller unit (MCU) is effectively synchronized by using a signal received by a hardware subsystem of the MCU. The synchronization signal can control multiple power converters and can be generated by one power converter or a synchronization controller with generation of the synchronization signal generated using a hardware subsystem of an MCU, namely a hardware timer. The timer can be used to obtain a switch state from a memory table using direct memory access (DMA).
Owner:DCBEL INC

GPU Circuit Self-Context Save During Context Unmap

Systems and methods for efficient context switching in multithread processors are disclosed. A processing system comprises a direct memory access module configured to detect a preemption request generated by the scheduling circuit. Responsive to the preemption request, the direct memory access module determines whether execution of a first task from a plurality of tasks needs to be replaced by execution of a second task. When the replacement is necessitated, the module saves a first plurality of registers associated with the first task at a memory location transmitted by the scheduling circuit and queues the second task for execution. The memory location is transmitted by the scheduling circuit as part of the preemption request.
Owner:ADVANCED MICRO DEVICES INC

Electromagnetic scattering-oriented sparse approximate inverse Shenwei parallel preprocessing method and system

The invention provides a sparse approximate inverse Shenwei parallel preprocessing method and system for electromagnetic scattering, and relates to the technical field of processor parallel computing, and the method comprises the steps: carrying out the performance hotspot analysis of a sparse approximate inverse preprocessor in an electromagnetic scattering simulation process, and determining a hotspot function of the sparse approximate inverse preprocessor; extracting a sparse matrix vector multiplication operation of a hotspot function, performing master-slave core parallel calculation on the sparse matrix vector multiplication operation, migrating the sparse matrix vector multiplication operation to slave core calculation, and accelerating hotspot calculation by using a heterogeneous parallel sparse approximate inverse algorithm; parallel computing of master-slave core intensive numerical computing tasks is achieved; in the parallel computing process, the slave cores communicate with the master core in a direct memory access mode, and during the period, the master core is in a waiting state to ensure data consistency and communication synchronization until all the slave cores compute distributed tasks.
Owner:QILU UNIVERSITY OF TECHNOLOGY (SHANDONG ACADEMY OF SCIENCES) +1