3results about How to "Lower memory access latency" patented technology

The application discloses a batch processing matrix multiplication optimization implementation method and system for a heterogeneous processor, and the method comprises the following steps: in step S1, a CPU allocates space for a matrix on a shared DDR memory through an hthread_malloc function; in step S2, the CPU calculates decision parameters through a decision algorithm, wherein the decision parameters comprise a matrix block size parameter and an m_batch size parameter; and in step S3, a DSP function is started based on the decision parameters. The application has the following beneficial effects: a high-efficiency batch processing matrix multiplication (BGEMM) algorithm is implemented on a DSP, and the BGEMM algorithm can effectively accelerate multi-field applications including deep learning; the memory access delay of a DSP calculation unit is reduced, the calculation speed is improved, and the calculation efficiency of GEMM is improved.

This application provides a hardware passthrough method, apparatus, device, and storage medium for virtual machines. The hardware passthrough method includes: obtaining an attribute description file for a newly created virtual machine; the attribute description file describes the resource requirements of the newly created virtual machine, including PCIe interface parameters and memory allocation specifications; based on a PCIe device topology mapping table, determining the target hardware resources that conform to the PCIe interface parameters and their corresponding target NUMA nodes; within the target NUMA node, allocating memory resources of corresponding capacity to the newly created virtual machine according to the memory allocation specifications; and binding and mapping the target hardware resources to the newly created virtual machine through the IOMMU hardware virtualization mechanism, thereby achieving hardware passthrough. By parsing the virtual machine resource requirements and matching them according to precise hardware topology and NUMA node information, the collaborative allocation of PCIe devices and memory resources is dynamically and efficiently achieved, significantly improving the utilization rate of heterogeneous computing resources and reducing energy consumption and maintenance costs.

This invention discloses a data prefetching method, product, device, and medium based on multiple memory access patterns, relating to the field of computer architecture technology. The method includes: monitoring for L2 cache memory access miss events in the processor; if the miss status register hits the event, splitting the miss address to obtain the base address of the spatial region and the offset address within the region. When the program counter pattern training table hits the base address, stride and spatiotemporal pattern training is performed on the offset address to obtain a fixed stride, space / time related access pattern. Valid memory access patterns are filtered by confidence level and stored in the corresponding LLC pattern table, with an index recorded in the prefetch pattern record table. Subsequently, based on the memory access miss event and index information, the target pattern is read from the corresponding pattern table to calculate the prefetch address, generate a request, and execute the prefetch. Through this scheme, it is possible to adapt to multiple scenarios and accurately identify memory access patterns for more precise data prefetching.