The invention belongs to the field of
edge computing, and discloses an edge
intelligent computing device and method supporting multi-level storage and computing integrated acceleration, and the device comprises a main processor
system, a near memory computing module and a near
flash memory computing module. The near memory calculation module integrates an NPU (
Network Processing Unit) with a distributed SRAM (
Static Random Access Memory) and an HBM
DRAM (
Dynamic Random Access Memory) with an MAC (
Media Access Control) array, and realizes high-
throughput reasoning acceleration And the near
flash memory calculation module is used for tightly
coupling the SSD controller and the retrieval acceleration engine to realize the nearest retrieval acceleration of
mass data at the SSD level. All the modules are interconnected through a PCIe
bus, a three-level storage and calculation integrated framework of SRAM-HBM
DRAM-SSD is constructed, cross-
level data migration is effectively reduced, and the
bottleneck of the PCIe
bus is avoided. According to the method, high-
throughput video reasoning and TB-
level data retrieval tasks on the edge side can be efficiently supported at the same time, and the calculation energy efficiency ratio and the
system throughput rate are remarkably increased.