The invention provides an RDMA-based
big data transmission and storage
system and method and a
semiconductor detection device.The
big data transmission and storage
system comprises a hardware layer and a
software layer, the hardware layer comprises an NVMe SSD storage array, an NVMe
RAID acceleration card based on a GPU architecture and an RDMA network card, and the
software layer comprises an NVMe SSD storage array, an NVMe
RAID acceleration card based on the GPU architecture and an RDMA network card; the
software layer comprises a multi-thread transmission module, a self-adaptive
memory pool module, a transmission control module, a
data verification and
retransmission module, a scheduling and optimizing module and a disk falling and
storage management module. According to the method, multi-channel transmission parallelization is achieved through data direct connection,
zero copy transmission,
RAID acceleration and multi-thread parallel RDMA transmission in a hardware link, data is directly connected and transmitted from a memory to the NVMe SSD storage array, data receiving and disk falling thread decoupling directly access the NVMe SSD storage array through asynchronous writing, network overload or storage blockage is avoided, and the
data transmission efficiency is improved. The
data transmission efficiency and reliability are high, and popularization and application in scenes needing large-scale image transmission
processing such as
semiconductor detection are facilitated.