FPGA-based three-dimensional convolver

Abstract

The invention discloses an FPGA-based three-dimensional convolver, and aims at solving the technical problem that input data is repeatedly loaded in the prior art. The FPGA-based three-dimensional convolver comprises six modules realized in an FPGA: an input data storage module, a three-dimensional convolution kernel storage module, a two-dimensional convolver array module, an intermediate data delay line module, a summer module and a data output controller module, wherein the input data storage module is used for carrying out input cache on a to-be-processed feature map; the three-dimensional convolution kernel storage module is used for storing a three-dimensional convolution kernel in the FPGA in a form of a plurality of two-dimensional convolution kernels; the two-dimensional convolver array module is used for convolving the to-be-processed feature map and the three-dimensional convolution kernel and then outputting the convolved to-be-processed feature map and three-dimensional convolution kernel; the intermediate data delay line module is used for adding convolution results of appointed two-dimensional convolver, delaying the adding result and then outputting the adding result; the summer module is used for adding output of the two-dimensional convolver array module and output of an intermediate data delay line and then carrying out output; and the data output controller module is used for controlling the sequence of a plurality of outputs of the summer module. The FPGA-based three-dimensional convolver is capable of remarkably enhancing the three-dimensional convolution operation speed and can be used for the aspect of target tracking or behavior detection.

Description

technical field [0001] The invention belongs to the technical field of video processing, and relates to an FPGA-based three-dimensional convolution device, which can be used in a system based on an FPGA hardware platform for target tracking or human behavior detection using convolutional neural network technology. Background technique [0002] With the advancement of microelectronics manufacturing technology and integrated circuit design, Field Programmable Gate Array (FPGA) has been developed rapidly, because of its rich resources, flexible design, and low power consumption, it has been widely used. The FPGA implementation platform has broad development prospects because of its high performance, low power consumption, and reconfigurable characteristics. As a programmable standard device, FPGA can be applied to various functions, which requires a short development cycle, low development cost, and strong flexibility. In recent years, the development of high-level synthesis t...

AI Technical Summary

Problems solved by technology

This structure occupies less resources, but the degree of parallelism is not high, and the input data needs to be loaded multiple times, which increases the requirements for the data transmission bandwidth between the data source and the FPGA, thereby limiting the overall speed of the three-dimensional convolution operation.

Images