Check patentability & draft patents in minutes with Patsnap Eureka AI!

MobileNet-SSD target detection device and method based on FPGA acceleration

A target detection and target technology, applied in the field of target detection and recognition, can solve the problems of system real-time, complex model, large amount of parameters and calculation, and achieve high processing speed, high precision target detection, and low power consumption.

Active Publication Date: 2021-06-29
NANJING UNIV OF TECH
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] There are two main difficulties in deploying the most advanced CNN-based target detection algorithm to FPGA to achieve hardware acceleration: (1) The convolutional neural network-based target detection algorithm usually has a complex network model and a large number of parameters. And the amount of calculation is large, but the FPGA storage resources, computing resources and system bandwidth are extremely limited, which causes problems in the real-time performance of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • MobileNet-SSD target detection device and method based on FPGA acceleration
  • MobileNet-SSD target detection device and method based on FPGA acceleration
  • MobileNet-SSD target detection device and method based on FPGA acceleration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0063] A MobileNet-SSD object detection method based on FPGA acceleration of the present invention will be further described in detail in conjunction with the accompanying drawings and specific implementation methods.

[0064] A MobileNet-SSD target detection method based on FPGA acceleration, comprising the steps:

[0065] Step1: Obtain the initial image of the target to be detected, and store the initial image data of the target and the CNN weight file of the convolutional neural network in the external memory DDR;

[0066] Step2: Add a detection layer to the Mobilenet-SSD convolutional neural network, share the CNN accelerator between different network layers, set an on-chip buffer on the CNN accelerator, and optimize the Mobilenet-SSD convolutional neural network;

[0067] Step3: Run the Mobilenet-SSD convolutional neural network through the parallel block parameter optimization method, and output the feature map channel of the target image and the block coefficient of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a MobileNet-SSD target detection device and method based on FPGA acceleration, and the method comprises the following steps: Step 1: obtaining an initial image of a to-be-detected target, and storing the initial image data of the target and a convolutional neural network weight file; 2, adding a detection layer into the Mobilenet-SSD convolutional neural network, sharing an accelerator among different network layers, and arranging an on-chip buffer area on the accelerator; 3, operating the Mobilenet-SSD convolutional neural network through a parallel block parameter optimization method, and outputting block coefficients of a feature map channel and a convolution kernel channel of the target image; 4, through a pipeline algorithm, completing target feature extraction, bounding box regression and object category prediction of the Mobilenet-SSD convolutional neural network; 5, performing post-processing on target feature extraction, bounding box regression and object category prediction information obtained by the convolutional neural network; and 6, testing a target detection result on the target image to be detected. According to the invention, the improved Mobilenet-SSD is adopted as a target detection algorithm, and high-precision target detection is realized.

Description

technical field [0001] The invention relates to the technical field of target detection and recognition, in particular to an FPGA-accelerated MobileNet-SSD target detection device and method. Background technique [0002] Target detection is widely used in civil and military fields such as artificial intelligence, medical research, and national defense security. The target detection algorithm based on deep learning uses convolutional neural network CNN (Convolutional Neural Network) to extract features and complete image classification and positioning. Compared with the traditional algorithm, the speed and speed are greatly improved, but the convolutional neural network often has a huge amount of parameters and calculations, and the parameters and structure of the network layer are changeable, which makes it difficult for the target detection algorithm to be applied in limited resources and high requirements. Embedded applications with processing speed and low power consumpt...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F15/78G06F13/42G06N3/04G06N3/063
CPCG06F15/781G06F13/4291G06N3/063G06N3/045
Inventor 程明潘国标
Owner NANJING UNIV OF TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More