Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

YOLO V3 and YOLO V3 Tiny network switching method based on FPGA (Field Programmable Gate Array)

A network switching and network structure technology, applied in the field of network switching, can solve problems such as limited hardware characteristics, network loss of variability, etc., to achieve the effects of optimizing programs, reducing workload problems, and reducing design pressure

Pending Publication Date: 2020-11-20
逢亿科技(上海)有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the continuous popularization of artificial intelligence technology, its application in all walks of life is becoming more and more extensive, but the target detection based on FPGA, although benefiting from the high-speed calculation and low power consumption of FPGA, is also limited by its hardware Features, limited resources can only accommodate network models with limited equivalents, so it causes an embarrassing problem. Under FPGA, the network accuracy of YOLO V3 is about 10% to 15% higher than that of YOLO V3 Tiny, but under FPGA-based YOLO V3 The frame rate of the network is only 1.836FPS, and YOLO V3 Tiny has 26.141FPS in the same environment. However, under the common requirements of precision and speed, an FPGA development board cannot accommodate two network structures.
[0003] Schematic diagram of the structure of the YOLO model under the traditional FPGA figure 1 As shown, the main convolution module consists of N_PE computing units. Through the AXI bus, the weights are cached to the FPGA, and these convolution units perform calculations and other operations at the same time, and then write the results into the cache. This design structure is simple and direct , but when the logic design is completed, the shape of the network has been determined, subsequent data can only flow according to the current design, and the network loses its variability.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • YOLO V3 and YOLO V3 Tiny network switching method based on FPGA (Field Programmable Gate Array)
  • YOLO V3 and YOLO V3 Tiny network switching method based on FPGA (Field Programmable Gate Array)
  • YOLO V3 and YOLO V3 Tiny network switching method based on FPGA (Field Programmable Gate Array)

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0035] Assume that in a certain experimental scenario, the UAV recognizes the target of the ground personnel at high altitude. In the process of the UAV moving rapidly, if in the traditional way, it is either a tiny network, then the frame rate is fast enough, but the accuracy Insufficient, many targets will be filtered out, and although the V3 network has high enough precision, the frame rate is very low due to the amount of calculation. miss the target.

[0036] So under this method, if Figure 8 As shown, in the high-speed movement of the UAV, the sensor transmits the image data to the FPGA. By default, the tiny network is used to meet the high frame rate requirements. After the target is found, the preset logic in the judgment module, For example, if the confidence of a small number of categories is low, immediately switch to the V3 network, or you can also replace the network through manual intervention, and then perform recognition again. Although the frame rate is low ...

specific Embodiment 2

[0040] Assume that under the design architecture based on this method, in the V3 network, such as Figure 7 , the 75-layer Conv is pruned into a 41-layer Conv. At this time, it is only necessary to modify the layer number and shape of the parameter table, the address of reading and writing data, and the modules that each layer of the network needs to pass through according to the network structure after pruning. parameters, there is no need to adjust the FPGA code, which greatly reduces the workload of secondary development to meet the requirements of rapid network structure replacement.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a YOLO V3 and YOLO V3 Tiny network switching method based on an FPGA (Field Programmable Gate Array). According to the invention, on the premise of not increasing extra controllogic, data is controlled to pass through or skip the functional modules by configuring parameters; parameter control is operated or standby according to a preset YOLO _ V3 network structure; meanwhile, the parameters can also be configured into a YOLO V3 Tiny3 network structure, so that the effect of switching networks can be achieved through the design, the selection of the networks can be dynamically adjusted as required, and the requirements for higher precision, higher speed and lower power consumption are met.

Description

technical field [0001] The invention relates to the technical field of network switching methods, in particular to an FPGA-based YOLO V3 and YOLO V3Tiny network switching method. Background technique [0002] With the continuous popularization of artificial intelligence technology, its application in all walks of life is becoming more and more extensive, but the target detection based on FPGA, although benefiting from the high-speed calculation and low power consumption of FPGA, is also limited by its hardware Features, limited resources can only accommodate network models with limited equivalents, so it causes an embarrassing problem. Under FPGA, the network accuracy of YOLO V3 is about 10% to 15% higher than that of YOLO V3 Tiny, but under FPGA-based YOLO V3 The frame rate of the network is only 1.836FPS, and YOLO V3 Tiny has 26.141FPS in the same environment. However, under the common requirements of precision and speed, one FPGA development board cannot accommodate two n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/04G06N3/063G06F15/78
CPCG06N3/063G06F15/7807G06F15/7839G06N3/045Y02D10/00
Inventor 史佳鑫
Owner 逢亿科技(上海)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products