Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An intelligent optoelectronic information processing system and method based on accelerated processing

An information system and optoelectronic technology, applied in the field of image target recognition, can solve the problems of high GPU power consumption, the on-chip DSP computing power cannot meet the requirements, etc., to improve the inference rate, ensure the rate and recognition accuracy, and reduce the complexity. Effect

Active Publication Date: 2022-04-22
SHANGHAI AEROSPACE CONTROL TECH INST
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is currently no network model specifically designed for infrared image target recognition, and the convolutional neural network needs strong computing power to support image processing. In order to ensure the accuracy of image recognition, the number of parameters of the deep neural network can reach tens of millions or even billions. , the computing power of the existing on-chip processor DSP is far from meeting the requirements
Existing convolutional neural networks usually use GPUs to achieve network acceleration. However, GPU power consumption is relatively high. For example, the power consumption of 1080ti boards commonly used in deep learning is usually around 250W, which is not suitable for intelligent photoelectric information processing systems. Low power consumption requirements, therefore, in order to achieve real-time detection and recognition of infrared air targets, it is necessary to develop an intelligent photoelectric information processing system based on real-time target recognition of embedded convolutional neural networks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An intelligent optoelectronic information processing system and method based on accelerated processing
  • An intelligent optoelectronic information processing system and method based on accelerated processing
  • An intelligent optoelectronic information processing system and method based on accelerated processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] An intelligent photoelectric information processing method based on accelerated processing of the present invention comprises the following steps:

[0046] (1) Collect data. Use the infrared acquisition equipment to collect the infrared image sequence of the target, and number the pictures according to the order of collection, such as 0001-0999, to construct the target data sample set.

[0047] (2) Mark the target information. Manually mark the target position and category of the sample set to obtain the center position, length, width, and model type information of the target model in the target infrared image; and use horizontal flip, rotation, mirror transformation, brightness transformation, scaling, adding Gaussian white noise these 6 kinds of sample augmentation methods to expand the collected sample set; divide the sample set into training samples and test samples according to the ratio of 8:2;

[0048] (3) Network training. Using the data sample set obtained i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of target detection and tracking, in particular to an intelligent photoelectric information processing system and method based on accelerated processing. The image sequence of the target model is collected by the infrared detector, and the image information is transmitted to the x86 host through the WLAN network port, and then the communication with the FPGA board is realized through the PCIe interface, and the improved YOLO v3 deep learning network calculation based on the FPGA is realized. Acceleration, and position pre-push based on particle filter algorithm, and ensure the computing power and low delay of the system, to achieve real-time detection and tracking of infrared targets.

Description

technical field [0001] The invention belongs to the field of image target recognition, and in particular relates to a deep learning target model recognition method based on FPGA board, YOLO v3 algorithm, particle filter algorithm and hardware acceleration. Background technique [0002] Traditional infrared image target recognition algorithms use DSP processors to realize infrared target detection and tracking based on traditional image algorithms such as Gaussian filtering and threshold segmentation. In the face of complex scenes and the presence of various infrared occlusions and interferences, it is difficult to achieve the target effective detection and stable tracking. [0003] Due to its powerful feature representation ability, deep convolutional neural network has been successfully applied in the field of target detection and recognition, and achieved good results. However, there is currently no network model specifically designed for infrared image target recognition...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/33G06N3/04G06N3/08H04N5/765
CPCH04N5/33H04N5/765G06N3/08G06N3/045
Inventor 杨俊彦印剑飞钮赛赛邵艳明谭覃燕
Owner SHANGHAI AEROSPACE CONTROL TECH INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products