Supercharge Your Innovation With Domain-Expert AI Agents!

Multi-scale target detection network based on Libra R-CNN and traffic sign detection method

A technology for target detection and traffic signs, applied in the field of image processing, can solve problems such as affecting the training effect, not considering the balance of positive and negative samples, and less extraction frames.

Pending Publication Date: 2020-09-04
BEIJING UNION UNIVERSITY
View PDF3 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] In the process of using IoU-balanced Sampling, there are still three problems that affect the training effect: (1) Due to the large number of background extraction frames (negative samples) and too few extraction frames (positive samples) containing targets, it is not considered The balance between positive and negative samples; (2) Although the processing of negative samples increases the number of difficult negative samples, the number of difficult negative samples is much smaller than that of simple negative samples, so the imbalance between difficult samples and simple negative samples is still exists; (3) the anchor box is a box that locates the target area

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-scale target detection network based on Libra R-CNN and traffic sign detection method
  • Multi-scale target detection network based on Libra R-CNN and traffic sign detection method
  • Multi-scale target detection network based on Libra R-CNN and traffic sign detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] Important parameter settings, the number of iterations is set to 12, and the initial learning rate is 0.02. In the 8th and 11th iterations, the learning rate is reduced by 0.1, and the number of images processed per GPU is 2. In experiments with the traffic sign dataset, in addition to all the changes above, we also changed the scale of each octave to 6 and the initial learning rate to 0.05 to get better performance in this application scenario, This parameter setting can be used in any scene without limitation.

[0049] The specific implementation is as attached figure 1 shown.

[0050] Step 1, input image. Read in the urban traffic road scene pictures.

[0051] Step two, feature extraction. Feature extraction is carried out through ResNet50, and the image is converted into an RGB image. The image is subjected to feature extraction through convolution kernel convolution, and appropriate weights are obtained to generate a multi-layer feature map.

[0052] Step 3,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a multi-scale target detection network based on a Libra R-CNN. The network aims at solving the problem that traffic sign detection under urban roads is complex in environment. The number of types of targets is large and the number is unbalanced, the Libra R-CNN is improved, the method comprises the following steps of: modifying an IoU-based Sampling module; using the GA-RPNfor replacing the original RPN, and replacing the Balanced L1 Loss with the Smarth L1 Loss, so that more accurate and more diversified samples are generated in the training period, the detection accuracy is improved, and the effectiveness of the method is verified through experiments. The experiment is carried out on an MS COCO 2017 and a traffic sign data set. The mAP of the improved Libra R-CNNis improved by 3 percent points, and the mAP reaches 0.773. Experimental results show that compared with an original target detection network, the performance of the improved network is remarkably improved.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a Libra R-CNN-based multi-scale target detection network and a traffic sign detection method based thereon, which can be used to detect traffic signs in urban road scenes. Background technique [0002] Machine vision and deep learning are now widely used in many applications. Relatively mature technologies have been developed. Large and medium-scale target detection has reached a high level of accuracy, but there are still many difficulties. Small target detection in complex backgrounds The problem and the data imbalance problem that commonly exists in multi-category label targets are two outstanding difficulties. They cause weight imbalance and seriously affect the accuracy of detection, but they have not been well solved in the world, and therefore It has become a key issue affecting the practical application of artificial intelligence. Traffic sign detect...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V20/54G06V2201/09G06V2201/07G06N3/045G06F18/253
Inventor 李学伟赵子婧刘宏哲徐成
Owner BEIJING UNION UNIVERSITY
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More