Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Anti-occlusion pedestrian detection method based on attention mechanism

A pedestrian detection and attention technology, which is applied in the fields of deep learning, pattern recognition, and computer vision, can solve the problem that the neural network cannot autonomously distinguish the importance of different features, affects the performance of detection, and degrades the detection performance, so as to alleviate the local characteristics of pedestrians. Missing, noise-mitigating, high-res effects

Pending Publication Date: 2020-03-27
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above-mentioned representative method of pedestrian detection based on convolutional neural network has a sharp decline in detection performance under severe occlusion. The main reason is that occlusion will lead to the loss of local features of pedestrians, and at the same time introduce interference information that does not belong to pedestrians, and the neural network cannot autonomously distinguish different features. In addition, the loss function of common detection algorithms does not consider the influence of occlusion degree on the position candidate box, especially in the case of very dense pedestrians, a large number of occlusion candidate boxes will mislead the update of the gradient, and ultimately affect the performance of detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Anti-occlusion pedestrian detection method based on attention mechanism
  • Anti-occlusion pedestrian detection method based on attention mechanism
  • Anti-occlusion pedestrian detection method based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The technical solutions and beneficial effects of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0040] Such as figure 1 As shown, the present invention provides an anti-occlusion pedestrian detection method based on the attention mechanism, and the specific steps are as follows:

[0041] Step 1: Firstly, the preprocessing of the pedestrian image data adopts general image scaling, horizontal flipping, random translation and other data enhancement methods to expand the diversity of data. In addition, it also includes a cropping method specially designed for occluded pedestrians. The specific method is: for each picture, 5 pedestrians with an occlusion rate less than 80% are randomly selected, bounded by the center point of their bounding box, and one of the upper, lower, left, and right sides is randomly selected For cropping, the cropping ratio is not greater than 50% of the width and height, and then padding (f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an anti-occlusion pedestrian detection method based on an attention mechanism, and the method comprises the steps: obtaining the multilayer convolution features of a pedestrianimage, and generating a new feature layer containing semantic information and detail information through the structural fusion of a new feature pyramid; adopting k-means clustering to obtain the sizeof a preset pedestrian bounding box; predicting regression bias and classification confidence of all pedestrian bounding boxes; calculating a cross entropy loss function and an improved adaptive occlusion perception regression loss function to obtain an overall loss function; carrying out iterative optimization and continuous training to obtain a detection model; and sending the to-be-detected picture into the detection model, and removing a frame with a high overlapping degree by adopting a non-maximum suppression method to finally obtain a detection result. The method can improve the detection capability of shielded pedestrians, and has higher detection precision and robustness.

Description

technical field [0001] The invention belongs to the fields of computer vision, pattern recognition, deep learning and the like, and in particular relates to a method for detecting the position of pedestrians in complex traffic scene images or video frames. Background technique [0002] With the rise of the artificial intelligence boom and the advent of the era of big data, computer vision technology based on images and videos to understand the world has been vigorously developed. As an important branch of general target detection, pedestrian detection has important applications in intelligent transportation, automatic driving, video surveillance, intelligent robots and other fields. In addition, pedestrian detection algorithms with high detection accuracy and good robustness are the premise and foundation of many advanced tasks in computer vision, such as pedestrian pose recognition, behavior analysis, multi-target tracking, and pedestrian re-identification. Therefore, how ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/103G06N3/045G06F18/23213G06F18/241G06F18/253Y02T10/40
Inventor 周大可宋荣王栋杨欣
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products