Unlock instant, AI-driven research and patent intelligence for your innovation.

A pedestrian detection method based on deep learning multi-network soft fusion

A pedestrian detection and deep learning technology, applied in the fields of image processing, target detection and deep learning, to solve the problem of insufficient detection accuracy, wide application range, and rapid detection.

Active Publication Date: 2022-05-20
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is: the present invention provides a pedestrian detection method based on deep learning multi-network soft fusion, which overcomes the fact that the existing method cannot accurately describe the pedestrian position in real time under the trade-off between pedestrian detection accuracy and speed The problem can improve the detection ability in the case of real-time detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] A pedestrian detection method based on deep learning multi-network soft fusion, the flow chart of the implementation is as follows figure 1 As shown, it consists of two parallel computing parts: pedestrian candidate area extraction and pedestrian semantic segmentation. The semantic segmentation refines the final pedestrian detection results of the entire system. The system computing speed depends on the slow processing branch. Part of the results are fused and output. Specifically include the following steps:

[0064] Step 1: Input the image to be processed.

[0065] Step 2: Input the image from step 1 into a figure 2 In the YOLOv3 pedestrian candidate area generator based on Darknet-53, the pedestrian candidate area is generated.

[0066] Further, the specific implementation steps of YOLOv3 in the step 2 are as follows:

[0067] Step 2.1. First, 3 scales (13*13, 26*26, and 52*52) are fused in the YOLOv3 network, and independent detection is performed on the fused ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian detection method based on deep learning multi-network soft fusion, and relates to the technical fields of image processing, target detection and deep learning; it includes S1: inputting an image to be processed; S2: inputting the image to be processed into a Darknet-based In the YOLO v3 pedestrian candidate area generator with 53 as the basic network, pedestrian candidate areas are generated; S3: input the image to be processed into the front-end prediction module, and output C feature maps; S4: input C feature maps into the semantic segmentation system, and output C A feature map containing context information; S5: Fuse the results of the semantic segmentation system with the pedestrian candidate results generated by the pedestrian candidate area generator; S6: Output the detection image. The present invention parallel softly fuses two systems of pedestrian candidate area generator and semantic segmentation, efficiently detects pedestrians in various challenging scenarios, and improves the detection ability of small targets at the same time.

Description

technical field [0001] The invention relates to the technical fields of image processing, target detection and deep learning, in particular to a pedestrian detection method based on deep learning and multi-network soft fusion. Background technique [0002] Object detection is an important problem in computer vision, which requires detecting the location of objects in video or digital images. Object detection is widely used in image detection, object recognition, video surveillance and other fields. Pedestrian detection, as a branch of object detection problems, involves detecting specific human categories, and it has a wide range of applications in areas such as autonomous driving, person recognition, and robotics. [0003] The goal of pedestrian detection algorithms is to draw bounding boxes in images or videos that accurately describe the location of pedestrians in real time. However, this is difficult to achieve due to the trade-off between accuracy and speed. Because ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/10G06V10/82G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06V2201/07G06N3/045
Inventor 袁国慧叶涛王卓然彭真明潘为年柳杨孙煜成周宇杨博文张文超
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA