Vehicle-mounted video target detection method based on deep learning

A technology for vehicle-mounted video and target detection, which is applied to instruments, computing, character and pattern recognition, etc. It can solve the problems of unreliable classifiers, poor robustness, and redundant windows, and achieve rich image features, increase time overhead, and save time. The effect of time cost

Active Publication Date: 2019-07-05
NANJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 54 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This kind of sliding window selection strategy for target detection is not targeted, has high time complexity, redundant windows, and the hand-designed features are less robust, and the classifier is

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vehicle-mounted video target detection method based on deep learning
  • Vehicle-mounted video target detection method based on deep learning
  • Vehicle-mounted video target detection method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention will be further described below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solution of the present invention more clearly, but not to limit the protection scope of the present invention.

[0023] The purpose of the present invention is to propose a vehicle-mounted video target detection method based on deep learning. On the basis of FasterR-CNN, the feature map of the depth image is added to supplement the vehicle detail information, and the same convolutional neural network as the extracted color image feature is selected. , the color image channel and the depth image channel adopt a parallel structure, and the extracted features are fused in series to obtain the final RGB-D features, and a difficult sample mining strategy is added in the training to improve the algorithm's ability to detect small targets and difficult objects in complex traffic scenes. target detection accuracy....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a vehicle-mounted video target detection method based on deep learning, and the method comprises the steps: employing an improved Faster R-CNN algorithm to realize target detection in a complex traffic environment, to provide a driving safety auxiliary function. An existing target tracking algorithm has a serious problem of small target missed detection. The depth information channel is added, the depth information channel is connected with an original color image channel in parallel, fusion is carried out in the channel dimension, candidate frame extraction and targetdetection are carried out on the fused feature image, the detection rate of a small target is improved, in addition, training of a difficult sample is added in training, and the overall target recognition rate of the algorithm is improved. According to the method, a problem of small target missed detection by using the Faster R-CNN algorithm is fully considered. The accuracy of vehicle recognitionin a complex traffic scene is improved through depth image feature fusion and a difficult sample mining method.

Description

technical field [0001] The invention relates to a vehicle-mounted video target detection method based on deep learning, and belongs to the technical field of video image processing. Background technique [0002] In the process of driving, it is the basis of the driving safety assistance system to detect and track the vehicles, pedestrians and other obstacles in front of the vehicle, and to analyze the behavior of the vehicle in front on this basis. The main steps of traditional target detection methods are generally: extracting target features, training corresponding classifiers, sliding window search, repetition and false positive filtering. This kind of sliding window selection strategy for target detection is not targeted, has high time complexity, redundant windows, and the hand-designed features are less robust, and the classifier is not reliable; at the same time, the existing target detection algorithms cannot be trained flexibly. The data can be used to learn effect...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/46G06K9/62
CPCG06V20/40G06V20/56G06V10/454G06F18/24G06F18/214
Inventor 张登银金天宇丁飞赵莎莎刘锦薛睿聂涵王雪纯
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap