Vehicle detection method based on laser and vision fusion

A vehicle detection and vision technology, applied in the field of intelligent driving vehicle environment perception, can solve the problem that the environment perception solution cannot meet the needs of vehicle target detection, achieve the effect of strong network generalization ability, meet real-time requirements, and improve accuracy

Active Publication Date: 2020-03-31
SOUTH CHINA UNIV OF TECH
View PDF2 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the present invention is that the current environmental perception scheme relying only on a single sensor cannot meet the target detection requirements of vehicles in complex traffic scenes. In order to improve the target detection accuracy and reduce the false detection rate in the environmental perception system, the present invention proposes a A vehicle detection method in traffic environment based on laser and vision fusion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vehicle detection method based on laser and vision fusion
  • Vehicle detection method based on laser and vision fusion
  • Vehicle detection method based on laser and vision fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The object of the present invention will be further described in detail through specific examples below, and the examples cannot be repeated here one by one, but the implementation mode of the present invention is not limited to the following examples.

[0031] Such as figure 1 As shown, a vehicle detection method based on laser and vision fusion includes the following steps:

[0032] 1) Use the deep learning algorithm to obtain the target detection information for the input image and the laser point cloud respectively. The steps include: using the deep learning image target detection algorithm YOLOv3 to obtain the 2D image detection frame category, the pixel coordinate position of the center point, and the length and width dimensions for the image and other information. For the point cloud, the deep learning point cloud target detection algorithm PointRCNN is used to obtain information such as the category of the 3D detection frame, the spatial coordinates of the cent...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a vehicle detection method based on laser and vision fusion. The method comprises the following steps of 1) acquiring target detection information for an input image and laserpoint cloud; 2) performing optimal matching on the images of the front frame and the rear frame and the point cloud detection frame, and establishing a tracking sequence of an image and point cloud detection target; 3) fusing the tracking sequences of the image and the detection frame thereof and the tracking sequences of the point cloud and the detection frame thereof; 4) classifying all the target detection boxes, outputting a fusion list, and outputting a fusion result; and 5) obtaining the accurate position of the surrounding vehicle relative to the vehicle in the current frame, reading the next frame of image and the point cloud data, circulating the steps 1) to 5), and outputting a fusion detection result. According to the method, on the basis of point cloud and image target detection, the detection result is subjected to information tracking, the detection result is optimally matched, and the fusion result is preferentially input into the final fusion list, so that compared witha single sensor target detection method, the target detection precision is improved, and the false detection rate is reduced.

Description

technical field [0001] The invention relates to the field of environment perception of intelligent driving vehicles, in particular to a vehicle detection method based on fusion of laser and vision. Background technique [0002] Nowadays, intelligence has become an important development trend of the automobile industry, and more and more intelligent assisted driving functions are gradually changing people's travel experience. With the continuous improvement of intelligence, intelligent driving is developing rapidly in the direction of unmanned driving. The environmental perception system needs to provide accurate and reliable target category and location information for unmanned vehicles, and provide reliable decision-making information for unmanned vehicle path planning and vehicle control. [0003] In recent years, more and more advanced target detection algorithms have been continuously produced in visual image and laser point cloud processing, but target detection only r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00G06K9/62G01S17/66G01S17/50G01S17/931
CPCG06T7/0002G01S17/66G01S17/50G06T2207/10028G06T2207/20081G06T2207/20221G06V2201/08G06F18/23G06F18/241Y02T10/40
Inventor 郑少武李巍华
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products