Machine vision and millimeter wave radar fused multi-vehicle target tracking method

A millimeter-wave radar and machine vision technology, applied in the field of multi-vehicle target tracking, can solve the problems of missing effective targets and excessive size of the visual tracking bounding box, and achieve the effects of avoiding defects, rich feature information, and strong expression ability

Pending Publication Date: 2020-10-30
CHONGQING UNIV
View PDF0 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the defects in the prior art, the present invention provides a multi-vehicle target tracking method based on the fusion of machine vision and millimeter-wave radar to solve the problem in the prior art that the size of the visual tracking bounding box is too large when multiple vehicles ahead are continuously tracked Or the technical problem that the effective target is lost after the error is accumulated due to too small

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Machine vision and millimeter wave radar fused multi-vehicle target tracking method
  • Machine vision and millimeter wave radar fused multi-vehicle target tracking method
  • Machine vision and millimeter wave radar fused multi-vehicle target tracking method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] Such as figure 1 As shown, the present invention provides a kind of multi-vehicle target tracking method of fusion of machine vision and millimeter wave radar, comprising the following steps:

[0056] Obtain millimeter-wave radar detection data, filter the data, and obtain vehicle targets;

[0057] Obtain the road environment image, use the deep learning neural network model to detect the surrounding environment vehicles in the road environment image, and obtain the position information and size information of the visual tracking target;

[0058] According to the position information and size information, the improved particle filter algorithm is used to track multiple targets in the visual image;

[0059] Using the machine vision and millimeter wave radar fusion model, associate the vehicle target with the visual tracking target according to the association decision strategy, and use the millimeter wave radar ranging information to correct the position and size of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a machine vision and millimeter-wave radar fused multi-vehicle target tracking method, which comprises the following steps of: acquiring road target information by using millimeter-wave radar, and screening vehicle targets according to a kinematics parameter related filtering model; detecting vehicles in front of the road by using the visual information, and performing multi-vehicle target tracking based on a detection result; projecting the vehicle target into the image by adopting a machine vision and millimeter wave radar fusion model, setting an association judgmentstrategy to associate the visual tracking target with the vehicle target, and correcting the position and the size of the visual tracking bounding box in the image based on distance information detected by the millimeter wave radar. The technical problem that in the prior art, when multiple vehicles in front are continuously tracked, after errors are accumulated due to the fact that the size of avisual tracking boundary frame is too large or too small, an effective target is lost can be solved.

Description

technical field [0001] The invention relates to the technical field of intelligent vehicle automatic driving environment perception, in particular to a multi-vehicle target tracking method based on the fusion of machine vision and millimeter-wave radar. Background technique [0002] With the improvement of intelligence, informatization, and automation, more and more enterprises and institutions are vigorously developing intelligent driving systems and advanced driver assistance systems for automobiles. As the "eyes" of self-driving cars, environmental perception plays a very important role in providing vehicles with road traffic information ahead. As an important part of environment perception, tracking has been paid more and more attention by researchers. [0003] At present, the fusion of multi-sensor information is a research hotspot in the field of tracking. The prior art provides a target recognition method based on the fusion of video images and millimeter-wave radar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246G06T7/277G06T7/62G06T7/90G06K9/00G06K9/46G06K9/62G01S13/58G01S13/72
CPCG06T7/246G06T7/277G06T7/62G06T7/90G01S13/726G01S13/587G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30252G06V20/584G06V20/56G06V10/507G06V10/56G06F18/22
Inventor 郑玲甘耀东张翔李以农高锋詹振飞
Owner CHONGQING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products