Data fusion dynamic vehicle detection method based on millimeter wave radar and machine vision

A millimeter-wave radar and data fusion technology, applied in radio wave measurement system, radio wave reflection/re-radiation, instruments, etc., can solve the problems of target vehicle false detection, missed detection, vulnerability to light and weather, etc. Achieve the effect of improving false detection and missed detection, reducing the impact of vehicle detection, and improving recognition accuracy

Active Publication Date: 2020-07-03
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF5 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to use a single visual sensor for vehicle detection, which is easily affected by light and weather, resulting in false detection and missed detection of the target vehicle

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data fusion dynamic vehicle detection method based on millimeter wave radar and machine vision
  • Data fusion dynamic vehicle detection method based on millimeter wave radar and machine vision
  • Data fusion dynamic vehicle detection method based on millimeter wave radar and machine vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Below in conjunction with embodiment the present invention will be further described.

[0045] The present invention proposes a data fusion dynamic vehicle detection method based on millimeter-wave radar and machine vision, such as figure 1 As shown, the method includes acquisition and processing of target vehicle information based on millimeter-wave radar, vehicle detection based on machine vision, and vehicle detection based on fusion of millimeter-wave radar and machine vision data. Specific steps are as follows:

[0046] Step 1. Jointly calibrate the millimeter-wave radar and camera installed on the vehicle to obtain the conversion relationship between the radar coordinate system and the image coordinate system, and determine the fusion of the two sensor data in space and time according to the sensor sampling frequency Program.

[0047] Make the normal vector of the working plane of the millimeter-wave radar and the direction of the optical axis of the camera para...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data fusion dynamic vehicle detection method based on millimeter-wave radar and machine vision. A millimeter-wave radar data processing module, a vision image processing module and a data fusion processing module are included. Firstly, through sensor joint calibration, a projection matrix of a millimeter wave radar and a visual sensor is obtained, and a conversion relation between a radar coordinate system and an image coordinate system is established; preprocessing the acquired millimeter-wave radar data, performing effective target screening, projecting a radar detection target to a visual image through a conversion relationship, and obtaining a target region of interest according to the position of the projection target; performing target information fusion according to the overlapping condition of the target region of interest obtained from the image processing algorithm and the target region of interest detected by the millimeter-wave radar; and finally,verifying whether there is a vehicle in the fused region of interest based on an image processing algorithm. According to the invention, the front vehicle can be effectively detected, and the system has good environmental adaptability and stability.

Description

technical field [0001] The invention belongs to the technical field of intelligent automobile vehicle detection, in particular to a data fusion dynamic vehicle detection method based on millimeter wave radar and machine vision. Background technique [0002] In recent years, the technology of automobile intelligence has become increasingly mature, and the intelligent assisted driving module has brought vigorous development to the intelligent driving automobile market. Among them, environmental perception ability is the basis of intelligent assisted driving technology, and the detection of obstacles in front of the vehicle is an important part of environmental perception. [0003] Existing environmental perception systems mainly rely on a single sensor, such as the patent "Vehicle Detection System and Method Based on Binocular Stereo Vision" (application number: 201510556400.5) applied by Shanghai University; the patent "a vision-based Combined vehicle detection method" (appl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G01S13/93
CPCG01S13/931G06V20/584G06V2201/08G06F18/25
Inventor 李舜酩王一博陆建涛
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products