Millimeter wave radar and vision cooperative target detection and identification method based on neural network

A millimeter-wave radar and neural network technology, applied in the field of millimeter-wave radar and vision collaborative target detection and recognition, can solve the problems of occupied time, missed detection, low accuracy, etc. Check the effect of the phenomenon

Active Publication Date: 2019-10-22
烟台芯扬聚阵微电子有限公司
View PDF6 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The former takes a lot of time to obtain the region of interest and becomes the main time bottleneck of the target detection algorithm; the latter has low accuracy in identifying small objects and is prone to missed detection.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Millimeter wave radar and vision cooperative target detection and identification method based on neural network
  • Millimeter wave radar and vision cooperative target detection and identification method based on neural network
  • Millimeter wave radar and vision cooperative target detection and identification method based on neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments, and the purpose and effect of the present invention will become clearer. It should be understood that the specific embodiments described here are only used to explain the present invention and are not intended to limit the present invention.

[0041] figure 1 It is an algorithm flow chart of the present invention.

[0042] The millimeter-wave radar emits high-frequency millimeter waves, which are collected by the receiving system after being reflected by the target, and the distance of the target is determined by frequency measurement, thereby forming point cloud data. After the image data captured by the camera at the same time is scaled to 256x256, it is sent to the DarkNet-53 network structure for processing, and an image feature map with a size of n×n×c is obtained. Such as figure 2 It is the network structure diagram of DarkNet-53.

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a millimeter wave radar and vision cooperative target detection and identification method based on a neural network. A millimeter wave radar can obtain information such as theposition and the speed of an object by transmitting and receiving millimeter waves. A camera can obtain a visual image of an object. The position information obtained by the millimeter wave radar ismapped to the image. The region of interest is delineated in the image feature map. The region of interest is sent to the deep learning neural network to be processed, and the identification and positioning information of the target can be obtained. According to the invention, a millimeter wave radar and visual processing combined mode is adopted to complete target detection and recognition tasks.By means of a deep learning neural network technology, the object positioning time is shortened, and the recognition accuracy is improved.

Description

technical field [0001] The invention relates to the field of target recognition and positioning by sensor fusion, in particular to a neural network-based millimeter-wave radar and vision collaborative target detection and recognition method. Background technique [0002] At present, the known image target recognition and positioning algorithms mainly use neural networks to directly process images, mainly including RCNN series, YOLO series, SSD and so on. These neural network processing methods are mainly divided into two types: one is to extract the region of interest on the image through exhaustive search or neural network structure, and then send the region of interest to the neural network for position regression and category recognition; the other is Use neural networks to directly regress object locations and classes across images. The former takes a lot of time to obtain the region of interest and becomes the main time bottleneck of the target detection algorithm; the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/32G06K9/62G01S7/41G06N3/08
CPCG01S7/417G06N3/08G06V20/10G06V20/62G06F18/23213
Inventor 宋春毅宋钰莹徐志伟赵自豪陈钦
Owner 烟台芯扬聚阵微电子有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap