Multi-sensor fusion method based on DS-GNN algorithm

A multi-sensor fusion and sensor technology, which is applied in the direction of instruments, calculations, computer components, etc., can solve the problems that the advantages of sensor recognition technology cannot be effectively utilized, and the system robustness is not strong.

Active Publication Date: 2020-01-24
JIANGSU UNIV
View PDF5 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this type of algorithm can speed up the image recognition process, it cannot effectively take advantage of the sensor's recognition technology advantages, and the system robustness is not strong

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-sensor fusion method based on DS-GNN algorithm
  • Multi-sensor fusion method based on DS-GNN algorithm
  • Multi-sensor fusion method based on DS-GNN algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0075] The specific embodiments of the present invention will be described in conjunction with the accompanying drawings, so that future researchers can better understand the present invention.

[0076] This paper invented a multi-sensor fusion method based on the DS-GNN algorithm (Dempster / Shafer evidence theory-global nearest neighbor), including the following main steps:

[0077] Step 1: Spatiotemporal Fusion of Camera and Radar

[0078] According to the range and azimuth information of millimeter-wave radar, different spatial transformation matrices are applied to realize the spatial fusion of vision and millimeter-wave radar. The method of multi-thread synchronization is used to solve the time fusion problem of camera and millimeter-wave radar.

[0079] Step 2: Multi-Sensor Data Association

[0080] The Global Nearest Neighbor Algorithm (GNN) is used to correlate the data of the target obtained by the radar and the camera with the target source, so as to determine which...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-sensor fusion method based on a DS-GNN algorithm, and the method comprises the following steps that firstly the radar resolves multiple possible targets through its ownsignal processing to obtain their positions and speed information, the camera module provides the positions and speed information of the targets, joint calibration of the millimeter-wave radar and camera is required before the system detection to realize the fusion of multiple sensors in time and space, a global nearest neighbor (GNN) algorithm is introduced to match all the original target information and observed values one by one to confirm which observed values of the radar and camera are generated by the same vehicle, and finally a D-S evidence theory is used to effectively fuse the observed values, including target state update and existence probability update, wherein the state update process is basically consistent with standard Kalman filtering, and the existence probability is tracked simultaneously. The multi-sensor fusion method based on the DS-GNN algorithm provided by the invention can realize the accurate identification and tracking of target vehicles.

Description

technical field [0001] The invention relates to the technical field of vehicle intelligent driving and active safety, in particular to a multi-sensor fusion method based on a DS-GNN algorithm. Background technique [0002] For advanced driver assistance systems (ADAS) and autonomous driving, a single sensor is increasingly unable to meet people's safety requirements for increasingly complex traffic environments. However, both the radar and the camera have their own defects, and they will be affected by various adverse environmental factors, which will greatly weaken the ability of target recognition in specific scenes. In the vehicle collision avoidance method and system, due to the restriction of the perception ability of a single sensor, there are certain defects, and the vehicle collision cannot be effectively avoided in the actual full working condition scene. Therefore, the research on target tracking method based on multi-sensor fusion has great theoretical significan...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G01S13/72G01S13/86G01S13/931G06K9/62
CPCG01S13/723G01S13/931G01S13/867G06F18/251Y02T10/40
Inventor 刘志强张光林张腾
Owner JIANGSU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products