Three-dimensional multi-target tracking method fusing images and laser point clouds

A multi-target tracking and laser point cloud technology, applied in the field of three-dimensional multi-target tracking, can solve the problems of tracking loss and difficult identification of disappearing targets

Active Publication Date: 2020-01-10
NAT INNOVATION INST OF DEFENSE TECH PLA ACAD OF MILITARY SCI
View PDF7 Cites 53 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to solve the technical problems of tracking loss cau

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional multi-target tracking method fusing images and laser point clouds
  • Three-dimensional multi-target tracking method fusing images and laser point clouds
  • Three-dimensional multi-target tracking method fusing images and laser point clouds

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific preferred examples, but the protection scope of the present invention is not limited thereby.

[0048] Such as figure 1 As shown, in this example, a three-dimensional multi-target tracking method for fusing images and laser point clouds, the steps include:

[0049] S1. Obtain point cloud data from lidar, detect the three-dimensional space position information of the target and extract point cloud features;

[0050] S2. Obtain image data from the camera, project the 3D boundary of the target onto the image plane, and extract image features of the projected area;

[0051] S3. Calculate the similarity matrix of the detected target and the tracking track on the point cloud three-dimensional space position information, point cloud features and image features, and merge the three similarity matrices;

[0052] S4. The combined similarity matrix is ​​used...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a three-dimensional multi-target tracking method fusing images and laser point clouds. The method is characterized by fusing the point cloud of a laser radar and the image dataof a camera to give full play to the complementary advantages between the point cloud data and the image data, extracting the three-dimensional space position information, the point cloud features and the image features of a target, matching a detection target and a tracking track, carrying out the state estimation on the tracking track in combination with a Kalman filter, thereby realizing the accurate and stable three-dimensional multi-target tracking. The method can be used for tracking and predicting the moving targets, such as pedestrians, vehicles, etc., in various unmanned vehicles, and can also be used in the fields of security monitoring, unmanned aerial vehicle-to-ground target reconnaissance and the like.

Description

technical field [0001] The invention belongs to the technical field of information and communication, and in particular relates to a three-dimensional multi-target tracking method. Background technique [0002] Most current multi-target tracking methods are based on a single sensor, such as lidar or camera alone. The point cloud data of lidar can provide the three-dimensional information of the target. Although it can better overcome the mutual occlusion problem of the target, the point cloud data only has geometric information, and it is difficult to identify the target attributes. Therefore, it is difficult to identify the target that reappears during the tracking process to identify. [0003] Since image data has richer information than point cloud data, multi-target tracking based on image and video data is currently the most researched method, but the image is greatly affected by light and shadow, which greatly improves the reliability of tracking. reduce. In additio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/246G06T7/277G06T7/73G06T7/80G06K9/62G06N3/04G01S17/66
CPCG06T7/246G06T7/277G06T7/73G06T7/80G01S17/66G06T2207/10044G06T2207/10028G06T2207/20081G06T2207/20084G06T2207/30241G06T2207/20221G06V2201/07G06N3/045G06F18/22
Inventor 许娇龙聂一鸣肖良赵大伟
Owner NAT INNOVATION INST OF DEFENSE TECH PLA ACAD OF MILITARY SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap