The invention discloses a two-stage multi-
modal 3D target detection method based on space-semantic-range multi-dimensional joint modeling, and the method comprises the steps: collecting the multi-
modal data of a 3D target, fusing an
RGB image and a
LiDAR point cloud through an image-guided depth completion technology, and generating a virtual
point cloud; frame labeling is carried out on the 3D target in the partial virtual
point cloud to obtain full-labeling data, and the full-labeling data comprises a 3D bounding box surrounding the 3D target, a category
label and
direction information; constructing a dual-stage multi-
modal 3D target detection model of dual-stage multi-dimensional joint modeling, wherein the model comprises a
spatial perception sampling sub-module, a multi-dimensional importance
score sampling sub-module, a sparse convolutional
backbone network, a distance
perception sub-network and a detection head; the full-
annotation data and the virtual point cloud serve as training data, a two-stage multi-mode 3D target detection model is trained, then a 3D bounding box, a category
label and
direction information in the full-
annotation data serve as true values, a
loss function is calculated, detection head parameters are trained, and the trained model is the 3D target detection model; and inputting a virtual point cloud generated by performing depth completion on the
RGB image and the
LiDAR point cloud into the trained 3D target detection model to obtain a 3D bounding box, category information and
direction information of the 3D target.