The invention discloses a multi-
modal three-dimensional
point cloud semantic segmentation method based on adaptive
noise filtering, and belongs to the technical field of automatic driving environment
perception. The method comprises the following steps: firstly, acquiring data by using a
laser radar and a
monocular camera, and constructing a multi-
modal panoramic feature
tensor containing a geometric structure and color textures through projection and mapping; extracting shallow geometric distribution features through a residual context module, and extracting multi-scale environment features through an expanded residual
encoder; performing global context aggregation by using a self-attention mechanism of a Transform architecture, and establishing a full-image pixel dependency relationship to make up for a
convolution locality defect; in the decoding stage, a channel cross fusion attention module (CCA) is adopted to process deep semantic features and shallow jump connection features, and a channel weight
mask is dynamically generated to adaptively screen effective features and suppress high-
frequency noise; and finally, outputting a two-dimensional semantic segmentation result and back-projecting the result to a three-dimensional space to obtain a semantic
point cloud. According to the method, through global
semantic integration and local detail screening, the problems of
terrain misjudgment and
noise interference of
severe weather (such as rain,
snow and dust) in a cross-country scene are effectively solved, and the robustness and precision of automatic driving
perception are remarkably improved.