The invention provides a multi-view panoramic image indoor
layout prediction method fusing
semantics and planarity. The method comprises the following steps: step 1, carrying out three-dimensional semantic segmentation combined with three-dimensional
point cloud reconstruction and a multi-view geometry and two-dimensional segmentation
large model; step 2, obtaining a pure structured
point cloud; step 3, multi-plane detection and classification; 4, extracting an initial contour; 5, generating a wall line based on
plane fitting; step 6, performing multi-
label graph segmentation guided by the two-dimensional contour and the wall surface; step 7, extracting a non-Manhattan ceiling line; and step 8, stretching the two-dimensional wall line along the vertical direction on the basis of the contour of the dimensional plane graph in combination with the vertical height of the room, generating an intersection line of the wall surface and the ceiling and an intersection line of the wall surface and the ground, and finally outputting a complete indoor three-dimensional vectorization
layout model. According to the method, the
layout integrity of the complex scene is improved, the boundary
recovery precision of the
occlusion area is improved compared with that of a traditional
projection method, and the detection accuracy is improved by matching with multi-model RANSAC plane detection.