The invention relates to the technical field of automatic driving, in particular to an open set 3D occupancy prediction framework suitable for an automatic driving scene, which comprises a multi-
source data processing module, an occupancy prediction
processing module, a model training optimization module and a post-
processing and
visualization module. According to the open set 3D occupancy prediction framework suitable for the automatic driving scene and the implementation method, through a dynamic-static separation fusion-Poisson reconstruction technology, high-quality dense 3D occupancy representation is generated, holes are filled, semantic differences between a dynamic target and a static scene are reserved, the void rate of a
voxel grid after densification is reduced in a nuScenes
data set test, and the performance of the open set 3D occupancy prediction framework suitable for the automatic driving scene is improved. The method has the advantages that the accuracy of semantic tags is improved, the problem of sparsity of 3D data is solved, 2D visual features, 3D
voxel features and CLIP text features are aligned through knowledge
distillation loss, and high-precision prediction of known categories and effective recognition of unknown categories are realized at the same time through double prediction heads and an unknown category decision-making mechanism.