The invention relates to the technical field of three-dimensional reconstruction, and discloses a
monocular depth guided object-level NeRF
reconstruction method, which comprises the following steps: firstly, through
monocular video sequence input, generating a frame-by-frame initial
depth map by using a depth
estimation module, and estimating a relative camera attitude between adjacent frames through a relative attitude
estimation module; calculating the absolute attitude of the camera in combination with the initial
depth map and the relative camera attitude; then constructing a geometrically enhanced NeRF model, and optimizing scene representation through multi-resolution hash position coding and spherical
harmonic direction coding; introducing photometric loss, depth contrast loss and density loss to jointly optimize parameters of the NeRF model, and constraining
geometric reconstruction of the object by using depth information; and finally, through a four-stage iterative training strategy, alternately optimizing depth
estimation, a camera attitude and a NeRF model, and generating an object-level controllable three-dimensional model. According to the method, depth information is fully utilized to optimize the NeRF training process, so that end-to-end reconstruction from a
monocular video to an object-level controllable model is completed.