The invention relates to the technical field of three-dimensional reconstruction, and provides a local feature adaptive fusion and high-fidelity new
view angle synthesis method based on three-dimensional reconstruction. According to the method, a local feature module is introduced into a
point cloud network, robust matching of local features is realized, a self-
adaptive matching strategy is combined, high-resolution images can be efficiently processed, and the precision and stability of three-dimensional reconstruction are remarkably improved. The method is suitable for application scenes such as three-dimensional rendering, three-dimensional reconstruction and new
view angle synthesis. The specific process comprises dense reconstruction and initial rendering; and carrying out missing region repairing and iterative optimization. Generating a high-precision
point cloud based on an improved
stereo matching algorithm, and rendering an initial image of a target
view angle in combination with camera parameters; a conditional video generation model is adopted, and holes,
distortion and artifacts in initial rendering are repaired; and carrying out progressive
complementation on the
occlusion region by using the view angle consistency constraint, and improving the reconstruction integrity by jointly optimizing the
point cloud geometry and texture. According to the method, the final picture quality is remarkably improved through
feature matching optimization and efficient
processing capacity. Local feature branches and global context information are coordinated, and the problem of matching
ambiguity in a complex scene is solved; the adaptive fusion strategy gives consideration to high-resolution
image processing efficiency and detail retention; and the detail fidelity and the overall quality of the rendering result are effectively improved.