The invention discloses a scale and structure consistency
image generation method fusing three-dimensional geometric prior, and belongs to the technical field of
computer vision and
image generation. The method comprises the following steps: acquiring a scene image and depth information corresponding to the scene image, reconstructing a scene
point cloud containing pixel space coordinates and color information, acquiring a
colored point cloud of an object to be inserted, placing the
colored point cloud at a specified position of the scene through
rigid body transformation, and unifying a coordinate
system with the scene point cloud; projecting the transformed
object point cloud to an
image plane through a camera model, determining a visible point according to the depth, and constructing an
insertion region
mask to remove pixels of a region corresponding to a scene; then constructing a multi-channel geometric structure priori graph containing color, depth and other information, and splicing the multi-channel geometric structure priori graph with the cleared scene image to form a
diffusion type generation model input; and finally, generating an image under geometric prior guidance, ensuring that the inserted object is consistent with the original scene in the aspects of position, scale, perspective and the like, solving the problem of insufficient
geometric consistency of the existing method, and realizing
image content insertion with an accurate structure and real vision.