The invention discloses a video face changing consistency enhancement method based on multi-source feature
collaboration, which belongs to the technical field of
video processing, and comprises the following steps: S1, video input: inputting an original video, and extracting a frame of image; s2, constructing an expression network; s3, face
network construction: extracting face 2D key point picture information, and injecting the face 2D key point picture information into a face network; s4, background
network construction: extracting face
background information of the video, and injecting the face
background information into a background network; s5, constructing an illumination network; s6,
feature fusion: splicing outputs of the expression network, the face network, the background network and the illumination network together, and entering a
feature extraction network; and S7,
video output: injecting the picture information of the reference face and the features extracted by the four networks into a video generation
large model, and generating a face changing video by adopting the video generation
large model and inputting the face changing video. According to the method, various information of the face in the video, such as illumination, background, face key points, expressions and the like, is comprehensively extracted, so that the quality of the video generated in video replacement is improved.