The embodiment of the invention discloses a video generation method and device,
electronic equipment, a storage medium and a product, and the method comprises the steps: determining the image features of a guide image and the text features of a prompt text, and carrying out the denoising
processing of a preset number of time steps through a pre-trained video generation model based on the image features, the text features and preset
noise, a target video is determined, and a cross attention module in the video generation model comprises a query
feature mapping layer, a text key
feature mapping layer, a
text value feature mapping layer, an image key feature mapping layer and an image value feature mapping layer; and in the denoising
processing of each
time step, a cross attention module performs cross attention calculation on the image features, the text features and the preset
noise to obtain cross attention output so as to determine the target
video based on the denoising
processing of each
time step and the cross attention output of each
time step. Therefore, the matching degree between the generated target video and the user requirement is improved, and the user experience is improved.