Image processing method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses an image processing method and device, electronic equipment and a storage medium. The method comprises the steps that an image frame sequence is acquired, theimage frame sequence comprises to-be-processed image frames and one or more image frames adjacent to the to-be-processed image frames, the to-be-processed image frames and the image frames in the image frame sequence are subjected to image alignment, and multiple pieces of alignment feature data are obtained; a plurality of similarity features between a plurality of alignment feature data and alignment feature data corresponding to the to-be-processed image frame are determined based on the plurality of alignment feature data, and weight information of each alignment feature data in the plurality of alignment feature data is determined based on the plurality of similarity features; and according to the weight information of each alignment feature data, the plurality of alignment feature data is fused to obtain fusion information of the image frame sequence for obtaining the processed image frame corresponding to the to-be-processed image frame, thereby improving the quality of multi-frame alignment and fusion in image processing, and enhancing the display effect of image processing.

Description

technical field [0001] The present application relates to the technical field of computer vision, and in particular to an image processing method and device, electronic equipment and a storage medium. Background technique [0002] Video restoration is the process of recovering high-quality output frames from a series of low-quality input frames. However, the necessary information to restore high-quality frames has been lost in low-quality frame sequences. The main tasks of video restoration include video super-resolution, video deblurring, video denoising, etc. [0003] The process of video restoration often includes four steps: feature extraction, multi-frame alignment, multi-frame fusion and reconstruction, among which multi-frame alignment and multi-frame fusion are the key to video restoration technology. For multi-frame alignment, an algorithm based on optical flow is often used at present, which not only takes a long time but also has poor results, especially when th...

AI Technical Summary

Problems solved by technology

For multi-frame alignment, an algorithm based on optical flow is often used at present, which not only takes a long time but also has poor results, especially when the input frame has occlusion, motion, and serious blurring, and further, based on the above-mentioned alignment The quality of multi-frame fusion is not good enough, and there may be errors in restoration. It can be seen that the accuracy of multi-frame alignment and multi-frame fusion is not high, and the video restoration effect is not good.

Images