Panoramic video frame insertion method, device and corresponding storage medium

Abstract

The present invention provides a panoramic video frame interpolation method, which includes acquiring the down-sampled frame image and the down-sampled frame image; outputting the optical flow diagram of the front and rear frame images and the optical flow diagram of the front and rear frame images; and calculating the optical flow of the image before frame interpolation Figure and image optical flow diagram after frame interpolation; inverse transformation operation, obtain the frame image before the downsampling after transformation and the frame image after downsampling after transformation; output the optical flow diagram of the front and rear frame images, the optical flow diagram of the front and rear frame images and the image Occlusion relationship diagram; obtain the frame image before downsampling after correction and the frame image after downsampling after correction; obtain the optical flow map of the image before upsampling and interpolation and the optical flow map of the image after upsampling and interpolation; use the image before downsampling after correction , The frame image after downsampling after correction, the image occlusion relationship diagram, the optical flow diagram of the image before upsampling and interpolation, and the optical flow diagram of the image after upsampling and interpolation, and calculate the interpolation image corresponding to the interpolation position.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a panoramic video frame insertion method, device and corresponding storage medium. Background technique [0002] With the development of science and technology, people have higher and higher requirements for video images, so some companies have developed various panoramic video processing methods to meet people's requirements for high-quality video images. [0003] When a user makes a slow-motion panoramic video, in order to provide smoothness of the slow-motion panoramic video, it is necessary to increase the video frame rate of the panoramic video, that is, to perform a frame insertion operation on the original panoramic video. The existing panoramic video frame interpolation methods directly estimate the interpolated video frames through neural network-based algorithms such as the classic Flownet-S, Flownet-C or Lite-flownet, which occupy a large amount of sys...

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a panoramic video frame insertion method and a panoramic video frame insertion device that occupy less system memory and have higher accuracy in interpolation video frame estimation; to solve the existing panoramic video frame insertion method and panoramic video frame insertion device The technical problem that the system content occupies a large amount and the estimation accuracy of the interpolated video frame is low when the interpolated video frame is estimated

Images