Optical flow prediction method and device, electronic equipment and storage medium

Abstract

The invention discloses an optical flow prediction method and device, electronic equipment and a storage medium. The method comprises the following steps: inputting two frames of images into an optical flow prediction network; processing through an optical flow prediction network; generating an initial forward optical flow and an initial backward optical flow of the two frames of images; determining a shielding area in each frame of image; generating an appearance flow of each frame of image, wherein a corresponding relation between pixel points with similar appearances in the image is recorded in the appearance flow; according to the appearance flow and the occlusion area of each frame of image, determining target pixel points in a non-occlusion area in each frame of image, wherein the target pixel points comprise all pixel points similar to all pixel points in the occlusion area in appearance; for the previous frame of image, replacing the initial forward optical flow of the occlusion area with the initial forward optical flow of the target pixel point in the non-occlusion area to obtain a predicted forward optical flow; and for the next frame of image, replacing the initial backward optical flow of the occlusion area with the initial backward optical flow of the target pixel point in the non-occlusion area to obtain a predicted backward optical flow.

Description

Technical field [0001] Technical Field The present invention relates to machine vision, and particularly relates to an optical flow prediction method, apparatus, electronic apparatus and a storage medium. Background technique [0002] With the development of computer technology, the development of computer vision quite quickly. Optical Flow is a fundamental task in computer vision, in many areas autopilot, video processing, object detection, behavior analysis plays an important role. Presently, the optical flow prediction method when the prediction image of the optical flow, the optical flow in the image for the occlusion region estimation less accurate. Thus, a need for a new optical flow prediction method, in order to improve the accuracy of optical flow estimation in occlusion regions. Inventive content [0003] Embodiment of the present invention provides an optical flow prediction method, apparatus, electronic apparatus and a storage medium, to solve the technical problem o...

AI Technical Summary

Problems solved by technology

[0003] Embodiments of the present invention provide an optical flow prediction method, device, electronic equipment, and storage medium to solve the technical problem of poor optical flow estimation accuracy in occluded areas existing in the prior art

Images