Unlock instant, AI-driven research and patent intelligence for your innovation.
Motion video frame rate enhancement method and system based on optical flow estimation and foreground detection
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A technology for foreground detection and video frame rate, applied in computer vision related fields, can solve problems such as complex model and complex preprocessing, and achieve the effect of simplifying preprocessing steps, reducing complexity, and complementing frames realistically.
Pending Publication Date: 2022-02-18
青岛根尖智能科技有限公司
View PDF0 Cites 1 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0005] In order to solve the problems of complex preprocessing and complex models in the current method, this disclosure proposes a motion video frame rate enhancement method and system based on optical flow estimation and foreground detection. The foreground motion information of the video, using the generative confrontation network (GAN for short) to generate realistic motion video supplementary frames, can simulate the motion characteristics of video moving objects, making the supplementary frames more realistic
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0030] In the technical solutions disclosed in one or more embodiments, such as Figure 1-3 As shown, the motion video frame rate enhancement method based on optical flow estimation and foreground detection includes the following steps:
[0031] Step S1, using the foreground detection algorithm to process the acquired video data to be processed to obtain a complete moving target image;
[0032] Step S2, using the optical flow estimation network to fit the video data to be processed to obtain foreground optical flow information;
[0033] Step S3, according to the target image obtained by the foreground detection and the foreground optical flow information, use the generative adversarial network to generate video supplementary frames, and supplement the original video data according to the video supplementary frames.
[0034] In this embodiment, the input frame is preprocessed in combination with foreground detection and optical flow estimation of the moving target, and a reali...
Embodiment 2
[0065] Based on Embodiment 1, this embodiment provides a motion video frame rate enhancement system based on optical flow estimation and foreground detection, including a video acquisition device and a server;
[0066] Wherein, the video collection device is configured to collect the video data to be enhanced and transmit it to the server;
[0067] The server is configured to execute the steps described in the method of Embodiment 1.
[0068] Wherein, the video acquisition device may be a camera.
Embodiment 3
[0070] Based on Embodiment 1, this embodiment provides a motion video frame rate enhancement system based on optical flow estimation and foreground detection, including:
[0071] Foreground detection module: configured to use the foreground detection algorithm to process the acquired video data to be processed to obtain a complete moving target image;
[0072] Optical flow estimation module: configured to obtain foreground optical flow information by using the optical flow estimation network to fit the video data to be processed;
[0073] Complementary frame module: configured to use the generative confrontation network to generate video supplementary frames according to the target image and foreground optical flow information obtained by foreground detection, and to perform supplementary frames on the original video data according to the video supplementary frames.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
The invention provides a motion video frame rate enhancement method and system based on optical flowestimation and foreground detection, and the method comprises the following steps: carrying out the processing of obtained to-be-processed video data through employing a foreground detectionalgorithm, and obtaining a complete motion target image; fitting the to-be-processed video data by using the optical flowestimation network to obtain foreground optical flow information; and according to the target image obtained by foreground detection and foreground optical flow information, generating a video supplementary frame by using the generative adversarial network, and performing frame supplementation on the to-be-processed video data according to the video supplementary frame. According to the method, foreground detection, optical flow estimation of a moving target and foreground motion information of an original video are combined, and a vivid motion video complementary frame is generated by utilizing the generative adversarial network, so that the motion characteristics of the video moving target can be simulated, and the complementary frame is more vivid.
Description
technical field [0001] The present disclosure relates to the technical field related to computer vision, in particular, to a method and system for enhancing the frame rate of motion video based on optical flow estimation and foreground detection. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art. [0003] Due to the rapid development of multimedia technology, a variety of video sources with different frame rates appear on the market, and frame rate conversion between the above video sources is unavoidable. Frame rate up-conversion is a technique for converting low frame rate video to higher frame rate video. At the same time, with the continuous improvement of people's requirements for video quality, high-definition video applications are becoming more and more common. Therefore, it is particularly important to study the frame rate up-conversion a...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More 
Login to View More