Video frame insertion method and device, equipment and storage medium
A frame insertion and video technology, applied in the computer field, can solve problems such as large gaps in perception and experience, and achieve the effects of avoiding blur effects, saving computing costs, and improving the accuracy of optical flow estimation
Active Publication Date: 2021-06-08
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF5 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In order to reduce bandwidth costs, one of the most direct ways is to distribute frame rate video, but this method is far from the high frame rate video experience of 60FPS (FramesPer Second, frames per second) and 120FPS.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0019] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
[0020] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.
[0021] figure 1 It shows an exemplary system architecture 100 to which emb...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a video frame insertion method, device and equipment and a storage medium, and relates to the field of artificial intelligence such as computer vision and deep learning. A specific embodiment of the method comprises the following steps: acquiring a (t-1)-th frame image and a (t + 1)-th frame image in a target video; respectively extracting deep features of the (t-1)-th frame image and the (t + 1)-th frame image; estimating forward optical flow information from the t-1 moment to the t moment and reverse optical flow information from the t + 1 moment to the t moment based on the deep features of the (t-1)-th frame image and the (t + 1)-th frame image; based on the forward optical flow information and the reverse optical flow information, mapping the deep features of the (t-1)-th frame image and the (t + 1)-th frame image to obtain the deep features at the t moment; and based on the deep features at the t moment, generating a t-th frame of image, and inserting the t-th frame of image between a (t-1)-th frame of image and a (t + 1)-th frame of image. According to the embodiment, the optical flow at the target moment is directly estimated, calculation overhead is saved, and optical flow estimation precision is improved.
Description
technical field [0001] The embodiments of the present application relate to the field of computers, specifically to fields of artificial intelligence such as computer vision and deep learning, and in particular to video frame insertion methods, devices, equipment, and storage media. Background technique [0002] With the rise of live video services, the cost of server distribution bandwidth has become the main cost of live broadcast service providers. In order to reduce bandwidth costs, one of the most direct ways is to distribute frame rate video, but this method is far from the high frame rate video experience of 60FPS (FramesPer Second, frames per second) and 120FPS. Video frame insertion technology can insert intermediate frames between video frames, increase the video frame rate, and make the video look smoother, thereby reducing the occurrence of jumping, shaking, etc., and greatly improving the user experience. Contents of the invention [0003] Embodiments of the ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/2187H04N21/2343H04N21/4402G06K9/00G06N3/08
CPCH04N21/2187H04N21/234381H04N21/440281G06N3/08G06V20/46
Inventor 李超
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD