Method and system for inserting image frame between videos and electronic device

An image frame and image technology, applied in the field of inter-video frame insertion, can solve problems such as affecting viewing experience, low video usable value, and video transmission frame loss.

Active Publication Date: 2019-10-22
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF8 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the application of more and more entertainment-level short videos, there is a large demand for short video transmission and playback in China, but at the same time, the problem is that video transmission will be caused by various reasons such as network transmission. Frames are lost during the process. In this case, the visual discontinuity of the viewer will be caused, which not only affects the viewing experience, but may also cause the video to have low usability due to the loss of key information.
The literature [Walker J, Marino K, GuptaA, et

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for inserting image frame between videos and electronic device
  • Method and system for inserting image frame between videos and electronic device
  • Method and system for inserting image frame between videos and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

[0060] Aiming at the technical problems existing in the prior art, this application proposes a method for memory prediction and video frame insertion using a long-term short-term memory network (LSTM). This method uses a convolutional neural network to turn the frame insertion process into a learning process. The process enables the network to continuously learn the relevant parameter weights, insert automatically generated image frames into the continuous but occasionally interrupted video to complete the visual continuity of the video, and provide viewers with a better viewing experience....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a system for inserting image frames between videos and an electronic device. The method comprises the following steps: respectively selecting m frames of featuremaps containing pedestrians before video loss time and after video restoration time, and respectively collecting a set number of human body posture points from each feature map; inputting all the human body posture points into an Alex Net network, wherein the Alex Net network predicts pedestrian postures of the to-be-restored image by using a method of combining cubic polynomial fitting and cubicspline interpolation; inputting the human body posture points corresponding to the feature map before the video loss time into an LSTM network to obtain a pedestrian posture prediction result of the to-be-restored image; and obtaining a to-be-restored image according to pedestrian posture prediction results of the Alex Net network and the LSTM network, calculating an insertion position of the to-be-restored image in the video, and inserting the to-be-restored image into a corresponding position in the video. The precision of an existing algorithm is improved.

Description

technical field [0001] The present application belongs to the technical field of frame insertion between videos, and in particular relates to a method, system and electronic equipment for inserting image frames between videos. Background technique [0002] With the application of more and more entertainment-level short videos, there is a large demand for short video transmission and playback in China, but at the same time, the problem is that video transmission will be caused by various reasons such as network transmission. Frames are lost during the process. In this case, the viewer will feel discontinuous in vision, which not only affects the viewing experience, but may also cause the video to have low usability due to the loss of key information. [0003] In the case of frame loss, existing technologies often improve the quality of the transmission process so that the video is uploaded or downloaded without frame loss as much as possible, but there is nothing that can be ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/44H04N21/647G06N3/08G06N3/04
CPCH04N21/44H04N21/64792G06N3/08G06N3/044G06N3/045
Inventor 张昱航任宏帅叶可江须成忠
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap