Video abstraction generation method and device, electronic equipment and computer storage medium

A technology of video summarization and generation device, applied in the field of computer vision

Active Publication Date: 2019-03-01
SHENZHEN SENSETIME TECH CO LTD
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Artificial intelligence technology has achieved good solutions to many computer vision problems, such as image classification, and the performance of artificial intelligence has even surpassed that of humans, but this is limited to some aspects with clear goals

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video abstraction generation method and device, electronic equipment and computer storage medium
  • Video abstraction generation method and device, electronic equipment and computer storage medium
  • Video abstraction generation method and device, electronic equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0101]Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of the components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present application unless specifically stated otherwise.

[0102] Meanwhile, it should be understood that, for the convenience of description, the dimensions of various parts shown in the accompanying drawings are not drawn in an actual proportional relationship.

[0103] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the application, its application, or uses.

[0104] Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods, and apparatus should be considered pa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the application discloses a video abstraction generation method and device, electronic equipment and a computer storage medium. The method includes: carrying out feature extraction on a shot in a shot sequence of a to-be-processed video stream to obtain image features of each shot, wherein each shot includes at least one frame of video image; acquiring global features of the shots according to the image features of all the shots; determining weights of the shots according to the image features and the global features of the shots; and obtaining video abstraction of the to-be-processed video stream on the basis of the weights of the shots. The image features and the global features are combined for determining a weight of each shot, an effect of understanding the video from an angle of the whole video is realized, a relationship of each shot and the global video is utilized, the video abstraction determined on the basis of the weights of the shots of the embodiment canexpress video contents as a whole, and the problem that video abstraction is more one-sided is avoided.

Description

technical field [0001] The present application relates to computer vision technology, especially a method and device for generating a video summary, electronic equipment, and computer storage media. Background technique [0002] With the rapid increase of video data, in order to quickly browse these videos in a short time, video summarization begins to play an increasingly important role. Video summarization is an emerging technique for video understanding. Video summarization is to extract some shots from a longer video to synthesize a shorter new video that contains the story line or highlights in the original video. [0003] Artificial intelligence technology has achieved good solutions to many computer vision problems, such as image classification, and the performance of artificial intelligence has even surpassed that of humans, but this is limited to some aspects with clear goals. Compared with other computer vision tasks, video summarization is more abstract and emph...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/8549G06V10/764
CPCH04N21/8549H04N21/23418H04N21/8456G06N3/08G06V20/47G06V20/48G06V20/49G06V10/82G06V10/764G06N3/048G06N3/045G06F18/22G06F18/214
Inventor冯俐铜肖达旷章辉张伟
OwnerSHENZHEN SENSETIME TECH CO LTD