Method and device for extracting video abstract

A video summary and video technology, applied in the field of video analysis, can solve the problem of removing similar components of videos

Inactive Publication Date: 2009-06-24
广东清立方科技有限公司
View PDF0 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, just doing redundant analysis from the video key frame level

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for extracting video abstract
  • Method and device for extracting video abstract
  • Method and device for extracting video abstract

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Such as figure 1 As shown, the embodiment of the present invention provides a method for extracting video summaries, including:

[0043] Step 101: Segment the original video to obtain the video footage of the original video and the key frames of the original video;

[0044] Step 102: cluster key frames with similar video features into one category, and name the key frames clustered into one cluster;

[0045] In this embodiment, the key frames of each cluster describe similar video content, so that the content of the entire video is represented by the results of several clusters.

[0046] Step 103: selecting the key frame with the smallest average distance from each cluster as the reserved key frame, and splicing the video shots corresponding to the reserved key frame into a rough video summary;

[0047] Step 104: Generate video clips in the rough video summary and calculate the similarity of the video clips, detect the video clips whose similarity of the video clips e...

Embodiment 2

[0051] Such as figure 2 As shown, a method for extracting video summaries specifically includes:

[0052] Step 201: Segment the original video, obtain the scene and video footage of the original video, and generate key frames of the original video at the same time;

[0053] Wherein, the video can be divided into four levels from the overall structure: the whole video, the scene, the video lens and the key frame of the video. Each video shot is a continuous video sequence obtained by uninterrupted shooting by the camera, that is, a video sequence obtained when the camera is turned on and off once. A key frame is a representative description of a video shot, and one or more key frames are used to represent the content of the entire video shot.

[0054] Step 202: Calculate the distance between any two key frames, and store the calculated distance in a distance matrix;

[0055] For example, there is a section of key frames A, B, C, D, E, the distance between A and B is calcula...

Embodiment 3

[0074] Such as image 3 As shown, the embodiment of the present invention provides a device for extracting video summaries, including:

[0075] Obtaining module 301, for dividing the original video, obtaining the video footage of the original video and the key frame of the original video;

[0076] The clustering module 302 is used for clustering key frames with similar video features into one category, and naming the key frames clustered into one cluster;

[0077] Stitching module 303, for selecting average distance minimum and key frame as retaining key frame from each clustering, the video footage corresponding to retaining key frame is spliced ​​into rough video summary;

[0078] The removal module 304 is used to generate video clips in the rough video summary and calculate the similarity of the video clips, detect the video clips whose similarity of the video clips exceeds the third threshold, and remove the detected video clips in the rough video summary , splicing the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for extracting video summarization, and belongs to the field of the video analysis. The method comprises the following steps: video shots and key frames are obtained; key frames with similar video features are gathered in a same class, and key frames gathered in the same class are named as a cluster; the key frame with a minimal average distance is selected from each cluster and serves as a reserved key frame; a rough video summarization is formed by the splicing of video shots corresponding to the reserved key frames; video clips are produced from the rough video summarization, and the similarity of the video clips are calculated; video clips with a video clip similarity exceeding a third threshold value are detected; the detected video clips are removed from the rough video summarization; and a video summarization ids formed by splicing the left parts. The device comprises a dividing module, a segmentation module, a splicing module and a removing module. The invention ensures that the extracted video summarization is more compact, and better user experience can be brought.

Description

technical field [0001] The invention relates to the field of video analysis, in particular to a method and device for extracting video summaries. Background technique [0002] With the rapid development of computer network and multimedia technology, the application of multimedia data is becoming more and more extensive. Due to the continuous reduction of storage costs and the advancement of data compression technology, multimedia data has experienced explosive growth. Massive video data increases the difficulty for users to retrieve and browse videos. Video summarization technology allows users to browse video content more effectively, and has received extensive attention in recent years. [0003] As a major application of content-based video analysis, a large amount of research has focused on video summarization extraction algorithms in recent years. There are also many achievements in content-based video summarization in China. Among them, the video preview is a basic ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 戴琼海高跃季向阳王好谦
Owner 广东清立方科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products