Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video abstract generation method and device based on shortest path

A technology of shortest path and video summarization, applied in the field of image processing, can solve the problems of difficult selection of merge points or split points, large computational complexity, and increased calculation amount, and achieves high efficiency, simple calculation, and reduced calculation amount. Effect

Active Publication Date: 2018-12-07
HEFEI UNIV OF TECH
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] These traditional methods based on clustering methods and graphical models have been verified to have certain effectiveness, but in fact they all have their own defects.
For example, in the clustering method, it is often necessary to comprehensively consider issues such as the initial cluster center setting, the determination of the number of key frames, and the stability of threshold selection. Although there is no need to set the cluster center and the number of key frames in advance, it has a large computational complexity. , the disadvantage that it is difficult to select the merge point or the split point; in addition, the key frame extraction is affected by subjective factors to a certain extent
However, in the actual situation of the method based on the graphical model, the number of video frames of a video is often quite large. At the same time, the relationship between all the frame pictures needs to be considered, the graphical model will become quite complicated, and the amount of calculation will also increase.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video abstract generation method and device based on shortest path
  • Video abstract generation method and device based on shortest path
  • Video abstract generation method and device based on shortest path

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] This embodiment provides a method for generating a video abstract based on the shortest path, which is used in a device for generating a video abstract. like figure 1 As shown, the video summary generation method includes the following steps:

[0051] Step 101: Obtain video frame information of the video to be processed.

[0052] In this embodiment, the video to be processed may be a video stored in the video summary storage device, may be a video transmitted to the video summary storage device in real time through a network or an external device, or may be a video in a segment of the video summary storage device in this video summary storage device. Extracted video segments.

[0053] Step 102: Sampling the video frame information to obtain sampling information of the video frame information.

[0054] In this embodiment, the sampling method for sampling the video frame information is equal interval sampling.

[0055]Calculate the forward position information, backwa...

Embodiment 2

[0061] This embodiment provides a method for generating a video abstract based on the shortest path, which is used in a device for generating a video abstract. like figure 2 As shown, the video summary generation method includes the following steps:

[0062] Step 201: Obtain video frame information of a video to be processed.

[0063] Step 202: Sampling the video frame information to obtain sampling information of the video frame information.

[0064] Step 203: Determine the segmentation position of the video to be processed according to the sampling information, and segment the video to be processed at the segmentation position to obtain a segmented video.

[0065] Step 201, step 202, and step 203 are completely the same as those in the first embodiment above, and will not be repeated here.

[0066] Step 204: Use the video frame feature information entropy of the segmented video as the video frame feature information of the segmented video.

[0067] Wherein, for the gray...

Embodiment 3

[0098] This embodiment provides an apparatus for generating a video abstract based on the shortest path. like image 3 As shown, the video summary generation device includes:

[0099] 301 obtaining module, used for obtaining the video frame information of the video to be processed;

[0100] 302 sampling module, for sampling the video frame information, and obtaining the sampling information of the video frame information;

[0101] 303 segmentation modules, used to determine the segmentation position of the video to be processed according to the sampling information, and segment the video to be processed at the segmentation position to obtain the segmented video;

[0102] 304 clustering modules, for clustering the video frames in the segmented video, to obtain candidate key frames;

[0103] 305 generation module, be used for taking the candidate key frame of each subsection video as a vertex, when any two described vertexes meet constraint condition, construct directed graph...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video abstract generation method and a video abstract generation device based on the shortest path. The method comprises the steps of acquiring video frame information of a video to be processed; sampling the video frame information, and acquiring sampling information of the video frame information; determining a segmentation position of the video to be processed according to the sampling information, and segmenting the video to be processed at the segmentation position to acquire a segmented video; clustering video frames in the segmented video, and acquiring a candidate key frame; and building a digraph, computing the shortest path through combining the digraph with the shortest path algorithm, eliminating redundancy of the candidate key frame of the shortest path to acquire a key frame, and generating a video abstract according to the key frame. The method and device provided by the invention have the advantages of simple graph model, small calculation amount and high video abstract acquisition efficiency.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a shortest-path-based video summary generation method and device. Background technique [0002] Video summarization, also known as video enrichment, is a simple summary of video content. Whether it is daily life or professional needs, it is often necessary to quickly browse and retrieve massive video data, and generating a summary of the video to display the key content of the video can greatly improve the efficiency of video browsing and retrieval. [0003] Static video summarization is a form of video summarization, also known as video summary, which represents the content of the video with a series of static semantic units extracted from the original video stream. Static semantic units are such as key frames, titles, slides, etc. Slices and the like can generally represent the static feature information of the video shot content. Typical clustering-based met...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/8549H04N21/845
CPCH04N21/8456H04N21/8549
Inventor 赵烨葛钊刘学亮
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products