Video key frame extraction method based on multi-characteristic fusion shot clustering

A multi-feature fusion and video key frame technology, which is applied in the direction of instruments, character and pattern recognition, computer components, etc., can solve the problems that the number of extracted key frames is limited by the initial conditions and the distribution of key frames is uneven, so as to achieve rich performance and improved performance. universal effect

Inactive Publication Date: 2017-09-29
NANJING UNIV OF POSTS & TELECOMM
View PDF2 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to propose a method for extracting key frames based on multi-feature fusion shot clustering for the common problems existing in current video key frame extraction
This method solves the problem that the number of extracted key frames is limited by the initial conditions and the distribution of key frames is uneven in the existing methods, and improves the extraction effect of the algorithm for different types of video data, with high universality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video key frame extraction method based on multi-characteristic fusion shot clustering
  • Video key frame extraction method based on multi-characteristic fusion shot clustering
  • Video key frame extraction method based on multi-characteristic fusion shot clustering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be described in detail below in conjunction with specific embodiments.

[0042] Such as figure 1 As shown, the key frame extraction method of the present invention comprises the following steps:

[0043] 1) Obtain the HSV color feature of the video frame.

[0044] A) Read a set of image frame data in the video lens to obtain the RGB data matrix of the image. Because the HSV color model is more intuitive and more in line with the visual experience of the human eye, the HSV color information matrix of the image frame is obtained by the following formulas (1)-(3): , and normalized;

[0045]

[0046]

[0047]

[0048] Among them, R, G, and B respectively represent the red, green, and blue color components of the image pixel, and H, S, and V represent the hue, saturation, and brightness component values ​​​​of the HSV color space, and the value range is [0,1] .

[0049] B) Differential quantization is performed on the three components ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video key frame extraction method based on multi-characteristic fusion shot clustering and belongs to the video content analysis field. Research of the method is based on video shot segmentation. The method comprises the following steps of step1, extracting a group of image frame set in a video shot, extracting an HSV histogram characteristic of each frame of image and a canny edge contour characteristic, and weighting and forming characteristic information of key frame clustering; step2, using an adaptive mean value clustering method to successively classify each frame of image to a corresponding clustering cluster and updating a clustering center of each clustering cluster in real time; step3, extracting an image frame which is nearest to each clustering center as a key frame of each cluster respectively, and arranging according to a time sequence so as to form a key frame set; and step4, calculating an attention index of each key frame and extracting one frame with a highest attention index as a representative frame of a video. By using the method of the invention, problems that flexibility of a traditional key frame extraction algorithm is not high and a fidelity is low are solved.

Description

technical field [0001] The invention belongs to the field of video content analysis, and in particular relates to a video key frame extraction method based on multi-feature fusion shot clustering. Background technique [0002] With the development of computer, communication and multimedia technology, the data volume of multimedia video data is growing in a blowout style. At the same time, traditional video analysis methods cannot adapt to the continuous growth of data volume and the increasingly complex structure of video data. In the structured analysis of video data, it is first necessary to decompose the complete video segment into different shot units. However, a shot still contains a lot of data content, and the inter-frame redundancy within the shot is still relatively large. The calculation amount and calculation repetition rate of directly analyzing the video shot unit will still be relatively high. Extract representative keyframe sequences from content information....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/48G06K9/62
CPCG06V20/46G06V10/507G06V10/46G06V10/56G06F18/2321G06F18/253
Inventor 张登银孙彬
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products