Keyword-based video abstract generation method

A technology of video summarization and keywords, applied in the field of artificial intelligence and computer vision, can solve the problems of lack of representation, users are not intuitive enough, and cannot understand the video content at a glance, so as to reduce the time of manual operation.

Pending Publication Date: 2019-11-12
SUN YAT SEN UNIV
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0017] 1. Firstly, the summary generated is displayed in the cut form of the video, which is not intuitive enough for users to understand the content of the video at a glance
[0018] 2. This kind of customized video summary is often static, which ignores the part that the user really wants to know
[0019] 3. The video summary automatically generated by the system is too random and not representative

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Keyword-based video abstract generation method
  • Keyword-based video abstract generation method
  • Keyword-based video abstract generation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0034] figure 1 It is the overall flow chart of the method for generating video summaries in the embodiment of the present invention, such as figure 1 As shown, the method includes:

[0035] S1, performing visual channel preprocessing on the video to obtain preliminary segmentation shots;

[0036] S2, using the segmented lens to segment the video scene and cluster the video frames;

[0037] S3, using the clustered video frames to perform keyword-based visual c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a keyword-based video abstract generation method, which comprises the following steps of: performing visual channel processing on a video, and performing keyword-based visual content abstract extraction to obtain an image abstract; preprocessing the video voice text content, and performing keyword-based voice text content abstract extraction to obtain a text abstract; and obtaining a final image-text abstract by utilizing the image abstract and the text abstract. The invention provides the method for automatically generating the video abstract, so that the manual operation time of a video uploader is greatly reduced; the requirements of a video search user are fully considered, and a video abstract which is more suitable for the search intention of the user is provided for the user; by using the method based on the artificial intelligence deep learning technology, the generated video abstract can reflect the content of the video more accurately.

Description

technical field [0001] The invention relates to the fields of artificial intelligence and computer vision, in particular to a keyword-based method for generating video summaries. Background technique [0002] Video summarization technology has been proposed since the 1990s. As a research hotspot and difficulty, it has received continuous attention from many research teams at home and abroad. Theoretically, video is an image set obtained by combining a series of video frames according to event sequence or spatial distribution rules, which can express semantic information from multiple angles. However, video summarization should not only analyze the original video stream, but also comprehensively consider multimedia information such as meaningful audio streams and text streams accompanying the video. [0003] Video summarization refers to the use of computer technology to analyze the video structure, understand the video content, and select representative and meaningful parts...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/738G06K9/00G06K9/62G06F17/27G10L15/26
CPCG06F16/739G10L15/26G06V20/49G06V20/40G06F18/23213G06F18/2411
Inventor 黄煜博王若梅林淑金周凡林格
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap