Adaptive intelligent generation method of picture-text video thumbnails based on query terms

A thumbnail and self-adaptive technology, applied in video data retrieval, video data browsing/visualization, special data processing applications, etc., can solve problems such as multi-storage space, fuzzy key frame definition, key frame selection, etc., to save time , increase browsing efficiency and reduce storage space

Active Publication Date: 2019-01-04
SUN YAT SEN UNIV
View PDF6 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The aforementioned technical shortcomings are that the design of the recognition module is complicated, and the definition of key frames is vague; key frames cannot be selected according to the wishes of end users, that is, there are discrepancies ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Adaptive intelligent generation method of picture-text video thumbnails based on query terms

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0037] figure 1 It is a flow chart of a method for adaptively and intelligently generating graphic-text video thumbnails based on query words in an embodiment of the present invention, such as figure 1 As shown, the method includes:

[0038] S1. Obtain a target video, perform extraction processing, and obtain audio and video information in the video;

[0039] S2. Perform structured processing on the audio and video information to obtain structured video data and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a self-adaptive intelligent generation method of picture-text video thumbnails based on query words. The method comprises the following steps: acquiring an object video, extracting the object video, and obtaining audio and video information in the video; performing structured processing on the audio and video information to obtain structured video data and structured audiodata; selecting the structured video data to obtain a key frame corresponding to the query keyword semantics, namely a visual element; extracting and processing the structured audio data to obtain text elements related to query keyword semantics; obtaining visual elements and text elements for dynamic composition processing, and obtaining picture-text video thumbnails; the thumbnails are obtained,the semantic text of the thumbnails is extracted, the global color matching monitoring process is carried out, and the target video thumbnails related to the semantics of the query keywords are obtained. The embodiment of the invention can intelligently generate video thumbnails according to query keywords according to a system, thereby saving human resources and having more purposefulness than the existing automatic generation technology of video thumbnails.

Description

technical field [0001] The invention relates to the technical fields of algorithm optimization and analysis, computer image processing and deep learning, in particular to a method for adaptively and intelligently generating graphic and video thumbnails based on query words. Background technique [0002] Video thumbnails play a vital role in how users find videos and evaluate content relevance. The selection of thumbnails is not only related to the magnitude of video transmission in social networks, but also seriously affects the instant gratification of online viewers' information acquisition. However, selecting the most suitable thumbnail from thousands of video frames is a time-consuming and skillful manual process. Although there are currently some methods that can automatically or semi-automatically extract thumbnails from videos, there are still great limitations in specific scenarios, such as when the user needs to specify a video thumbnail related to a certain topic ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/732G06F16/74G06F16/783
Inventor 李超林淑金周凡
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products