Video key information extraction system aiming at user interest semantics

A technology of key information and user interests, applied in the field of graphics and image processing, can solve problems such as difficult semantic modeling, time-consuming, laborious, and fuzzy

Inactive Publication Date: 2018-03-09
BEIJING FORESTRY UNIVERSITY
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, videos on the Internet are usually randomly shot by non-professionals. The videos contain a lot of blur caused by jitter and intra-class transformations caused by complex shooting scenes. Direct semantic model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video key information extraction system aiming at user interest semantics
  • Video key information extraction system aiming at user interest semantics
  • Video key information extraction system aiming at user interest semantics

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] In order to better understand the present invention, some basic concepts are firstly explained.

[0062] Windowing: When processing a speech signal, it is impossible to measure and calculate an infinitely long signal, but to take a finite time segment for analysis. The method is to intercept a time segment from the signal, and then use the observed signal time segment to perform periodic extension processing to obtain a virtual infinitely long signal. After the wirelessly long signal is truncated, its spectrum is distorted, and the original concentrated energy is distorted. Dispersed into two wider frequency bands, this phenomenon is called spectrum energy leakage. In order to reduce the spectrum energy leakage, different truncation functions can be used to truncate the signal. The truncation function is called a window function, or window for short. Leakage is related to the side lobes on both sides of the window function spectrum. If the height of the two lobes tends...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a video key information extraction system aiming at user interest semantics. The system comprises an image acquisition module, a video preprocessing module, a joint team weight learning module and a key information extraction module. The method includes: taking interest description of different users on video as keywords to retrieve images on the Internet through the imageacquisition module; using the joint team weight learning module to retrieve the keywords which are different in description and related in semantics, and acquiring a target semantic model at the sametime; utilizing associated audio data of the video to assist pre-extraction of video clips probably containing key information; calculating whether each video clip contains the key information that users are interested in or not through the target semantic model. The system can perform semantic modeling on content that the users are interested in according to different concerns of the users so asto effectively guide personalized video key information extraction, and semantic knowledge acquired on the Internet can greatly reduce dependency of data on manual annotation.

Description

technical field [0001] The invention relates to a video key information extraction system aimed at user interest semantics, belonging to the field of graphics and image processing. Background technique [0002] Most of the traditional methods extract the highlights of the video based on the underlying features, ignoring the selection of the content that the user is interested in. Extracting video clips is a relatively subjective task. When the video content is complex or the duration is long, different users are interested in the content of the same video. For example, for a basketball game video, the content that users are interested in may be highlights such as slam dunks and three-pointers, or they may focus on technical actions such as players' ball-handling postures and court moves. The expectations for highlight extraction are different. [0003] In recent years, the research on extracting video highlights by using high-level semantics has gradually attracted the att...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/7834G06F16/7867G06F16/95
Inventor 王晗俞璜悦
Owner BEIJING FORESTRY UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products