A short video recommendation method based on video content understanding and user dynamic interest

A technology of video content and recommendation method, which is applied in the field of online video, can solve the problems of difficult use of video information, sparse user feedback data, and non-exploration of video content, etc., and achieve the effect of accurate personalized recommendation, increased stickiness, and improved experience

Active Publication Date: 2019-06-11
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF7 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Currently, methods for video recommendation only consider the user's preference for video history behavior, but do not explore video content
Compared with the personalized recommendation of ordinary resources, the personalized recommendation of mobile short video has the problem that unstructured video information is difficu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A short video recommendation method based on video content understanding and user dynamic interest
  • A short video recommendation method based on video content understanding and user dynamic interest
  • A short video recommendation method based on video content understanding and user dynamic interest

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0029] Such as figure 1 As shown, the short video recommendation method based on video content understanding and user dynamic interests described in the present invention specifically includes the following steps:

[0030] (1) Use deep learning technology to extract multimodal features of short videos, including visual features and auditory features, to represent short video content;

[0031] There are many defects in traditional image features, such as poor robustness and inaccurate representation. With the development of deep learning technology, image feature extraction with more representational and abstract capabilities becomes possible.

[0032] Since the time limit of short videos is between 6 seconds and 300 seconds, short videos are usually edited and spliced ​​by smaller micro-lenses. Each frame of a short video t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a short video recommendation method based on video content understanding and user dynamic interest, and the method comprises the steps of firstly, extracting deep visual features of a video through a deep learning technology, extracting an audio file from the video, and extracting auditory features; fusing the video features, the social features and the user features by using PCA dimension reduction, data standardization and other technologies to obtain deep fusion features for feature representation of historical behaviors of the user; secondly, extracting the influence of historical behaviors on the current interest by using a self-attention mechanism, and learning an interest evolution path on the candidate video by using a recurrent neural network to obtain accurate dynamic interest of the user; and finally, utilizing a multilayer perceptron to carry out click probability prediction and recommendation on the video candidate set. The method is applied to thepersonalized recommendation of the short video, and the recommendation accuracy can be effectively improved by adopting the technical scheme of the invention.

Description

technical field [0001] The invention belongs to the technical field of network video, and in particular relates to a short video recommendation method based on video content understanding and user dynamic interest. Background technique [0002] With the popularity of mobile terminals and the speed up of the Internet, short, flat and fast videos are favored by major platforms and users, and short video platforms are gradually rising, followed by problems of information overload and personalized needs. Massive video is a huge challenge for video consumers and video producers. For video consumers, it is difficult to find the videos that users are really interested in from a large number of videos; for video providers, it is difficult to distribute videos to appropriate users. Due to these urgent needs, the personalized recommendation of mobile short videos has become a hot research topic. [0003] The methods applied to personalized recommendation include content-based recomm...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/44H04N21/45H04N21/466
Inventor 金莹莹许娟何鑫
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap