Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Audio-visual recommendation system and method based on bilinear perceptual graph neural network model

A neural network model and recommendation system technology, applied in the field of audio-visual recommendation systems, can solve the problems of low utilization of recommendation algorithms, low recommendation accuracy of recommendation methods, and ignoring feature interaction information.

Active Publication Date: 2022-05-10
COMMUNICATION UNIVERSITY OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above problems, the purpose of the present invention is to provide an audio-visual recommendation system based on a bilinear perceptual graph neural network model to solve the problem in the prior art that the recommendation algorithm based on a graph neural network is usually implemented using a GNN+linear collector Propagation and aggregation of neighbor information, that is, by superimposing the neighbor information of a node on its own information in a linear manner, and performing the above operations multiple times, although this method can extract the features of the graph data and capture the high-order features between features connectivity, but ignores the feature interaction information between two adjacent nodes; in addition, text data (such as IPTV movie program titles and program introductions, etc.) are generally not widely used in recommendation algorithms. As a result, the current recommendation system lacks the proportion of text-based information, and text-based data contains rich information and has a greater impact on user preferences when using it. Therefore, the current recommendation method has low recommendation accuracy and poor adaptability.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio-visual recommendation system and method based on bilinear perceptual graph neural network model
  • Audio-visual recommendation system and method based on bilinear perceptual graph neural network model
  • Audio-visual recommendation system and method based on bilinear perceptual graph neural network model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] At present, the recommendation algorithm based on the graph neural network usually uses the GNN+linear collector to realize the propagation and aggregation of neighbor information, that is, by superimposing the neighbor information of a node on its own information in a linear manner, and performing the above operation multiple times , although this method can extract the features of graph data and capture the high-order connectivity between features, it ignores the feature interaction information between two adjacent nodes; in addition, text data (such as IPTV movies Program titles and program introductions, etc.) are generally not widely used in recommendation algorithms, resulting in the current recommendation system lacking the proportion of program text, and text-type data contains rich information and has a greater impact on user preferences , so the current recommendation method has low recommendation accuracy and poor adaptability.

[0041] In view of the above p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides an audio-visual recommendation system and method based on a bilinear perceptual graph neural network model, which calculates the similarity between the obtained program vector and the pre-acquired user embedding vector through the similarity function; and then uses the predictive activation function (sigmoid activation function ) to limit the range of similarity to the preset interval, so that the value in the preset interval can be used as the possibility evaluation score of the user's audio-visual choice, and it is constructed as a personalized audio-visual recommendation model based on the knowledge map - a dual Linear knowledge-aware graph neural network model system; the system captures the second-order feature interaction information of neighbor nodes in the knowledge graph by adding a bilinear collector on the basis of the graph neural network, obtains the program knowledge vector, and expresses it through the program text The module obtains the program text vector, and then obtains the recommendation data based on the program knowledge vector and the program text vector. In this way, the accuracy of audio-visual recommendation is improved, the operation effect of audio-visual recommendation is improved, and user stickiness is improved.

Description

technical field [0001] The present invention relates to the technical field of media recommendation, and more specifically, to an audio-visual recommendation system based on a bilinear perceptual graph neural network model. Background technique [0002] With the development of the Internet and the advent of the era of information explosion, people have completed the transition from information scarcity to information overload. The emergence of personalized recommendation system relieves the pressure of information overload and helps users obtain information that is really helpful to them from massive amounts of data. Therefore, the knowledge map that can be used as auxiliary information can be introduced into the recommendation system to effectively alleviate the data sparsity and cold start problems suffered by the collaborative filtering algorithm and improve the recommendation effect. Therefore, graph neural network technology can be used to capture and learn from it. re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/435G06F16/48G06F16/36G06N3/04
CPCG06F16/435G06F16/48G06F16/367G06N3/045
Inventor 李传珍穆雨彤蔡娟娟刘昱辰张洋王晖
Owner COMMUNICATION UNIVERSITY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products