Recommendation model based on double-layer self-attention comment modeling

An attention and model technology, applied in the field of recommendation system, can solve problems such as context loss and variable-length phrase extraction, and achieve the effect of improving recommendation performance

Inactive Publication Date: 2020-04-24
EAST CHINA NORMAL UNIV
View PDF6 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This model uses the self-attention network to mine the user's emotions on different aspects of the item, and constructs a fine-grained user-item portrait; and solves the problem of variable-length phrase extraction, alleviating the problems of noise and context loss introduced by CNN's fixed window

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Recommendation model based on double-layer self-attention comment modeling
  • Recommendation model based on double-layer self-attention comment modeling
  • Recommendation model based on double-layer self-attention comment modeling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] Below in conjunction with accompanying drawing, the specific implementation method of the present invention is further explained, figure 1 It is the overall architecture diagram of the model, which is divided into three parts:

[0047] (1) User portrait module: extract the user's emotional polarity for each item feature from the user comment collection, and construct a user portrait;

[0048] (2) Item portrait module: extract the user's emotional polarity for each item feature from the item review collection, and construct an item portrait;

[0049] (3) Interaction module: Based on the feature vectors of user portraits and item portraits, use factorization machine (FM) to match and predict ratings.

[0050] figure 2 It is a hierarchical structure diagram of the model of the present invention. The following is a detailed description of the preprocessing flow in the present invention, the structure of the three modules, the experimentally verified data set and the model ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a recommendation model based on double-layer self-attention comment modeling. The model comprises a user portrait module, an article portrait module and an interaction module.The user portrait module and the article portrait module are the same in structure, firstly, related words spaced by any distance in sentences are flexibly combined by introducing self-attention in aphrase extraction layer, and article feature phrases and emotion phrases are formed; then article feature phrases are associated with emotion phrases by using self-attention in the phrase associationlayer to obtain emotion polarity of a user for each article feature for constructing a user-article portrait, and finally experimental verification is performed on the model on six data sets from Amazon 5-core. According to the method, the self-attention network is introduced into comment modeling of the recommendation system, the emotional polarity of the user to the'article features' is considered under the deep learning framework, the problems of noise and context loss caused by phrase extraction of the CNN are relieved, the user-article portrait is modeled in a fine-grained mode, and the recommendation performance is improved.

Description

technical field [0001] The invention belongs to the field of recommendation systems, in particular to a recommendation model based on double-layer self-attention comment modeling. Background technique [0002] In recommender systems, traditional collaborative filtering methods, which infer user and item behavior patterns from rating data, are still competitive techniques today. However, when encountering data sparsity and cold start problems, the performance of collaborative filtering methods has dropped significantly. Therefore, many researchers have tried to introduce review texts as a supplement, mining multiple elements in reviews to model user-item portraits. The seven common elements in reviews are "high-frequency words", "review topic", "sentiment for item features", "contextual sentiment", "contrastive sentiment" and "emotion", these elements have been obtained in the traditional machine learning era Deep research. [0003] However, existing deep learning methods o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9535G06F16/9536G06K9/62
CPCG06F16/9536G06F16/9535G06F18/214
Inventor 吴雯郭望施力业贺樑
Owner EAST CHINA NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products