Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Recommendation method based on self-attention mechanism

A recommendation method and attention technology, applied in the field of item recommendation, can solve the problems of negative impact of recommendation effect, impact on model learning effect, large change frequency of rating and evaluation, etc., to improve learning ability, accurate recommendation effect, and enrich representation ability. Effect

Active Publication Date: 2021-12-21
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The above research is mainly based on the recommendation based on the user’s historical information. The neural perception recommendation method proposed by Jin et al. does not consider the preference weight between the user and each item. All interactions use the same weight value, and the missing information may affect the model’s performance. learning result
At the same time, this method needs to additionally calculate the overall quality score of the store through user feedback, and the frequency of changes in the score and evaluation of the store will increase the training cost of the model
DeepCoNN uses two feature extraction modules. Each user needs to obtain the features of items and products from user reviews and product reviews through this module. The calculation cost is relatively large, and a large amount of text information learning may have a negative impact on the recommendation effect.
[0005] In fact, the position of the selected item in the user record can reflect the interest of the user at the corresponding time node. The above studies did not use the position information in the sequence, and ignored the degree of correlation between items in the historical information.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Recommendation method based on self-attention mechanism
  • Recommendation method based on self-attention mechanism
  • Recommendation method based on self-attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0050] like figure 1 As shown, the recommended method based on the self-focusing mechanism in this embodiment includes the following implementation steps:

[0051] A, training recommended model:

[0052] A1, collect user history interaction information and preprocessing, forming a training sample set, including steps A11-A14:

[0053] A11, get the user's history interactive record and convert to the user-project interactive matrix; where the items of the interactive matrix include user coding, project coding, and project categories; obtain the number of each user by conversion processing i ∈ {u 1 U 2 , ..., u N }, Number D of each item j ∈ {D 1 , D 2 , ..., D M }, And project D j Correspondence Where n is the number of users, m is the number of items, and T is the number of project categories.

[0054] A12, set 0 filled on the project category information;

[0055] A13, convert user coding, project coding, and project category to One-Hot encoding, and perform numerical compressio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of article recommendation, discloses a recommendation method based on a self-attention mechanism, and aims to improve the training efficiency of a recommendation model and the effect of personalized recommendation. The method comprises the following steps: firstly, collecting and preprocessing historical interaction information of a user to form a training sample set; designing a recommendation model, taking the training sample set as the input of the recommendation model, and adopting a square loss function as an optimization target to train the recommendation model; finally, calculating through the trained recommendation model to obtain the interaction probability of the user and to-be-recommended items, sorting the interaction probability according to the size, and generating a recommendation candidate set of the user.

Description

Technical field [0001] The present invention relates to the field of recommended items, particularly relates to a method based on self-recommended attention mechanisms. Background technique [0002] In the era of information explosion, the rapid growth of the number of goods, difficult for users to find what they are interested in a short time, how to use the user's history quickly and accurately generate personalized recommendations become a research hotspot. Recommendation algorithm to help users find content of interest, the current mainstream methods are: collaborative filtering recommendation algorithm based content recommendation algorithms, based on depth learning model recommendation algorithm. Among them, the recommendation algorithm depth learning model based on its ability to fit the generalization ability has become the most important method. [0003] In terms of recommendation algorithm based on deep learning model, Jin et al proposed a preference vector nerve percep...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q30/06G06F16/9536G06K9/62G06N3/04G06N3/08
CPCG06Q30/0631G06F16/9536G06N3/08G06N3/048G06F18/253Y02T10/40
Inventor 田玲闫科康昭惠孛罗光春张天舒曾翰林
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products