Deep reinforcement learning interactive recommendation system and method based on knowledge enhancement

A reinforcement learning and recommendation system technology, applied in the recommendation field, can solve problems such as sparse user feedback, difficulty, and huge action space

Pending Publication Date: 2022-03-01
NORTHEASTERN UNIV
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing interactive recommendation methods based on reinforcement learning still have two limitations: (1) Most of the existing interactive recommendation methods use historical interaction records to learn strategies. However, due to the sparse user feedback and the huge action space, it is difficult to Efficiently learn the optimal recommendation strategy; (2) The existing methods based on reinforcement learning represent the state / action of each individual user in isolation, and have not considered the potential relationship between different users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep reinforcement learning interactive recommendation system and method based on knowledge enhancement
  • Deep reinforcement learning interactive recommendation system and method based on knowledge enhancement
  • Deep reinforcement learning interactive recommendation system and method based on knowledge enhancement

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0100] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0101] On the one hand, a deep reinforcement learning interactive recommendation system based on knowledge augmentation, such as figure 1 As shown, it includes data acquisition and cleaning module, environment simulator building module, knowledge graph building module, graph convolution module, user state representation module, policy network module and value network module.

[0102] The data collection and cleaning module is used to collect historical interaction records generated in the cleaning system. The historical interaction records include user information and interaction item information in the interaction records, and store the remaining data after data cleaning ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a deep reinforcement learning interactive recommendation system and method based on knowledge enhancement, and relates to the technical field of recommendation. The system comprises a data acquisition and cleaning module, an environment simulator construction module, a knowledge graph construction module, a graph convolution module, a user state representation module, a strategy network module and a value network module. According to the method, rich semantic information in a knowledge graph is combined, a graph convolutional network structure is utilized, embedded representation of adjacent entities is propagated recursively along high-order connectivity, a graph attention network thought is adopted, item representation is enhanced by utilizing the rich semantic information in the knowledge graph, and meanwhile, a user-item bipartite graph is fused, so that the method is more efficient and efficient. The potential relationship is fully mined from collective user behaviors, so that the dynamic preference of the user is accurately captured, and the optimal recommendation strategy is autonomously learned by using deep reinforcement learning, so that the recommendation accuracy is improved.

Description

technical field [0001] The invention relates to the technical field of recommendation, in particular to a deep reinforcement learning interactive recommendation system and method based on knowledge enhancement. Background technique [0002] With the rapid development of mobile applications such as Douyin, Pandora, and Instagram Feeds, existing recommendation systems are under enormous pressure to cope with the constant emergence of new users, changing user interests, and dynamic changes in the environment. However, traditional recommendation methods, such as content-based recommendation methods and matrix factorization-based recommendation methods, all assume that user interests are static, and learn user preferences for items from historical interaction data between users and items. . However, these methods often ignore the dynamic changes of user interests and environments. Furthermore, most of the existing recommender systems aim to maximize the immediate (short-term) r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9535G06F16/28G06N3/04G06N3/08
CPCG06F16/9535G06F16/288G06N3/08G06N3/045
Inventor 于亚新刘树越乔勇鹏王子腾夏子芳乔佳琪
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products