Continuous learning method of sequence recommendation model based on sample playback

A learning method and sample technology, applied in the direction of neural learning methods, biological neural network models, instruments, etc., can solve the problems of recommendation system recommendation effect discount, catastrophic forgetting, model easy to forget user preference mode, etc., to achieve broad application scenarios, The effect of filling research gaps

Pending Publication Date: 2021-11-02
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method makes it very easy for the model to forget the previously learned user preference patterns, leading to the occurrence of catastrophic forgetting problems
This will greatly reduce the recommendation effect of the recommendation system deployed in the continuous learning scenario

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Continuous learning method of sequence recommendation model based on sample playback
  • Continuous learning method of sequence recommendation model based on sample playback
  • Continuous learning method of sequence recommendation model based on sample playback

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0040] The technical solution of the present invention is mainly aimed at solving the problem of catastrophic forgetting, and proposes a continuous learning method based on a sequence recommendation model based on sample playback, using a sample selection strategy based on item category balance from historical data for a small number of representative examples The samples are sampled and stored, and the stored sample samples are pla...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a continuous learning method of a sequence recommendation model based on sample playback, which relates to the technical field of sequence recommendation, and comprises the following steps: 1, constructing a sequence recommendation model, and training the sequence recommendation model by using initial data; 2, sampling a small part of representative example samples based on a sample selection strategy of article category balance; 3, calculating and storing soft labels of the sampled example samples so as to participate in calculation of a distillation loss function part in next model updating; 4, providing an accurate recommendation service for a user by using the sequence recommendation model, and collecting new data obtained in a new period at the same time; and 5, updating parameters of the sequence recommendation model by using new data obtained in a new period and previously stored sampled examples The problem of disastrous forgetting faced by using a neural network sequence recommendation model in a continuous learning scene is effectively solved.

Description

technical field [0001] The invention relates to the technical field of sequence recommendation, in particular to a continuous learning method of a sequence recommendation model based on sample playback. Background technique [0002] In recent years, research on the algorithm design and practical application of sequential recommendation systems has attracted widespread attention in both academia and industry. With the introduction and use of deep learning technology, sequential recommendation algorithms based on deep learning have more powerful feature mining capabilities than traditional recommendation algorithms such as collaborative filtering and factorization machines, so they can effectively capture and utilize user interest preferences The trend of change, and then generate better recommendation results. [0003] Although existing neural network sequence recommendation models have achieved sufficient success, they are usually trained and tested offline using static dat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9535G06Q30/06G06N3/04G06N3/08
CPCG06F16/9535G06Q30/0631G06N3/04G06N3/08
Inventor 杨敏原发杰王李翰李成明姜青山
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products