Federal learning-based sequence recommendation method and system

A recommendation method and federated technology, applied in integrated learning, instrumentation, computing, etc., can solve the problems of ignoring the personalization of the client-side model, affecting the performance of the global model, and extreme performance of the local model, so as to improve the personalized experience and avoid Homogenization problem, the effect of a wide range of applications

Active Publication Date: 2022-06-07
ZHEJIANG UNIV +1
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, policy-based methods learn to generate strategies to directly generate actions. This type of scheme focuses on continuous action spaces, and there is a non-negligible gap between discrete and continuous action spaces; value-based methods evaluate the Q value of all actions in a specific state. Select the action with the largest Q value, so when the action space is large, the algorithm efficiency will become very inefficient
[0004] In addition to considering the performance of recommendations, data privacy security and real-time performance are also important research directions. The existing classic general-purpose federated learning algorithm is FedAvg and its related variants. In this way, the model parameters or gradient information participating in the aggregation are involved in the aggregation. Most of them use the average or weighted average method. Such a simple aggregation method tends to ignore the personalization of the client-side model. More importantly, it may encounter some The potential threat of model attacks, that is, some local models perform extremely or poorly, such a simple average will affect the performance of the global model, especially in the field of sequence recommendation, which requires more intelligent and personalized selection modes and aggregation methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Federal learning-based sequence recommendation method and system
  • Federal learning-based sequence recommendation method and system
  • Federal learning-based sequence recommendation method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0025] The federated learning architecture proposed by the present invention is as follows: figure 1 As shown in the figure, serialization modeling is performed using reinforcement learning under the condition that user data and information are not available locally. During the process of communication between the local and the central server, the transmitted content is no longer the original data, but the model parameters of a certain proportion of the client. It solves the problem of data privacy protection and the low efficiency of centralized sampling, reduces the economic loss caused by cold start, and is of great significance for large-scale recommendation scenarios.

[0026] like figure 2 As shown, the sequence recommendation method based on federated learning mainly includes the following steps:

[0027] Step 1: The central server pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sequence recommendation method and system based on federal learning, and belongs to the field of personalized recommendation and the field of user privacy protection. According to the method, personal information and real-time and historical data of a user are stored locally, each client can perform state representation according to own historical data, an interaction relationship between the user and an article is captured, and a recommendation process is regarded as a serialized decision process based on deep reinforcement learning; according to the method, an attention mechanism is introduced into an aggregation algorithm of federated learning, correlation of feature information extracted by each client and data difference brought by individuation of each client are considered, a weight coefficient is formulated for each client, which is a fine-grained re-weighting means, the individuation degree of data is increased, and the robustness of the data is improved. According to the method, the recommendation accuracy is improved, the method is more suitable for the field of sequence recommendation, and personalized recommendation for the user is realized while personal data privacy is protected.

Description

technical field [0001] The present invention relates to the field of recommendation methods and user privacy protection, in particular to a method and system for sequence recommendation based on federated learning. Background technique [0002] With the continuous development of information technology, the information on the Internet has grown exponentially, and users cannot quickly find the information they want on the Internet, thus the personalized recommendation technology was born. At present, common recommendation methods assume that user preferences are a static process, that is, their preferences are basically unchanged from current historical data. Therefore, existing algorithms use technologies such as collaborative filtering, matrix factorization, and deep learning based on historical data. Modeling user preferences to independently predict the rating or ranking of each item to be recommended. Although this technical solution is highly interpretable, it can contin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9535G06N20/20
CPCG06F16/9535G06N20/20
Inventor 吴超陈玥李皓王永恒
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products