Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for data processing based on federated learning, equipment and medium

A data processing and federation technology, applied in the field of artificial intelligence, can solve the problems of training efficiency and low accuracy

Pending Publication Date: 2020-05-19
CHINA PING AN LIFE INSURANCE CO LTD
View PDF0 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a data processing method, device, device, and medium based on federated learning to solve the problem of low training efficiency and accuracy when using data provided by multiple data parties to train models.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for data processing based on federated learning, equipment and medium
  • Method and device for data processing based on federated learning, equipment and medium
  • Method and device for data processing based on federated learning, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0031] The federated learning-based data processing method provided by the embodiment of the present invention can be applied to terminal devices configured by financial institutions such as banks, securities, insurance, or other institutions, and is used to quickly train each The institution's own model can effectively ensure the stability of the training process, and at the same time fully reflect the quality and characteristics of the data of each da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a device for data processing based on federated learning, equipment and a medium. The method comprises the following steps executed by a first terminal: determining user feature data shared by a first terminal and a second terminal; performing feature coding processing on the user feature data to obtain to-be-processed feature data; obtaining a model predictionvalue obtained by processing based on the to-be-processed feature data; obtaining a loss value obtained by processing the training label data and the model prediction value by adopting a predefined loss function; sending the external loss value to the second terminal in an encryption mode if the loss value is the external loss value; and determining a target gradient based on the internal loss value and a current model parameter corresponding to the first to-be-trained model if the loss value is an internal loss value, and performing model optimization on the first to-be-trained model according to the target gradient to obtain a target prediction model. The data processing method based on federated learning can effectively improve the model training efficiency and accuracy.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a data processing method, device, equipment and medium based on federated learning. Background technique [0002] With the widespread application of artificial intelligence technology, various machine learning methods have emerged. At present, in order to solve the data island and realize the interaction of information and the learning of models under the premise of not providing sensitive data to the outside world, a new learning method - federated learning is proposed. Federated Learning (Federated Learning) is an emerging basic technology of artificial intelligence. Its design goal is to ensure information security during big data exchange and ensure compliance with laws and regulations. Efficient machine learning. [0003] At present, when some financial institutions are training the model, because the user data of the financial institution itself ca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08G06F21/60
CPCG06N3/08G06F21/606G06F21/602Y02T10/40
Inventor 董厶溢
Owner CHINA PING AN LIFE INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products