A method for joint training based on multi-party 3D printing database
A 3D printing and database technology, applied in electrical digital data processing, instruments, design optimization/simulation, etc., can solve problems such as application and development limitations, and achieve the effects of easy convergence, good practicability, and reduced number of rounds
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0034] A method for joint training based on a multi-party 3D printing database, comprising a plurality of training members and a server, wherein the models of the training members are: Wi , the data for each training member is Xi , , labeled as y i ; the model of the server is W , and the server's model W Model with trained members Wi The network structure is consistent; including the following steps:
[0035] Step S100: in the first j During training iterations, train members i read Xi one of batch The data bi , and make the model Wi forward propagation of , to get the predicted label , and then according to the actual label y i , calculate the model Wi The loss function of , and then use the back-propagation algorithm to get the gradient matrix G i ;
[0036] Step S200: train members i pair gradient matrix G i The elements in are sorted from large to small according to the absolute value, and the first m elements are selected to obtain the correspo...
Embodiment 2
[0040] This embodiment is optimized on the basis of Embodiment 1. Before the iterative training, model initialization is performed: the server pairs the model W Initialize and send the initialization results to all training members, W i Initialize, determine the gradient upload scale coefficient α, attenuation coefficient ρ, learning rate γ.
[0041] Further, in the step S200, the statistical model is obtained W i The total number of elements in the M , calculate the number of gradient elements to be uploaded this time .
[0042] The other parts of this embodiment are the same as those of Embodiment 1, and thus are not repeated here.
Embodiment 3
[0044] This embodiment is optimized on the basis of Embodiment 1 or 2, and the correlation calculation in step S300 is as follows:
[0045]
[0046] in:
[0047]
[0048] in: D KL for KL Divergence,
[0049] P represents the data quality of each training member,
[0050] Q Indicates the data quality of all samples of the server.
[0051] The other parts of this embodiment are the same as the above-mentioned Embodiment 1 or 2, and thus are not repeated here.
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com