Training method for improving robustness of multi-branch prediction single model in Internet of Things scene

A training method and multi-branch technology, applied in the computer field, can solve problems such as the inability to reflect the diversity of Internet of Things data, and achieve the effect of improving classification ability and robustness.

Inactive Publication Date: 2020-07-14
EAST CHINA NORMAL UNIV
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, conventional training methods can only effectively utilize the diversity of model structures, and cannot reflect the diversity of data brought about by the continuous expansion of the Internet of Things into training.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method for improving robustness of multi-branch prediction single model in Internet of Things scene
  • Training method for improving robustness of multi-branch prediction single model in Internet of Things scene
  • Training method for improving robustness of multi-branch prediction single model in Internet of Things scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0029] The multi-branch prediction single model is structurally shaped like figure 1 .

[0030] In such a structured model, L ED The loss function makes the branch direct non-maximum prediction vectors classified as much as possible during training, so as to realize the overall diversity improvement effect of this model, thereby improving the robustness and the defense ability against adversarial samples. The LED loss function formula is:

[0031] L ED = L BE +γ·H(P * )+μ·L Ds

[0032] Where LBE is cross entropy, H(P * ) is the Shannon entropy, L DS is the separation measure of the non-maximum prediction vector, γ and μ are hyperparameters, representing the influence ability of the two parts.

[0033] In conventional training, the pre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a training method for improving robustness of a multi-branch prediction single model in an Internet of Things scene, and the method comprises: segmenting training data under the structure of a cloud terminal, distributing the training data to terminals, forming an environment with data diversity, setting different optimization targets for each terminal, and improving the structural diversity. And each terminal updates the weight issued by the cloud by depending on the training data and the optimization target of the terminal, then the cloud recovers the weight of each terminal for aggregation, finally training is completed through multiple cycles, and the optimal weight of the multi-branch prediction single model is stored. According to the method, the structural diversity of the multi-branch prediction single model is successfully combined with the data diversity under the scene of the Internet of Things, so that the robustness of the multi-branch prediction single model is further improved, the classification capability of adversarial samples is improved, and the multi-branch prediction single model can safely and reliably complete a classification task.

Description

technical field [0001] The invention belongs to the field of computers and relates to a training method for a multi-branch prediction single model. In particular, it involves improving the robustness of single network models with high precision but difficult to correctly classify adversarial samples. The idea of ​​federated learning is used in it, which solves the problem that today's Internet of Things requires safe and reliable artificial intelligence in scenarios suitable for the Internet of Things. . Background technique [0002] In recent years, the number of Internet of Things has been increasing, and at the same time, it has been more closely integrated with deep learning, especially in image processing tasks. However, these high-precision image classifiers are vulnerable to adversarial examples. Adversarial examples are intentionally added micro-perturbations on clean images. These perturbations will not interfere with the judgment of the human eye, but can fool th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62
CPCG06F18/2148G06F18/24
Inventor 陈铭松韦璠邵明莉何积丰曹鹗张健宁夏珺
Owner EAST CHINA NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products