Deep learning model poisoning attack detection method and device based on mutual information

A deep learning and attack detection technology, applied in machine learning, computing models, character and pattern recognition, etc., can solve problems such as time-consuming, expensive, and poor detection of embedded attacks, and achieve good detection results and good applicability

Active Publication Date: 2021-08-31
ZHEJIANG UNIV OF TECH
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most existing testing techniques for autonomous driving rely on manual collection of test data for different driving conditions, which becomes unacceptably expensive as test scenarios increase
At the same time, the existing testing technologies are all based on the detection of poisoning attacks that are visible to triggers. The detection effect of feature embedding attacks that are not visible to triggers is very poor, and there are problems such as time-consuming and low efficiency in the detection process.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning model poisoning attack detection method and device based on mutual information
  • Deep learning model poisoning attack detection method and device based on mutual information
  • Deep learning model poisoning attack detection method and device based on mutual information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0053] Such as figure 1 As shown, a mutual information-based deep learning model poisoning attack detection method includes the following steps:

[0054] (1) Obtain the sample set and the deep learning model to be tested

[0055] (1.1) The sample set is an image data set, specifically including the MNIST data set, CIFAR10 data set and Driving data set, etc., respectively obtain some benign test set samples Data in various data sets test And save,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep learning model poisoning attack detection method based on mutual information. The method comprises the following steps: (1) obtaining a sample set and a to-be-detected deep learning model; (2) pre-training a deep learning model; (3) generating a poisoning model pool and a trigger sample pair; and (4) judging whether the deep learning model is poisoned or not by utilizing mutual information. The invention also discloses a deep learning model poisoning attack detection device based on mutual information, which is used for implementing the method. The method has good applicability, can effectively judge whether the model is poisoned or not and find out a poisoned target class, and can obtain a better detection effect.

Description

technical field [0001] The invention relates to the technical field of poisoning detection, in particular to a mutual information-based deep learning model poisoning attack detection method and device thereof. Background technique [0002] Deep learning has gradually become a research hotspot and mainstream development direction in the field of artificial intelligence. Deep learning is a computational model composed of multiple processing layers, and a machine learning technique that learns data representations with multiple levels of abstraction. Deep learning represents the main development direction of machine learning and artificial intelligence research, and has brought revolutionary progress to the fields of machine learning and computer vision. Artificial intelligence technology has made breakthroughs in the fields of computer vision and natural language processing, ushering in a new round of explosive development of artificial intelligence. Deep learning is key to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/55G06K9/62G06N20/00
CPCG06F21/55G06N20/00G06F18/2415G06F18/214
Inventor 陈晋音邹健飞熊晖
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products