Black-Box Adversarial Attacks via Markov Random Field Covariance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing black-box adversarial attack methods are inefficient in generating perturbations that can effectively misclassify deep neural network classifiers with limited query access, as they assume independent gradient terms, whereas gradients are often correlated, and require multiple steps or gradient estimation.

Innovation Solution

The method employs Markov random field parameters for covariance modeling of gradient correlations, using black-box gradient estimation and Fourier basis vectors to generate perturbations in a single step, leveraging the Fast Gradient Sign Method with a pre-specified L∞ perturbation bound, to create adversarial inputs that maximize loss and misclassify the classifier.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing black-box adversarial attack methods are used, then attack capability is achieved, but query efficiency is low and multiple steps are required

Engineering Contradiction:
Improvequery efficiencyVSAvoidnumber of steps required
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent performs preliminary action by pre-estimating the gradient covariance matrix using a small subset of training data before the actual adversarial attack. This pre-computed covariance information is then reused during the attack phase, eliminating the need for repeated gradient estimations in each attack step. The covariance estimation is done once beforehand, and the resulting matrix guides the entire attack process, thereby reducing both query efficiency loss and time consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies beforehand cushioning by pre-computing and storing the gradient covariance matrix as a form of preparatory information that cushions against the need for repeated expensive operations. This pre-computed statistical information acts as a buffer that enables efficient attack generation without requiring real-time gradient computations, thus cushioning the system against query inefficiency and time loss.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Measurement precision

If gradient terms are assumed independent, then computation is simplified, but attack accuracy decreases due to ignoring gradient correlations

Engineering Contradiction:
Improveattack accuracyVSAvoidcomputation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by transforming the gradient estimation problem into a covariance matrix estimation problem. Instead of estimating full gradient vectors which are high-dimensional and complex, the method estimates the covariance matrix parameters that capture gradient correlations. This parameter transformation reduces the computational burden while preserving the essential correlation information, thereby improving attack accuracy without proportionally increasing computation complexity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies local quality by focusing computational resources on estimating only the relevant covariance structure rather than full gradient information. The method selectively captures the correlation patterns that are most important for adversarial attack generation, rather than uniformly processing all gradient dimensions. This localized approach to quality estimation improves accuracy where it matters most while controlling overall computational complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11455515B2Efficient black box adversarial attacks exploiting input data structure
Publication Date: 2022.09.27 ROBERT BOSCH GMBH
  • US11455515B2 patent drawing
  • US11455515B2 patent drawing

AI summary

Markov random field parameters are identified to use for covariance modeling of correlation between gradient terms of a loss function of the classifier. A subset of images are sampled, from a dataset of images, according to a normal distribution to estimate the gradient terms. Black-box gradient estimation is used to infer values of the parameters of the Markov random field according to the sampling. Fourier basis vectors are generated from the inferred values. An original image is perturbed using the Fourier basis vectors to obtain loss function values. An estimate of a gradient is obtained from the loss function values. An image perturbation is created using the estimated gradient. The image perturbation is added to an original input to generate a candidate adversarial input that maximizes loss in identifying the image by the classifier. The neural network classifier is queried to determine a classifier prediction for the candidate adversarial input.