Adversarial Image Noise Generation via Feature Importance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current adversarial attack methods for image recognition models are inefficient, requiring significant time and resulting in unstable attack effects due to the complexity of deep learning models and the difficulty in optimizing deep neural networks, which leads to poor timeliness and effectiveness in generating high-quality adversarial examples.

Innovation Solution

The proposed solution utilizes a deep residual network (ResNet) and a generative adversarial network to generate adversarial examples by obtaining feature maps through feature encoding and decoding, incorporating noise information and relative importance values to create a noise image that is superimposed on the original image, thereby generating a high-quality adversarial example that can deceive image recognition models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If deep learning methods are used to build image recognition models, then the model can perform image recognition tasks, but the complexity of deep learning models makes adversarial attacks time-consuming and unstable

Engineering Contradiction:
Improveimage recognition abilityVSAvoidattack generation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent introduces an intermediary mechanism (feature map processing and noise generation module) between the original image and the adversarial attack. Instead of directly attacking the complex deep learning model, the method extracts feature maps, generates noise based on feature importance, and superimposes it on the original image. This intermediary approach simplifies the attack process while maintaining effectiveness against deep learning models.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameters of the attack by using feature importance weights to modulate noise intensity at different spatial locations. Instead of uniform noise addition, the method dynamically adjusts noise parameters based on the extracted feature maps, making the attack more efficient and targeted while reducing the time required compared to traditional brute-force adversarial attack methods.

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If traditional adversarial attack methods are used, then noise can be added to images, but the attack effect is unstable and requires significant optimization time

Engineering Contradiction:
Improveadversarial attack effectVSAvoidoptimization time
Core Design Contradiction:
Object-affected harmful factorsVSDuration of action of moving object

Solution Approach 1:

The patent performs preliminary action by extracting feature maps and calculating feature importance weights before generating the adversarial noise. This pre-processing step identifies which regions of the image are most critical for model recognition, allowing the noise generation to be targeted and efficient from the start, eliminating the need for lengthy iterative optimization processes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies local quality by using spatially varying noise intensity based on feature importance. Different regions of the image receive different amounts of noise depending on their importance to the model's recognition task. This localized approach concentrates the adversarial effect on critical regions, improving attack stability while reducing the overall time required compared to uniform noise addition methods.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If noise is added to deceive image recognition models, then high-quality adversarial examples can be generated, but the process is complex and time-consuming

Engineering Contradiction:
Improveadversarial example qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the adversarial example generation process into distinct modules: feature map extraction, feature importance calculation, noise generation, and noise superposition. This segmentation allows each module to be processed independently and efficiently, reducing overall processing complexity while maintaining high adversarial example quality through specialized handling of each task.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230094206A1Image processing method and apparatus, device, and storage medium
Publication Date: 2023.03.30 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US20230094206A1 patent drawing
  • US20230094206A1 patent drawing
  • US20230094206A1 patent drawing

AI summary

An image processing method and apparatus, a device, and a non-transitory computer-readable storage medium are provided. In the method, a first feature map is obtained based on feature-encoding of an original image. A second feature map of the original image is obtained based on the first feature map. The second feature map includes noise information to be superimposed on the original image. A third feature map of the original image is obtained based on the first feature map. The third feature map includes different feature values. Each feature value represents a relative importance of an image feature at a position corresponding to the respective feature value. A noise image is generated based on the second feature map and the third feature map. The original image and the noise image are superimposed, to obtain a first adversarial example image