Neural Network Topology Reconfiguration Against Backdoor Attacks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing artificial neural networks are vulnerable to adversarial cyber attacks, particularly backdoor attacks, which degrade performance and integrity, and current pruning techniques to enhance robustness reduce accuracy.
Innovation Solution
Reconfigure the neural network topology by pruning dormant neurons and links susceptible to attacks and implementing a scale-free topology through additional link connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pruning techniques are applied to remove dormant neurons and links, then robustness against cyber attacks is improved, but accuracy of data learning deteriorates
Solution Approach 1:
The patent extracts and removes only the dormant neurons and links that are susceptible to cyber attacks, rather than removing random or excessive connections. This selective extraction approach eliminates vulnerable components while preserving the functional integrity and learning accuracy of the neural network.
Solution Approach 2:
The patent identifies and removes vulnerable neurons and links before the neural network is deployed or before cyber attacks occur. This preliminary action prevents potential attack vectors from being established, thereby improving robustness without requiring post-attack repairs or accuracy compromises.
2Reliability
If additional link connections are implemented to achieve scale-free topology, then robustness against cyber attacks is improved, but device complexity increases
Solution Approach 1:
The patent implements a scale-free topology where neurons have asymmetric connection degrees following a power-law distribution. Some neurons have many connections (hubs) while others have few, creating an asymmetric structure that is robust against random failures and targeted attacks on individual nodes, while avoiding uniform complexity across all connections.
Solution Approach 2:
The patent changes the connectivity parameter distribution from random or regular patterns to a scale-free power-law distribution. This parameter change optimizes the balance between robustness and complexity by concentrating connections on critical neurons while maintaining sparsity elsewhere, thereby improving attack resistance without proportionally increasing overall complexity.
Data Source
AI summary
The present invention relates to device and method for reconfiguring artificial neural network topology robust against cyber attacks. According to one embodiment of the present invention, the device comprising an input layer, a plurality of hidden layers, and an output layer, may include: a pruning unit configured to determine at least one target neuron for pruning from the plurality of hidden layers and remove links connecting the determined target neuron and neurons associated with the determined target neuron, and a link reconfiguration unit configured to implement additional link connections among neurons constituting the input layer, the plurality of hidden layers, and the output layer to reinforce the connections removed by the pruning and reconfigure the artificial neural network topology into a scale-free structure.


