Distributed Neural Network Layout to Prevent Model Imitation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional neural network configurations in image capturing devices with low computational power are vulnerable to imitation due to the transmission of computation results to servers, which can be intercepted and used to replicate the network configuration.
Innovation Solution
Distribute intermediate layers of the neural network across an image capturing apparatus and a server with higher computational power, ensuring the input and output layers are on the image capturing apparatus, and prevent data interception by transmitting and processing intermediate data within a secure communication network.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If intermediate layers and output layer are disposed on a server with high computational power, then processing time is reduced, but the neural network configuration becomes vulnerable to imitation due to data transmission
Solution Approach 1:
The neural network is segmented into multiple layers distributed across different devices. Specifically, the input layer and output layer are disposed on the image capturing apparatus, while intermediate layers are disposed on both the image capturing apparatus and the server. This segmentation allows processing to be distributed, reducing the processing time while preventing complete imitation of the neural network configuration since not all layers are accessible to any single device.
2Measurement precision
If more intermediate layers are added to the neural network, then reasoning accuracy is improved, but computational load increases and processing time increases
Solution Approach 1:
The intermediate layers are segmented and distributed between the image capturing apparatus and the server. The server, with its higher computational power, handles a portion of the intermediate layer processing, while the image capturing apparatus handles other portions. This distribution enables the system to maintain a large number of intermediate layers for high reasoning accuracy while reducing the processing time burden on any single device.
Solution Approach 2:
The system merges the computational resources of the image capturing apparatus and the server to handle the intermediate layer processing. By combining the processing capabilities of both devices, the system can process more intermediate layers in parallel, thereby maintaining high reasoning accuracy while reducing overall processing time.
Data Source
AI summary
An information processing system capable of preventing imitation of the configuration of a neural network. The information processing system includes an image capturing apparatus and a server that are communicable with each other. In the information processing system, an input layer, a plurality of intermediate layers, and an output layer form the neural network. The input layer and the output layer are disposed in one of the image capturing apparatus and the server. Further, the intermediate layers are disposed such that the intermediate layers are distributed between the first apparatus and the second apparatus.


