ML Inference Obfuscation for Side-Channel Parameter Protection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing machine learning models, particularly neural networks, are vulnerable to side channel attacks that can decode their parameters when deployed on hardware devices, compromising security-sensitive applications like face unlock tasks.
Innovation Solution
A special hardware device performs obfuscating operations concurrently with inference operations, altering measurable characteristics such as power consumption, electromagnetic waves, or time profiles to obscure neural network parameters, making them difficult to decipher.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If neural network parameters are kept confidential to prevent side channel attacks, then security is improved, but the hardware device becomes less transparent and harder to verify
Solution Approach 1:
The patent introduces a random number generator as an intermediary component that generates random values to mask the actual neural network operations. This random number generator acts as a mediator between the input data and the neural network processing, inserting randomness into the computational path without requiring fundamental changes to the hardware architecture. The random values are combined with actual data during processing, making it difficult for attackers to correlate power consumption or electromagnetic emissions with specific neural network operations, thereby preventing side channel attacks while maintaining hardware feasibility.
2Reliability
If obfuscating operations are performed concurrently with inference operations, then security against side channel attacks is improved, but computational overhead and processing time increase
Solution Approach 1:
The patent merges the obfuscating operations with the inference operations by integrating the random number generation and masking processes into the existing neural network computation pipeline. Instead of performing separate obfuscating operations that would double the computational workload, the random values are generated and combined concurrently with the actual inference computations. This merging approach allows the security-enhancing operations to share computational resources and processing time with the inference operations, reducing the overall computational overhead while maintaining security.
3Reliability
If random values are combined with actual data during neural network operations, then side channel attacks are prevented, but measurement precision of power consumption and electromagnetic emissions is reduced
Solution Approach 1:
The patent changes the parameters of the neural network operations by introducing random values that alter the power consumption and electromagnetic emission characteristics during computation. By varying the data values with random noise, the physical side channels (power consumption, electromagnetic emissions) that attackers monitor are no longer directly correlated with the actual neural network operations. This parameter change effectively masks the true computational patterns, making side channel measurements inaccurate for attack purposes while preserving the functional correctness of the neural network output.
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing inference operations of a machine learning model. One of the methods includes receiving, by a hardware device, data representing a machine learning model comprising a plurality of model parameters for inference operations. The hardware device comprises a set of computation units arranged in one or more processing elements. Instructions are obtained for performing obfuscating operations configured to obfuscate one or more measurable characteristics of the machine learning model, when the machine learning model is executed by the one or more processing elements. A first portion of the set of computation units is caused to perform the inference operations of the machine learning model, and a second portion of the set of computation units is caused to perform the obfuscating operations concurrently with the first portion of the set of computation units performing the inference operations.


