Homomorphic Feature Classification for Confidential Nearest-Neighbor Search
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing facial recognition systems like FaceNet lack confidentiality guarantees for both input data and classification results, and computationally complex solutions for confidential data classification are not suitable for non-confidential data.
Innovation Solution
A method using homomorphic encryption to perform confidential data classification by encrypting discriminant feature vectors and performing nearest neighbor searches in the homomorphic domain, allowing classification to be conducted without revealing sensitive information to the platform.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If homomorphic encryption is used to ensure confidentiality of classification results, then confidentiality is improved, but computational complexity increases
Solution Approach 1:
The system segments the classification task into two parts: a complex deep neural network embedding module that runs locally on the user's device to extract feature vectors, and a simpler classification module that runs on the server using homomorphic encryption. This segmentation allows the computationally intensive part to be performed locally without encryption overhead, while the server only handles lighter encrypted operations.
Solution Approach 2:
The embedding model is trained and fixed in advance during an offline phase. The complex neural network weights are predetermined and stored, so during online classification, only the simpler nearest-neighbor search needs to be performed on encrypted data, significantly reducing the computational complexity of encrypted operations.
2Reliability
If noise-making techniques are applied to reference data to ensure confidentiality, then confidentiality is improved, but facial recognition performance degrades
Solution Approach 1:
Homomorphic encryption acts as an intermediary mechanism that enables confidential computation without degrading performance. Instead of adding noise to reference data, the system uses cryptographic primitives to protect the classification results while maintaining the integrity and accuracy of the original data for recognition purposes.
Solution Approach 2:
The patent replaces the mechanical approach of noise-making (which directly interferes with data quality) with a cryptographic approach (homomorphic encryption) that protects confidentiality through mathematical transformations without affecting the underlying data quality or recognition performance.
3Measurement precision
If complete retraining is performed to recognize new faces, then recognition accuracy is improved, but system maintainability worsens
Solution Approach 1:
The recognition system is divided into a fixed embedding module (trained once offline) and a flexible classification module (can be updated online). When new faces need to be recognized, only the simple classification module needs to be updated with new reference vectors, rather than retraining the entire complex neural network, thus improving system maintainability.
Solution Approach 2:
The complex feature extraction capabilities are prepared in advance through offline training of the embedding model. This preliminary action creates a robust foundation that can accommodate new classification tasks by simply adding new reference vectors to the classification module, avoiding the need for complete retraining.
4Reliability
If homomorphic encryption is used for confidential data classification, then confidentiality of non-confidential data is improved, but computational complexity increases
Solution Approach 1:
The system segments operations into local encrypted feature extraction (using pre-trained embedding models) and server-side encrypted classification. The embedding models are optimized to work efficiently with encrypted inputs, and the server performs only simple distance calculations in the encrypted domain, maintaining good classification efficiency.
Solution Approach 2:
The system changes the parameter space by projecting high-dimensional encrypted input data into a lower-dimensional embedding space using pre-trained models. This dimensionality reduction maintains the essential features needed for classification while reducing the computational burden of subsequent encrypted operations, thus improving efficiency.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention relates to a computer platform (100) and a method for confidential classification of data. The computer platform comprises an artificial neural network (110) as well as a classifier (130). The artificial neural network is capable, after a learning phase, of transforming an input data vector into a discriminating feature vector having a smaller dimension. A user then generates, from a plurality of reference data vectors, the same plurality of reference feature vectors, which are encrypted in an encryption module (140) by the user using the public key of a homomorphic cryptosystem and stored in a reference database (120) of the platform. When the user subsequently requests the classification of an input data vector, the artificial neural network, or a copy thereof, provides the classifier (130) with a corresponding discriminating feature vector (y). The distances from said vector to the different reference feature vectors of the reference database are calculated in the homomorphic domain and the index of the reference feature vector closest to y, i.e. the identifier i 0 of the class to which it belongs, is returned to the user.