Differential Privacy Feature Processing for Vertical Federated Learning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In vertical Federated learning scenarios, data privacy issues hinder the integration of feature processing across different parties, as some parties lack sample labels necessary for feature evaluation indices like weight of evidence (WoE) and information value (IV) calculations, which are crucial for feature selection and coding.
Innovation Solution
A differential privacy-based method and apparatus that enable feature transformation processing by encrypting binary classification labels and adding noise, allowing parties to calculate noise addition indices without compromising data privacy, using mechanisms like homomorphic encryption and Gaussian noise to ensure secure data handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is centrally integrated to enable feature processing across parties, then feature selection and coding capability is improved, but data privacy security deteriorates
Solution Approach 1:
The patent introduces differential privacy as an intermediary mechanism between data holders and data users. Instead of direct data access, the system uses noisy aggregated statistics from multiple parties to perform feature processing. This mediator layer enables collaborative feature selection and coding while preventing any single party from exposing their raw data, thus resolving the contradiction between processing capability and privacy security.
Solution Approach 2:
The patent segments the feature processing task into separate contributions from different parties. Each party independently computes local statistics on their data segments, and these segmented results are aggregated through secure multiparty computation. This segmentation allows feature processing to proceed across parties without requiring centralization of raw data, maintaining both productivity and privacy.
2Measurement precision
If sample labels are shared to enable WoE and IV calculations, then feature evaluation accuracy is improved, but data privacy loss increases
Solution Approach 1:
The patent creates encrypted copies of label information that can be used for WoE and IV calculations without exposing the actual labels. Through homomorphic encryption and differential privacy, the system generates computational copies that preserve the statistical properties needed for accurate feature evaluation while being mathematically impossible to reverse to the original sensitive data, thus maintaining measurement precision without privacy loss.
Solution Approach 2:
The patent transforms the label data from its original sensitive form into differential privacy-protected statistical parameters. Instead of sharing raw labels, parties share noisy aggregated counts and statistics that are sufficient for calculating WoE and IV indices. This parameter transformation maintains the accuracy needed for feature evaluation while fundamentally changing the data representation to eliminate privacy risks.
3Reliability
If differential privacy noise is added to protect privacy, then data security is improved, but calculation precision deteriorates
Solution Approach 1:
The patent applies differential privacy noise at the appropriate granularity level - adding noise to aggregated statistics rather than individual records. This partial application of noise provides sufficient privacy protection for the security requirement while minimizing the impact on calculation precision. The noise level is calibrated to be excessive only where needed for privacy, not excessively applied throughout the entire computation.
Solution Approach 2:
The patent预先 cushions the impact of noise on precision by using robust statistical methods in the WoE and IV calculations. The feature evaluation algorithms are designed to be resilient to differential privacy noise, and the system pre-calculates multiple noisy estimates that can be aggregated to reduce variance. This beforehand cushioning ensures that while individual noisy measurements have reduced precision, the final feature indices maintain sufficient accuracy for practical use.
Data Source
AI summary
Embodiments of this specification provide a differential privacy-based feature processing method and apparatus. The method relates to a first party and a second party, the first party stores a first feature portion of a plurality of samples, the second party stores a plurality of binary classification labels corresponding to the plurality of samples, and the method includes: The second party separately encrypts the plurality of binary classification labels corresponding to the plurality of samples, to obtain a plurality of encrypted labels. The first party determines, based on the plurality of encrypted labels and a differential privacy noise, a positive sample encrypted noise addition quantity and a negative sample encrypted noise addition quantity corresponding to each bin in a plurality of bins. The plurality of bins are obtained by performing binning processing on the plurality of samples for a feature in the first feature portion. The second party decrypts the positive sample encrypted noise addition quantity and the negative sample encrypted noise addition quantity, to obtain a positive sample noise addition quantity and a negative sample noise addition quantity, so as to determine a noise addition index of a corresponding bin.


