Differential Privacy Feature Processing for Vertical Federated Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In vertical Federated learning scenarios, data privacy issues hinder the integration of feature processing across different parties, as some parties lack sample labels necessary for feature evaluation indices like weight of evidence (WoE) and information value (IV) calculations, which are crucial for feature selection and coding.

Innovation Solution

A differential privacy-based method and apparatus that enable feature transformation processing by encrypting binary classification labels and adding noise, allowing parties to calculate noise addition indices without compromising data privacy, using mechanisms like homomorphic encryption and Gaussian noise to ensure secure data handling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is centrally integrated to enable feature processing across parties, then feature selection and coding capability is improved, but data privacy security deteriorates

Engineering Contradiction:
Improvefeature processing capabilityVSAvoiddata privacy risk
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces differential privacy as an intermediary mechanism between data holders and data users. Instead of direct data access, the system uses noisy aggregated statistics from multiple parties to perform feature processing. This mediator layer enables collaborative feature selection and coding while preventing any single party from exposing their raw data, thus resolving the contradiction between processing capability and privacy security.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the feature processing task into separate contributions from different parties. Each party independently computes local statistics on their data segments, and these segmented results are aggregated through secure multiparty computation. This segmentation allows feature processing to proceed across parties without requiring centralization of raw data, maintaining both productivity and privacy.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If sample labels are shared to enable WoE and IV calculations, then feature evaluation accuracy is improved, but data privacy loss increases

Engineering Contradiction:
Improvefeature evaluation accuracyVSAvoiddata privacy
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent creates encrypted copies of label information that can be used for WoE and IV calculations without exposing the actual labels. Through homomorphic encryption and differential privacy, the system generates computational copies that preserve the statistical properties needed for accurate feature evaluation while being mathematically impossible to reverse to the original sensitive data, thus maintaining measurement precision without privacy loss.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the label data from its original sensitive form into differential privacy-protected statistical parameters. Instead of sharing raw labels, parties share noisy aggregated counts and statistics that are sufficient for calculating WoE and IV indices. This parameter transformation maintains the accuracy needed for feature evaluation while fundamentally changing the data representation to eliminate privacy risks.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If differential privacy noise is added to protect privacy, then data security is improved, but calculation precision deteriorates

Engineering Contradiction:
Improvedata securityVSAvoidfeature index calculation accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies differential privacy noise at the appropriate granularity level - adding noise to aggregated statistics rather than individual records. This partial application of noise provides sufficient privacy protection for the security requirement while minimizing the impact on calculation precision. The noise level is calibrated to be excessive only where needed for privacy, not excessively applied throughout the entire computation.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent预先 cushions the impact of noise on precision by using robust statistical methods in the WoE and IV calculations. The feature evaluation algorithms are designed to be resilient to differential privacy noise, and the system pre-calculates multiple noisy estimates that can be aggregated to reduce variance. This beforehand cushioning ensures that while individual noisy measurements have reduced precision, the final feature indices maintain sufficient accuracy for practical use.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS20240152643A1Differential privacy-based feature processing method and apparatus
Publication Date: 2024.05.09 ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
  • US20240152643A1 patent drawing
  • US20240152643A1 patent drawing
  • US20240152643A1 patent drawing

AI summary

Embodiments of this specification provide a differential privacy-based feature processing method and apparatus. The method relates to a first party and a second party, the first party stores a first feature portion of a plurality of samples, the second party stores a plurality of binary classification labels corresponding to the plurality of samples, and the method includes: The second party separately encrypts the plurality of binary classification labels corresponding to the plurality of samples, to obtain a plurality of encrypted labels. The first party determines, based on the plurality of encrypted labels and a differential privacy noise, a positive sample encrypted noise addition quantity and a negative sample encrypted noise addition quantity corresponding to each bin in a plurality of bins. The plurality of bins are obtained by performing binning processing on the plurality of samples for a feature in the first feature portion. The second party decrypts the positive sample encrypted noise addition quantity and the negative sample encrypted noise addition quantity, to obtain a positive sample noise addition quantity and a negative sample noise addition quantity, so as to determine a noise addition index of a corresponding bin.