Isolated ML Training Architecture for Sensitive Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Training machine learning algorithms on sensitive data is challenging due to ethical and legal constraints, as direct access to the data is illegal and requires strict control and monitoring of all activities, and existing data obfuscation techniques are insufficient or decrease data utility.
Innovation Solution
A computer system with multiple isolated zones and soft air gaps for controlled communication using messaging queues, allowing researchers to train models on sensitive data without direct access, utilizing distributed learning techniques like federated and split learning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If researchers directly access sensitive data for training machine learning models, then model training effectiveness is improved, but data privacy and ethical compliance deteriorate
Solution Approach 1:
The patent introduces an intermediary training system that sits between the sensitive data storage and the researcher's access. The training system receives encrypted data segments, performs distributed model training using techniques like federated learning and split learning, and returns results without exposing raw data to researchers. This intermediary architecture enables effective model training while maintaining data privacy through cryptographic protections and controlled data flow.
2Ease of operation
If sensitive data is stored on a single central device, then data accessibility for training is improved, but security against exploitation deteriorates
Solution Approach 1:
The patent segments the sensitive data into multiple encrypted segments and distributes them across multiple independent storage devices or locations. Each segment alone is insufficient for model training, requiring coordination and communication between multiple devices. This segmentation approach maintains security by ensuring that no single device holds the complete sensitive dataset, while still enabling effective distributed model training through the training system that aggregates results from multiple segments.
3Reliability
If strict control and monitoring of all activities are implemented, then data security is improved, but system complexity and operational difficulty worsen
Solution Approach 1:
The patent implements self-service mechanisms where the distributed training system automatically manages security protocols, encryption, and coordination without requiring manual intervention for each operation. The system includes automated authentication, encrypted communication channels, and built-in security protocols that operate transparently. This reduces operational complexity while maintaining strict security control, as the system enforces security rules automatically rather than requiring human monitoring of each activity.
Data Source
AI summary
A computer system comprising a first zone comprising first computing components configured to provide a consumer web application to define a machine learning model to be trained on a sensitive data set, and send the model via a first messaging queue; a second zone comprising second computing components that are isolated from the first zone, and configured to receive and send messages via the first messaging queue, receive the model, provide a vetter web application, and send the model via a second messaging queue; and a third zone comprising third computing components isolated from the first and second zone, and configured to receive and send messages via the second messaging queue, receive the model, provide an execution manager application configured to control execution of operating system containers on client devices to train the model on sensitive data, the client devices being isolated from the first and second zone.


