Automated Cloud Data Processing Pipelines for Compliance Checks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing pipelines for cloud-based medical systems face challenges in ensuring data protection compliance and technical requirements, requiring manual programming and multiple transmission steps, which are inefficient and labor-intensive.
Innovation Solution
A method for generating and executing data processing pipelines that includes selecting software modules and input data, checking compliance with data protection and technical requirements, and automatically generating a pipeline using machine-readable data contracts and user planning inputs, allowing non-technical users to create compliant pipelines.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is minimized through anonymization or pseudonymization to comply with data protection requirements, then data protection compliance is improved, but the usability of data for further processing by software modules deteriorates
Solution Approach 1:
The patent introduces an intermediary component that sits between data minimization and software module processing. This intermediary automatically adapts the minimized data to the specific requirements of downstream software modules, ensuring both data protection compliance and usability. The intermediary translates or transforms the minimized data into formats suitable for various modules without requiring manual intervention or compromising security.
2Reliability
If data processing pipelines are manually programmed by software developers to ensure thorough knowledge of programming, data protection and participant systems, then compliance and correctness are improved, but the complexity and time required for pipeline creation deteriorates
Solution Approach 1:
The system enables self-service pipeline generation where non-expert users can create compliant data processing pipelines through automated tools. The system automatically handles compliance checks, module selection, and pipeline configuration based on user specifications, eliminating the need for manual programming expertise while ensuring thorough compliance with data protection requirements and system constraints.
Solution Approach 2:
The patent implements preliminary action by pre-configuring compliance rules, data protection requirements, and module specifications before pipeline creation. The system prepares all necessary constraints and parameters in advance, allowing users to generate compliant pipelines through simple configuration rather than complex manual programming. This preliminary setup ensures that all generated pipelines automatically meet compliance standards.
3Reliability
If multiple transmission steps and manual labor are used to cover data protection and hardware requirements, then compliance with requirements is improved, but the productivity and efficiency of the workflow deteriorates
Solution Approach 1:
The patent merges multiple separate compliance checks and transmission steps into a single integrated automated pipeline generation process. Instead of performing data protection verification, hardware requirement checking, and module configuration as separate manual steps, the system combines all these functions into one automated workflow that generates compliant pipelines in a single operation, dramatically improving productivity while maintaining all necessary compliance standards.
Data Source
AI summary
One or more example embodiments of the present invention relates to a method for generating a data processing pipeline for a cloud computing system, wherein the data processing pipeline comprises at least one software module for execution in at least one execution environment, wherein the execution environment has allocated execution environment information data. The method includes receiving at least one software module selection of a user, receiving at least one input data selection of a user, receiving at least one user planning input, checking a compliance with at least one of data protection requirements or technical requirements of the data processing pipeline, which is to be generated.