Document Segmentation for Secure Distributed Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Labor-intensive jobs involving confidential data are typically not outsourced due to security and quality assurance concerns, leading to increased costs and slower processing within enterprises, as existing methods fail to efficiently distribute and secure such data across a distributed environment.
Innovation Solution
An automated system that determines the desired granularity of document subcomponents based on security policies, splits the data into secure components, and distributes them across a network for parallel processing by multiple workers, ensuring security and confidentiality while allowing for efficient outsourcing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If confidential data is distributed to multiple workers for processing, then processing speed and productivity improve, but security and confidentiality are compromised
Solution Approach 1:
The patent divides confidential documents into multiple non-overlapping segments or blocks, distributing different segments to different workers. Each worker processes only their assigned segment without accessing other segments, thereby maintaining security while enabling parallel processing. The segmentation is controlled by a granularity determinator that decides how to split the document based on security requirements and processing needs.
2Reliability
If confidential data is kept centralized within the enterprise, then security and confidentiality are maintained, but processing speed and productivity decrease
Solution Approach 1:
The patent introduces a centralized controller as an intermediary that coordinates the distribution and collection of document segments. This controller manages the segmentation, assigns segments to workers, collects processed segments, and reassembles them into the final document. This intermediary enables secure distributed processing while maintaining centralized security oversight.
3Reliability
If documents are split into finer granularities for distribution, then security is improved and more workers can process in parallel, but system complexity and coordination overhead increase
Solution Approach 1:
The patent employs a dynamic granularity determinator that adjusts the segmentation granularity based on the specific document, security requirements, and available worker resources. Rather than using fixed segmentation rules, the system dynamically determines the optimal granularity for each document, balancing security needs with processing efficiency and minimizing unnecessary system complexity.
Data Source
AI summary
Systems and methods for distributing work among a plurality of workers in a distributed environment using a granularity determinator module to determine a desired granularity of a data to be worked-on whereby each one of a plurality of document subcomponents individually maintains a level of security based on a security policy. The data is separated out into a plurality of subcomponents which are transmitted to respective workers. A consolidator module can be used to consolidate subcomponents worked on by the respective workers into one worked-on document or file for validation purposes. The system and methods provide an efficient and cost effective way to distribute confidential work to workers without compromising the confidentiality of the information contained in the document or file being worked on.