Distributed Deduplication for Cloud Identity Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud computing systems face overload and resource wastage due to duplicate requests, which can be intentional or unintentional, leading to increased processing and storage demands and potential security vulnerabilities, especially in multi-tenancy environments where identity migration is involved.
Innovation Solution
Implementing distributed deduplication methods across the cloud computing system architecture at various stages, including the endpoint, queue, and data store, to identify and discard duplicate requests, thereby preventing unnecessary processing and storage, and ensuring a secure migration path for mailbox identities between tenants.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If duplicate requests are processed without deduplication, then system functionality is maintained, but system overload and resource wastage occur
Solution Approach 1:
The patent implements deduplication checks at multiple preliminary stages before full processing occurs. At the endpoint level, incoming requests are checked against a data store of previously processed requests. At the queue level, additional deduplication occurs before worker roles retrieve and execute tasks. This preliminary action prevents duplicate requests from consuming processing resources, directly resolving the contradiction between maintaining system functionality and avoiding resource wastage.
2Reliability
If multiple deduplication methods are implemented distributed across the architecture, then duplicate request detection is improved, but system complexity increases
Solution Approach 1:
The patent segments the deduplication function across multiple independent components in the system architecture. The endpoint performs first-level deduplication by checking incoming requests against the data store. The queue performs second-level deduplication on messages before worker retrieval. Worker roles perform third-level deduplication before storing results. This segmentation improves reliability through multiple checking layers while managing complexity by distributing functions across existing architectural components rather than creating a monolithic complex system.
Solution Approach 2:
The data store serves multiple functions: it stores processed request information for deduplication checking, stores migration data, and stores processing results. The endpoint, queue, and worker roles all participate in both request processing and deduplication functions. This multi-functionality improves duplicate detection accuracy while reducing overall system complexity by leveraging existing components for multiple purposes.
3Ease of operation
If identity migration is performed through conventional offline means, then data transfer is achieved, but security vulnerabilities and attack surfaces increase
Solution Approach 1:
The patent extracts the identity migration process from conventional offline manual methods and implements it through the secure cloud-based distributed system. The endpoint, queue, and worker roles handle migration requests through automated deduplication-controlled processing. Migration data is stored securely in the data store with controlled access. This extraction eliminates the security vulnerabilities of offline manual transfer while maintaining ease of operation through automated workflows that require minimal user intervention.
Solution Approach 2:
The patent introduces the cloud computing system architecture as an intermediary between source and target tenants for identity migration. The endpoint receives migration requests, the queue manages them with deduplication checks, and worker roles execute the actual migration through the data store. This intermediary approach provides secure controlled transfer of identities, eliminating direct exposure and attack surfaces while maintaining operational simplicity through automated processes.
4Loss of energy
If deduplication is implemented at all stages, then resource conservation is maximized, but processing time may increase due to multiple checks
Solution Approach 1:
The patent performs deduplication checks at preliminary stages (endpoint and queue levels) before full processing occurs. By checking for duplicates early in the request lifecycle, the system avoids the time cost of full processing for duplicate requests. The data store provides rapid lookup capability for these preliminary checks. This preliminary action maximizes resource conservation by preventing duplicate processing while minimizing time loss through efficient early detection.
Solution Approach 2:
The system uses copies of request identifiers and metadata in the data store for rapid deduplication checking rather than copying full request data. Worker roles retrieve minimal information from the data store for comparison purposes. This copying approach enables fast deduplication checks at multiple stages without significant processing time overhead, balancing resource conservation with processing efficiency.
Data Source
AI summary
Examples of the present disclosure describe systems and methods for migrating mailbox identities. In aspects, a system may receive one or more requests to perform tasks for migrating identities of a plurality of mailboxes included in a security group created at a source tenant to a plurality of mail users created at a target tenant that correspond to the plurality of mailboxes. Based on the one or more requests, the system may copy the identities to a data store associated with the target tenant, upload mapping data to the data store, and use that mapping data to map the identities copied to the data store to the corresponding plurality of mail users in the target tenant. For each of the identities mapped, the system may copy at least one or more attributes of the respective identity from the data store to the respective corresponding mail user in the target tenant.