Cross-Region Data Sharing Broker for Multi-Cloud Warehouses
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud-based data warehousing systems face challenges in sharing data across different cloud platforms and regions due to limitations in native sharing protocols, which prohibit data sharing and replication between accounts associated with different organizations, leading to inefficiencies and security risks.
Innovation Solution
An on-demand data collection mechanism is implemented to facilitate data sharing and replication across multi-cloud platform/region environments by sending instructions to computing devices associated with different cloud-based data warehouses to share and replicate data within the cloud-based data warehousing system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data sharing is enabled across different cloud platforms and regions, then data accessibility and collaboration are improved, but security control and data protection become more difficult to maintain
Solution Approach 1:
The patent introduces a data sharing broker as an intermediary component that mediates data sharing requests between accounts on different cloud platforms. The broker validates sharing policies, authenticates requests, and coordinates cross-platform data access, thereby maintaining security control while enabling broad data accessibility. This intermediary layer ensures that security policies are enforced consistently across multiple cloud environments without restricting legitimate data sharing needs.
2Productivity
If physical copying of data is used for sharing, then data availability is improved, but storage costs and processing overhead increase
Solution Approach 1:
The patent implements a hybrid copying approach where metadata and data access pointers are replicated across cloud platforms rather than copying entire data sets. When data sharing is requested, the system creates references to the original data locations and replicates only the necessary access metadata. This allows multiple accounts to access the same data without duplicating the actual data storage, significantly reducing storage overhead while maintaining data availability across different cloud environments.
3Adaptability or versatility
If cross-platform data sharing protocols are implemented, then interoperability is improved, but system complexity increases
Solution Approach 1:
The patent implements a universal data sharing protocol that can operate across multiple cloud platforms (AWS, Azure, Google Cloud) through a single standardized interface. The data sharing broker is designed with multi-functional capabilities to handle different cloud platform-specific protocols and translate them into a unified cross-platform sharing mechanism. This universal approach enables interoperability across diverse cloud environments without requiring separate complex integration systems for each platform combination, thereby reducing overall system complexity while maintaining broad compatibility.
Data Source
AI summary
Methods, systems, devices, and computer-readable media for orchestrating the sharing of data between accounts that are hosted by a cloud-based data warehousing system on different cloud platforms or in different cloud regions of a cloud platform, and where such accounts may be associated with different organizations. Sharing of data in the multi-cloud platform and/or multi-cloud region environments may be facilitated by the on-demand creation of one or more data collection accounts.