Connector Framework for Secure Real-Time Distributed Data Ingestion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed information storage systems face security concerns due to the interception and unauthorized access of data during transmission and storage, especially when multiple geographic locations are involved.
Innovation Solution
A computing platform with a connector framework that preconfigures identities of data production systems, ingests information directly into storage layers, and replicates it in real time across multiple data recipient systems using SSL connections, without involving third-party systems, to enhance security and resilience against data loss.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If information is stored in a distributed manner across multiple storage locations, then information availability and resilience to system failures are improved, but security concerns arise due to potential interception during transmission and access by third parties
Solution Approach 1:
The patent segments information into multiple separate data segments before distribution. Each segment is stored at different storage locations, and no single location contains the complete information. This segmentation approach maintains information availability across distributed systems while enhancing security, as intercepting individual segments does not reveal the complete information.
Solution Approach 2:
The patent introduces an intermediary encoding mechanism that transforms information into an encoded format before distribution. This intermediary step ensures that even if data is intercepted during transmission or accessed by unauthorized parties, the information remains protected and unusable without the proper decoding key.
2Reliability
If information is transmitted across multiple geographic regions for distributed storage, then data resilience is improved, but transmission time and system complexity increase
Solution Approach 1:
The patent performs preliminary actions by pre-configuring storage locations and establishing transmission channels before actual information distribution. This preparation reduces the time required for actual data transmission and minimizes system complexity during the distribution process itself.
Solution Approach 2:
The patent creates multiple copies of segmented information and distributes them simultaneously across different geographic regions. This parallel copying approach reduces overall transmission time compared to sequential distribution, while maintaining data resilience through geographic distribution.
3Adaptability or versatility
If third-party systems are involved in distributed storage processes, then system versatility is improved, but security control and data protection are weakened
Solution Approach 1:
The patent extracts and removes third-party systems from the trusted distribution chain. By eliminating external intermediaries, the system maintains full security control over information transmission and storage, while still achieving versatility through support for multiple storage locations and formats under direct system management.
Data Source
AI summary
Aspects of the disclosure relate to information security. A computing platform may configure a connector framework to: preconfigure identities of data production systems without involvement of a third party system, and ingest information, received from the data production systems, directly into a storage layer at each of a plurality of data recipient systems, where the information may be received in a plurality of different programming languages, and the plurality of data production systems may be located in different geographic regions. The computing platform may receive, at the connector framework and from a first data production system of the data production systems, first information. The computing platform may ingest the first information by: replicating, using the connector framework, the first information, and making available, to the plurality of data recipient systems, the first information, which may cause storage of the replicated first information in real time.