Reference Data Tool for Local Application Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data architectures face challenges in providing direct access to external data for applications executing locally, as they often lack native APIs or communication channels to reach remote host data platforms, hindering their ability to perform tasks effectively.
Innovation Solution
A reference data tool (RDT) is implemented within a reference data platform that captures and replicates data elements from external host data platforms into custom tables, making them accessible to local applications through intermediary data flows, such as database management systems or web service interfaces, enabling local applications to process data even without native access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If local applications execute tasks without direct access to external host data platforms, then application functionality is limited, but system complexity and bandwidth consumption increase
Solution Approach 1:
The reference data tool proactively extracts and replicates data elements from external host data platforms to local custom tables before applications need them. This preliminary data preparation enables applications to access required data locally without direct connections to external platforms, enhancing functionality while controlling system complexity through automated intermediary management
Solution Approach 2:
The reference data tool acts as an intermediary component between local applications and external host data platforms. It captures data elements from external platforms and stores them in local custom tables, allowing applications to access external data indirectly through this mediator without establishing direct connections, thus resolving the contradiction between functionality and complexity
2Speed
If data is replicated from external platforms to custom tables, then data access speed improves, but bandwidth consumption increases
Solution Approach 1:
The reference data tool selectively extracts only the specific data elements required by local applications from external host data platforms, rather than replicating entire datasets. This partial action approach accelerates data access for needed elements while minimizing bandwidth consumption by transferring only essential data portions to local custom tables
3Reliability
If direct connections to external data platforms are established, then real-time data access is enabled, but system reliability decreases due to dependency on external availability
Solution Approach 1:
The reference data tool creates local copies of required data elements from external host data platforms and stores them in custom tables. Applications access data from these local copies rather than connecting directly to external platforms, ensuring reliable data access independent of external platform availability while maintaining data integrity through the copying mechanism
Data Source
AI summary
A reference data tool helps meet the technical challenges associated with providing important data to an application that needs the data. The tool causes execution of custom reports on an external data platform that extract the data needed by the application from the external data platform. The tool creates a custom data store for the data in a location accessible to the application. After the tool receives the extracted data, the tool automatically writes the data into the proper location in the custom data store.