Data Warehouse External Function Invocation via API Mediator
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional cloud data warehouses do not provide users with the ability to call out to remote software components for external functionality, limiting their ability to utilize external services for data analysis and processing.
Innovation Solution
A network-based data warehouse system that enables users to invoke external functionality by binding functions, table functions, or procedures to remote software code exposed as a web API, using temporary security credentials and a cloud computing service platform for authentication and execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional cloud data warehouses are used, then data storage and analysis capabilities are provided, but the ability to call external software components is lacking
Solution Approach 1:
The patent introduces an intermediary layer between the data warehouse and external software components. This intermediary enables secure communication and function invocation without requiring direct integration, thus improving adaptability while managing complexity through abstraction.
2Productivity
If external code is integrated into the data warehouse, then data processing capabilities are enhanced, but security concerns arise
Solution Approach 1:
The system employs an intermediary authentication and authorization mechanism that verifies external code before execution. This mediator layer ensures that security protocols are maintained while allowing enhanced data processing capabilities through external function integration.
Solution Approach 2:
The system performs preliminary authentication and validation of external code before it is executed within the data warehouse environment. This advance verification ensures security requirements are met prior to code execution, enabling productivity enhancement without compromising reliability.
3Adaptability or versatility
If external functionality is invoked, then functionality versatility is improved, but authentication complexity increases
Solution Approach 1:
The patent implements a universal authentication mechanism that handles multiple external function types through a single standardized interface. This multi-functional approach improves versatility while reducing authentication complexity by eliminating the need for separate authentication processes for different external functions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A query referencing a function associated with a remote software component is received by a network-based data warehouse system. Temporary security credentials corresponding to a role at a cloud computing service platform are obtained. The role has permission to send calls to a web endpoint corresponding to the remote software component. A request comprising input data and electronically signed using the temporary security credentials is sent to a web Application Programming Interface (API) management system of the cloud computing service platform. The request, when received by the web API management system, causes the web API management system to invoke external functionality provided by the remote software component at the web endpoint with respect to the input data. A response comprising a result of invoking the external functionality is received from the web API management system, and the result data is processed according to the query.