External Function System for Cloud Database Data Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cloud database services face challenges in managing data interfaces between databases and different network services in a scalable manner, leading to prohibitive computational and network overhead.
Innovation Solution
Implementing an external function system that generates and stores user-defined functions on a distributed database, using serializer and deserializer functions to transform data between the database format and the format of external services, thereby eliminating the need for additional third-party services for data format transformation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If cloud database services are used to easily create new database instances, then database creation ease is improved, but data interface management complexity between database and network services increases
Solution Approach 1:
The patent introduces an external function system as an intermediary layer between the cloud database service and external network services. This system provides standardized interface mechanisms (UDFs, serializers, deserializers) that mediate data exchange, thereby maintaining ease of database creation while reducing data interface management complexity through abstraction and automation.
2Adaptability or versatility
If data format transformation is performed between database and network services, then data compatibility is improved, but computational overhead increases
Solution Approach 1:
The patent implements serializers and deserializers that are pre-configured and stored within the database system. These components perform data format transformation in advance and in an automated manner, reducing computational overhead during actual data exchange operations by having transformation logic readily available and optimized beforehand.
Solution Approach 2:
The external function system provides universal serializer and deserializer components that can handle multiple data formats and network service protocols through a unified interface. This multi-functionality reduces computational overhead by avoiding the need for separate transformation logic for each specific service, thereby improving data compatibility efficiently.
3Adaptability or versatility
If additional third-party services are used for data format transformation, then data format flexibility is improved, but system complexity and operational burden increase
Solution Approach 1:
The patent merges the data format transformation functionality directly into the cloud database service by integrating serializers, deserializers, and the external function system within the database architecture. This consolidation eliminates the need for separate third-party transformation services, maintaining data format flexibility while reducing overall system complexity and operational burden.
Solution Approach 2:
The external function system enables the database to perform data format transformation autonomously using its own integrated components (UDFs, serializers, deserializers) without requiring external third-party services. This self-service capability provides data format flexibility while simplifying the system architecture by removing dependencies on additional external services.
Data Source
AI summary
An external function system can be implemented on a database to perform processing on one or more external network services. The external function system can comprise a particular external function for a particular external service, an outbound serializer function, and an inbound serializer function that are linked with the particular external function. The outbound serializer function can be configured to transform the data of a query from a database format to a different format of the particular external network service. The inbound deserializer function can be configured to receive data returned from the external service and transform the data to the format of the database.