Public Cloud Direct Storage–Function Routing for Lower I/O Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing public cloud systems suffer from high data transmission latency due to an excessively long I/O path for file transmission, which cannot meet the requirements of service scenarios sensitive to data transmission latency.
Innovation Solution
A public cloud system architecture that allows direct communication between the cloud storage service apparatus and the cloud function service apparatus, bypassing the gateway, enabling direct transmission of object files and processing logic defined by the tenant, utilizing channels like HTTP, TCP, WebSocket, or RPC protocols.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the gateway is used for file transmission between cloud storage service apparatus and cloud function service apparatus, then the system architecture is standardized and manageable, but the I/O path becomes excessively long and data transmission latency increases
Solution Approach 1:
The patent introduces a direct communication channel as an intermediary path between the cloud storage service apparatus and cloud function service apparatus, bypassing the gateway for data transmission. This allows the system to maintain standardized gateway-based architecture for management while creating a dedicated shortcut for data flow, thus resolving the contradiction between architectural standardization and transmission latency.
Solution Approach 2:
The patent segments the system communication path into two distinct routes: a management route through the gateway for standardized control and authentication, and a data transmission route directly between storage and function apparatus for low-latency file I/O. This segmentation allows each path to be optimized for its specific purpose without compromising the other.
2Loss of time
If the I/O path is shortened by bypassing the gateway, then data transmission latency is reduced, but the complexity of direct communication establishment increases
Solution Approach 1:
The patent establishes communication credentials and channel configurations in advance during system initialization or before data transmission begins. The cloud storage service apparatus and cloud function service apparatus pre-share authentication information and communication parameters, so that when direct file transmission is needed, the path is already prepared and ready, eliminating the complexity of real-time connection establishment.
Solution Approach 2:
The patent uses standardized communication protocols and interface definitions that are copied from established patterns, allowing the direct communication path to follow proven templates rather than requiring custom implementation. This reduces the complexity of establishing direct connections while maintaining the performance benefits of bypassing the gateway.
Data Source
AI summary
A public cloud system includes a cloud storage service apparatus configured to store an object file, and a cloud function service apparatus configured to obtain an objective function, wherein the objective function is data processing logic defined by a tenant for the object file. The cloud storage service apparatus is further configured to, when receiving a download request for the object file from a first client, send the object file to the cloud function service apparatus. The cloud function service apparatus is further configured to run the objective function to process the object file based on the data processing logic, and return a processed file to the cloud storage service apparatus. The cloud storage service apparatus is further configured to send the processed file to the first client.