Asynchronous Messaging via File Sharing for ML Services
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication frameworks for providing computing services across multiple regions face challenges due to high processing power requirements for maintaining synchronous communication sessions, leading to degraded performance and increased complexity and cost.
Innovation Solution
An asynchronous communication system utilizing a file sharing system as a messaging queue, where request and response files are transmitted securely and efficiently between processing servers and client nodes without maintaining continuous communication sessions, leveraging existing file sharing infrastructure to manage requests and responses through SFTP.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If synchronous communication sessions are maintained for providing computing services across multiple regions, then service availability and responsiveness are improved, but processing power requirements and system complexity increase significantly
Solution Approach 1:
The patent introduces a message queue system as an intermediary component between client devices and computing service providers. This message queue decouples the synchronous communication requirement, allowing clients to submit requests and receive responses without maintaining continuous communication sessions. The message queue handles the intermediary communication tasks, reducing the complexity of the overall communication framework while maintaining service availability across multiple regions.
2Productivity
If synchronous communication sessions are maintained for providing computing services, then real-time service delivery is improved, but processing power consumption increases
Solution Approach 1:
The patent implements periodic polling mechanisms where client applications periodically check for response files in their designated directories rather than maintaining continuous synchronous communication sessions. This periodic action reduces the constant processing power consumption associated with maintaining active communication sessions while still enabling timely delivery of computing services. The system checks for new responses at intervals, balancing productivity with reduced energy usage.
3Adaptability or versatility
If additional communication infrastructure components are added to support multi-region services, then service scalability is improved, but system complexity and cost increase
Solution Approach 1:
The patent leverages existing file sharing systems and directory structures that are already present in most computing environments to implement the message queue functionality. Instead of introducing entirely new infrastructure components, the system repurposes existing universal file sharing capabilities to handle inter-region communication. This approach enables service scalability across multiple regions while avoiding the increased complexity and cost associated with deploying dedicated communication infrastructure.
4Reliability
If continuous communication sessions are maintained for secure data transmission, then data security is improved, but processing overhead and system resource consumption increase
Solution Approach 1:
The patent implements preliminary authentication and authorization mechanisms where client applications and computing service providers establish security credentials and permissions before actual data transmission occurs. Security tokens, encryption keys, and access permissions are pre-configured and stored in the message queue system. This preliminary action ensures data security without requiring continuous authentication handshakes during communication, thereby reducing processing overhead and energy consumption while maintaining reliable secure transmission.
Data Source
AI summary
Methods and systems are presented for providing an asynchronous communication system for facilitating computing services to computer nodes across multiple availability zones. Each computer node includes a client application configured to receive a service request and to generate a request file based on the service request. The client application uploads the request file to a folder hosted by a file sharing system and shared with a processing server. When a new request file is detected in the folder, the processing server downloads the request file from the file sharing system. Based on performing one or more computing services according to the request file, the processing server generates a response file including output data from the computing services. The processing server uploads the response file to the folder hosted by the file sharing system. The client application downloads the response file and presents the output data on a device.