Proxy Server for FTP Cluster Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for FTP file transmission, particularly in large-scale and high-concurrent connection scenarios, face limitations in processing capability and efficiency due to the constraints of single-instance FTP servers, leading to low file transmission efficiency.
Innovation Solution
A data transmission method utilizing a proxy server that directs viewing and transmission requests to a two-stack FTPServer multi-instance distributed cluster, where the proxy server records processing ranges of each server and balances load to optimize file transfer efficiency by scheduling requests across multiple servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single-instance FTP server is used, then the system structure is simple, but the processing capability is limited and cannot satisfy large-scale multi-connection scenarios
Solution Approach 1:
The patent divides the single FTP server into multiple FTP server instances distributed across different servers. Each instance handles a portion of the connections and file operations, thereby increasing the overall processing capability while maintaining manageable complexity through modular architecture.
Solution Approach 2:
The patent transitions from a single-server architecture to a multi-server distributed cluster architecture. This dimensional change from one server to multiple servers enables the system to handle large-scale multi-connection scenarios by distributing the load across the cluster.
2Productivity
If a multi-instance FTP server is used, then the supporting capability for large-scale scenarios is improved, but the efficiency in high concurrent connection scenarios is not well solved
Solution Approach 1:
The patent introduces an FTP proxy server as an intermediary between clients and the multi-instance FTP server cluster. The proxy server receives client requests, determines the appropriate target server instance based on file location and server load, and forwards requests accordingly. This mediation optimizes request routing and improves handling efficiency in high concurrent connection scenarios.
Solution Approach 2:
The patent dynamically adjusts request routing parameters based on real-time server status, file location, and load conditions. By changing routing parameters adaptively, the system optimizes performance for high concurrent connections while maintaining the multi-instance architecture's supporting capability.
3Ease of manufacture
If file sharing by copying is used, then implementation is simple, but storage space is wasted and transmission efficiency is reduced
Solution Approach 1:
The patent uses symbolic linking (a form of copying that references rather than duplicates) to enable file sharing across the distributed FTP server cluster. Instead of physically copying files to multiple servers, the system creates references that point to the original file location, thereby preserving storage space while enabling efficient file access and sharing.
4Adaptability or versatility
If a distributed file system like NFS or CEPH is used, then file sharing among multiple servers is achieved, but system complexity increases
Solution Approach 1:
The patent extracts the file sharing functionality from the complex distributed file system layer and implements it directly at the application level using symbolic links and a centralized file directory database. This extraction eliminates the need for complex distributed file systems like NFS or CEPH while maintaining file sharing capability across the FTP server cluster.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Embodiments of the present invention provide a data transmission method, a proxy server, a storage medium, and an electronic apparatus. The method comprises: receiving, by a proxy server, a target request sent by a client; in the case that the target request is a viewing request, acquiring, by the proxy server, target attribute information of a target file from a stored copy of the attribute information, and returning the target attribute information to the client; in the case where a target request is a transmission request, a proxy server sends the target request to a target server in a data server, wherein the data server is a two-stack FTPServer multi-instance distributed cluster server, the data server comprises a plurality of first servers, and the proxy server records a range of processing FTP users reported by each first server.