Distributed cluster based file transfer method and system

Abstract

The application discloses a file transmission method and system based on a distributed cluster. The distributed cluster comprises at least two distributed input nodes and at least two hosts connected with the distributed input nodes, and the distributed input nodes are connected with a server through a switch. The method comprises the following steps: storing a target file in the server; and uniformly transmitting the target file to the hosts by the server through the distributed input nodes. According to the application, the server can uniformly transmit the target file to multiple hosts in the distributed cluster through the distributed input nodes based on the distributed networking, the transmission of large files is supported, the uniform transmission and efficient transmission of files in the local area network under the distributed networking are realized, the hosts can not directly acquire files from the Internet but acquire files by being distributed by the server, so that the hosts are prevented from being attacked by the network, and the security of file acquisition is improved because the distributed cluster and the server are connected through the local area network.

Description

Technical Field

[0001] This invention relates to the field of data transmission technology, and in particular to a file transfer method and system based on a distributed cluster. Background Technology

[0002] Distributed KVM (Keyboard Video Mouse) is widely used in command centers, control centers, and other similar locations. KVM connects to a set of keyboard, mouse, and monitor at the workstation, allowing control of multiple remote hosts and switching between them, making management simpler and more convenient and improving work efficiency.

[0003] When it's necessary to transfer files or install software uniformly across multiple hosts, the current technology uses USB flash drive remote transfer, which involves inserting a USB flash drive into the corresponding distributed output node at the agent's side to remotely transfer files to the host. However, USB flash drive remote transfer only supports one-to-one file transfer. When a file needs to be transferred to multiple hosts, multiple copies are required. Furthermore, due to the limited storage capacity of USB flash drives, if the file to be transferred is large, multiple copy operations are needed to complete the entire transfer of the file on a single host, increasing the complexity and operational risks of file transfer. Summary of the Invention

[0004] This invention provides a file transfer method and system based on a distributed cluster to improve the convenience and security of unified file transfer to a distributed cluster.

[0005] According to one aspect of the present invention, a file transfer method based on a distributed cluster is provided. The distributed cluster includes at least two distributed input nodes and at least two hosts connected to the distributed input nodes. The distributed input nodes are connected to a server via a switch. The method includes:

[0006] The target file is stored on the server;

[0007] The server transmits the target file to the host in a unified manner through the distributed input node.

[0008] According to another aspect of the present invention, a file transfer system based on a distributed cluster is provided, characterized in that the system includes a distributed cluster, a server, and a switch, wherein the distributed cluster includes at least two distributed input nodes and at least two hosts connected to the distributed input nodes, and the distributed input nodes are connected to the server through the switch.

[0009] The server is used to obtain the target file and transmit the target file to the host through the distributed input node.

[0010] The technical solution of this invention is based on distributed networking, enabling the server to uniformly transmit target files to multiple hosts in a distributed cluster through distributed input nodes, and supports the transmission of large files, realizing unified and efficient file transmission under distributed networking in a local area network; and since the hosts obtain files through the server rather than directly from the Internet, the failure of the hosts to be attacked by the network is avoided, and since the distributed cluster and the server are connected through the local area network, the security of file acquisition is improved.

[0011] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a flowchart of a file transfer method based on a distributed cluster according to Embodiment 1 of the present invention;

[0014] Figure 2 This is a schematic diagram of a file transfer system based on a distributed cluster.

[0015] Figure 3 This is a flowchart of another file transfer method based on a distributed cluster provided in Embodiment 2 of the present invention;

[0016] Figure 4 This is a schematic diagram of another structure for a file transfer system based on a distributed cluster. Detailed Implementation

[0017] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0018] It should be noted that the terms "candidate," "target," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0019] Example 1

[0020] Figure 1 The flowchart of a file transfer method based on a distributed cluster is provided in Embodiment 1 of the present invention. This embodiment is applicable to the situation of uniformly distributing files to hosts in a distributed cluster. The method can be executed by a file transfer system based on a distributed cluster, which can be implemented in hardware and / or software.

[0021] In this embodiment of the invention, the distributed cluster includes at least two distributed input nodes and at least two hosts connected to the distributed input nodes. The distributed input nodes are connected to the server through a switch.

[0022] Distributed input nodes (DINodes) are used to connect to servers via switches to retrieve files. Each DINode has a one-to-one connection with a host computer, which stores the data transmitted by the connected DINodes and performs corresponding data processing. The server, DINodes, and host can be connected via network cables. Figure 2 The diagram shows the structure of a file transfer system based on a distributed cluster. Figure 2 This includes the connection relationship between the distributed cluster and the server.

[0023] like Figure 1 As shown, the method includes:

[0024] S110. Store the target file on the server.

[0025] In this context, the target file refers to the data that needs to be uniformly distributed to each host in the distributed cluster. The target file can be in the form of videos, images, documents, or installation software packages. The server refers to the platform that manages the distributed cluster uniformly, enabling unified management of various types of devices, including those within the distributed cluster. For example, the server can be a visualization server; currently, the distributed KVM industry generally configures visualization servers as a unified management platform for distributed products, central control hosts, broadcast control servers, and splicing processors. The primary function of this platform is currently to provide unified management for multiple types of devices. The solution in this embodiment of the invention uses this configured management platform to perform unified file transfer between distributed cluster devices, enriching the functionality of the management platform and improving product utilization.

[0026] Specifically, the target files that need to be transmitted uniformly are uploaded to the server. For example, the target files can be downloaded and saved on the server via the Internet, or transferred and stored on the server via a USB flash drive connected to the server.

[0027] In one feasible embodiment, the method further includes, before storing the target file on the server:

[0028] The security of the target file is determined.

[0029] Specifically, since the target files are uniformly distributed to the distributed cluster, a security audit is performed on the target files before storing them on the server to ensure their security. For example, the target files can be verified based on the content to be transmitted, and the determination can be based on the matching degree between the target files and the content to be transmitted. Alternatively, operators can audit the content of the target files to improve their security, thereby ensuring the security of the distributed cluster.

[0030] S120. The server transmits the target file to the host in a unified manner through distributed input nodes.

[0031] Distributed input nodes act as intermediate devices, enabling the server to uniformly distribute target files to multiple distributed hosts. Since the transmission is done via network cable, the target files can be large files.

[0032] Specifically, the server transmits the target file to the distributed input nodes via a router. After receiving the target file, the distributed input nodes transmit the received target file to the connected host via a USB interface. The transmission of the target file to each host is centrally managed by the server, with the distributed input nodes acting as intermediaries. The hosts do not need to be connected to the public network, thus protecting the security of the data on the hosts.

[0033] For example, the server itself is a central management server that provides unified control over various types of devices. It supports unified management of distributed devices and a unified interface operation. The distributed KVM system itself provides customers with convenient remote computer control functionality.

[0034] Currently, the server and the hosts in the distributed cluster are not connected. This solution transmits relevant documents or software from the server to the distributed input nodes in the distributed cluster, and then the distributed input nodes uniformly transmit files to the connected computer hosts. This solves the technical problems of unified file distribution and unified software installation in KVM use cases.

[0035] The technical solution of this invention is based on distributed networking, enabling the server to uniformly transmit target files to multiple hosts in a distributed cluster through distributed input nodes, and supports the transmission of large files, realizing unified and efficient file transmission under distributed networking in a local area network; and since the hosts obtain files through the server rather than directly from the Internet, the failure of the hosts to be attacked by the network is avoided, and since the distributed cluster and the server are connected through the local area network, the security of file acquisition is improved.

[0036] Example 2

[0037] Figure 3 This is a flowchart of a file transfer method based on a distributed cluster provided in Embodiment 2 of the present invention. In this embodiment, a storage device is configured in the distributed input node.

[0038] Specifically, a storage device is configured in the distributed input node to temporarily store target files transferred from the server, allowing the host to retrieve the target files from the storage device. The storage device can be an external USB flash drive or similar device connected to the distributed input node.

[0039] In one feasible embodiment, the storage device is a storage chip, which is connected via an extension interface in a distributed input node.

[0040] Specifically, to ensure the reliability of the storage device in the distributed input node, a storage device is added internally to the distributed input node. Furthermore, to improve the ease of adding the storage device, a storage chip is added to the expansion interface of the internal chip in the distributed input node. For example, a storage chip is connected to the DSP chip of the distributed input node via an eMMC expansion interface. The capacity of the storage chip can be determined according to the scenario and is not limited here.

[0041] like Figure 3 As shown, the method includes:

[0042] S210. Store the target file on the server.

[0043] S220. The server distributes the target files to the distributed input nodes and stores them in the storage devices of the distributed input nodes.

[0044] After adding storage devices to the distributed input nodes, each distributed input node, upon receiving a target file uniformly distributed by the server, first stores the target file in its internal storage device. For example, the server and the distributed input nodes transmit the target file via the HTTP protocol; the target file can be a video, image, document, or EXE file, etc.

[0045] S230, the distributed input node transfers the target file in the storage device to the host.

[0046] The distributed input node transfers the target file from the storage device to the connected host via a USB interface. For example, to facilitate subsequent file reception by the distributed input node, the target file is deleted from the storage device after being transferred to the host.

[0047] In one feasible embodiment, the distributed cluster also includes agent nodes connected to the distributed input nodes; the target file includes at least two files to be transmitted;

[0048] Accordingly, S230 includes:

[0049] The target file to be transferred is determined from at least two files to be transferred in the storage device by the agent node;

[0050] The distributed input nodes transmit the target file to the host.

[0051] like Figure 4 This is a schematic diagram of another structure of a file transfer system based on a distributed cluster. The distributed cluster also includes agent nodes, which are connected to distributed input nodes. An agent node can be connected to at least one distributed input node and control the host corresponding to the at least one distributed input node from the agent node.

[0052] Specifically, the target agent node is connected to at least one target distributed input node, and the at least one target distributed input node is connected to at least one host. The target agent node determines at least two files to be transferred stored in the at least one target distributed input node, and selects the target file to be transferred from these two files. The distributed input node then transfers this target file to the host corresponding to the target distributed input node. For example, the target agent node is simultaneously connected to a first distributed input node and a second distributed input node. The target agent node selects a first target file to be transferred from the at least two files to be transferred in the first distributed input node, and a second target file to be transferred from the at least two files to be transferred in the second distributed input node. The first distributed input node transfers the first target file to be transferred to a first host connected to the first distributed input node, and the second distributed input node transfers the second target file to be transferred to a second host connected to the second distributed input node. The first distributed input node includes at least one distributed input node, and the second distributed input node includes at least one distributed input node. If the first distributed input node includes at least two distributed input nodes, or the second distributed input node includes at least two distributed input nodes, the target file to be transferred can be determined by the target agent node simultaneously through at least two distributed input nodes, thereby improving the efficiency of file transfer.

[0053] By utilizing the storage devices in the distributed input nodes, the agent nodes are able to retrieve files automatically from the server. This ensures the efficiency of the server in distributing files to the distributed cluster while enabling the agent nodes in the distributed cluster to retrieve files autonomously.

[0054] The solution in this embodiment can enrich the functions of the server management platform. In addition to the unified management function, it adds the function of unified file transmission and distribution. Furthermore, each agent node in the distributed cluster can also retrieve relevant documents from the corresponding distributed input node. If the target file is an EXE file, it can be uniformly installed on the host in the distributed cluster, thereby improving product utilization.

[0055] In one feasible embodiment, before the distributed input nodes transfer the target file from the storage device to the host, the method further includes:

[0056] The security of the target file is determined.

[0057] Specifically, since the target files are uniformly distributed to the distributed cluster, to further ensure their security, the distributed input nodes perform a security audit on the target files again before transmitting them to the hosts. For example, the target files can be validated based on the content to be transmitted, determined by the degree of matching between the target files and the content, or the operators can audit the content of the target files to improve their security, thereby ensuring the security of the hosts in the distributed cluster.

[0058] By using both the host and distributed input nodes to ensure the security of the target file, the security of uniformly distributing files to the distributed cluster is further improved.

[0059] The technical solution of this invention, by adding a storage device to the distributed input node, enables the storage of target files uniformly transmitted by the server, thereby improving the convenience of uniform file transmission and enhancing the security and autonomy of the distributed cluster in obtaining files.

[0060] Example 3

[0061] Figure 2 and Figure 4 This is a schematic diagram of a file transfer system based on a distributed cluster, provided in Embodiment 3 of the present invention. The system includes a distributed cluster, a server, and a switch. The distributed cluster includes at least two distributed input nodes and at least two hosts connected to the distributed input nodes. The distributed input nodes are connected to the server via the switch. The server is used to obtain a target file and transmit the target file to the hosts uniformly through the distributed input nodes.

[0062] The technical solution of this invention is based on distributed networking, enabling the server to uniformly transmit target files to multiple hosts in a distributed cluster through distributed input nodes, and supports the transmission of large files, realizing unified and efficient file transmission under distributed networking in a local area network; and since the hosts obtain files through the server rather than directly from the Internet, the failure of the hosts to be attacked by the network is avoided, and since the distributed cluster and the server are connected through the local area network, the security of file acquisition is improved.

[0063] Optionally, a storage device is configured in the distributed input node;

[0064] Correspondingly, the server is used to uniformly distribute the target file to the distributed input nodes;

[0065] The distributed input node is used to store the target file in the storage device and transmit the target file in the storage device to the host.

[0066] Optionally, the distributed cluster further includes agent nodes connected to the distributed input node; the target file includes at least two files to be transmitted.

[0067] Accordingly, the agent node is used to determine the target file to be transferred from at least two files to be transferred in the storage device;

[0068] The distributed input node is used to transmit the target file to be transmitted to the host.

[0069] Optionally, the storage device is a storage chip, which is connected through an expansion interface in the distributed input node.

[0070] Optionally, the server is also used to determine the security of the target file.

[0071] Optionally, the distributed input node is also used to determine the security of the target file.

[0072] The file transfer system based on a distributed cluster provided in the embodiments of the present invention can execute the file transfer method based on a distributed cluster provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method.

[0073] The acquisition, storage, use, and processing of data in this application comply with relevant national laws and regulations and do not violate public order and good morals.

Claims

1. A file transfer method based on a distributed cluster, characterized in that, The distributed cluster includes at least two distributed input nodes and at least two hosts connected to the distributed input nodes, wherein the distributed input nodes are connected to a server via a switch. The method includes: The target file is stored on the server; The server transmits the target file to the host in a unified manner through the distributed input node.

2. The method according to claim 1, characterized in that, The distributed input node is configured with a storage device; Accordingly, the server transmits the target file to the host uniformly through the distributed input nodes, including: The server uniformly distributes the target file to the distributed input nodes and stores it in the storage device of the distributed input nodes; The distributed input node transmits the target file from the storage device to the host.

3. The method according to claim 2, characterized in that, The distributed cluster also includes agent nodes connected to the distributed input node; the target file includes at least two files to be transmitted. Accordingly, the distributed input node transmits the target file from the storage device to the host, including: The target file to be transferred is determined from at least two files to be transferred in the storage device by the agent node; The distributed input node transmits the target file to be transmitted to the host.

4. The method according to claim 2 or 3, characterized in that, Before the distributed input node transmits the target file from the storage device to the host, the method further includes: The security of the target file is determined.

5. The method according to any one of claims 1-3, characterized in that, Before storing the target file on the server, the method further includes: The security of the target file is determined.

6. The method according to claim 2 or 3, characterized in that, The storage device is a storage chip, which is connected through an expansion interface in the distributed input node.

7. A file transfer system based on a distributed cluster, characterized in that, The system includes a distributed cluster, a server, and a switch. The distributed cluster includes at least two distributed input nodes and at least two hosts connected to the distributed input nodes. The distributed input nodes are connected to the server via the switch. The server is used to obtain the target file and transmit the target file to the host through the distributed input node.

8. The system according to claim 7, characterized in that, in, The distributed input node is configured with a storage device; Correspondingly, the server is used to uniformly distribute the target file to the distributed input nodes; The distributed input node is used to store the target file in the storage device and transmit the target file in the storage device to the host.

9. The system according to claim 8, characterized in that, The distributed cluster also includes agent nodes connected to the distributed input node; the target file includes at least two files to be transmitted. Accordingly, the agent node is used to determine the target file to be transferred from at least two files to be transferred in the storage device; The distributed input node is used to transmit the target file to be transmitted to the host.

10. The system according to claim 8 or 9, characterized in that, The storage device is a storage chip, which is connected through an expansion interface in the distributed input node.

Images