An IROS-based ultra-large file transmission system and method

Abstract

The present invention provides an IROS-based ultra-large file transmission system and method, which belongs to the field of data communication technology. It includes a file sending server and a file receiving server. The file sending module is used to convert files in the sending directory into ordered messages and publish them to the intelligent robot operating system of the file sending server; the intelligent operation robot system in the file sending server is used to send the cached ordered messages in an orderly manner to the intelligent robot operating system of the file receiving server; the file receiving module is used to extract the ordered messages in the intelligent robot operating system in the file receiving server, and restore the ordered messages to corresponding files and store them in the receiving directory. The present invention can efficiently and reliably transmit ultra-large files, has better performance than existing file transmission technologies, and can effectively handle network anomalies to ensure the reliability of ultra-large file transmission.

Description

Technical Field

[0001] The present invention relates to an IROS-based ultra-large file transmission system and method, belonging to the technical field of data communication. Background Art

[0002] Files are one of the most common methods of storing data. This is especially true with the widespread use of big data, video, and high-definition images, which generate a large number of large files. These large files, especially those over 4GB, are very difficult to transfer for various reasons. IROS is a new intelligent robot operating system, similar in functionality to ROS but offering higher performance, reliability, and security. IROS is essentially robotics middleware, applicable not only to robots but also to PCs and servers, providing basic communication services such as messaging, services, and parameters.

[0003] Patent CN110392105B states in its background technology that with the rapid development and widespread application of information technology, cloud computing and big data are emerging in an endless stream. A wide variety of web applications are being applied across various industries, and file upload and download functions are becoming essential. However, when it comes to uploading and downloading extremely large files, such as operating system images and large software installation packages, upload and download can be very slow. The industry's customary method for uploading large files is to use fragmented transmission, which involves splitting the large file into multiple smaller files for transmission and then merging them into the larger file after all the smaller files have been transferred. This fragmented file transfer solution results in a lengthy merge operation, which is proportional to the file size. Merging files larger than 4GB can even take more than 5 minutes, resulting in a poor user experience. Summary of the Invention

[0004] The purpose of the present invention is to provide an IROS-based ultra-large file transmission system and method, which can efficiently and reliably transmit ultra-large files, has better performance than existing file transmission technologies and can effectively handle network anomalies to ensure the reliability of ultra-large file transmission.

[0005] To achieve the above-mentioned purpose, the present invention is implemented through the following technical solutions:

[0006] The system includes a file sending server and a file receiving server; the file sending server includes a sending directory, a file sending module and an intelligent robot operating system, and the file receiving server includes a receiving directory, a file receiving module and an intelligent robot operating system;

[0007] The sending directory stores files to be sent; the file sending module is used to convert the files in the sending directory into ordered messages and publish them to the intelligent robot operating system of the file sending server; the intelligent operation robot system in the file sending server is used to send the cached ordered messages in an orderly manner to the intelligent robot operating system of the file receiving server; the file receiving module of the file receiving server is used to extract the ordered messages in the intelligent robot operating system in the file receiving server, and restore the ordered messages to corresponding files and store them in the receiving directory.

[0008] Preferably, the file sending server and the file receiving server are connected via an IP-based network, including a local area network or a wide area network.

[0009] Preferably, the files in the sending directory include ultra-large files, and the ultra-large files are larger than or equal to 4GB.

[0010] Preferably, the file sending module reads the file contents in the sending directory in a streaming order and converts the read file contents into ordered messages; the file receiving module writes the obtained ordered messages into the receiving directory in a streaming manner.

[0011] Preferably, the ordered messages converted by the file sending module are cached in the topic of the intelligent robot operating system of the file sending server, and the ordered messages received by the file receiving module are cached in the topic of the intelligent robot operating system of the file receiving server.

[0012] An IROS-based method for transferring large files, comprising the following:

[0013] The file sending module in the file sending server periodically traverses the sending directory. When it traverses to the file to be transmitted, it obtains the size of the file to be transmitted, reads the content of the file to be transmitted in a streaming order according to the set fragment size, converts the content into ordered messages, and caches the ordered messages in an orderly manner in the topic of the intelligent robot operating system of the file sending server;

[0014] The intelligent robot operating system of the file sending server reads out the cached ordered messages in the order in which they enter the cache, and sends them to the intelligent robot operating system of the file receiving server in the order in which they are read out. After receiving the ordered messages, the intelligent robot operating system of the file receiving server caches them in the topic of the intelligent robot operating system of the file receiving server in an orderly manner.

[0015] The file receiving module subscribes to the topic messages in the intelligent robot operating system in the file receiving server, obtains the ordered messages of the files in real time and order, and writes them into the receiving directory in a streaming manner in real time according to the order in which the messages are obtained.

[0016] The advantages of the present invention are: the present invention can transfer very large files from one server to another without the need for additional merging operations and other additional time consumption, and with the help of IROS's efficient and reliable message transmission capabilities, the present invention can efficiently and reliably transmit very large files, with performance superior to existing file transfer technologies and effectively handle network anomalies to ensure the reliability of very large file transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings are used to provide further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention but do not constitute a limitation of the present invention.

[0018] Figure 1 Schematic diagram of the system structure of the present invention.

[0019] Figure 2 Schematic diagram of the structure of the device of the present invention.

[0020] In the figure: S1 is the file receiving server, S2 is the file sending server, D1 is the sending directory, and D2 is the receiving directory. DETAILED DESCRIPTION

[0021] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0022] Example 1

[0023] like Figure 1 The system, shown in Figure 1, is an IROS-based ultra-large file transfer system. The system includes a file sending server and a file receiving server. The file sending server and the file receiving server are connected over an IP-based network, including a local area network (LAN) or a wide area network (WAN). The file sending server includes a sending directory, a file sending module, and an intelligent robot operating system. The file receiving server includes a receiving directory, a file receiving module, and an intelligent robot operating system. The files in the sending directory include ultra-large files, each of which is larger than or equal to 4GB.

[0024] The file sending module is used to convert the files in the sending directory into ordered messages and publish them to the intelligent robot operating system of the file sending server; the intelligent operation robot system in the file sending server is used to send the cached ordered messages in an orderly manner to the intelligent robot operating system of the file receiving server; the file receiving module of the file receiving server is used to extract the ordered messages in the intelligent robot operating system in the file receiving server, and restore the ordered messages to corresponding files and store them in the receiving directory.

[0025] The file sending module reads the file contents in the sending directory in a streaming order and converts the read file contents into ordered messages; the file receiving module writes the obtained ordered messages into the receiving directory in a streaming manner.

[0026] The ordered messages converted by the file sending module are cached in the topic of the intelligent robot operating system of the file sending server, and the ordered messages received by the file receiving module are cached in the topic of the intelligent robot operating system of the file receiving server.

[0027] During the transfer of ultra-large files, this system caches the messages generated by the fragments in an orderly and configurable manner. After the files reach the target S2 server in an orderly manner, there is no need to reorder them. The time it takes to write a file is only related to the file size and disk speed (related to hardware performance). No additional merging operations are required. Other extra time consumption is the same as for small file transfers and can be ignored.

[0028] Example 2

[0029] An IROS-based method for transferring large files, comprising the following:

[0030] The file sending module in the file sending server periodically traverses the sending directory. When it traverses to the file to be transmitted, it obtains the size of the file to be transmitted, reads the content of the file to be transmitted in a streaming order according to the set fragment size, converts the content into ordered messages, and caches the ordered messages in an orderly manner in the topic of the intelligent robot operating system of the file sending server;

[0031] The intelligent robot operating system of the file sending server reads out the cached ordered messages in the order in which they enter the cache, and sends them to the intelligent robot operating system of the file receiving server in the order in which they are read out. After receiving the ordered messages, the intelligent robot operating system of the file receiving server caches them in the topic of the intelligent robot operating system of the file receiving server in an orderly manner.

[0032] The file receiving module subscribes to the topic messages in the intelligent robot operating system in the file receiving server, obtains the ordered messages of the files in real time and order, and writes them into the receiving directory in a streaming manner in real time according to the order in which the messages are obtained.

[0033] Example 3

[0034] Combine Figure 2 As shown, an embodiment of the present disclosure provides an IROS-based ultra-large file transmission device 300, including a processor 304 and a memory 301. Optionally, the device may also include a communication interface 302 and a bus 303. The processor 304, the communication interface 302, and the memory 301 may communicate with each other through the bus 303. The communication interface 302 may be used for information transmission. The processor 304 may call the logic instructions in the memory 301 to execute the IROS-based ultra-large file transmission method of the above embodiment.

[0035] In addition, the logic instructions in the memory 301 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0036] Memory 301, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the methods in the embodiments of the present disclosure. Processor 304 executes the program instructions / modules stored in memory 301 to perform functional applications and data processing, thereby implementing the IROS-based large file transfer method in the above-mentioned embodiments.

[0037] The memory 301 may include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data generated based on the use of the terminal device. Furthermore, the memory 301 may include high-speed random access memory and non-volatile memory.

[0038] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned IROS-based very large file transmission method.

[0039] The aforementioned computer-readable storage medium may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0040] The technical solutions of the embodiments of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present disclosure. The aforementioned storage medium may be a non-transitory storage medium, including: a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disk, and other media that can store program code, or a transient storage medium.

[0041] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art will be able to modify the technical solutions described in the aforementioned embodiments or substitute equivalents for some of the technical features. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention shall be included within the scope of protection of the present invention.

Claims

1. A method for transmitting large files based on IROS, characterized in that: It includes a file sending server and a file receiving server; the file sending server includes a sending directory, a file sending module and an intelligent robot operating system, and the file receiving server includes a receiving directory, a file receiving module and an intelligent robot operating system; The sending directory stores files to be sent; the file sending module is used to convert the files in the sending directory into ordered messages and publish them to the intelligent robot operating system of the file sending server; the intelligent operation robot system in the file sending server is used to send the cached ordered messages in an orderly manner to the intelligent robot operating system of the file receiving server; the file receiving module of the file receiving server is used to extract the ordered messages in the intelligent robot operating system of the file receiving server, and restore the ordered messages to corresponding files and store them in the receiving directory; The method comprises: The file sending module in the file sending server periodically traverses the sending directory. When it traverses to the file to be transmitted, it obtains the size of the file to be transmitted, reads the content of the file to be transmitted in a streaming order according to the set fragment size, converts the content into ordered messages, and caches the ordered messages in an orderly manner in the topic of the intelligent robot operating system of the file sending server; The intelligent robot operating system of the file sending server reads out the cached ordered messages in the order in which they enter the cache, and sends them to the intelligent robot operating system of the file receiving server in the order in which they are read out. After receiving the ordered messages, the intelligent robot operating system of the file receiving server caches them in the topic of the intelligent robot operating system of the file receiving server in an orderly manner. The file receiving module subscribes to the topic messages in the intelligent robot operating system in the file receiving server, obtains the ordered messages of the files in real time and order, and writes them into the receiving directory in a streaming manner in real time according to the order in which the messages are obtained.

2. The IROS-based large file transmission method according to claim 1, characterized in that: The file sending server and the file receiving server are connected based on an IP network, including a local area network or a wide area network.

3. The IROS-based large file transmission method according to claim 1, characterized in that: The files in the sending directory include super-large files, and the super-large files are larger than or equal to 4 GB.

4. The IROS-based large file transmission method according to claim 2, characterized in that: The file sending module reads the file contents in the sending directory in a streaming order and converts the read file contents into ordered messages; the file receiving module writes the obtained ordered messages into the receiving directory in a streaming manner.

5. The IROS-based large file transmission method according to claim 1, characterized in that: The ordered messages converted by the file sending module are cached in the topic of the intelligent robot operating system of the file sending server, and the ordered messages received by the file receiving module are cached in the topic of the intelligent robot operating system of the file receiving server.

6. An IROS-based ultra-large file transmission device, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the IROS-based very large file transmission method according to any one of claims 1 to 5 when running the program instructions.

7. An IROS-based ultra-large file transfer device, characterized in that: include: Product body; The IROS-based ultra-large file transmission device as described in claim 6 is installed in the product body.

8. A storage medium storing program instructions, characterized in that: When the program instructions are run, the IROS-based large file transmission method according to any one of claims 1 to 5 is executed.

Images