A remote file processing method, device, equipment, medium and program product

By generating binary stream chunks and using port grouping for transmission, the stability and security issues of remote large file transmission are solved, enabling fast remote file access and improving the user experience.

CN119697174BActive Publication Date: 2025-12-12INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411831070.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-12
Publication Date
2025-12-12
Estimated Expiration
2044-12-12

AI Technical Summary

Technical Problem

Remote file transfer, especially of large files, is subject to risks such as long transfer times, data corruption due to network instability, and security vulnerabilities. Furthermore, current technologies require the complete download of the file before processing, which impacts user experience.

Method used

Binary stream chunks are generated from a file database, grouped by the server, and transmitted to the user end via a port. Combined with network transmission protocols and retransmission mechanisms, file integrity and security are ensured, and rapid processing is supported before remote file access.

Benefits of technology

It improves the stability and efficiency of large file transfers, ensures file integrity, supports fast access to remote files, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119697174B_ABST
    Figure CN119697174B_ABST
Patent Text Reader

Abstract

The application discloses a remote file processing method, device, equipment, medium and program product. The method comprises the following steps: when it is determined that a user end initiates a download request for a first file, a plurality of binary stream cut blocks are generated according to the first file through a file database, and the binary stream cut blocks are sent to a server; the binary stream cut blocks are grouped according to the number of ports through the server, a corresponding relationship between each cut block group and each port is established, and the binary stream cut blocks are transmitted to the user end through the ports corresponding to each cut block group respectively and a first network transmission protocol; after it is determined that the binary stream cut blocks are received, the first file is restored according to the binary stream cut blocks through the user end, and the first file is stored. The technical scheme is suitable for the distributed technology field, can realize remote downloading of a super large file, and improves the transmission stability of the super large file.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of distributed technology, and in particular to a remote file processing method, device, equipment, medium and program product. BACKGROUND

[0002] Under the background of the vigorous development of modern computer information technology, the analysis and processing of various types of digital information all depend on files on the file system, and files usually need to be loaded into local memory before they can be normally used.

[0003] For a remote file with a large amount of data, the time waiting for the complete transmission of the file will be very long, and the transmission of the remote file is easily affected by the stability of the network, resulting in problems such as data damage or file transmission failure, affecting the subsequent use of the file, and when the remote file is transmitted through the network, the network message of the file transmission is easily eavesdropped by hackers, thereby causing security risks such as information leakage. SUMMARY

[0004] The present application provides a remote file processing method, device, equipment, medium and program product, which can realize remote downloading of super large files and improve the transmission stability of super large files.

[0005] According to an aspect of the present application, a remote file processing method is provided, which is executed by a user terminal, a server and a file database in a remote file processing system, comprising:

[0006] When the file database determines that the user terminal initiates a download request for a first file, it generates a plurality of binary stream cut blocks according to the first file and sends each binary stream cut block to the server;

[0007] The server groups the binary stream cut blocks according to the number of ports, establishes a corresponding relationship between each cut block group and each port, and transmits the binary stream cut blocks to the user terminal through the ports corresponding to each cut block group and the first network transmission protocol;

[0008] After the user terminal determines that the reception of the binary stream cut blocks is complete, it restores the first file according to each binary stream cut block and stores the first file.

[0009] Optionally, when the file database determines that the user terminal initiates a download request for a first file, it generates a plurality of binary stream cut blocks according to the first file, comprising:

[0010] When the file database determines that the user terminal initiates a download request for a first file, it performs binary encoding on the first file to obtain a binary file;

[0011] The file database is used to divide the binary file according to a predefined chunk size, and each binary stream chunk is labeled according to the order of the binary stream chunks in the binary file.

[0012] The advantage of this arrangement is that the binary file is divided according to a predefined chunk size, which is more flexible than directly transmitting the entire large file in an unstable network environment or limited bandwidth. During network transmission, the chunk method makes each chunk relatively independent and sequentially associated. Even if a chunk is lost or damaged during transmission, the problematic chunk can be retransmitted through the retransmission mechanism, ensuring that the final received file is complete and accurate, thereby enhancing the reliability of the entire file download process.

[0013] Optionally, the user terminal is used to restore the first file according to the binary stream chunks after determining that the reception of the binary stream chunks is complete, including:

[0014] The user terminal is used to combine the binary stream chunks according to the labels of the binary stream chunks after determining that the reception of the binary stream chunks is complete.

[0015] The user terminal is used to decode the combined binary stream total file to restore the first file.

[0016] The advantage of this arrangement is that during network transmission, the file is divided into multiple binary stream chunks for transmission. Due to the complexity of the network environment, these chunks may arrive at the user terminal in different orders, or individual chunks may be delayed during transmission. By combining the binary stream chunks according to their labels, it can be ensured that these chunks can be combined into a complete binary stream total file in the correct order.

[0017] Optionally, the binary stream chunks are transmitted to the user terminal through the ports corresponding to each chunk group and the first network transmission protocol, further including:

[0018] When the service terminal determines that the transmission of at least one binary stream chunk in the target chunk group fails, it controls the target chunk group to be retransmitted, and when it determines that the retransmission of the target chunk group fails, it switches the target chunk group from the current port to the target port for transmission.

[0019] When the service terminal determines that the transmission of each chunk group is interrupted, it records the breakpoints of each chunk group, and when it determines that the port transmission has returned to normal, it continues the transmission according to the breakpoints of each chunk group.

[0020] The advantage of the arrangement is that the server can better cope with various complex network scenarios, whether it is a short network fluctuation or a long network failure, and the system has corresponding measures to ensure smooth file transmission, thereby improving the adaptability of the entire file transmission system in different network environments.

[0021] Optionally, the remote file processing method further comprises:

[0022] Through the user end, when the user initiates a remote access operation on a second file, a target access request for the second file is sent to the server end;

[0023] Through the server end, when the target access request sent by the user end is received, it is determined whether the user end has target access authority, and when it is determined that the user end has target access authority, the access behavior of the user end copied by the second network transmission protocol is obtained;

[0024] Through the server end, the target byte stream is determined according to the access behavior, and the target byte stream is sent to the user end by using the second network transmission protocol, so that the user end performs a remote access operation on the second file according to the target byte stream.

[0025] The advantage of the arrangement is that fast remote access of large files can be realized before the user end downloads the file, solving the problem in the prior art that the entire file needs to be downloaded to the local before the file can be processed, and improving the user remote access experience.

[0026] Optionally, through the server end, the target byte stream is determined according to the access behavior, comprising:

[0027] Through the server end, the access behavior is played back, the byte stream used in the playback process is obtained, and the byte stream used in the playback process is determined as the target byte stream.

[0028] The advantage of the arrangement is that the target byte stream can be quickly extracted and fed back to the user end by playing back the access behavior to obtain the target byte stream, so that the file content related to the current access operation of the user end can be quickly displayed on the user end, thereby improving the access efficiency.

[0029] According to another aspect of the present application, a remote file processing device is provided, which is cooperatively executed by a user end, a server end and a file database in a remote file processing system, comprising:

[0030] A file chunking module is configured to, through the file database, when it is determined that the user end initiates a download request for a first file, generate a plurality of binary stream chunks according to the first file, and send each binary stream chunk to the server end;

[0031] The chunk transmission module is configured to group the binary stream chunks according to the number of ports, establish a corresponding relationship between each chunk group and each port, and transmit the binary stream chunks to the user terminal through the ports corresponding to each chunk group and the first network transmission protocol.

[0032] The file restoration module is configured to restore the first file according to each binary stream chunk and store the first file after determining that the receiving of the binary stream chunks is completed.

[0033] According to another aspect of the present application, an electronic device is provided, which comprises:

[0034] at least one processor; and

[0035] a memory connected to the at least one processor in communication; wherein

[0036] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the remote file processing method according to any one of the embodiments of the present application.

[0037] According to another aspect of the present application, a computer readable storage medium is provided, which stores computer instructions for enabling a processor to implement the remote file processing method according to any one of the embodiments of the present application when executed by the processor.

[0038] According to another aspect of the present application, a computer program product is provided, which comprises a computer program for implementing the remote file processing method according to any one of the embodiments of the present application when executed by a processor.

[0039] The technical solution of the embodiments of the present application can realize the remote downloading of large files, effectively improve the stability and transmission efficiency of file transmission, and ensure the file security and correctness of the downloaded files by using a file database to generate a plurality of binary stream chunks according to a first file when a user terminal initiates a downloading request for the first file, sending each binary stream chunk to a server, grouping the binary stream chunks according to the number of ports using the server, establishing a corresponding relationship between each chunk group and each port, transmitting the binary stream chunks to the user terminal through the ports corresponding to each chunk group and the first network transmission protocol, and restoring the first file according to each binary stream chunk and storing the first file using the user terminal after determining that the receiving of the binary stream chunks is completed.

[0040] It is to be understood that the details set forth herein do not limit the scope of the embodiments of the application to the specific embodiments described. Rather, the scope of the embodiments of the application is to be defined by the claims. BRIEF DESCRIPTION OF DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0042] Figure 1 is a flow chart of a remote file processing method according to an embodiment of the present application;

[0043] Figure 2 is a structural schematic diagram of a remote file processing system according to an embodiment of the present application;

[0044] Figure 3 is a port transmission schematic diagram according to an embodiment of the present application;

[0045] Figure 4 is a flow chart of another remote file processing method according to an embodiment of the present application;

[0046] Figure 5 is a flow chart of another remote file processing method according to an embodiment of the present application;

[0047] Figure 6 is a structural schematic diagram of a remote file processing device according to an embodiment of the present application;

[0048] Figure 7 is a structural schematic diagram of an electronic device implementing the remote file processing method according to an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the technical personnel in the art better understand the present application scheme, the following will combine the drawings in the embodiments of the present application, and the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only some embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present application.

[0050] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and in the above-described drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not have to be limited to only those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0051] Embodiment one

[0052] Figure 1 A flowchart of a remote file processing method provided for the first embodiment of the present application, the present embodiment can be applicable to remote transmission of a super large file, saving the super large file in the local of the user end, the method can be executed by a remote file processing device, which can be realized in the form of hardware and / or software, and can be generally configured in a remote file processing system with data processing function. As shown in the figure, the method comprises: Figure 1

[0053] S110, by the file database, when it is determined that the user end initiates a download request for the first file, a plurality of binary stream cuttings are generated according to the first file, and each binary stream cutting is sent to the server.

[0054] Figure 2 A structural schematic diagram of an optional remote file processing system. As shown in the figure, a personal computer can represent a user end, which is controlled by a user, in the remote file processing system, a plurality of user ends can be configured with a server, each user end is connected with the server, Figure 2 The service program in the figure can represent the server, the file can represent the file database, and the user end can download or access the file in the file database. Figure 2

[0055] Optionally, the file database can be used to store files, and when the user end initiates a remote file download or a remote file access, the corresponding file information is sent to the server.

[0056] Optionally, the first file can refer to a file that needs to be remotely downloaded by the user end and has been stored in the file database.

[0057] Optionally, when the user end initiates a download request for the first file, the download request for the first file can be sent to the file database through the server.​​

[0058] Optionally, the server can first check the download request to determine whether the user terminal has the download permission, and when it is determined that the user terminal has the download permission of the first file, the download request for the first file is sent to the file database. The server can perform permission checking through the document security protection system shown in Figure 2 .

[0059] Optionally, the first file can be transmitted in binary form between the file database, the server and the user terminal. The binary stream is a sequence of binary data.

[0060] Optionally, the file database can encode the first file to generate a binary file, and perform chunking on the binary file according to a pre-defined chunk size. Each chunk is encoded according to the order of each chunk in the first file to distinguish the order of each chunk of the first file.

[0061] S120, through the server, the binary stream chunks are grouped according to the number of ports, the correspondence between each chunk group and each port is established, and the binary stream chunks are transmitted to the user terminal through the ports corresponding to each chunk group and the first network transmission protocol.

[0062] Optionally, the server and the user terminal can transmit the binary stream chunks through multiple ports. The ports can use the first communication protocol for transmission. The first communication protocol can refer to a communication protocol used to store files locally on a user computer. In the example shown in Figure 2 , the first communication protocol is a file transfer protocol, which is a self-developed communication protocol.

[0063] Optionally, the number of ports can refer to the number of ports configured in the server for downloading files. The server can establish a chunk group matched with each port according to the number of binary stream chunks and the number of ports. A plurality of binary stream chunks are reasonably allocated in each chunk group. The ports are used to transmit each binary stream chunk in the chunk group corresponding to the port to the user terminal.

[0064] Figure 3 is an optional port transmission schematic diagram. As shown in Figure 3 , the left side block is the already allocated chunk group. The chunk group can be identified by the corresponding port name. After determining the port corresponding to each chunk group, the binary stream chunks are transmitted in parallel through the ports in the right side block.

[0065] S130, through the user terminal, after determining that the reception of the binary stream chunks is completed, the first file is restored according to each binary stream chunk, and the first file is stored.

[0066] Optionally, when the user terminal determines that all binary stream segments are received, the order of the binary stream segments can be determined according to the labels of the binary stream segments, and the binary stream segments can be merged according to the order to obtain a merged binary stream total file. At this time, the binary stream total file is equivalent to a file obtained by binary encoding the first file. After decoding the binary stream total file, the first file can be obtained.

[0067] Optionally, in the above method, a method for a user terminal to remotely download a file from a file database is provided, but a remote file processing system as shown in Figure 2 Optionally, in the above method, a method for a user terminal to remotely download a file from a file database is provided, but a remote file processing system as shown in

[0068] Through the user terminal, when it is determined that the user initiates an upload request for a third file, a plurality of binary stream segments are generated according to the third file, and the binary stream segments are sent to the server by using a first network transmission protocol.

[0069] Through the server, the binary stream segments are grouped according to the number of ports, a corresponding relationship between each segment group and each port is established, and the binary stream segments are transmitted to the file database through the ports corresponding to each segment group and a third network transmission protocol.

[0070] Through the file database, after it is determined that the binary stream segments are received, the third file is restored according to the binary stream segments, and the third file is stored.

[0071] Optionally, the third file can refer to a remotely uploaded file, and the third network transmission protocol can refer to TCP (Transmission Control Protocol), and the reliability of the TCP protocol is used to realize file uploading.

[0072] The technical scheme of the embodiment of the application can remotely download a large file by using the file database, when it is determined that the user terminal initiates a download request for the first file, generating a plurality of binary stream segments according to the first file and sending the binary stream segments to the server, using the server to group the binary stream segments according to the number of ports, establishing a corresponding relationship between each segment group and each port, and transmitting the binary stream segments to the user terminal through the ports corresponding to each segment group and a first network transmission protocol, using the user terminal to restore the first file according to the binary stream segments after it is determined that the binary stream segments are received, and storing the first file. The stability and transmission efficiency of file transmission are effectively improved, the file safety during remote file downloading is ensured, and the correctness of the downloaded file is ensured.

[0073] Embodiment Two

[0074] Figure 4 A flow chart of a remote file processing method provided for Embodiment Two of the present application, which is based on the above-mentioned embodiment, specifically describes a remote file downloading method. As shown in the figure, the method comprises: Figure 4

[0075] S210, through the file database, when determining that the user end initiates a downloading request for the first file, binary encoding the first file to obtain a binary file.

[0076] S220, through the file database, according to a pre-defined chunk size, chunking the binary file, and according to the order of each binary stream chunk in the binary file, labeling each binary stream chunk.

[0077] S230, through the file database, sending each binary stream chunk to the service end.

[0078] S240, through the service end, grouping the binary stream chunks according to the number of ports, establishing a corresponding relationship between each chunk group and each port, and through the ports corresponding to each chunk group respectively and the first network transmission protocol, transmitting the binary stream chunks to the user end.

[0079] In addition, through the ports corresponding to each chunk group respectively and the first network transmission protocol, transmitting the binary stream chunks to the user end, further comprises:

[0080] Through the service end, when determining that at least one binary stream chunk in the target chunk group fails to be transmitted, controlling the target chunk group to be re-transmitted, and when determining that the re-transmission of the target chunk group fails, switching the target chunk group from the current port to the target port for transmission;

[0081] Through the service end, when determining that all the chunk groups interrupt the transmission, recording the breakpoints of all the chunk groups, and when determining that the port transmission returns to normal, continuing the transmission according to the breakpoints of all the chunk groups.

[0082] Optionally, the target group can refer to a group in which a chunk fails to be transmitted. If the chunk transmission fails accidentally, the current port corresponding to the target group can be used to attempt re-transmission. If the re-transmission still fails, the target port can be switched to, and after the transmission task in the target port is completed, the target group can be re-transmitted using the target port.

[0083] Optionally, when all the chunk groups interrupt the transmission due to network interruption or other reasons, the breakpoints of all the chunk groups can be recorded, and after it is determined that the port transmission returns to normal, the re-transmission can be started from the binary stream chunk where the breakpoint is located.​

[0084] S250, by the user terminal, after determining that the receiving of the binary stream chunks is completed, merging the binary stream chunks according to the labels of the binary stream chunks.

[0085] S260, by the user terminal, decoding the merged binary stream total file to restore the first file.

[0086] The technical scheme of the embodiment of the application, by using the file database, when determining that the user terminal initiates a download request for the first file, generating a plurality of binary stream chunks according to the first file, and sending each binary stream chunk to the server, using the server, grouping the binary stream chunks according to the number of ports, establishing a corresponding relationship between each chunk group and each port, and transmitting the binary stream chunks to the user terminal through the ports corresponding to each chunk group respectively and the first network transmission protocol, using the user terminal, after determining that the receiving of the binary stream chunks is completed, restoring the first file according to each binary stream chunk, and storing the first file, can realize remote downloading of large files, effectively improve the stability and transmission efficiency of file transmission, and ensure the file safety during remote file downloading and the correctness of the downloaded file.

[0087] Embodiment three

[0088] Figure 5 A flowchart of a remote file processing method provided by the third embodiment of the application, the embodiment specifically describes a remote file access method based on the above-mentioned embodiments. As shown in the figure, the method comprises: Figure 5

[0089] S310, by the user terminal, when the user initiates a remote access operation of a second file, sending a target access request for the second file to the server.

[0090] It can be understood that for the loading of a remote file, a common method is to perform network transmission of the file to a local disk in advance, and after the complete transmission of the file, the file is read from the disk to the memory for use, but if the data volume of the remote file is large, the waiting time for the complete transmission of the file will be very long, which seriously affects the user experience or the efficiency of data analysis and processing of the program, therefore, in the embodiment, a remote file processing method is proposed, which enables the user terminal to quickly and conveniently perform a remote file access operation before the file is downloaded.

[0091] Optionally, the remote access operation type can include but is not limited to a viewing operation and an editing operation.

[0092] Optionally, the second file can refer to a file that the user terminal currently needs to perform a remote operation, and the second file is stored in the file database.​

[0093] Optionally, the target access request can include the file identifier of the second file, the remote access operation type of the user terminal, and the user terminal identifier.

[0094] Optionally, the user terminal can be used by a specific user or a group, and the group can refer to an organization or a department in an enterprise, and the user terminal identifier can be used to distinguish the user of the user terminal.

[0095] S320, through the service terminal, when receiving the target access request sent by the user terminal, determining whether the user terminal has the target access permission, and when determining that the user terminal has the target access permission, obtaining the access behavior of the user terminal copied by the second network transmission protocol.

[0096] Optionally, in the remote file processing system as shown in Figure 2 The document security protection system can be installed in the service terminal or connected to the service terminal.

[0097] Optionally, the document security protection system can include an access permission list of each file in the file database, and the access permission list can include a plurality of user terminal identifiers with viewing permission and a plurality of user terminal identifiers with editing permission of each file, for example, for the target file, the access permission list can store each user identifier and each group identifier with the target document viewing permission, and each user identifier and each group identifier with the target document editing permission.

[0098] Optionally, the service terminal can send the file identifier, the remote access operation type of the user terminal, and the user terminal identifier in the target access request to the document security protection system, and obtain the feedback result of the document security protection system, so as to determine whether the user terminal has the target access permission.

[0099] Optionally, through the document security protection system, when it is determined that the user terminal does not have the target access permission of the second file, the file processing failure information is returned to the user terminal.

[0100] It can be understood that for a large file, the user only involves a small part of the file when viewing or editing, and the access behavior of the user terminal can refer to the part of the file currently viewed or edited by the user, for example, the access behavior of the user terminal can be to view the second page of the second file.

[0101] Optionally, when it is determined that the user terminal has the target access authority, the access behavior of the user terminal is copied through the second network transmission protocol, and the copied access behavior is sent to the server, the server replays the access behavior to record the byte stream used in the replay process, and the byte stream used in the replay process can be used as the target byte stream.

[0102] S330, through the server, the target byte stream is determined according to the access behavior, and the target byte stream is sent to the user terminal by using the second network transmission protocol, so that the user terminal performs remote access operation of the second file according to the target byte stream.

[0103] Among them, through the server, the target byte stream is determined according to the access behavior, including:

[0104] Through the server, the access behavior is replayed, the byte stream used in the replay process is obtained, and the byte stream used in the replay process is determined as the target byte stream.

[0105] Optionally, the second network transmission protocol can be Figure 2 The server bytes protocol in the above-mentioned, which is also a user's self-developed protocol, the second network transmission protocol can be used to transmit the byte stream required for current viewing or editing of the file, so as to achieve the purpose of fast access.

[0106] The technical scheme of the embodiment of the application, by using the user terminal, when the user initiates the remote access operation of the second file, the target access request for the second file is sent to the server, by using the server, when the target access request sent by the user terminal is received, it is determined whether the user terminal has the target access authority, and when it is determined that the user terminal has the target access authority, the access behavior of the user terminal copied by the second network transmission protocol is obtained, the target byte stream is determined according to the access behavior, and the target byte stream is sent to the user terminal by using the second network transmission protocol, so that the user terminal performs remote access operation of the second file according to the target byte stream. The mode can realize fast remote access of large files before the user terminal downloads the file, solve the disadvantages that the complete file needs to be downloaded to the local before the file can be processed in the prior art, and improve the user remote access experience.

[0107] Embodiment four

[0108] Figure 6 A structure diagram of a remote file processing device provided by the fourth embodiment of the application. As shown in Figure 6 The device includes a file cutting module 410, a cutting transmission module 420 and a file restoration module 430.

[0109] The file cutting module 410 is configured to, when determining that the user terminal initiates a download request for the first file, generate a plurality of binary stream cutting blocks according to the first file through the file database, and send each binary stream cutting block to the server.

[0110] The cutting block transmission module 420 is configured to, through the server, group the binary stream cutting blocks according to the number of ports, establish a corresponding relationship between each cutting block group and each port, and transmit the binary stream cutting blocks to the user terminal through the ports corresponding to each cutting block group respectively and the first network transmission protocol.

[0111] The file restoration module 430 is configured to, through the user terminal, after determining that the receiving of the binary stream cutting blocks is completed, restore the first file according to each binary stream cutting block, and store the first file.

[0112] The technical scheme of the embodiment of the application can realize the remote downloading of a large file, effectively improve the stability and transmission efficiency of file transmission, ensure the file safety during the remote file downloading process, and ensure the correctness of the downloaded file, by the following manner: when determining that the user terminal initiates a download request for the first file, generating a plurality of binary stream cutting blocks according to the first file through the file database, and sending each binary stream cutting block to the server, grouping the binary stream cutting blocks according to the number of ports through the server, establishing a corresponding relationship between each cutting block group and each port, and transmitting the binary stream cutting blocks to the user terminal through the ports corresponding to each cutting block group respectively and the first network transmission protocol, and after determining that the receiving of the binary stream cutting blocks is completed, restoring the first file according to each binary stream cutting block through the user terminal, and storing the first file.

[0113] On the basis of the above-mentioned embodiments, the file cutting module 410 can be specifically configured to:

[0114] When determining that the user terminal initiates a download request for the first file, performing binary encoding on the first file through the file database to obtain a binary file;

[0115] According to the file database, cutting the binary file according to a pre-defined cutting size, and labeling each binary stream cutting block according to the order of each binary stream cutting block in the binary file.

[0116] On the basis of the above-mentioned embodiments, the file restoration module 430 can be specifically configured to:

[0117] After determining that the receiving of the binary stream cutting blocks is completed, merging the binary stream cutting blocks according to the labels of the binary stream cutting blocks through the user terminal.

[0118] The user end decodes the combined binary stream total file to restore the first file.

[0119] On the basis of the above embodiments, the chunk transmission module 420 can also be used for:

[0120] When the service end determines that the transmission of at least one binary stream chunk in the target chunk group fails, the service end controls the retransmission of the target chunk group, and when it is determined that the retransmission of the target chunk group fails, the target chunk group is switched from the current port to the target port for transmission.

[0121] When the service end determines that the transmission of each chunk group is interrupted, the service end records the breakpoints of each chunk group, and when it is determined that the port transmission is restored to normal, the transmission is continued according to the breakpoints of each chunk group.

[0122] On the basis of the above embodiments, a file remote access module can also be included, comprising:

[0123] The access request sending unit is configured to, through the user end, when the user initiates a remote access operation on the second file, send a target access request for the second file to the service end.

[0124] The access behavior acquisition unit is configured to, through the service end, when the target access request sent by the user end is received, determine whether the user end has target access authority, and when it is determined that the user end has target access authority, acquire the access behavior of the user end copied by the second network transmission protocol.

[0125] The byte stream transmission unit is configured to, through the service end, determine a target byte stream according to the access behavior, and send the target byte stream to the user end using the second network transmission protocol, so that the user end performs a remote access operation on the second file according to the target byte stream.

[0126] On the basis of the above embodiments, the byte stream transmission unit can be specifically used for:

[0127] The service end replays the access behavior, acquires the byte stream used in the replay process, and determines the byte stream used in the replay process as the target byte stream.

[0128] The remote file processing device provided in the embodiments of the present application can perform the remote file processing method provided in any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of the execution method.

[0129] Embodiment five

[0130] Figure 7A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0131] like Figure 7 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0132] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0133] Processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, central processing unit (CPU), graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the remote file processing method as described in the embodiments of the present invention. That is:

[0134] When it is determined that the user end initiates a download request for the first file, the file database generates a plurality of binary stream chunks according to the first file, and sends each binary stream chunk to the service end;

[0135] The service end groups the binary stream chunks according to the number of ports, establishes a corresponding relationship between each chunk group and each port, and transmits the binary stream chunks to the user end through the ports corresponding to each chunk group respectively and the first network transmission protocol;

[0136] When it is determined that the user end initiates a download request for the first file, the file database generates a plurality of binary stream chunks according to the first file, and sends each binary stream chunk to the service end;

[0137] In some embodiments, the remote file processing method can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded onto the RAM 13 and executed by the processor 11, one or more steps of the remote file processing method described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to perform the remote file processing method by any other suitable means, such as by means of firmware.

[0138] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0139] Computer programs for implementing the methods of the present application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer program, when executed, can cause instructions defined in the flow charts and / or block diagrams to be implemented. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine as a stand-alone software package, and partially on a remote machine or entirely on a remote machine or server.

[0140] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer-readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of a machine-readable storage medium will include one or more lines of a program of instructions in a transitory signal, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0141] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0142] The systems and techniques described herein can be implemented in a computing system that includes a back end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front end component, e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described herein, or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0143] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0144] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the scope of the present disclosure. For example, the steps recited in the present disclosure can be performed in parallel, in series, or in a different order, and the present disclosure is not limited herein as such.

[0145] The specific embodiments described above are not intended to limit the scope of the present disclosure. Those skilled in the art will understand that various modifications, combinations, sub-combinations, and alternatives can be made to the specific embodiments without departing from the spirit and principles of the present disclosure. Any further modifications, equivalents, and / or alternatives come within the scope of the present disclosure as recited by the claims.

Claims

1. A remote file processing method, executed in cooperation by a user terminal, a server terminal, and a file database in a remote file processing system, characterized in that, include: Using the file database, when it is determined that a user has initiated a download request for the first file, multiple binary stream segments are generated based on the first file, and each binary stream segment is sent to the server. The server divides the binary stream into groups based on the number of ports, establishes a correspondence between each group and each port, and transmits the binary stream to the user terminal through the port corresponding to each group and the first network transmission protocol. After confirming the completion of receiving binary stream segments, the user terminal restores the first file according to each binary stream segment and stores the first file. The remote file processing method further includes: When a user initiates a remote access operation for a second file through the user's client, a target access request for the second file is sent to the server. When the server receives a target access request from the user, it determines whether the user has the target access permission. If the user has the target access permission, it obtains the user's access behavior copied by the second network transmission protocol. The server determines the target byte stream based on the access behavior and sends the target byte stream to the user terminal using the second network transmission protocol, so that the user terminal can perform remote access operations on the second file based on the target byte stream. Specifically, determining the target byte stream based on the access behavior via the server includes: The server replays the access behavior, obtains the byte stream used in the replay process, and determines the byte stream used in the replay process as the target byte stream.

2. The method according to claim 1, characterized in that, Using the file database, when it is determined that a user has initiated a download request for a first file, multiple binary stream segments are generated based on the first file, including: Using the file database, when it is determined that a user has initiated a download request for the first file, the first file is binary encoded to obtain a binary file; The binary file is divided into blocks according to the predefined block size using the file database, and each binary stream block is labeled according to its order in the binary file.

3. The method according to claim 2, characterized in that, After confirming the completion of receiving binary stream segments via the user terminal, the first file is reconstructed based on each binary stream segment, including: After confirming the completion of receiving binary stream segments, the user terminal merges the binary stream segments according to their labels. The user terminal decodes the merged binary stream file to restore the first file.

4. The method according to claim 1, characterized in that, The binary stream segments are transmitted to the user terminal via the ports corresponding to each segment and the first network transmission protocol, and also include: Through the server, when it is determined that at least one binary stream segment in the target segment group has failed to be transmitted, the server controls the target segment group to be retransmitted, and when it is determined that the retransmission of the target segment group has failed, the server switches the target segment group from the current port to the target port for transmission. The server records the breakpoint of each segmented group when it is determined that the transmission of each segmented group is interrupted. When it is determined that the port transmission has resumed normally, the transmission continues to be executed according to the breakpoint of each segmented group.

5. A remote file processing device, comprising a user terminal, a server terminal, and a file database in a remote file processing system, characterized in that, include: The file segmentation module is used to generate multiple binary stream segments based on the first file when it is determined that the user has initiated a download request for the first file, and send each binary stream segment to the server. The chunking and transmission module is used to group the binary stream into chunks according to the number of ports through the server, establish the correspondence between each chunk group and each port, and transmit the binary stream chunks to the user terminal through the port corresponding to each chunk group and the first network transmission protocol. The file restoration module is used to restore the first file according to each binary stream segment after confirming that the received binary stream segments have been completed through the user terminal, and to store the first file. The remote file processing device further includes a remote file access module, comprising: The access request sending unit is used to send a target access request for the second file to the server through the user terminal when the user initiates a remote access operation for the second file; The access behavior acquisition unit is used to determine whether the user terminal has the target access permission when the server receives the target access request sent by the user terminal, and when it is determined that the user terminal has the target access permission, acquire the access behavior of the user terminal copied by the second network transmission protocol. The byte stream transmission unit is used to determine the target byte stream based on the access behavior through the server, and send the target byte stream to the user terminal using the second network transmission protocol, so that the user terminal can perform remote access operation of the second file based on the target byte stream; Specifically, the byte stream transmission unit is used for: The server replays the access behavior, obtains the byte stream used in the replay process, and determines the byte stream used in the replay process as the target byte stream.

6. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the remote file processing method according to any one of claims 1-4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the remote file processing method according to any one of claims 1-4.

8. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the remote file processing method according to any one of claims 1-4.

Citation Information

Patent Citations

  • Access traffic file generation method and device, server and storage medium

    CN108040045A

  • Method, device and equipment for accessing file system

    CN108833369A