Remote file processing method and device, equipment, medium and program product
By dividing remote files into binary streams and slicing them with server-side packet transmission methods, the stability and security of remote file transfers are solved, and efficient and reliable file transfer is achieved.
Patent Information
- Application Number
- CN202411831070.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-12
- Publication Date
- 2025-03-25
- Estimated Expiration
- 2044-12-12
AI Technical Summary
The transmission of remote files is easily affected by network stability, resulting in data corruption or file transfer failure, and there is a security risk of information leakage.
The file is divided into multiple binary streams and diced by the file database, and the server uses the grouping and transmission of dices according to the number of ports to ensure that each diced is transmitted independently and a retransmission mechanism is used to ensure file integrity.
It improves the transfer stability and efficiency of super-large files, ensures the integrity and security of files, and adapts to different network environments.
Smart Images

Figure CN119697174A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of distributed technology, and in particular to a remote file processing method, device, equipment, medium and program product. Background Art
[0002] With the rapid development of modern computer information technology, the analysis and processing of various types of digital information rely on files on the file system, and files usually need to be loaded into local memory before they can be used normally.
[0003] For remote files with large amounts of data, it takes a long time to wait for the file to be fully transmitted. The transmission of remote files is easily affected by network stability, resulting in problems such as data corruption or file transfer failure, affecting the subsequent use of the file. In addition, when remote files are transmitted over the network, the network messages of the file transmission are easily eavesdropped by hackers, leading to security risks such as information leakage. Summary of the invention
[0004] The present invention provides a remote file processing method, device, equipment, medium and program product, which can realize the remote download of super large files and improve the transmission stability of super large files.
[0005] According to one aspect of the present invention, a remote file processing method is provided, which is executed by a user end, a server end and a file database in a remote file processing system, and includes:
[0006] When it is determined through the file database that the user terminal initiates a download request for the first file, a plurality of binary stream blocks are generated according to the first file, and each binary stream block is sent to the server terminal;
[0007] The binary stream blocks are grouped by the server according to the number of ports, a correspondence between each block group and each port is established, and the binary stream blocks are transmitted to the user end through the ports corresponding to each block group and the first network transmission protocol;
[0008] After the user terminal determines that the receiving of the binary stream segments is completed, the first file is restored according to the binary stream segments, and the first file is stored.
[0009] Optionally, when it is determined through the file database that the user terminal initiates a download request for the first file, generating a plurality of binary stream segments according to the first file includes:
[0010] When it is determined through the file database that the user terminal initiates a download request for the first file, binary encoding is performed on the first file to obtain a binary file;
[0011] The binary file is segmented into blocks according to a predefined segmentation size through the file database, and each binary stream segment is numbered according to the order of each binary stream segment in the binary file.
[0012] The advantage of this setting is that the binary file is divided according to the pre-defined block size. Compared with directly transmitting the entire large file, it can be transmitted more flexibly in the case of unstable network environment or limited bandwidth. During the network transmission process, the block cutting method makes each block relatively independent and sequentially related. Even if a block has problems such as data loss or damage during the transmission process, the retransmission mechanism can be used to retransmit the problematic block in a targeted manner to ensure that the final received file is complete and error-free, thereby enhancing the reliability of the entire file download process.
[0013] Optionally, after determining that the receiving of the binary stream segments is completed, restoring the first file according to the binary stream segments by the user end includes:
[0014] After the user terminal determines that the receiving of the binary stream blocks is completed, the binary stream blocks are merged according to the labels of the binary stream blocks;
[0015] The combined binary stream total file is decoded through the user end to restore the first file.
[0016] The advantage of this setting is that during the network transmission process, the file is divided into multiple binary stream blocks for transmission. Due to the complexity of the network environment, these blocks may arrive at the user end in different orders, or individual blocks may arrive late during the transmission process. By merging the binary stream blocks according to their labels, it can be ensured that these blocks can be combined into a complete binary stream file in the correct order.
[0017] Optionally, the binary stream blocks are transmitted to the user end through the ports corresponding to the block groups and the first network transmission protocol, further comprising:
[0018] By means of the server, when it is determined that at least one binary stream block in the target block group fails to be transmitted, the target block group is controlled to be retransmitted, and when it is determined that the retransmission of the target block group fails, the target block group is switched from the current port to the target port for transmission;
[0019] Through the service end, when it is determined that the transmission of each block group is interrupted, the breakpoint of each block group is recorded, and when it is determined that the port transmission is restored to normal, the transmission is continued according to the breakpoint of each block group.
[0020] The advantage of this setting is that the server can better cope with various complex network scenarios. Whether it is a short-term network fluctuation or a long-term network failure, the system has corresponding measures to ensure the smooth progress of file transfer, thereby improving the adaptability of the entire file transfer system in different network environments.
[0021] Optionally, the remote file processing method further includes:
[0022] When the user initiates a remote access operation to the second file, the user sends a target access request for the second file to the server.
[0023] By the service end, when receiving a target access request sent by a user end, determining whether the user end has the target access right, and when determining that the user end has the target access right, obtaining the access behavior of the user end copied by the second network transmission protocol;
[0024] The target byte stream is determined by the server according to the access behavior, and the target byte stream is sent to the client using a second network transmission protocol, so that the client can perform a remote access operation on the second file according to the target byte stream.
[0025] The advantage of this setting is that it can achieve fast remote access to large files before the user downloads the files, which solves the disadvantage of the existing technology that the complete file needs to be downloaded locally before the file can be processed, and improves the user's remote access experience.
[0026] Optionally, determining the target byte stream according to the access behavior by the server includes:
[0027] The access behavior is replayed through the server, the byte stream used in the replay process is obtained, and the byte stream used in the replay process is determined as the target byte stream.
[0028] The advantage of this setting is that by replaying the access behavior to obtain the target byte stream, the byte stream required for the current access by the user end can be quickly extracted and fed back to the user end, thereby quickly displaying the file content related to the current access operation of the user end on the user end, thereby improving access efficiency.
[0029] According to another aspect of the present invention, a remote file processing device is provided, which is executed by a user end, a server end and a file database in a remote file processing system, and includes:
[0030] A file segmentation module, configured to generate a plurality of binary stream segments according to the first file through the file database when determining that the user terminal initiates a download request for the first file, and send each binary stream segment to the server;
[0031] A block transmission module, used to group the binary stream blocks according to the number of ports through the server, establish a corresponding relationship between each block group and each port, and transmit the binary stream blocks to the user end through the ports corresponding to each block group and the first network transmission protocol;
[0032] The file restoration module is used to restore the first file according to each binary stream block and store the first file through the user end after determining that the receiving binary stream block is completed.
[0033] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:
[0034] at least one processor; and
[0035] a memory communicatively connected to the at least one processor; wherein,
[0036] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the remote file processing method described in any embodiment of the present invention.
[0037] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the remote file processing method described in any embodiment of the present invention when executed.
[0038] According to another aspect of the present invention, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the remote file processing method according to any embodiment of the present invention is implemented.
[0039] The technical solution of the embodiment of the present invention utilizes a file database. When it is determined that a user terminal initiates a download request for a first file, multiple binary stream blocks are generated according to the first file, and each binary stream block is sent to a server. The server is used to group the binary stream blocks according to the number of ports, establish a correspondence between each block group and each port, and transmit the binary stream blocks to the user terminal through the ports corresponding to each block group and the first network transmission protocol. After determining that the reception of the binary stream blocks is completed, the user terminal restores the first file according to each binary stream block and stores the first file. This can realize remote downloading of large files, effectively improve the stability and efficiency of file transmission, and at the same time ensure the file security during the remote file download process and ensure the correctness of the downloaded file.
[0040] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0042] Figure 1 is a flowchart of a remote file processing method provided according to Embodiment 1 of the present invention;
[0043] Figure 2 is a schematic diagram of the structure of a remote file processing system provided according to an embodiment of the present invention;
[0044] Figure 3 is a port transmission schematic diagram provided according to an embodiment of the present invention;
[0045] Figure 4 is a flowchart of another remote file processing method provided according to Embodiment 2 of the present invention;
[0046] Figure 5 is a flowchart of another remote file processing method provided according to Embodiment 3 of the present invention;
[0047] Figure 6 is a schematic diagram of the structure of a remote file processing device provided according to a fourth embodiment of the present invention;
[0048] Figure 7 It is a structural schematic diagram of an electronic device for implementing the remote file processing method according to an embodiment of the present invention. DETAILED DESCRIPTION
[0049] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0050] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0051] Embodiment 1
[0052] Figure 1 This is a flowchart of a remote file processing method provided in the first embodiment of the present invention. This embodiment is applicable to the case where a very large file is transmitted remotely and stored locally on the user side. The method can be executed by a remote file processing device, which can be implemented in the form of hardware and / or software and can generally be configured in a remote file processing system with data processing functions. Figure 1 As shown, the method includes:
[0053] S110. When it is determined through the file database that the user terminal initiates a download request for the first file, a plurality of binary stream blocks are generated according to the first file, and each binary stream block is sent to the server terminal.
[0054] Figure 2 FIG. 1 is a schematic diagram of the structure of an optional remote file processing system. Figure 2 As shown, a personal computer can represent a client, and the user controls the personal computer. In a remote file processing system, multiple clients and a server can be configured, and each client is connected to the server. Figure 2 The service program in the file may represent the server, the file may represent the file database, and the user end may download or access the files in the file database.
[0055] Optionally, the file database can be used to store files and send corresponding file information to the server when the user initiates remote file download or remote file access.
[0056] Optionally, the first file may refer to a file that has been stored in a file database and that the user terminal needs to download remotely.
[0057] Optionally, when the user terminal initiates a download request for the first file, the download request for the first file may be sent to the file database through the server terminal.
[0058] Optionally, the server may first verify the download request to determine whether the user terminal has the download authority. When it is determined that the user terminal has the download authority for the first file, the server sends the download request for the first file to the file database. Figure 2 The document security protection system shown in the figure performs permission verification.
[0059] Optionally, the first file may be transmitted in binary form between the file database, the server and the client, and the binary stream is a series of binary data sequences.
[0060] Optionally, the file database may encode the first file to generate a binary file, and cut the binary file into pieces according to a predefined piece size, and encode each piece according to the order of each piece in the first file to distinguish the order of each piece of the first file.
[0061] S120, through the server, grouping the binary stream blocks according to the number of ports, establishing a correspondence between each block group and each port, and transmitting the binary stream blocks to the user end through the ports corresponding to each block group and the first network transmission protocol.
[0062] Optionally, the server and the user can transmit binary stream blocks through multiple ports, and the ports can be transmitted using a first communication protocol. The first communication protocol can refer to a communication protocol used to store files locally on the user's computer. Figure 2 In the example shown, the first communication protocol is the file transfer protocol, which is a self-developed communication protocol.
[0063] Optionally, the number of ports may refer to the number of ports configured in the server for downloading files. The server may establish a block grouping that matches each port according to the number of binary stream blocks and the number of ports. Multiple binary stream blocks may be reasonably allocated in each block group. The port is used to transmit each binary stream block in the corresponding block grouping to the user end.
[0064] Figure 3 FIG. 1 is a schematic diagram of an optional port transmission. Figure 3 As shown, the left box contains the allocated block groups, which can be identified by the corresponding port names. After determining the port corresponding to each block group, the binary stream blocks are transmitted in parallel through the ports in the right box.
[0065] S130. After determining that the receiving of the binary stream segments is completed, the user terminal restores the first file according to the binary stream segments and stores the first file.
[0066] Optionally, when the user end determines that it has completed receiving all binary stream segments, it can determine the order of each binary stream segment according to the label of each binary stream segment, and merge the binary stream segments according to the order to obtain the merged binary stream total file. At this time, the binary stream total file is equivalent to the file after binary encoding the first file. After decoding the binary stream total file, the first file can be obtained.
[0067] Optionally, in the above method, a method is provided for a user terminal to remotely download files from a file database, but the method is as follows: Figure 2 The remote file processing system shown can also enable the user to upload files remotely, including:
[0068] When it is determined that the user initiates an upload request for the third file, a plurality of binary stream blocks are generated according to the third file by the user end, and each binary stream block is sent to the server end by using the first network transmission protocol;
[0069] By means of the server, the binary stream blocks are grouped according to the number of ports, a correspondence between each block group and each port is established, and the binary stream blocks are transmitted to a file database through the ports corresponding to each block group and a third network transmission protocol;
[0070] After determining that the receiving of the binary stream segments is completed through the file database, the third file is restored according to each binary stream segment, and the third file is stored.
[0071] Optionally, the third file may refer to a remotely uploaded file, and the third network transmission protocol may refer to TCP (Transmission Control Protocol), and the reliability of the TCP protocol is used to implement file uploading.
[0072] The technical solution of the embodiment of the present invention utilizes a file database. When it is determined that a user terminal initiates a download request for a first file, multiple binary stream blocks are generated according to the first file, and each binary stream block is sent to a server. The server is used to group the binary stream blocks according to the number of ports, establish a correspondence between each block group and each port, and transmit the binary stream blocks to the user terminal through the ports corresponding to each block group and the first network transmission protocol. After determining that the reception of the binary stream blocks is completed, the user terminal restores the first file according to each binary stream block and stores the first file. This can realize remote downloading of large files, effectively improve the stability and efficiency of file transmission, and at the same time ensure the file security during the remote file download process and ensure the correctness of the downloaded file.
[0073] Embodiment 2
[0074] Figure 4 This is a flowchart of a remote file processing method provided by Embodiment 2 of the present invention. Based on the above embodiments, this embodiment specifically describes a remote file downloading method. Figure 4 As shown, the method includes:
[0075] S210: When it is determined through the file database that the user terminal initiates a download request for the first file, binary-encode the first file to obtain a binary file.
[0076] S220, dividing the binary file into blocks according to a predefined block size through the file database, and labeling each binary stream block according to the order of each binary stream block in the binary file.
[0077] S230, cutting each binary stream into pieces and sending them to the server through the file database.
[0078] S240, through the server, grouping the binary stream blocks according to the number of ports, establishing a correspondence between each block group and each port, and transmitting the binary stream blocks to the user end through the ports corresponding to each block group and the first network transmission protocol.
[0079] The method includes: transmitting the binary stream blocks to the user end through the ports corresponding to the block groups and the first network transmission protocol, and further comprising:
[0080] By the server, when it is determined that at least one binary stream block in the target block group fails to be transmitted, the target block group is controlled to be retransmitted, and when it is determined that the retransmission of the target block group fails, the target block group is switched from the current port to the target port for transmission;
[0081] Through the service end, when it is determined that the transmission of each block group is interrupted, the breakpoint of each block group is recorded, and when it is determined that the port transmission is restored to normal, the transmission is continued according to the breakpoint of each block group.
[0082] Optionally, the target packet may refer to a packet whose block transmission fails. If the block transmission fails occasionally, you can use the current port corresponding to the target packet to try to retransmit. If the retransmission still fails, you can switch to the target port and wait until the transmission task in the target port is completed, and then use the target port to try to retransmit the target packet.
[0083] Optionally, when the transmission of each block group is interrupted due to abnormal network interruption, the breakpoint of each block group can be recorded, and after it is determined that the port transmission has returned to normal, retransmission can be started from the binary stream block where the breakpoint is located.
[0084] S250 . After determining that the receiving of the binary stream blocks is completed, the user terminal merges the binary stream blocks according to the labels of the binary stream blocks.
[0085] S260: Decode the combined binary stream file through the user end to restore the first file.
[0086] The technical solution of the embodiment of the present invention utilizes a file database. When it is determined that a user terminal initiates a download request for a first file, multiple binary stream blocks are generated according to the first file, and each binary stream block is sent to a server. The server is used to group the binary stream blocks according to the number of ports, establish a correspondence between each block group and each port, and transmit the binary stream blocks to the user terminal through the ports corresponding to each block group and the first network transmission protocol. After determining that the reception of the binary stream blocks is completed, the user terminal restores the first file according to each binary stream block and stores the first file. This can realize remote downloading of large files, effectively improve the stability and efficiency of file transmission, and at the same time ensure the file security during the remote file download process and ensure the correctness of the downloaded file.
[0087] Embodiment 3
[0088] Figure 5 This is a flowchart of a remote file processing method provided by Embodiment 3 of the present invention. Based on the above embodiments, this embodiment specifically describes a remote file access method. Figure 5 As shown, the method includes:
[0089] S310: When a user initiates a remote access operation to a second file, a target access request for the second file is sent to a server through a user terminal.
[0090] It is understandable that for loading remote files, a common practice is to transfer the files to the local disk over the network in advance, and then read the files from the disk into the memory for use after the files are completely transferred. However, if the remote file data volume is large, the time waiting for the complete transmission of the file will be very long, which will seriously affect the user experience or the efficiency of the program in data analysis and processing. Therefore, in this embodiment, a remote file processing method is proposed, which enables the user end to quickly and conveniently perform remote file access operations before downloading the file.
[0091] Optionally, the remote access operation type may include but is not limited to a viewing operation and an editing operation.
[0092] Optionally, the second file may refer to a file on which the user terminal currently needs to perform a remote operation, and the second file is stored in a file database.
[0093] Optionally, the target access request may include a file identifier of the second file, a remote access operation type of the user terminal, and a user terminal identifier.
[0094] Optionally, the user terminal may be used by a specific user or a group. The group may refer to an organization or department within an enterprise, and the user of the user terminal may be distinguished by the user terminal identifier.
[0095] S320. When receiving a target access request sent by a user terminal, the server determines whether the user terminal has target access rights, and when it is determined that the user terminal has target access rights, obtains the access behavior of the user terminal copied by the second network transmission protocol.
[0096] Optional, in Figure 2 The remote file processing system shown also includes a document security protection system. The document security protection system can be installed inside the server or inside the remote file system and connected to the server.
[0097] Optionally, the document security protection system may include an access permission list for each file in the file database, the access permission list including multiple user terminal identifiers with viewing permissions and multiple user terminal identifiers with editing permissions for each file. For example, for a target file, the access permission list may respectively store each user identifier and each group identifier with viewing permissions for the target document, as well as each user identifier and each group identifier with editing permissions for the target document.
[0098] Optionally, the server may send the file identifier in the target access request, the remote access operation type of the user, and the user identifier to the document security protection system, and obtain feedback from the document security protection system to determine whether the user has the target access rights.
[0099] Optionally, through the document security protection system, when it is determined that the user terminal does not have the target access rights for the second file, file processing failure information is returned to the user terminal.
[0100] It is understandable that for a large file, when a user views or edits it, he or she actually only involves a small part of the content in the file. The user's access behavior can refer to the part of the file that the user is currently viewing or editing. For example, the user's access behavior can be viewing page 2 of the second file.
[0101] Optionally, when it is determined that the user terminal has the target access rights, the access behavior of the user terminal is copied through the second network transmission protocol and the copied access behavior is sent to the server terminal. The server terminal replays the access behavior to record the byte stream needed during the replay process. The byte stream used during the replay process can be used as the target byte stream.
[0102] S330, determining a target byte stream according to the access behavior through the server, and sending the target byte stream to the client using a second network transmission protocol, so that the client can perform a remote access operation on the second file according to the target byte stream.
[0103] Among them, the target byte stream is determined by the server according to the access behavior, including:
[0104] The access behavior is replayed through the server, the byte stream used in the replay process is obtained, and the byte stream used in the replay process is determined as the target byte stream.
[0105] Optionally, the second network transmission protocol can be Figure 2 The server bytes protocol is also a user-developed protocol. The second network transmission protocol can be used to transmit the byte stream required for the current viewing or editing of the file to achieve fast access.
[0106] The technical solution of the embodiment of the present invention utilizes the user end to send a target access request for the second file to the server end when the user initiates a remote access operation to the second file, and utilizes the server end to determine whether the user end has the target access right when receiving the target access request sent by the user end, and when it is determined that the user end has the target access right, obtain the access behavior of the user end copied by the second network transmission protocol, determine the target byte stream according to the access behavior, and utilize the second network transmission protocol to send the target byte stream to the user end, so that the user end can perform a remote access operation on the second file according to the target byte stream. This method can realize fast remote access to large files before the user end downloads the files, solves the disadvantage of the prior art that the complete file needs to be downloaded locally before the file can be processed, and improves the user's remote access experience.
[0107] Embodiment 4
[0108] Figure 6 This is a schematic diagram of the structure of a remote file processing device provided by Embodiment 4 of the present invention. Figure 6 As shown, the device includes: a file segmentation module 410, a segmentation transmission module 420 and a file restoration module 430.
[0109] The file segmentation module 410 is used to generate multiple binary stream segments according to the first file through the file database when it is determined that the user terminal initiates a download request for the first file, and send each binary stream segment to the server.
[0110] The block transmission module 420 is used to group the binary stream blocks according to the number of ports through the server, establish a corresponding relationship between each block group and each port, and transmit the binary stream blocks to the user end through the ports corresponding to each block group and the first network transmission protocol.
[0111] The file restoration module 430 is used to restore the first file according to each binary stream segment after determining that the receiving binary stream segment is completed through the user end, and store the first file.
[0112] The technical solution of the embodiment of the present invention utilizes a file database. When it is determined that a user terminal initiates a download request for a first file, multiple binary stream blocks are generated according to the first file, and each binary stream block is sent to a server. The server is used to group the binary stream blocks according to the number of ports, establish a correspondence between each block group and each port, and transmit the binary stream blocks to the user terminal through the ports corresponding to each block group and the first network transmission protocol. After determining that the reception of the binary stream blocks is completed, the user terminal restores the first file according to each binary stream block and stores the first file. This can realize remote downloading of large files, effectively improve the stability and efficiency of file transmission, and at the same time ensure the file security during the remote file download process and ensure the correctness of the downloaded file.
[0113] Based on the above embodiments, the file segmentation module 410 can be specifically used for:
[0114] When it is determined through the file database that the user terminal initiates a download request for the first file, binary encoding is performed on the first file to obtain a binary file;
[0115] The binary file is segmented into blocks according to a predefined segmentation size through the file database, and each binary stream segment is numbered according to the order of each binary stream segment in the binary file.
[0116] Based on the above embodiments, the file restoration module 430 can be specifically used for:
[0117] After the user terminal determines that the receiving of the binary stream blocks is completed, the binary stream blocks are merged according to the labels of the binary stream blocks;
[0118] The combined binary stream total file is decoded through the user end to restore the first file.
[0119] Based on the above embodiments, the block transmission module 420 can also be used for:
[0120] By means of the server, when it is determined that at least one binary stream block in the target block group fails to be transmitted, the target block group is controlled to be retransmitted, and when it is determined that the retransmission of the target block group fails, the target block group is switched from the current port to the target port for transmission;
[0121] Through the service end, when it is determined that the transmission of each block group is interrupted, the breakpoint of each block group is recorded, and when it is determined that the port transmission is restored to normal, the transmission is continued according to the breakpoint of each block group.
[0122] On the basis of the above embodiments, a file remote access module may also be included, including:
[0123] An access request sending unit, configured to send a target access request for the second file to the server through the user terminal when the user initiates a remote access operation for the second file;
[0124] An access behavior acquisition unit, configured to determine, through the service end, whether the user end has the target access right when receiving the target access request sent by the user end, and to acquire the access behavior of the user end copied by the second network transmission protocol when it is determined that the user end has the target access right;
[0125] The byte stream transmission unit is used to determine the target byte stream according to the access behavior through the server, and send the target byte stream to the client using the second network transmission protocol, so that the client can perform remote access operation of the second file according to the target byte stream.
[0126] Based on the above embodiments, the byte stream transmission unit can be specifically used for:
[0127] The access behavior is replayed through the server, the byte stream used in the replay process is obtained, and the byte stream used in the replay process is determined as the target byte stream.
[0128] The remote file processing device provided in the embodiment of the present invention can execute the remote file processing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
[0129] Embodiment 5
[0130] Figure 7A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0131] like Figure 7 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.
[0132] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0133] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 11 executes the various methods and processes described above, such as the remote file processing method described in an embodiment of the present invention. That is:
[0134] When it is determined through the file database that the user terminal initiates a download request for the first file, a plurality of binary stream blocks are generated according to the first file, and each binary stream block is sent to the server terminal;
[0135] The binary stream blocks are grouped by the server according to the number of ports, a correspondence between each block group and each port is established, and the binary stream blocks are transmitted to the user end through the ports corresponding to each block group and the first network transmission protocol;
[0136] After the user terminal determines that the receiving of the binary stream segments is completed, the first file is restored according to the binary stream segments, and the first file is stored.
[0137] In some embodiments, the remote file processing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the remote file processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the remote file processing method in any other appropriate manner (e.g., by means of firmware).
[0138] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0139] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0140] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0141] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
[0142] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0143] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.
[0144] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0145] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A remote file processing method, which is executed by a user end, a server end and a file database in a remote file processing system, characterized in that: include: When it is determined through the file database that the user terminal initiates a download request for the first file, a plurality of binary stream blocks are generated according to the first file, and each binary stream block is sent to the server terminal; The binary stream blocks are grouped by the server according to the number of ports, a correspondence between each block group and each port is established, and the binary stream blocks are transmitted to the user end through the ports corresponding to each block group and the first network transmission protocol; After the user terminal determines that the receiving of the binary stream segments is completed, the first file is restored according to the binary stream segments, and the first file is stored.
2. The method according to claim 1, characterized in that When it is determined through the file database that the user terminal initiates a download request for the first file, a plurality of binary stream segments are generated according to the first file, including: When it is determined through the file database that the user terminal initiates a download request for the first file, binary encoding is performed on the first file to obtain a binary file; The binary file is segmented into blocks according to a predefined segmentation size through the file database, and each binary stream segment is numbered according to the order of each binary stream segment in the binary file.
3. The method according to claim 2, characterized in that After determining that the receiving of the binary stream segments is completed, the user terminal restores the first file according to the binary stream segments, including: After the user terminal determines that the receiving of the binary stream blocks is completed, the binary stream blocks are merged according to the labels of the binary stream blocks; The combined binary stream total file is decoded through the user terminal to restore the first file.
4. The method according to claim 1, characterized in that: The binary stream is cut and transmitted to the user end through the ports corresponding to each cut group and the first network transmission protocol, and further includes: By means of the server, when it is determined that at least one binary stream block in the target block group fails to be transmitted, the target block group is controlled to be retransmitted, and when it is determined that the retransmission of the target block group fails, the target block group is switched from the current port to the target port for transmission; Through the service end, when it is determined that the transmission of each block group is interrupted, the breakpoint of each block group is recorded, and when it is determined that the port transmission is restored to normal, the transmission is continued according to the breakpoint of each block group.
5. The method according to claim 1, characterized in that Also includes: When the user initiates a remote access operation to the second file, the user sends a target access request for the second file to the server. By the service end, when receiving a target access request sent by a user end, determining whether the user end has the target access right, and when determining that the user end has the target access right, obtaining the access behavior of the user end copied by the second network transmission protocol; The target byte stream is determined by the server according to the access behavior, and the target byte stream is sent to the client using a second network transmission protocol, so that the client can perform a remote access operation on the second file according to the target byte stream.
6. The method according to claim 5, characterized in that Determining the target byte stream according to the access behavior through the server includes: The access behavior is replayed through the server, the byte stream used in the replay process is obtained, and the byte stream used in the replay process is determined as the target byte stream.
7. A remote file processing device, executed by the cooperation of a user end, a server end and a file database in a remote file processing system, characterized in that: include: A file segmentation module, configured to generate a plurality of binary stream segments according to the first file through the file database when determining that the user terminal initiates a download request for the first file, and send each binary stream segment to the server; A block transmission module, used to group the binary stream blocks according to the number of ports through the server, establish a corresponding relationship between each block group and each port, and transmit the binary stream blocks to the user end through the ports corresponding to each block group and the first network transmission protocol; The file restoration module is used to restore the first file according to each binary stream block and store the first file through the user end after determining that the receiving binary stream block is completed.
8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the remote file processing method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the remote file processing method according to any one of claims 1 to 6 when executed.
10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the remote file processing method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Access traffic file generation method and device, server and storage medium
CN108040045A
Method, device and equipment for accessing file system
CN108833369A
Internet of Things cloud platform remote terminal upgrading system and method
CN114416135A
Remote file transmission method and device, equipment and storage medium
CN114448974A
Method and apparatus for real-time parallel delivery of segments of a large payload file
SG96741A1