File one-way transmission system and method

By adopting distributed file storage and distributed memory sharing mechanisms in the file unidirectional transmission system, the problem that the system cannot detect and handle in a timely manner when the unidirectional channel abnormality is solved, reliable transmission of file data and timely detection of system failures are realized, and the availability and reliability of the system are improved.

CN119996407AActive Publication Date: 2025-05-13ZHONGTIE XINAN BEIJING INFORMATION SECURITY TECH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202510452185.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-11
Publication Date
2025-05-13
Estimated Expiration
2045-04-11

AI Technical Summary

Technical Problem

The existing one-way file transmission system cannot detect and process it in time when the one-way channel is abnormal, resulting in loss of file data and affecting the availability and reliability of the system.

Method used

The distributed file storage and distributed memory sharing mechanism are adopted to ensure that files can be detected and processed in a timely manner during the one-way transmission between the external and internal terminals. The transmission information is recorded through the first shared memory and the second shared memory to realize file deduplication and fault detection.

Benefits of technology

It improves the availability and reliability of the one-way file transfer system, ensures that file data will not be lost during transmission, and promptly detects system failures, improving the overall performance of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119996407A_ABST
    Figure CN119996407A_ABST
Patent Text Reader

Abstract

The invention provides a file one-way transmission system and method, and relates to the technical field of file one-way transmission. The one-way device comprises an outer end machine and an inner end machine which is in one-way connection with the outer end machine. The outer end machine comprises a file storage module and a first shared memory; the file storage modules of all the external end machines are connected with one another and are used for carrying out distributed storage on the to-be-transmitted files received by all the external end machines; the first shared memory is used for recording first transmission information of the to-be-transmitted file transmitted by the external end machine to the internal end machine and sharing the first transmission information with each external end machine; the inner end machine comprises a second shared memory; and the second shared memory is used for recording second transmission information of the to-be-transmitted file transmitted by the inner end machine and sharing the second transmission information with each inner end machine. According to the system and the method provided by the invention, the availability and the reliability of the one-way file transmission system are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of one-way file transmission, and in particular to a one-way file transmission system and method. Background Art

[0002] One-way file transmission is suitable for scenarios where data flow needs to be strictly controlled. Through the collaborative work of the internal and external terminals, combined with one-way transmission mechanism, data encryption and security monitoring technologies, the one-way file transmission system can effectively ensure the security and one-way nature of data.

[0003] Related technologies use technologies such as Keepalived to implement device failover; Linux Virtual Server (LVS) is used to implement the self-load balancing function of the device. This solution uses the external machine as the cluster working node, and fault detection is mainly based on the external machine. It does not have the ability to detect the working status of the one-way channel. Due to the one-way transmission characteristics of the system, the internal machine cannot notify the external machine after discovering the channel abnormality, and the external machine cannot know the status of the internal machine, causing the file data to be lost due to the problem of the one-way channel. When the intranet server detects that the received file is missing, it can only be processed passively through human intervention (retransmission), which may lead to untimely discovery and low efficiency, seriously affecting the availability and reliability of the one-way system.

[0004] Therefore, how to improve the availability and reliability of one-way file transmission systems has become a technical problem that needs to be solved urgently in the industry. Summary of the invention

[0005] The present invention provides a one-way file transmission system and method, which are used to solve the technical problem of how to improve the availability and reliability of the one-way file transmission system.

[0006] The present invention provides a one-way file transmission system, comprising: a plurality of one-way devices; The unidirectional device comprises: an external terminal and an internal terminal unidirectionally connected to the external terminal; The external terminal includes: a file storage module and a first shared memory; The file storage modules of each external terminal are interconnected and used for distributed storage of the files to be transmitted received by each external terminal; The first shared memory is used to record first transmission information of the file to be transmitted from the external terminal to the internal terminal, and to share the first transmission information with each external terminal; The internal terminal includes: a second shared memory; The second shared memory is used to record second transmission information of the internal terminal transmitting the file to be transmitted, and to share the second transmission information with each internal terminal.

[0007] In some embodiments, the one-way file transmission system further includes a first service switch and a first synchronization switch; The external terminals in each unidirectional device are connected to a plurality of file sending servers based on the first service switch; The external terminals in each unidirectional device are connected to each other based on the first synchronous switch.

[0008] In some embodiments, the one-way file transmission system further includes a second service switch and a second synchronization switch; The internal terminal in each unidirectional device is connected to a plurality of file receiving servers based on the second service switch; The internal terminals in each unidirectional device are connected to each other based on the second synchronous switch.

[0009] The present invention provides a one-way file transmission method, which is applied to an external terminal in the one-way file transmission system, and comprises: Receive the file to be transmitted sent by the file sending server; The files to be transmitted are stored in a distributed file storage system; the distributed file storage system is constructed based on the file storage modules of each external terminal; unidirectionally transmitting the file to be transmitted to the internal terminal corresponding to the external terminal, so that the internal terminal sends the file to be transmitted to the file receiving server; The first transmission information of the external terminal transmitting the file to be transmitted to the internal terminal is recorded in the first shared memory.

[0010] In some embodiments, after the file to be transmitted is unidirectionally transmitted to the internal terminal corresponding to the external terminal, the method includes: Accessing the first shared memory of each external terminal machine to obtain the first transmission information of each file to be transmitted; Get the storage duration of each file to be transferred; When the first shared memory of each external terminal contains the first transmission information of any file to be transmitted and / or the storage time of any file to be transmitted is longer than the preset storage time, the file storage module of each external terminal deletes the file to be transmitted.

[0011] The present invention provides a one-way file transmission method, which is applied to an internal terminal in the one-way file transmission system, comprising: Receive files to be transferred; Accessing the second shared memory of each internal terminal machine to obtain the second transmission information of the file to be transmitted; When the second transmission information of the file to be transmitted does not exist in the second shared memory of each internal terminal machine, the file to be transmitted is sent to the file receiving server; The second transmission information of the internal terminal transmitting the file to be transmitted is recorded in the second shared memory.

[0012] In some embodiments, after accessing the second shared memory of each internal terminal to obtain the second transmission information of the file to be transmitted, the method further includes: When the second transmission information of the file to be transmitted exists in the second shared memory of any internal terminal machine, the file to be transmitted is deleted.

[0013] The present invention provides an electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the one-way file transmission method when executing the computer program.

[0014] The present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the one-way file transmission method is implemented.

[0015] The present invention provides a computer program product, comprising a computer program, wherein the computer program implements the one-way file transmission method when executed by a processor.

[0016] The one-way file transmission system and method provided by the present invention include multiple one-way devices; the one-way devices include an external terminal and an internal terminal unidirectionally connected to the external terminal; the external terminal includes a file storage module and a first shared memory; the file storage modules of each external terminal are connected to each other, and are used to perform distributed storage on the files to be transmitted received by each external terminal; the first shared memory is used to record first transmission information of the files to be transmitted transmitted from the external terminal to the internal terminal, and to share the first transmission information with each external terminal; the internal terminal includes a second shared memory; the second shared memory is used to record second transmission information of the files to be transmitted transmitted by the internal terminal, and to share the second transmission information with each internal terminal; a distributed file storage mechanism is adopted on the external terminal side to ensure that any external terminal After receiving the file, the machine can directly store it in the distributed file storage system to avoid file loss. Through the distributed memory sharing mechanism and the one-way redundant transmission mechanism, it is ensured that as long as there is a complete one-way transmission link in the entire transmission system, the file can be completely one-way transmitted to the internal machine; a distributed memory sharing mechanism is adopted on the internal machine side to detect the transmission status of the file, deduplicate the files to be transmitted, and ensure that the files to be transmitted can be reliably transmitted to the file receiving server; the availability and reliability of the file one-way transmission system are improved; and according to the first transmission information and the second transmission information, the transmission of the file in the external machine and the internal machine can be detected, and the failure of the file one-way transmission system can be discovered in a timely and accurate manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 This is one of the structural schematic diagrams of the one-way file transmission system provided by the present invention.

[0020] Figure 2 This is the second structural schematic diagram of the one-way file transmission system provided by the present invention.

[0021] Figure 3 This is one of the flowcharts of the one-way file transmission method provided by the present invention.

[0022] Figure 4 It is a schematic diagram of the one-way external file processing flow provided by the present invention.

[0023] Figure 5 This is the second flowchart of the one-way file transmission method provided by the present invention.

[0024] Figure 6 It is a schematic diagram of the one-way internal end file processing flow provided by the present invention.

[0025] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the present invention are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units or modules is not necessarily limited to those steps or units or modules that are clearly listed, but may include other steps or units or modules that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] Figure 1 This is one of the structural diagrams of the one-way file transmission system provided by the present invention. Figure 1 As shown, the one-way file transmission system 100 includes a plurality of one-way devices 200 .

[0029] The unidirectional device 200 includes an external terminal 210 and an internal terminal 220 unidirectionally connected to the external terminal 210 .

[0030] The external terminal 210 includes a file storage module 211 and a first shared memory 212. The internal terminal 220 includes a second shared memory 221.

[0031] The file storage modules of each external terminal are interconnected and used for distributed storage of the files to be transmitted received by each external terminal.

[0032] The first shared memory is used to record first transmission information of the file to be transmitted from the external terminal to the internal terminal, and to share the first transmission information with each external terminal.

[0033] The second shared memory is used to record the second transmission information of the internal terminal machine transmitting the file to be transmitted, and to share the second transmission information with each internal terminal machine.

[0034] Specifically, the one-way file transmission system provided by the embodiment of the present invention is applied to technical scenarios that require strict control of data flow, ensuring data security and preventing data leakage. The one-way file transmission system is used to realize that files can only flow in one direction during the transmission process, and reverse transmission is not allowed, for example, files can only be transmitted from a file sending server in an extranet (external network) to a file receiving server in an intranet (internal network).

[0035] The file one-way transmission system may include multiple one-way devices set up in parallel. One-way devices are key components used to achieve one-way data transmission, usually deployed between networks with different security levels to ensure that data can only be transmitted from one direction to another and cannot flow in the reverse direction.

[0036] From a structural point of view, a one-way device can include an external terminal and an internal terminal that is unidirectionally connected to the external terminal. The external terminal is a device deployed in an external security domain (such as a non-confidential network) and is responsible for receiving files sent by the file sending server and forwarding them to the internal terminal. The internal terminal is a device in an internal security domain (such as a confidential network) and is responsible for receiving files sent by the external terminal and sending the files to the file receiving server.

[0037] The external terminal and the internal terminal are connected through a one-way channel. The one-way channel can be a file transfer channel constructed by a one-way transmission component such as a one-way optical gate or a one-way network gate, or a file transfer channel constructed by setting the network data flow direction through a software program. The external terminal and the internal terminal in a one-way device are set one-to-one.

[0038] The external terminal may include a file storage module and a first shared memory. The file storage module may be one or more independent storage areas divided from the storage of the external terminal. The file storage modules in each external terminal are interconnected to form a distributed file storage system (Distributed File System, DFS), and the specific connection method may include a network connection or a signal cable connection. Each file storage module constitutes a storage node in the distributed file storage system. The distributed file storage system can perform distributed storage on the files to be transmitted received by each external terminal.

[0039] All file data received by the external machine is stored in various storage nodes in a dispersed manner. The security and integrity of the files are guaranteed by the distributed file storage system. Even if there is only one valid storage node left in the entire system, the file data can be completely obtained. At the same time, combined with the storage characteristics of the distributed file storage system, after any external machine receives or captures the file, it stores the file in the distributed file storage system through the Application Programming Interface (API). The remaining external machines can directly read the file from the distributed file storage system and perform one-way packet transmission.

[0040] In order to ensure that the same file to be transmitted can be transmitted by all external machines in the system, all external machines also need to build a distributed shared memory (DSM) mechanism. The file information that the external machine has transmitted from the distributed file storage system needs to be notified to all other external machines through this memory sharing mechanism. Therefore, the external machine also includes a first shared memory. The memory is used to record the first transmission information of the file to be transmitted from the external machine to the corresponding internal machine, and to share the first transmission information with each external machine. The first transmission information may include the file name, file size, file importance level, file destination, file source, transmission time and the external machine number of the transmitted file.

[0041] Due to the use of unidirectional redundant transmission, the same file to be transmitted will appear in multiple internal terminals, but they cannot all be pushed to the file receiving server of the intranet. Therefore, all internal terminals in the system also need to build a distributed memory sharing mechanism to share the transmission status of the file. As long as there is an internal terminal that successfully pushes the file to the file receiving server of the intranet, the other internal terminals directly discard the file and record the log information. Therefore, the internal terminal includes a second shared memory. The second shared memory is used to record the second transmission information of the internal terminal transmitting the file to be transmitted, and to share the second transmission information with each internal terminal. The second transmission information may include file name, file size, file importance level, file destination, file source, transmission time, external terminal number of the transmitted file, internal terminal number of the transmitted file, etc.

[0042] The external machine acts as a storage node, performing distributed storage for the files to be transmitted, ensuring that any external machine can directly store the received files in the distributed file storage system; it also acts as a sending node, performing unidirectional redundant transmission of the files to be transmitted, ensuring that as long as there is a complete unidirectional transmission link in the entire transmission system, the files can be completely transmitted unidirectionally to the internal machine.

[0043] At the same time, in order to ensure that the file receiving server in the intranet only receives a complete set of file data (file to be transmitted), it is technically necessary to build a distributed memory sharing mechanism for all internal terminals to detect the file transmission status and perform deduplication on the files to be transmitted. The relevant technical measures of the one-way internal and external terminals in the entire transmission system cooperate with each other to ultimately ensure the integrity, reliability and loss-free one-way transmission of files.

[0044] The one-way file transmission system provided by the embodiment of the present invention comprises a plurality of one-way devices; the one-way devices comprise an external terminal and an internal terminal unidirectionally connected to the external terminal; the external terminal comprises a file storage module and a first shared memory; the file storage modules of each external terminal are interconnected and used for distributed storage of files to be transmitted received by each external terminal; the first shared memory is used for recording first transmission information of the files to be transmitted transmitted from the external terminal to the internal terminal, and for sharing the first transmission information with each external terminal; the internal terminal comprises a second shared memory; the second shared memory is used for recording second transmission information of the files to be transmitted transmitted by the internal terminal, and for sharing the second transmission information with each internal terminal; a distributed file storage mechanism is adopted on the external terminal side to ensure that any external terminal After receiving the file, the machine can directly store it in the distributed file storage system to avoid file loss. Through the distributed memory sharing mechanism and the one-way redundant transmission mechanism, it is ensured that as long as there is a complete one-way transmission link in the entire transmission system, the file can be completely one-way transmitted to the internal machine; a distributed memory sharing mechanism is adopted on the internal machine side to detect the transmission status of the file, deduplicate the files to be transmitted, and ensure that the files to be transmitted can be reliably transmitted to the file receiving server; the availability and reliability of the file one-way transmission system are improved; and according to the first transmission information and the second transmission information, the transmission of the file in the external machine and the internal machine can be detected, and the failure of the file one-way transmission system can be discovered in a timely and accurate manner.

[0045] In some embodiments, the one-way file transmission system further includes a first service switch, a second service switch, a first synchronization switch, and a second synchronization switch.

[0046] The external terminals in each unidirectional device are connected to a plurality of file sending servers based on the first service switch; and the external terminals in each unidirectional device are connected to each other based on the first synchronization switch.

[0047] The internal terminals in each unidirectional device are connected to a plurality of file receiving servers based on the second service switch; the internal terminals in each unidirectional device are connected to each other based on the second synchronization switch.

[0048] Specifically, Figure 2 This is the second structural diagram of the one-way file transmission system provided by the present invention. Figure 2As shown, the one-way file transmission system further includes a first service switch 230 , a second service switch 240 , a first synchronization switch 250 and a second synchronization switch 260 .

[0049] The external terminal includes a first service interface and a second service interface, wherein the first service interface is connected to the first service switch; and the second service interface is connected to the first synchronization switch.

[0050] Each file sending server is also connected to the first service switch. Through the first service switch, the external terminal realizes connection with multiple file sending servers and can receive the file to be transmitted sent by any file sending server.

[0051] Optionally, the first service switch can run a load balancing algorithm to dynamically allocate file transfer tasks according to the real-time load, communication quality, and storage space size of each external machine, and transmit the files to be transferred sent by the file sending server to the appropriate external machine. For example, the first service switch can monitor the processor and memory usage of the external machine in real time, as well as the number of tasks currently being processed, and give priority to allocating tasks to external machines with lower loads. The first service switch can give priority to external machines with low network latency, high bandwidth, and low network packet loss rate to increase the file transfer speed. The first service switch can monitor the storage space and read and write speed of the external machine in real time to ensure that the external machine has sufficient storage space to receive and temporarily store files, and select an external machine with better read and write performance.

[0052] The external terminals are connected to each other via the first synchronous switch, and can access the first shared memory to obtain the first transmission information.

[0053] The internal terminal includes a first service interface and a second service interface, the first service interface is connected to the second service switch; the second service interface is connected to the second synchronization switch.

[0054] Each file receiving server is also connected to the second service switch. Through the second service switch, the internal terminal realizes connection with multiple file receiving servers, and can send the file to be transmitted to any file receiving server.

[0055] Optionally, the second service switch can run a content detection algorithm to detect the content of the file to be transmitted sent by any internal terminal, identify whether there is malicious code, virus or unauthorized content in the file, and ensure that the file content complies with specific laws, regulations or corporate policies. The content detection algorithm may include a text detection algorithm, an image detection algorithm, etc. When non-compliant content is detected, the file transmission is automatically intercepted and an alarm mechanism is triggered.

[0056] The internal terminals are connected to each other via the second synchronous switch, and can access the second shared memory to obtain the second transmission information.

[0057] The one-way file transmission system provided by the embodiment of the present invention realizes parallel transmission by setting up a business switch; and realizes access between external machines and internal machines by setting up a synchronization switch; the business switch is responsible for traffic management and load balancing, while the synchronization switch is responsible for data consistency and real-time management; the collaborative work of the two can significantly improve the overall performance of the one-way file transmission system.

[0058] Figure 3 This is one of the flowcharts of the one-way file transmission method provided by the present invention. Figure 3 As shown, the method is applied to the external terminal in the one-way file transmission system in the above embodiment, and includes step 310, step 320, step 330 and step 340.

[0059] Step 310: Receive the file to be transmitted sent by the file sending server.

[0060] Specifically, each external terminal can be connected to multiple file sending servers through the first service switch to receive files to be transmitted.

[0061] Step 320: Store the files to be transmitted in a distributed file storage system; the distributed file storage system is constructed based on the file storage modules of each external terminal.

[0062] Specifically, a distributed file storage system can be constructed based on the file storage modules of each external terminal.

[0063] After receiving the file to be transmitted, the external terminal can store the file to be transmitted in the distributed file storage system. The distributed file storage system stores the file to be transmitted in a dispersed manner in the file storage modules of each external terminal. For example, the file to be transmitted can be divided into multiple smaller data blocks (or objects), and each data block will be stored in the file storage modules of different external terminals. In order to ensure the reliability of data, the distributed file storage system usually performs redundant backup of each data block and stores the backup in different file storage modules.

[0064] When a file needs to be restored, the distributed file storage system reads scattered data blocks from each storage node (file storage module of the external machine) according to the metadata information and reassembles them into a complete file. The metadata records the location, size and copy information of each data block, and the system locates and reads the data block through these metadata. Multiple copies of each data block are stored on different nodes. As long as one copy exists, the system can restore the data block. When a storage node failure is detected, the system automatically recovers data from other copies and recreates the copy to maintain redundancy. Through the above mechanism, the distributed file storage system can still ensure data integrity even if there is only one valid external machine left in the entire system.

[0065] Step 330: unidirectionally transmit the file to be transmitted to the internal terminal corresponding to the external terminal, so that the internal terminal sends the file to be transmitted to the file receiving server.

[0066] Specifically, after storing the file to be transmitted in the distributed file storage system, the external terminal unidirectionally transmits the file to be transmitted to the internal terminal corresponding to the external terminal, so that the internal terminal can send the file to be transmitted to the file receiving server.

[0067] Step 340: Record in the first shared memory the first transmission information of the external terminal transmitting the file to be transmitted to the internal terminal.

[0068] Specifically, the external terminal generates first transmission information according to the transmission process of the file to be transmitted, and then records the information in the first shared memory.

[0069] The one-way file transmission method provided by the embodiment of the present invention is applied to an external terminal, including: receiving a file to be transmitted sent by a file sending server; storing the file to be transmitted in a distributed file storage system; the distributed file storage system is constructed based on the file storage modules of each external terminal; unidirectionally transmitting the file to be transmitted to an internal terminal corresponding to the external terminal, so that the internal terminal sends the file to be transmitted to the file receiving server; recording first transmission information of the external terminal transmitting the file to be transmitted to the internal terminal in a first shared memory; a distributed file storage mechanism is adopted on the external terminal side, ensuring that any external terminal can directly store the received file in the distributed file storage system to avoid file loss, and through a distributed memory sharing mechanism and a one-way redundant transmission mechanism, ensuring that as long as there is a complete one-way transmission link in the entire transmission system, the file can be completely and one-way transmitted to the internal terminal; improving the availability and reliability of the one-way file transmission system.

[0070] In some embodiments, after the file to be transmitted is unidirectionally transmitted to the internal terminal corresponding to the external terminal, the method includes: Accessing the first shared memory of each external terminal machine to obtain the first transmission information of each file to be transmitted; Get the storage duration of each file to be transferred; When the first shared memory of each external terminal contains the first transmission information of any file to be transmitted and / or the storage time of any file to be transmitted is longer than the preset storage time, any file to be transmitted is deleted in the file storage module of each external terminal.

[0071] Specifically, after the file to be transmitted is unidirectionally transmitted from the external terminal to the internal terminal, the file to be transmitted can be deleted.

[0072] The first shared memory of each external terminal can be accessed to obtain the first transmission information of each file to be transmitted. Each file to be transmitted may be a file that has been transmitted by some external terminals and has not yet been transmitted by the remaining external terminals. At the same time, the storage duration of each file to be transmitted is obtained. The storage duration refers to the length of time that the file to be transmitted is received by any external terminal and stored in the distributed file storage system.

[0073] If the first transmission information of any file to be transmitted exists in the first shared memory of each external terminal (condition 1), it means that the file to be transmitted has been unidirectionally redundantly transmitted by all external terminals; if the storage time of any file to be transmitted is longer than the preset storage time (condition 2), it means that the file to be transmitted can be cleared to avoid accumulation in the distributed file storage system. The preset storage time can be set as needed.

[0074] Condition 1 can determine that the file has been transferred and does not need to be saved; condition 2 can prevent files from accumulating in the external machine. For example, when the file reaches the preset storage time, some external machines still fail to transfer. This measure is used to deal with the failure to download and transfer files caused by external machine abnormalities, disconnections, etc., to prevent files from accumulating in the distributed file storage system. The above two conditions can be combined. For example, for some important files, although they have been unidirectionally transferred to the internal machine, they still need to be retained in the external machine if it is not confirmed that the internal machine has transferred them to the file receiving server on the intranet.

[0075] When the above-mentioned condition 1 and / or condition 2 is met, the file to be transmitted can be deleted in the file storage module of each external terminal.

[0076] The one-way file transmission method provided by the embodiment of the present invention can determine whether to delete a file based on the first transmission information in the first shared memory of each external machine or the storage duration of the file to be transmitted, thereby preventing files from accumulating in the distributed file storage system constructed by the external machine.

[0077] Figure 4 is a schematic diagram of a one-way external file processing flow provided by the present invention, such as Figure 4As shown, after the external machine starts the task, it receives the file sent by the file sending server, caches it locally, uploads it to the distributed file storage system, and then transmits the file unidirectionally.

[0078] The distributed file storage system can obtain a file list, detect each file, and obtain the first transmission information from the first shared memory of each external terminal. According to the first transmission information, it is determined whether each file has been sent. If not, the file is transmitted in one direction; if it has been sent, each file is deleted according to whether the storage time of each file exceeds the preset storage time.

[0079] In some embodiments, fault diagnosis can be performed on each external machine based on the first transmission information in the first shared memory of each external machine.

[0080] For example, if the difference between the number of first transmission information in the first shared memory of any external terminal and the number of first transmission information in the first shared memory of the other external terminals is greater than a preset threshold, it can be determined that the external terminal may have a fault. It can also be further determined that the files that cannot be transmitted and the time when the transmission failure occurs are determined based on the comparison of the first transmission information in the first shared memory of the external terminal with the first transmission information in the first shared memory of the other external terminals.

[0081] Figure 5 FIG. 2 is a flowchart of the one-way file transmission method provided by the present invention. Figure 5 As shown, the method is applied to the internal terminal in the one-way file transmission system in the above embodiment, and includes step 510, step 520, step 530 and step 540.

[0082] Step 510: Receive the file to be transmitted.

[0083] Specifically, the internal terminal obtains the file to be transmitted through the external terminal connected thereto.

[0084] Step 520: Access the second shared memory of each internal terminal to obtain the second transmission information of the file to be transmitted.

[0085] Specifically, the second shared memory of each internal terminal machine may be accessed to obtain the second transmission information of the file to be transmitted.

[0086] Step 530: When the second transmission information of the file to be transmitted does not exist in the second shared memory of each internal terminal machine, the file to be transmitted is sent to the file receiving server.

[0087] Specifically, if the second shared memory of each internal terminal does not contain the second transmission information of the file to be transmitted, it means that the file has not been transmitted to the file receiving server in the intranet. At this time, the file to be transmitted can be sent to the file receiving server.

[0088] Step 540: Record the second transmission information of the internal terminal transmitting the file to be transmitted in the second shared memory.

[0089] Specifically, the internal terminal generates second transmission information according to the transmission process of the file to be transmitted, and then records the information in the second shared memory.

[0090] The one-way file transmission method provided by the embodiment of the present invention is applied to an internal terminal machine, including: receiving a file to be transmitted; accessing the second shared memory of each internal terminal machine to obtain second transmission information of the file to be transmitted; when the second transmission information of the file to be transmitted does not exist in the second shared memory of each internal terminal machine, sending the file to be transmitted to a file receiving server; recording the second transmission information of the file to be transmitted by the internal terminal machine in the second shared memory; adopting a distributed memory sharing mechanism on the internal terminal machine side to detect the transmission status of the file, deduplicate the file to be transmitted, and ensure that the file to be transmitted can be reliably transmitted to the file receiving server; improving the availability and reliability of the one-way file transmission system.

[0091] In some embodiments, after accessing the second shared memory of each internal terminal machine to obtain the second transmission information of the file to be transmitted, the method further includes: When the second transmission information of the file to be transmitted exists in the second shared memory of any internal terminal machine, the file to be transmitted is deleted.

[0092] Specifically, if there is second transmission information of the file to be transmitted in the second shared memory of any inner terminal machine, it means that the file has been transmitted to the file receiving server by the inner terminal machine. At this time, the file to be transmitted can be deleted to avoid the accumulation of files in the inner terminal machine.

[0093] The one-way file transmission method provided by the embodiment of the present invention performs deduplication processing on the files to be transmitted, thereby ensuring that the files to be transmitted can be reliably transmitted to the file receiving server.

[0094] Figure 6 is a schematic diagram of the one-way internal file processing flow provided by the present invention, such as Figure 6 As shown, after the internal terminal starts the task, it receives the current file sent by the external terminal, and detects the status of the current file by accessing the second transmission information in the second shared memory of the other internal terminals to determine whether the current file has been sent. If it has been sent, the current file is discarded; if it has not been sent, it is cached locally and then sent to the file receiving server.

[0095] The local cache can be scanned periodically. If the file has been sent, the file is discarded; if the file has not been sent, the file is sent and the local cache is cleared after the file is sent; if the sending fails continuously, the task is terminated and fault diagnosis is performed.

[0096] Figure 7 is a schematic diagram of the structure of the electronic device provided by the present invention, such as Figure 7 As shown, the electronic device may include: a processor (Processor) 710, a communication interface (Communications Interface) 720, a memory (Memory) 730 and a communication bus (Communications Bus) 740, wherein the processor 710, the communication interface 720, and the memory 730 communicate with each other through the communication bus 740. The processor 710 may call the logic command in the memory 730 to execute the method described in the above embodiment, for example: Receive the file to be transmitted sent by the file sending server; store the file to be transmitted in a distributed file storage system; the distributed file storage system is constructed based on the file storage modules of each external terminal; unidirectionally transmit the file to be transmitted to the internal terminal corresponding to the external terminal, so that the internal terminal sends the file to be transmitted to the file receiving server; record the first transmission information of the external terminal transmitting the file to be transmitted to the internal terminal in the first shared memory; Alternatively, receiving the file to be transmitted; accessing the second shared memory of each internal terminal machine to obtain the second transmission information of the file to be transmitted; if the second transmission information of the file to be transmitted does not exist in the second shared memory of each internal terminal machine, sending the file to be transmitted to the file receiving server; recording the second transmission information of the file to be transmitted by the internal terminal machine in the second shared memory.

[0097] In addition, the logic commands in the above-mentioned memory can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several commands to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program code.

[0098] The processor in the electronic device provided in the embodiment of the present invention can call the logic instructions in the memory to implement the above method. Its specific implementation method is consistent with the implementation method of the aforementioned method and can achieve the same beneficial effects, which will not be repeated here.

[0099] An embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method provided in the above embodiments is implemented.

[0100] Its specific implementation is consistent with the aforementioned method implementation and can achieve the same beneficial effects, so it will not be repeated here.

[0101] An embodiment of the present invention provides a computer program product, including a computer program. When the computer program is executed by a processor, the method described above is implemented.

[0102] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0103] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0104] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A one-way file transmission system, characterized in that: include: Multiple one-way devices; The unidirectional device comprises: an external terminal and an internal terminal unidirectionally connected to the external terminal; The external terminal includes: a file storage module and a first shared memory; The file storage modules of each external terminal are interconnected and used for distributed storage of the files to be transmitted received by each external terminal; The first shared memory is used to record first transmission information of the file to be transmitted from the external terminal to the internal terminal, and to share the first transmission information with each external terminal; The internal terminal includes: a second shared memory; The second shared memory is used to record second transmission information of the internal terminal transmitting the file to be transmitted, and to share the second transmission information with each internal terminal.

2. The one-way file transmission system according to claim 1, characterized in that: The one-way file transmission system also includes a first service switch and a first synchronization switch; The external terminals in each unidirectional device are connected to a plurality of file sending servers based on the first service switch; The external terminals in each unidirectional device are connected to each other based on the first synchronous switch.

3. The one-way file transmission system according to claim 1, characterized in that: The one-way file transmission system also includes a second service switch and a second synchronization switch; The internal terminal in each unidirectional device is connected to a plurality of file receiving servers based on the second service switch; The internal terminals in each unidirectional device are connected to each other based on the second synchronous switch.

4. A one-way file transmission method, characterized in that: An external terminal used in the one-way file transmission system according to any one of claims 1 to 3, comprising: Receive the file to be transmitted sent by the file sending server; The files to be transmitted are stored in a distributed file storage system; the distributed file storage system is constructed based on the file storage modules of each external terminal; unidirectionally transmitting the file to be transmitted to the internal terminal corresponding to the external terminal, so that the internal terminal sends the file to be transmitted to the file receiving server; The first transmission information of the external terminal transmitting the file to be transmitted to the internal terminal is recorded in the first shared memory.

5. The one-way file transmission method according to claim 4, characterized in that: After the file to be transmitted is unidirectionally transmitted to the internal terminal corresponding to the external terminal, the method includes: Accessing the first shared memory of each external terminal machine to obtain the first transmission information of each file to be transmitted; Get the storage duration of each file to be transferred; When the first shared memory of each external terminal contains the first transmission information of any file to be transmitted and / or the storage time of any file to be transmitted is longer than the preset storage time, the file storage module of each external terminal deletes the file to be transmitted.

6. A one-way file transmission method, characterized in that: An internal terminal used in the one-way file transmission system according to any one of claims 1 to 3, comprising: Receive files to be transferred; Accessing the second shared memory of each internal terminal machine to obtain the second transmission information of the file to be transmitted; When the second transmission information of the file to be transmitted does not exist in the second shared memory of each internal terminal machine, the file to be transmitted is sent to the file receiving server; The second transmission information of the internal terminal transmitting the file to be transmitted is recorded in the second shared memory.

7. The one-way file transmission method according to claim 6, characterized in that: After accessing the second shared memory of each internal terminal machine to obtain the second transmission information of the file to be transmitted, the method further includes: When the second transmission information of the file to be transmitted exists in the second shared memory of any internal terminal machine, the file to be transmitted is deleted.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method for unidirectional file transmission according to any one of claims 4 to 7 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for unidirectional file transmission according to any one of claims 4 to 7 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for unidirectional file transmission according to any one of claims 4 to 7 is implemented.

Citation Information

Patent Citations

  • Method and device for transmitting network data

    CN108173810A

  • One-way message transmission method and device, storage medium and equipment

    CN117336262A

  • Information ferrying system and information ferrying method

    CN117527341A

  • Seperation, crushing, dewatering, incineration, landfill, treatment, recycling equipment and method for waste, sludge, aggregate, rock

    KR1020240051100A