Cross-network data transmission platform and method based on big data

Abstract

The invention belongs to the technical field of civil aviation airport equipment operation and maintenance management, and discloses a cross-network data transmission platform and method based on big data. According to the method, sensitive information check is carried out through a security check strategy, and approval process management is carried out; a confirmation receipt is returned to the sender by using a system receipt mechanism, so that the authenticity and reliability of the information are ensured; an automatic retransmission mechanism is used for automatically detecting errors in data transmission, and a sender is requested to retransmit the error data, so that the integrity and reliability of the data are ensured. According to the invention, through an automatic detection and retransmission mechanism, the system can ensure the integrity and accuracy of data and reduce the error rate in data transmission; the communication efficiency is improved; and the need of manual intervention is reduced, and the operation and maintenance cost is reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of operation and maintenance management of civil aviation airport equipment, and particularly relates to a cross-network data transmission platform and method based on big data. Background Art

[0002] With the acceleration of the enterprise digitalization process, cross-network data transmission has become an indispensable part of daily business. However, traditional data transmission methods such as FTP applications, emails, and USB drives have many defects, such as insufficient security, easy data leakage, high operation and maintenance pressure, lack of unified management, and cumbersome processes. At the same time, enterprise data leakage incidents occur frequently, and the cost increases year by year, seriously threatening enterprise information security and business continuity.

[0003] Through the above analysis, the problems and defects of the existing technology are: in the network data transmission of the existing technology, the reliability of data transmission is low, the communication efficiency is poor, and the operation and maintenance cost is high. Summary of the Invention

[0004] To overcome the problems existing in the related technologies, the disclosed embodiments of the present invention provide a cross-network data transmission platform and method based on big data.

[0005] The technical solution is as follows: A cross-network data transmission method based on big data, including: S1, the sender forms a security inspection policy through custom sensitive feature libraries, regular expressions, and keyword checks, combined with full inspection points of file type, size, and sender / recipient identities, conducts sensitive information inspections, and automatically executes blocking, release, or triggers a manual approval process according to the inspection results; S2, based on the sensitive information inspection results, conducts hierarchical approvals according to the organizational structure and reporting relationships, and completes the approval process management through approval modes such as joint signature, individual signature, transfer for approval, and carbon copy; S3, the recipient processes the successfully received and approved information or instructions, and uses the system receipt mechanism to return a confirmation receipt to the sender to ensure the authenticity and reliability of the information; S4, uses an automatic retransmission mechanism to automatically detect errors in data transmission, requests the sender to retransmit the incorrect data, and ensures the integrity and reliability of the data.

[0006] In step S3, when the recipient processes the successfully received and approved information or instructions, it includes: fault analysis and handling. If the information fails to be successfully delivered or processed, the receipt provides the reason for the failure, including the target system being unreachable and the information format being incorrect, for the sender to take timely remedial measures.

[0007] Statistical analysis and optimization: By collecting and analyzing receipt data, evaluate and optimize the system's performance and service quality. Through statistical analysis of SMS receipt data, analyze the delivery rate and latency of different SMS service providers, and select a better-quality service provider. During the system operation, comprehensively collect key performance indicator data, including response time, throughput, CPU usage, memory occupancy, network latency, and the usage status of system resources. Based on the collected data, conduct in-depth analysis and carefully analyze the test data to accurately locate the performance bottlenecks. This may involve identifying issues such as inefficient database queries and high network latency, providing a strong basis for subsequent performance optimization work. In addition, the present invention will also conduct a comprehensive security analysis of the system, rigorously evaluate the security status of the system, and accurately identify security vulnerabilities that need to be urgently repaired to ensure the secure and stable operation of the system.

[0008] In step S3, the processing by the recipient of the specific information or instruction approved in step S2 also includes legal compliance and liability definition. In e-commerce, use the transaction receipt as evidence of the completion of the transaction between the two parties.

[0009] In step S3, the implementation methods of the system receipt mechanism include: Automatic receipt: In SMS communication and online transactions, automatically generate and send receipts through the system. Manual receipt: The recipient manually generates and sends a receipt after confirming the receipt of the information. Hybrid receipt: Combine the automatic and manual receipt methods. Use manual receipt for critical information to ensure accuracy, and use automatic receipt for non-critical information. Intelligent receipt: Use natural language processing technology to automatically identify key information in the receipt and classify and process the receipt information.

[0010] In step S4, the automatic retransmission mechanism is used to automatically detect errors in data transmission and request the sender to retransmit the incorrect data, including: Error Detection and Feedback: When sending data, the sender attaches redundant error detection codes. After receiving the data, the receiver performs error detection on the data based on the redundant error detection codes. For example, the verification method is automatically selected according to the confidentiality level. For non-confidential files, an md5 can be generated from the received file, and the encrypted md5 of the transmitted file is compared with the encrypted md5 generated by itself to check for differences. This method is efficient and fast. For confidential files, verification and comparison are performed using the SHA-256 algorithm. If an error is detected, the receiver sends a negative acknowledgment signal or a request for retransmission to the sender, asking the sender to retransmit the erroneous data. Since the established environment is cross-network and direct interface connection is not possible, the asynchronous file method is used to process the content of the parsed receipt file for the opposite network. Retransmission and Acknowledgment: After receiving the signal requesting retransmission, the sender retransmits the erroneous data. The sender can receive the content of the receipt file sent from the other side according to the default receipt file directory. After successfully receiving the retransmitted data, the receiver sends an acknowledgment signal to the sender. Since the established environment is cross-network and direct interface connection is not possible, the asynchronous file method is used to transmit the acknowledgment signal, indicating that the data has been successfully received and processed.

[0011] In step S4, the implementation methods of the system's automatic retransmission mechanism include: Frame Counter Method: A counter is added to the data frame. The receiver determines the order and integrity of the data frame by checking the value of the counter. During data transmission, to ensure that the receiving end can correctly receive data frames in the order of the sending end, the sending end usually adds a frame number before each data frame. This frame number is an incrementing counter value. Each time data is sent, the counter is automatically incremented by 1, and the new counter value is used as the frame number for the current data transmission.

[0012] After receiving a data frame, the receiving end extracts the frame number and compares it with the frame numbers of previously received data frames. If the value of the new frame number is larger, it indicates that the frame has been received in order, so the frame is valid and the frame number is saved for the next comparison. If the value of the new frame number is smaller or there is a discontinuity, it is determined that the data frame is invalid or out of order. At this time, the receiving end can take corresponding measures according to the protocol regulations, such as discarding the frame, requesting retransmission, etc.

[0013] The integrity check of data frames usually depends on the checksum or message integrity code (MIC) attached to the end of the data frame. Before sending data, the sender performs an operation on the data frame to be transmitted through a one-way algorithm to generate a corresponding checksum or MIC, and attaches it to the data frame for transmission together.

[0014] After receiving the data frame, the receiver will use the same one-way algorithm to calculate the received data frame (excluding the check code or MIC part) to obtain a receiver's check code or MIC. Then, the receiver will compare the check code or MIC calculated by itself with the check code or MIC attached by the sender. If they are the same, it means that the data frame has not been modified during the transmission process, so the data frame is complete; if they are different, it means that an error or tampering may have occurred during the transmission process of the data frame. At this time, the receiving end can take corresponding handling measures according to the protocol regulations, such as requesting retransmission, etc.

[0015] In the acknowledgment frame method, after sending a frame of data, the sender waits for the receiver to send an acknowledgment frame ACK; Retransmission request method: After detecting an error data, the receiver actively sends a retransmission request to the sender; after receiving the request, the sender retransmits the incorrect data.

[0016] In the frame counter method, if the counter value of a certain frame does not meet the expectation, the receiver requests the sender to retransmit that frame.

[0017] In the acknowledgment frame method, if the sender does not receive the acknowledgment frame within the specified time, it is considered that the data transmission fails, and the frame data is retransmitted; In the implementation method of the system automatic retransmission mechanism, there are set retransmission times and timeout time limit conditions.

[0018] Another object of the present invention is to provide a cross-network data transmission platform based on big data. This platform implements the cross-network data transmission method based on big data. This platform includes: The presentation layer is used to provide Web browsers, APPs, FTP clients, and APIs for displaying transmission data; The application layer is used to execute the cross-network data transmission data function; The system layer is used to manage the cross-network data transmission data; The infrastructure layer is used to provide the implementation hardware for the cross-network data transmission data.

[0019] The application layer includes: The file check sub-module is used to perform file type check, sensitive information check, file source check, virus check, and workflow approval; according to different confidentiality levels, different check items are carried out for file check. When entering a classified file, file content review will be carried out to check whether there is relevant classified data; the transmission of sensitive files can only be carried out after the process approval by relevant personnel is completed; the virus check is a security check mechanism for files from the external network to the private network area of the intranet, such as some virus scripts, etc. The file source and file type checks are both based on user permissions, whether there is permission to transmit this type of file and whether there is permission to transmit files to this network.

[0020] The receipt mechanism sub-module is used to perform log auditing, access to the database, receipt mechanism, resume interrupted transfer, and automatic retransmission in case of failure; Automatic receipt: The receipt is automatically generated and sent by the system. This method is applicable to scenarios with large amounts of information and high real-time requirements, such as SMS communication, online transactions, etc. Manual receipt: The recipient manually generates and sends the receipt after confirming receipt of the information. Although this method has higher flexibility, there may be risks of human delay or error. Hybrid receipt: Combines the automatic and manual receipt methods and flexibly selects according to specific requirements. For example, in some systems, manual receipt is used for critical information to ensure accuracy, while automatic receipt is used for non-critical information to improve efficiency. Intelligent receipt: Utilizes artificial intelligence technology to automatically analyze and process receipt information, improving the accuracy and processing efficiency of receipts. For example, through natural language processing technology, key information in the receipt is automatically identified and classified. The intelligent receipt mechanism is used for the result receipt and record of file transmission to ensure the successful transmission of files. Log auditing, the content transmitted by the user; The sending sub-module is used to perform sending files, receiving files, sending data, receiving data, and parsing file data; it is responsible for operations such as page interaction, and can send through page access models or interface files, and can parse file content for easy viewing of file content.

[0021] The transmission sub-module is used to perform notification and warning, statistical reports, multi-source content access, backup management, and high-performance transmission; the transmission module is mainly responsible for the efficient transmission of files, supporting multiple transmission protocols such as HTTP, FTP, SFTP, SCP, etc. It intelligently selects the transmission protocol according to the current bandwidth network situation. The transmitted files will be backed up according to the configuration, and the default backup period is one month. Transmission reports are generated based on the transmission efficiency and transmitted files, etc. It also monitors indicators such as the success and efficiency of file transmission in real time.

[0022] The system layer includes: a user management sub-module for managing the input users; The user permission management sub-module is used to manage the usage permissions of users; perform permission division for users, divide permissions for the first menu page, and different permissions can access different pages; second, the file types transmitted by users can be restricted according to permissions; third, the size of the transmitted files can be restricted according to permissions; the transmission path and network area of files can be restricted according to permissions, etc.

[0023] The security policy sub-module is used to manage the security inspection policies formed by combining all security checkpoints such as file types, sizes, sender and recipient identities, etc.; the security policy is a security audit module for security. First, it will perform the first-step security scan in combination with permissions. After completion, it will perform further scans according to the defined security policies.

[0024] The approval process sub-module (304) is used to manage the approval process; for some files, file paths, or network areas in the process, personnel approval is required for transmission; the initiator initiates the process approval for file transmission, and after the administrator approves, the file will be transmitted to the specified location and network area.

[0025] The alarm notification sub-module is used to manage alarm data; alarms refer to real-time monitoring, monitoring the content of files, monitoring file transmission, monitoring whether file transmission fails, etc. If a file transmission fails, an alarm will be issued.

[0026] The infrastructure layer includes: Servers, which are ordinary servers used for deploying services and storing files Optical isolation arm swing. Two network areas cannot be directly connected. All content needs to be transmitted through files. The optical isolation arm swing is a physical file-swinging service responsible for swinging files from Server A of the optical isolation to Server B of the optical isolation.

[0027] Combining all the above technical solutions, the beneficial effects of the present invention are as follows: Improve the reliability of data transmission: Through the automatic detection and retransmission mechanism, the system can ensure the integrity and accuracy of data and reduce the error rate in data transmission.

[0028] Enhance communication efficiency: The system's automatic retransmission mechanism can quickly respond to errors in data transmission, reduce transmission delays and retry times caused by errors, and thus enhance communication efficiency.

[0029] Reduce manual intervention: The implementation of this mechanism mainly relies on hardware circuits or software algorithms, reducing the need for manual intervention and lowering the operation and maintenance costs.

[0030] Wide application: The system automatic retransmission mechanism is widely applied to various occasions requiring reliable data transmission, such as automotive CAN bus communication, industrial control networks, wireless communication systems, etc. Brief Description of the Drawings

[0031] The accompanying drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure; Figure 1 It is a flowchart of a cross-network data transmission method based on big data provided by an embodiment of the present invention; Figure 2 It is a schematic diagram of a cross-network data transmission platform based on big data provided by an embodiment of the present invention; Figure 3 It is a schematic diagram of the principle of a cross-network data transmission platform based on big data provided by an embodiment of the present invention; In the figures: 1, display layer; 2, application layer; 201, file inspection sub-module; 202, mechanism execution sub-module; 203, sending sub-module; 204, transmission sub-module; 3, system layer; 301, user management sub-module; 302, user permission management sub-module; 303, security policy sub-module; 304, approval process sub-module; 305, alarm notification sub-module; 4, infrastructure layer; 401, server; 402, optical isolation device; 403, swing arm. Detailed Embodiments

[0032] To make the above objects, features, and advantages of the present invention more apparent and understandable, the following detailed description of the specific embodiments of the present invention is provided with reference to the accompanying drawings. Many specific details are set forth in the following description to fully understand the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without departing from the connotation of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed below.

[0033] The innovation of the present invention lies in: The cross-network transmission platform is a system for efficiently and securely transmitting data between different networks. The cross-network transmission platform is used to transmit data between different networks (such as local area networks, wide area networks, the Internet, etc.). It supports multiple transmission protocols and provides functions such as data encryption, authentication, error detection, and correction to ensure the security and integrity of data. Efficient transmission: The cross-network transmission platform utilizes advanced transmission technologies and optimized algorithms to achieve fast cross-network file transmission. Even for large files or a large number of files, the transmission can be completed in a short time, greatly improving work efficiency. Security guarantee: The platform usually adopts advanced encryption technologies and security authentication mechanisms to ensure the security of files during transmission. At the same time, the platform can also manage user permissions to prevent unauthorized access and operations. Strong compatibility: The cross-network transmission platform usually supports multiple file formats and network environments and can be compatible with different devices and operating systems. Users can easily perform file transmission and collaboration on different platforms without worrying about compatibility issues.

[0034] Centralized management: The platform provides a centralized management interface and tools, facilitating enterprises to manage and monitor cross-network file transmission. Enterprises can understand the status and progress of file transmission in real time, manage user permissions, and conduct audits to ensure the compliance and security of file transmission. Example 1, such as Figure 1 As shown, the cross-network data transmission method based on big data provided by the embodiment of the present invention includes: S1, the sender forms a security inspection policy through custom sensitive feature libraries, regular expressions, and keyword checks, combines full inspection points such as file type, size, and sender and recipient identities to conduct sensitive information inspections, and automatically executes blocking, releasing, or triggering a manual approval process according to the inspection results; Sensitive feature libraries, regular expressions, and keyword checks. According to some sensitive data features, or sensitive content, or classified content, they will be automatically mapped into one rule after another according to the specifications of the rule engine. Through the rule engine for screening, combined with full inspection points such as file type, size, and sender and recipient identities, a flexible security inspection policy is formed, and one rule after another is formed. Filter the current content according to the rules, and those that do not meet the rules. The rule engine selects relevant content according to the rules. For example, if a file contains classified information and cannot be transmitted, the file transmission is blocked; if there is no problem after the rule engine screens according to the rules, the relevant file is transmitted; if the rule engine screens according to the rules and meets the manual approval, the manual approval process is initiated.

[0035] S2, based on the sensitive information inspection results, conduct hierarchical approvals according to the organizational structure and reporting relationships, and complete the approval process management through approval modes such as joint signature, individual signature, transfer for approval, and carbon copy; S3. The recipient processes the successfully received and approved information or instructions, and uses the system receipt mechanism to return a confirmation receipt to the sender to ensure the authenticity and reliability of the information. S4. Use the automatic retransmission mechanism to automatically detect errors in data transmission, and request the sender to retransmit the erroneous data to ensure the integrity and reliability of the data.

[0036] Exemplarily, in step S3, receipt: The system receipt mechanism refers to a confirmation and feedback mechanism set up in systems such as information processing, communication, or transactions to ensure the accuracy, integrity, and traceability of information. This mechanism generates and returns a confirmation receipt to the sender to indicate that the recipient has successfully received and processed the specific information or instructions. The system receipt mechanism is widely used in various scenarios, such as information system security, SMS communication, alarm acceptance, etc.

[0037] For systems that handle important information or sensitive data, the receipt mechanism can enhance the trust between the sender and the recipient and ensure the authenticity and reliability of the information.

[0038] Fault analysis and handling: If the information fails to be successfully delivered or processed, the receipt usually provides the reason for the failure, such as the target system being unreachable, information format error, etc., which helps the sender to take remedial measures in a timely manner.

[0039] Statistical analysis and optimization: By collecting and analyzing receipt data, the performance, service quality, etc. of the system can be evaluated and optimized. For example, through SMS receipt data, the delivery rate and latency of different SMS service providers can be statistically analyzed to select a better-quality service provider.

[0040] Legal compliance and liability determination: In some cases, the receipt mechanism is also involved in issues of legal compliance and liability determination. For example, in e-commerce, the transaction receipt can be an important evidence for the completion of the transaction between both parties.

[0041] Among them, the implementation methods of the system receipt mechanism include: Automatic receipt: Automatically generate and send a receipt through the system. This method is applicable to scenarios with a large amount of information and high real-time requirements, such as SMS communication, online transactions, etc.

[0042] Manual receipt: Manually generate and send a receipt by the recipient after confirming the receipt of the information. Although this method has high flexibility, there may be risks of human delay or error.

[0043] Mixed receipt: Combine automatic and manual receipt methods and flexibly select according to specific requirements. For example, in some systems, for critical information such as content that the system cannot discriminate and content that requires manual review, such as transmission errors reported by the system. Manual receipt is used to ensure accuracy, while automatic receipt is used for non-critical information to improve efficiency.

[0044] Intelligent receipt: Utilize artificial intelligence technology to automatically analyze and process receipt information, improving the accuracy and processing efficiency of receipts. For example, through natural language processing technology, automatically identify key information in the receipt and classify it. By judging the receipt information and status, a successful status indicates that the file transmission is successful and no resending is required, etc., which belongs to the end; if it is a non-successful, failed status, such as a network connection exception, through the comparison of the rule engine, the corresponding processing method is screened out and processed.

[0045] Another exemplary one is that in step S4, the system automatic retransmission mechanism, also known as Automatic Repeat reQuest (ARQ), is an error control technology widely used in data communication. This mechanism automatically detects errors in data transmission and requests the sender to retransmit the incorrect data to ensure the integrity and reliability of the data.

[0046] The following is a detailed analysis of the system automatic retransmission mechanism, including: Mechanism principle: Error detection and feedback: In the system automatic retransmission mechanism, the sender attaches a certain redundant error detection code (such as CRC checksum) when sending data. After receiving the data, the receiver performs error detection on the data based on the error detection code. If an error is detected, the receiver sends a negative acknowledgment signal (such as NAK, Negative Acknowledgment) or a signal requesting retransmission to the sender, asking the sender to retransmit the incorrect data.

[0047] Error detection and feedback, the sender attaches a redundant error detection code when sending data, and the receiver performs error detection on the data based on the redundant error detection code after receiving the data. For example: Automatically select the verification method according to the confidentiality level. For non-confidential files, an md5 can be generated by receiving the file, and the encrypted md5 of the transmitted file is compared with the encrypted md5 generated by itself to check for differences, which is efficient and fast; while for confidential files, verification and comparison are performed through the SHA-256 algorithm; if an error is detected, the receiver sends a negative acknowledgment signal or a signal requesting retransmission to the sender, asking the sender to retransmit the incorrect data. Because the established environment is cross-network and the direct interface method is not available, it is through the asynchronous file method, facing the network, and parsing the content of the receipt file for processing; Retransmission and Confirmation: After receiving the signal requesting retransmission, the sender re - sends the erroneous data. The sender can receive the content of the receipt file sent from the other side according to the default receipt file directory. After successfully receiving the re - sent data, the receiver sends a confirmation signal to the sender. Since the established environment is cross - network and the direct connection interface is not available, the confirmation signal is transmitted through an asynchronous file, indicating that the data has been successfully received and processed.

[0048] Retransmission and Confirmation: After receiving the signal requesting retransmission, the sender re - sends the erroneous data. After successfully receiving the re - sent data, the receiver sends a confirmation signal (such as ACK, Acknowledgment) to the sender, indicating that the data has been successfully received and processed.

[0049] Implementation Methods: The implementation methods of the system's automatic re - transmission mechanism mainly include the following: Frame Counter Method: Add a counter to the data frame. The receiver determines the order and integrity of the data frame by checking the value of the counter. If the counter value of a certain frame does not meet the expectation, the receiver requests the sender to re - send that frame.

[0050] Frame Counter Method: Add a counter to the data frame. The receiver determines the order and integrity of the data frame by checking the value of the counter. During data transmission, to ensure that the receiving end can correctly receive data frames in the order of the sending end, the sending end usually adds a frame number before each data frame. This frame number is an incrementing counter value. Each time data is sent, the counter is automatically incremented by 1, and the new counter value is used as the frame number of the data sent this time.

[0051] After receiving the data frame, the receiving end extracts the frame number and compares it with the frame numbers of the previously received data frames. If the value of the new frame number is larger, it means that the frame is received in order, so the frame is valid and the frame number is saved for the next comparison. If the value of the new frame number is smaller or there is a discontinuity, it is determined that the data frame is invalid or out - of - order. At this time, the receiving end can take corresponding processing measures according to the protocol regulations, such as discarding the frame, requesting re - transmission, etc.

[0052] The integrity check of the data frame usually depends on the checksum or message integrity code (MIC) attached to the end of the data frame. Before sending data, the sender performs an operation on the data frame to be transmitted through a one - way algorithm to generate a corresponding checksum or MIC, and attaches it to the data frame and sends it together.

[0053] After receiving the data frame, the receiver will use the same one-way algorithm to operate on the received data frame (excluding the check code or MIC part) to obtain a receiver's check code or MIC. Then, the receiver will compare the check code or MIC calculated by itself with the check code or MIC attached by the sender. If they are the same, it means that the data frame has not been modified during the transmission process, so the data frame is complete; if they are different, it means that the data frame may have errors or been tampered with during the transmission process. At this time, the receiving end can take corresponding handling measures according to the protocol regulations, such as requesting retransmission, etc.; Acknowledge frame method: After sending a frame of data, the sender waits for the receiver to send an acknowledge frame ACK; Retransmission request method: After detecting an error data, the receiver actively sends a retransmission request to the sender; after receiving the request, the sender re-sends the incorrect data.

[0054] Acknowledge frame method: After sending a frame of data, the sender waits for the receiver to send an acknowledge frame (ACK). If the sender does not receive the acknowledge frame within the specified time, it is considered that the data transmission fails, and the frame of data will be re-sent.

[0055] Retransmission request method: After detecting an error data, the receiver will actively send a retransmission request to the sender. After receiving the request, the sender will immediately re-send the incorrect data.

[0056] When implementing the system's automatic retransmission mechanism, it is necessary to pay attention to avoiding infinite loop retransmission requests, which may lead to waste of system resources and communication blockage. Therefore, it is necessary to set reasonable retransmission times and timeout periods.

[0057] At the same time, it is also necessary to consider the reliability and stability of the channel to ensure that the retransmission request can be successfully transmitted to the sender and be correctly processed.

[0058] In summary, the system's automatic retransmission mechanism is an effective error control technology. It improves the reliability and communication efficiency of data transmission through an automatic detection and retransmission mechanism, and is widely used in various communication systems.

[0059] Embodiment 2, the cross-network data transmission platform based on big data provided by the embodiments of the present invention has: High-performance data transmission: Adopt a private file transfer protocol combined with a high-speed transmission plug-in to ensure the fast and reliable transmission of large files and massive files. Support resume from breakpoint and automatic retransmission of errors to ensure the transmission accuracy rate.

[0060] Comprehensive log auditing: Record all user operation logs and file exchange logs of the platform, and support long-term retention of original files. Provide log retrieval, export and automatic archiving and cleaning functions.

[0061] Enterprise-level integration capabilities: Provide open APIs to support integration with enterprise AD accounts, OA systems, BPM systems, antivirus engines, DLP, encryption / decryption systems, etc.

[0062] As Figure 2 shown, the cross-network data transmission platform based on big data provided by the embodiments of the present invention includes, from top to bottom: Presentation layer 1, used to provide Web browsers, APPs, FTP clients, and APIs for displaying transmission data; Application layer 2, used to execute the cross-network data transmission data function; System layer 3, used to manage the cross-network data transmission data; Infrastructure layer 4, used to provide the implementation hardware for the cross-network data transmission data; The application layer 2 includes: a file check sub-module 201, used to execute file type check, sensitive information check, file source check, virus check, and workflow approval; Mechanism execution sub-module 202, used to execute log auditing, access the database, receipt mechanism, breakpoint resumption, and automatic retransmission of failures; Sending sub-module 203, used to execute sending files, receiving files, sending data, receiving data, and parsing file data; Transmission sub-module 204, used to execute notification and alarm, statistical reports, multi-source content access, backup management, and high-performance transmission; The system layer 3 includes: a user management sub-module 301, used to manage the input users; User permission management sub-module 302, used to manage the usage permissions of users; Security policy sub-module 303, used to manage the security check policy formed by combining all checkpoints such as file type, size, sender and recipient identities, etc.; Approval process sub-module 304, used to manage the approval process; Alarm notification sub-module 305, used to manage the alarm data; The infrastructure layer 4 includes: a server 401, an air gap 402, and a swing arm 403.

[0063] Exemplarily, Figure 3It is the principle of the cross-network data transmission platform based on big data provided by the embodiments of the present invention. As can be seen from the above embodiments, the present invention improves data security: through multiple security checks and approval processes, effectively preventing data leakage. Reduces operation and maintenance costs: an automated and intelligent management interface reduces the burden on IT personnel. Enhances unified management: constructs a unified cross-network file ferry channel for convenient centralized control. Improves business efficiency: high-performance transmission technology ensures rapid file transfer and reduces waiting time. Complies with legal and regulatory requirements: clear measures such as data and personnel permission management, data review, and log auditing avoid compliance risks.

[0064] Cross-network transmission supports multiple transmission protocols and can select an efficient transmission method in real time according to the bandwidth.

[0065] The receipt mechanism can perform reissuance or alarm processing, etc. through the receipt combined with receipt parsing.

[0066] The above are only the relatively preferred specific implementation manners of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, any modifications, equivalent replacements, and improvements made within the spirit and principle of the present invention shall be covered by the protection scope of the present invention.

Claims

1. A cross-network data transmission method based on big data, characterized in that: The method includes: S1, the sender forms a security check strategy through a custom sensitive feature library, regular expressions and keyword checks, combined with the file type, size, sender and recipient identity check points, and conducts sensitive information checks. Based on the check results, it automatically blocks, releases or triggers the manual approval process; S2, based on the sensitive information inspection results, conduct approval step by step according to the organizational structure and reporting relationship, and complete the approval process management through the approval mode of joint signature, or signature, transfer and copy; S3, the receiver processes the information or instructions that have been successfully received and approved, and uses the system receipt mechanism to return the receipt to the sender to confirm the receipt, ensuring the authenticity and reliability of the information; S4, using the automatic retransmission mechanism to automatically detect errors in data transmission, requesting the sender to resend the erroneous data to ensure data integrity and reliability.

2. The cross-network data transmission method based on big data according to claim 1 is characterized in that: In step S3, the recipient processes the information or instructions that have been successfully received and approved, including: fault analysis and processing. If the information cannot be successfully delivered or processed, the receipt provides the reason for the failure.

3. The cross-network data transmission method based on big data according to claim 2 is characterized in that: Also includes: Statistical analysis and optimization: by collecting and analyzing receipt data, we evaluate and optimize the system's performance and service quality. We also use SMS receipt data to statistically analyze the delivery rates and delays of different SMS service providers. During system operation, comprehensive performance indicator data is collected, including response time, throughput, CPU usage, memory usage, network latency, and system resource usage.

4. The cross-network data transmission method based on big data according to claim 1 is characterized in that: In step S3, the implementation of the system receipt mechanism includes: Automatic receipts: In SMS communications and online transactions, receipts are automatically generated and sent by the system; Manual receipt, which is generated and sent manually by the recipient after confirming receipt of the message; Intelligent receipts use natural language processing technology to automatically identify the information in receipts and classify and process the receipt information.

5. The cross-network data transmission method based on big data according to claim 1 is characterized in that: In step S4, the automatic retransmission mechanism is used to automatically detect errors in data transmission and request the sender to resend the erroneous data, including: Error detection and feedback: the sender adds redundant error detection code when sending data. After receiving the data, the receiver performs error detection on the data based on the redundant error detection code. If an error is detected, the receiver sends a negative acknowledgement signal or a retransmission request signal to the sender, requiring the sender to resend the erroneous data. Resend and confirmation: After receiving the signal requesting resend, the sender resends the erroneous data. The sender receives the receipt file content sent by the other party according to the default receipt file directory. After successfully receiving the resent data, the receiver sends a confirmation signal to the sender, indicating that the data has been successfully received and processed.

6. The cross-network data transmission method based on big data according to claim 5 is characterized in that: The automatic retransmission mechanism can be implemented in the following ways: Frame counter mode: a counter is added to the data frame, and the receiver determines the order and integrity of the data frame by checking the value of the counter; Confirmation frame mode: after sending a frame of data, the sender waits for the receiver to send a confirmation frame ACK; Resend request method: After detecting erroneous data, the receiver actively sends a resend request to the sender; after receiving the request, the sender resends the erroneous data.

7. The cross-network data transmission method based on big data according to claim 6 is characterized in that: In the frame counter mode, if the counter value of a frame does not meet the expectation, the receiver requests the sender to resend the frame; In the confirmation frame mode, if the sender does not receive the confirmation frame within the specified time, it is considered that the data transmission has failed and the frame data is resent; In the implementation of the system automatic retransmission mechanism, the number of retransmissions and timeout limit conditions are set.

8. A cross-network data transmission platform based on big data, characterized in that: The platform implements the cross-network data transmission method based on big data as described in any one of claims 1 to 7, and the platform includes: The presentation layer (1) is used to provide Web browsers, apps, FTP clients, and APIs for displaying transmitted data. The application layer (2) performs data transfer functions across networks; The system layer (3) is used to manage data transmission across the network; The infrastructure layer (4) provides the hardware that implements data transmission across the network.

9. The cross-network data transmission platform based on big data according to claim 8 is characterized in that: The application layer (2) includes: A file checking submodule (201), used to perform file type checking, sensitive information checking, file source checking, virus checking, and workflow approval; The receipt mechanism submodule (202) is used to perform log auditing, database access, receipt mechanism, breakpoint continuation, and automatic retransmission on failure; A sending submodule (203) is used to execute sending files, receiving files, sending data, receiving data, and parsing file data; The transmission submodule (204) is used to perform notification and alarm, statistical reporting, multi-source content access, backup management, and high-performance transmission.

10. The cross-network data transmission platform based on big data according to claim 8, characterized in that: The system layer (3) includes: A user management submodule (301) is used to manage input users; A user rights management submodule (302) is used to manage user rights; A security policy submodule (303) is used to manage the security check policy formed by combining the check points of file type, size, sender and recipient identity; The approval process submodule (304) is used to manage the approval process; The alarm notification submodule (305) is used to manage alarm data.

Images