Data transmission system

Abstract

The embodiment of the invention relates to the technical field of network communication, in particular to a data transmission system, and aims to improve the intelligent scheduling and optimization capability of network data transmission. The system comprises a client device, a wide area network software client and a point-to-point transmission protocol are configured in the client device, and the wide area network software client is matched with the point-to-point transmission protocol; a wide area network software controller and a point-to-point transmission protocol are configured in the relay server, the wide area network software controller is used for network strategy configuration, network real-time monitoring and network flow scheduling, and the wide area network software controller is matched with the point-to-point transmission protocol; the client device receives the network address sent by the relay server through the wide area network software client; and the client device sends data to a corresponding network address through the point-to-point transmission protocol so as to realize point-to-point data transmission between clients.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of network communication technology, and in particular, to a data transmission system. Background Art

[0002] To meet the growing demand for network data transmission, Software-Defined Wide Area Network (SD-WAN) technology has been developed. This technology uses software-defined methods to achieve efficient data transmission through multiple links in the wide area network, realizing flexible configuration and intelligent scheduling of network resources.

[0003] Existing software-defined wide area networks (SD-WANs) face challenges such as large-scale data transmission, high-latency scenarios in multinational enterprise networks, high-latency requirements for real-time applications, and data transmission security, but their scheduling capabilities and optimization effects are limited. Summary of the Invention

[0004] The embodiments of the present application provide a data transmission system, which aims to improve the intelligent scheduling and optimization capabilities of network data transmission.

[0005] A first aspect of an embodiment of the present application provides a data transmission system, characterized in that the system includes: A client device, wherein the client device is configured with a wide area network software client and a point-to-point transmission protocol, and the wide area network software client is adapted to the point-to-point transmission protocol; A relay server, wherein the relay server is configured with a wide area network software controller and a point-to-point transmission protocol, the wide area network software controller is used for network policy configuration, real-time network monitoring, and network traffic scheduling, and the wide area network software controller is adapted to the point-to-point transmission protocol; The client device receives the network address sent by the relay server through the wide area network software client; The client device sends data to the corresponding network address through the point-to-point transmission protocol to achieve point-to-point data transmission between clients.

[0006] Optionally, the wide area network software controller includes: Centralized management interface for providing a graphical user interface; An intelligent policy engine, configured to predict network status change trends based on a pre-trained neural network model and generate corresponding network policies, including at least routing policies, security policies, and quality of service policies; The operation and maintenance module is used to identify network fault points and handle the network fault points through preset scripts and pre-trained neural network models.

[0007] Optionally, the relay server further includes a path selection module, which is used to evaluate network performance and select a corresponding network transmission path based on real-time network status data, including: Network monitoring submodule, used to collect network status information in real time; An intelligent evaluation submodule, configured to evaluate the network path according to the network status information and determine a target network path by using a multi-objective optimization intelligent evaluation algorithm; The path switching submodule is used to migrate the corresponding device to a new network path when the performance of the current network path is detected to be degraded.

[0008] Optionally, the relay server further includes a multi-path load balancing module, configured to adjust the traffic distribution ratio of each network path according to the traffic load of each network path, including: A traffic monitoring and analysis submodule, configured to monitor the traffic load data of each network path in real time, and determine the traffic pattern and traffic trend of each network path based on the traffic load data; The intelligent scheduling submodule is used to adjust the traffic distribution ratio of each network path according to the traffic load of each network path.

[0009] Optionally, the relay server further includes an intelligent traffic management module for classifying different types of traffic and adjusting network resource allocation according to application priority and service quality requirements, including: Traffic identification and classification submodule, used to classify traffic in the network based on deep packet inspection technology, or to classify traffic in the network based on traffic signature analysis technology; The priority scheduling submodule is used to allocate corresponding bandwidth and priority to different types of traffic based on the application priority and service quality requirements.

[0010] Optionally, the relay server further includes an end-to-end encryption module for encrypting data during transmission, including: Encryption algorithm integration submodule, used to integrate multiple encryption algorithms; The key management and distribution submodule is used to distribute the corresponding key to each client device and regularly change the encryption algorithm.

[0011] Optionally, the relay server further includes an adaptive quality of service policy module, configured to adjust the quality of service policy according to current network status information, including: The dynamic service quality adjustment submodule is used to adjust the service quality strategy according to the current network status information and application requirements.

[0012] The service perception submodule is used to identify the application corresponding to each service in the network and formulate a corresponding service quality strategy for the application based on the application information of the application.

[0013] Optionally, the system further includes a network virtualization module for constructing a virtual network layer in the physical network layer to implement allocation of network resources, including: The resource abstraction and encapsulation submodule is used to convert physical network resources into logical resources using virtualization technology, and then encapsulate and isolate them through the virtualization layer; The dynamic resource allocation submodule is used to allocate corresponding network resources to the client devices in the network according to business requirements and network status information.

[0014] Optionally, the data transmission system further includes a point-to-point transmission protocol integration module, including: The protocol adapter module is used to combine the control logic of the wide area network software with the mechanism of the point-to-point transmission protocol; A dynamic neighbor discovery submodule, configured to periodically broadcast presence information and monitor the presence information broadcast by other nodes; The data fragmentation and reassembly submodule is used to fragment the data packets at the data sending end, reassemble the fragmented data packets at the data receiving end, and verify the reassembled data packets.

[0015] Optionally, the dynamic path switching submodule includes: The distance initialization submodule is used to set the distance of the source node to zero and the distances of the remaining nodes to infinity; A node marking submodule is used to select a node with the smallest distance from the unprocessed nodes and mark the node as an unprocessed node; The distance update submodule is used to update the distance between each adjacent node according to a preset distance formula.

[0016] The data transmission system provided by the present application is adopted, which includes a client device, wherein the client device is configured with a wide area network software client and a point-to-point transmission protocol, and the wide area network software client is adapted to the point-to-point transmission protocol; a relay server, wherein the relay server is configured with a wide area network software controller and a point-to-point transmission protocol, and the wide area network software controller is used for network policy configuration, real-time network monitoring and network traffic scheduling, and the wide area network software controller is adapted to the point-to-point transmission protocol; the client device receives the network address sent by the relay server through the wide area network software client; the client device sends data to the corresponding network address through the point-to-point transmission protocol to realize point-to-point data transmission between clients.

[0017] In this application, a wide area network software client is configured in the client device, and a wide area network software controller is configured in the relay server, and both are adapted to the point-to-point transmission protocol, so that point-to-point transmission between client devices can be performed under the control of the relay server. The data does not need to be forwarded by the relay server, which solves the problems of large-scale data transmission, high latency and slow data transmission speed in cross-regional network scenarios, and effectively improves the intelligent scheduling and optimization capabilities of network data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 This is a network architecture diagram of a data transmission system proposed in one embodiment of the present application; Figure 2 This is a device networking information diagram proposed in one embodiment of the present application; Figure 3 This is a network connection information diagram proposed in one embodiment of the present application; Figure 4 This is a network test information diagram proposed in one embodiment of the present application; Figure 5 This is a schematic diagram of the system architecture proposed in one embodiment of the present application; Figure 6 This is a schematic diagram of the networking architecture proposed in one embodiment of the present application; Figure 7 This is a flowchart of adaptive networking data transmission proposed in one embodiment of the present application. DETAILED DESCRIPTION

[0020] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0021] For the convenience of explanation, the terms appearing in the embodiments of this application are first explained in a unified manner: WAN (Wide Area Network): WAN is the abbreviation of Wide Area Network, which refers to a computer network that covers a large geographical area, usually spanning cities, countries or even the world. It is used to connect local area networks (LANs) and other types of networks, supporting remote communication and data transmission.

[0022] SD-WAN (Software-Defined Wide Area Network): SD-WAN is a technology that uses software to control WAN traffic, aiming to improve network performance, flexibility and cost-effectiveness. It supports intelligent traffic steering based on application requirements, network conditions and bandwidth costs, enabling efficient data transmission through multiple WAN links.

[0023] QoS (Quality of Service): QoS is a network technology that aims to classify and manage network traffic to ensure that certain applications (such as video conferencing, voice calls) can obtain higher priority network resources, guarantee low latency, high bandwidth and stability, and reduce packet loss.

[0024] P2P protocol (Peer-to-Peer Protocol): P2P protocol is a distributed network protocol that allows multiple nodes (i.e. computers or devices) to communicate directly with each other without the need for an intermediary server. Each node acts as both a client and a server, distributing and receiving files, data or information.

[0025] UDP protocol (User Datagram Protocol): UDP is a transport layer protocol that allows data to be transmitted in a simple and fast manner, but does not guarantee the order or integrity of data packets. This protocol is very suitable for applications that are sensitive to latency but do not require data packet integrity, such as video streaming, online gaming and DNS queries.

[0026] TCP protocol (Transmission Control Protocol): TCP is a reliable transport layer protocol that ensures the ordered transmission and integrity of data packets. It establishes connections, confirms data packet reception and retransmits when lost, making it suitable for data transmission scenarios that require high reliability, such as file transfer, email and web browsing.

[0027] Load balancing: Load balancing is a distributed system technology that aims to evenly distribute traffic to multiple servers, ensuring efficient operation of networks or applications, optimizing resources and avoiding server overload. Through load balancing, the reliability, latency and throughput of services can be improved.

[0028] Bandwidth: Bandwidth refers to a network's transmission capacity, representing the maximum amount of data that can pass through the network in a given period of time. It is usually expressed in kilobits per second (Kbps) or megabits per second (Mbps). The higher the bandwidth, the more data the network can transmit, and the faster the communication speed.

[0029] Network Latency: Latency refers to the time it takes for data to be transmitted from the source to the destination, typically measured in milliseconds. Lower latency means faster network response, which is crucial for applications that require real-time feedback, such as online gaming and voice calls.

[0030] Relay Server: A relay server is a network service that relays data between clients. When a client cannot connect directly, the relay server acts as an intermediary node, ensuring that data can be transmitted to its destination through an indirect path.

[0031] Network Virtualization: Network virtualization is a technology that abstracts physical network resources through software, building multiple virtual network layers on a single physical network infrastructure. Each virtual network can have different configurations and uses, making network management more flexible and efficient, and improving security and resource utilization.

[0032] NAT type (Network Address Translation Types): is a technology used to convert private IP addresses into public IP addresses, allowing multiple devices to access the external network through a public IP address.

[0033] STUN (Session Traversal Utilities for NAT) is a network protocol used to resolve device communication barriers in a NAT (Network Address Translation) environment. It helps clients obtain public network addresses and port information, supporting direct connection establishment for real-time communication applications. refer to Figure 1 , Figure 1 This is a diagram of the data transmission system network architecture proposed in one embodiment of the present application. Figure 1 As shown, the system includes: A client device is configured with a wide area network (WAN) software client and a point-to-point transmission protocol, and the WAN software client is adapted to the point-to-point transmission protocol. A relay server is configured with a WAN software controller and a point-to-point transmission protocol, and the WAN software controller is used for network policy configuration, real-time network monitoring, and network traffic scheduling, and the WAN software controller is adapted to the point-to-point transmission protocol. The client device receives a network address sent by the relay server via the WAN software client. The client device sends data to the corresponding network address via the point-to-point transmission protocol, thereby implementing point-to-point data transmission between clients.

[0034] In this embodiment, a client device is configured with a WAN software client, enabling it to join a WAN and be controlled by a WAN software controller. The client device is also connected to multiple user terminals, such as mobile phones, wireless routers, and personal computers. The client device can be a server on a local area network or on the internet. Each client device is connected to a relay server and configured with a peer-to-peer (P2P) transmission protocol, enabling peer-to-peer communication between the client devices.

[0035] In this embodiment, the relay server is configured with a wide area network software controller, which can control the data transmission of each client device and is also adapted to the point-to-point transmission protocol. The relay server stores the IP address of each client device and is also configured with various expansion function modules.

[0036] When the relay server controls the client device to transmit data, it sends the corresponding network address to the client device. After receiving the network address, the client device transmits the data directly to the network address through the point-to-point transmission protocol, thereby completing the point-to-point data transmission between the two client devices.

[0037] In this embodiment, by integrating the point-to-point transmission protocol into the network system based on wide area network software, the client device's dependence on the central server is reduced, the network scalability and fault tolerance are improved, and the load pressure on the central node is reduced, while the data transmission speed between client devices is improved.

[0038] In another embodiment of the present application, the wide area network software controller includes: Centralized management interface, used to provide a graphical user interface.

[0039] In this embodiment, the WAN software controller serves as the system's centralized management unit, responsible for configuring network policies, real-time monitoring, and automatically adjusting network traffic. By leveraging the decentralized nature of point-to-point transmission, the WAN software controller dynamically allocates resources, improving network stability and adaptability. Through centralized management, the controller simplifies network operation and maintenance procedures and enhances overall network flexibility.

[0040] In this embodiment, the centralized management interface provides an intuitive graphical user interface (GUI), allowing network administrators to configure network policies, monitor network status, and adjust resource allocation through a single platform.

[0041] The intelligent policy engine is used to predict the trend of network status changes based on a pre-trained neural network model and generate corresponding network policies, which include at least routing policies, security policies, and service quality policies.

[0042] In this embodiment, the WAN software controller integrates an intelligent policy engine. Based on network conditions and service requirements, it leverages historical data and real-time information to predict network status trends through a neural network learning model and generate corresponding network policies. The specific policy parameters (bandwidth allocation ratio, quality of service level) are determined by the model output. Network policies include at least routing policies, security policies, and quality of service policies. The core goal of routing policies is to optimize network traffic paths and resource allocation by filtering, modifying routing attributes, or adjusting routing selection logic. Security policies include firewall settings and key settings for each node. Quality of service policies include selecting the optimal path for each node and providing high-priority traffic services.

[0043] For example, historical data includes the historical traffic load of each network node, real-time information includes the real-time traffic load and operating status of each network node, and the neural network learning model can adopt RNN, CNN, LSTM, GRU, DNN and other models.

[0044] The operation and maintenance module is used to identify network fault points and handle the network fault points through preset scripts and pre-trained neural network models.

[0045] In this embodiment, the preset script is a pre-written program, and its function is to determine whether a fault occurs at each network node based on the network status information of the node and identify the network fault point. The pre-trained neural network model uses historical fault data and corresponding processing methods as a training set. The trained model can select the corresponding processing method according to different fault conditions.

[0046] In this embodiment, the operation and maintenance module realizes automation and intelligence of network operation and maintenance through automated scripts and machine learning algorithms, automatically detects and resolves network failures, reduces operation and maintenance costs, and improves operation and maintenance efficiency.

[0047] In another embodiment of the present application, the relay server further includes a path selection module for evaluating network performance and selecting a corresponding network transmission path based on real-time network status data, including: The network monitoring submodule is used to collect network status information in real time.

[0048] In this embodiment, the path selection module can automatically evaluate network performance based on real-time network status information (bandwidth, latency, packet loss rate, etc.) and dynamically select the optimal transmission path. Through intelligent algorithms, the module ensures that data is always transmitted through the best-performing path based on preset rules and real-time monitoring data, thereby optimizing overall network efficiency.

[0049] In this embodiment, the path selection module includes a network monitoring submodule. The network monitoring submodule collects network status information in real time by deploying distributed network monitoring probes, including key indicators such as bandwidth, delay, and packet loss rate.

[0050] The intelligent evaluation submodule is used to evaluate the network path according to the network status information through a multi-objective optimization intelligent evaluation algorithm to determine the target network path.

[0051] In this embodiment, the intelligent evaluation submodule uses a multi-objective optimization intelligent evaluation algorithm to analyze multiple available paths, taking into account factors such as bandwidth utilization, latency, and cost. The algorithm uses machine learning or heuristic search strategies to quickly and accurately find the optimal path and determines the path priority using the following weighted comprehensive evaluation formula: (1) Among them, Indicates the priority of the i-th path; Indicates the delay of a path (Latency); Indicates the bandwidth of the i-th path (Bandwidth); represents the packet loss rate of the i-th path; α, β, and γ are weighting coefficients used to adjust the impact of delay, bandwidth, and packet loss rate on path selection.

[0052] The path switching submodule is used to migrate the corresponding device to a new network path when the performance of the current network path is detected to be degraded.

[0053] In this embodiment, the path switching submodule automatically triggers the path switching mechanism when it detects that the current path performance has degraded, seamlessly switching the old path to the new optimal path to ensure the continuity and efficiency of data transmission. The path from the source node to all other nodes is found based on the Dijkstra algorithm.

[0054] In this embodiment, the path switching submodule includes: The distance initialization submodule is used to set the distance of the source node to zero and the distances of the remaining nodes to infinity.

[0055] In this embodiment, the source node is a reference node for path finding.

[0056] In this embodiment, in the distance initialization submodule, the distance of the source node is first set to zero, and then the distances of the remaining nodes are set to infinity.

[0057] The node marking submodule is used to select the node with the smallest distance from the unprocessed nodes and mark the node as an unprocessed node.

[0058] In this embodiment, the node marking submodule marks the node with the smallest distance among the unprocessed nodes as an unprocessed node.

[0059] The distance update submodule is used to update the distance between each adjacent node according to a preset distance formula.

[0060] In this embodiment, the distance updating submodule updates the distance between each adjacent node according to a preset distance formula.

[0061] The default distance formula is: (2) Where d(v) is the current distance of node v, d(u) is the distance of processed node u, and w(u,v) is the weight of the edge u to v (such as latency, bandwidth, etc.).

[0062] In this embodiment, through intelligent algorithms, the system can quickly and accurately find the optimal path, optimize overall network efficiency, and ensure that data is always transmitted through the path with the best performance.

[0063] In another embodiment of the present application, the relay server further includes a multi-path load balancing module, which is configured to adjust the traffic distribution ratio of each network path according to the traffic load of each network path, including: The traffic monitoring and analysis submodule is used to monitor the traffic load data of each network path in real time, and determine the traffic pattern and traffic trend of each network path based on the traffic load data.

[0064] In this embodiment, the traffic analysis and monitoring submodule monitors the traffic load data of each network path, and then analyzes the traffic pattern and traffic trend of each network node based on the traffic load data.

[0065] In this embodiment, the traffic mode is a traffic transmission mode, such as normal transmission, periodic transmission, etc., and the traffic trend is a change trend of the traffic size.

[0066] The intelligent scheduling submodule is used to adjust the traffic distribution ratio of each network path according to the traffic load of each network path.

[0067] In this embodiment, the intelligent scheduling submodule adjusts the traffic allocation ratio of each network path based on the traffic load of each network path. This algorithm ensures that good network performance can still be maintained under high load conditions. The traffic allocation ratio is determined by the available bandwidth and latency of each path. The formula is as follows: (3) in represents the traffic weight assigned to the i-th path; Indicates the delay of a path (Latency); represents the bandwidth of the i-th path; n represents the number of available paths.

[0068] According to this formula, paths with larger bandwidth and lower latency will be allocated more traffic, thereby improving the overall network throughput and stability.

[0069] In another embodiment of the present application, the relay server further includes an intelligent traffic management module for classifying different types of traffic and adjusting network resource allocation according to application priority and service quality requirements, including: The traffic identification and classification submodule is used to classify the traffic in the network based on deep packet inspection technology, or to classify the traffic in the network based on traffic signature analysis technology.

[0070] In this embodiment, Deep Packet Inspection (DPI) is an application-layer network traffic analysis technology that implements refined traffic management by analyzing the application-layer content of data packets. Traffic signature analysis is a network traffic detection method based on a predefined rule base. It identifies specific applications, attacks, or abnormal behavior by matching packet signatures, playing a key role in network security and performance optimization.

[0071] In this embodiment, the traffic identification and analysis submodule classifies and identifies traffic passing through the network through deep packet inspection technology or traffic signature analysis technology.

[0072] The priority scheduling submodule is used to allocate corresponding bandwidth and priority to different types of traffic based on the application priority and service quality requirements.

[0073] In this embodiment, the priority scheduling submodule allocates different bandwidths and priorities to different types of traffic based on the application priority and service quality requirements, to ensure that business-critical applications have sufficient bandwidth and low latency.

[0074] The following formula can be used to evaluate the bandwidth utilization of each path to ensure efficient use of network resources: (4) Where U represents bandwidth utilization; represents the actual flow of the i-th path; represents the available bandwidth of the i-th path; n is the number of paths.

[0075] For example, the application running in client device A is a video player, and the traffic type passing through is video traffic. The application running in another client device B is a text browsing program, and the traffic type passing through is text traffic. The video player has a higher priority, so the priority of client device A is increased and more bandwidth is allocated to it.

[0076] In this embodiment, by identifying and classifying traffic, it is ensured that key business applications obtain sufficient bandwidth and low latency, thereby improving the utilization of network resources.

[0077] In another embodiment of the present application, the relay server further includes an end-to-end encryption module for encrypting data transmission, including: The encryption algorithm integration submodule is used to integrate multiple encryption algorithms.

[0078] In this embodiment, the encryption algorithm integration submodule inherits multiple advanced encryption algorithms (such as AES-GCM, CHACHA20-POLY1305), providing flexible encryption options to meet different security requirements.

[0079] The key management and distribution submodule is used to distribute the corresponding key to each client device and regularly change the encryption algorithm.

[0080] In this embodiment, the key management and distribution submodule distributes corresponding keys to each client device and also regularly changes the encryption algorithm to prevent potential security threats.

[0081] In this embodiment, the end-to-end encryption module supports multiple advanced encryption algorithms to achieve end-to-end encryption of data, ensuring data security and privacy protection during transmission, and is particularly suitable for business scenarios with high security requirements.

[0082] In another embodiment of the present application, the relay server further includes an adaptive service quality policy module, which is configured to adjust the service quality policy according to current network status information, including: The dynamic service quality adjustment submodule is used to adjust the service quality strategy according to the current network status information and application requirements.

[0083] The dynamic service quality adjustment submodule adjusts the service quality strategy according to the current network status information and application requirements.

[0084] For example, the service quality strategy includes mechanisms such as bandwidth reservation, queue management, and congestion control to ensure the performance of key services. During the service quality management process, dynamic optimization is performed based on indicators such as network delay, bandwidth requirements, and jitter. The formula is as follows: (5) Represents the service quality score, which is used to indicate the service quality of the i-th path. The higher the score, the better the quality. represents the actual bandwidth of the i-th path; Indicates the maximum possible bandwidth among all paths in the network; represents the delay of the i-th path, the transmission time of data from source to destination; Indicates the highest acceptable delay value in the network; represents the delay of the i-th path; Indicates the maximum acceptable jitter value in the network. Weight coefficients are used to adjust the impact of bandwidth, latency, and jitter on the QoS score. These coefficients can be set based on specific application requirements to reflect the relative importance of different factors in QoS evaluation. By calculating the QoS score for each path, the path with the highest quality of service is prioritized to ensure the performance of critical applications.

[0085] The service perception submodule is used to identify the application corresponding to each service in the network and formulate a corresponding service quality strategy for the application based on the application information of the application.

[0086] In this embodiment, the service perception submodule determines the application corresponding to each service through the service data corresponding to each network node, and then formulates a corresponding service quality policy for the application based on the application information corresponding to the application.

[0087] In this embodiment, by dynamically optimizing the service quality policy, the performance of key services is ensured, thereby improving the user experience.

[0088] In another embodiment of the present application, the system further includes a network virtualization module for constructing a virtual network layer in the physical network layer to implement allocation of network resources, including: The resource abstraction and encapsulation submodule is used to use virtualization technology to convert physical network resources into logical resources, and encapsulate and isolate them through the virtualization layer.

[0089] In this embodiment, the resource abstraction and encapsulation submodule uses virtualization technology to convert physical network resources into logical resources, and encapsulates and isolates them through the virtualization layer, providing users with virtual machine services in cloud resources, realizing flexible configuration and dynamic allocation of network resources, and client devices can access corresponding network resources through virtual addresses.

[0090] The dynamic resource allocation submodule is used to allocate corresponding network resources to the client devices in the network according to business requirements and network status information.

[0091] In this embodiment, the dynamic resource allocation submodule dynamically allocates network resources according to business requirements and network status information, and optimizes the utilization and adaptability of network resources through automated scripts and intelligent algorithms.

[0092] In another embodiment of the present application, the data transmission system further includes a point-to-point transmission protocol integration module, including: The protocol adapter module is used to combine the control logic of the wide area network software with the mechanism of the point-to-point transmission protocol.

[0093] In this embodiment, a point-to-point protocol adaptation layer is designed in the protocol adapter submodule. This layer is responsible for integrating the control logic of the wide area network software with the mechanism of the point-to-point transmission protocol. Through this layer, nodes can directly discover, establish and maintain communication links without the need for transit through a relay server, which significantly reduces the load pressure on the central node and improves the scalability and fault tolerance of the system.

[0094] The dynamic neighbor discovery submodule is used to periodically broadcast presence information and monitor the presence information broadcast by other nodes.

[0095] In this embodiment, the dynamic neighbor discovery submodule leverages the characteristics of the point-to-point transmission protocol to implement a dynamic neighbor discovery mechanism between nodes. Nodes periodically broadcast their presence information and monitor other nodes' broadcasts to build and maintain a dynamically updated neighbor list. This mechanism ensures diverse and flexible data transmission paths.

[0096] This embodiment uses the Kademlia protocol or its variants as the basis for the node discovery algorithm. It manages inter-node distances through XOR operations and a tree structure, achieving efficient node search and neighbor maintenance. The node discovery algorithm selects an appropriate hash function, stores the hash value corresponding to each node in a dynamic neighbor list, and dynamically manages this list, updating the hash values ​​of the nodes in the list in real time.

[0097] The data fragmentation and reassembly submodule is used to fragment the data packets at the data sending end, reassemble the fragmented data packets at the data receiving end, and verify the reassembled data packets.

[0098] In this embodiment, in order to optimize transmission efficiency and reliability, large data packets are fragmented and reassembled at the receiving end, and the data packets are verified to ensure the integrity and correctness of the data fragments.

[0099] The calculation formula for data shard size is: (6) Where t is the total packet size, and n is the number of fragments, dynamically calculated based on the path MTU (Maximum Transmission Unit) and overhead. Finally, a checksum is generated for each data fragment using an algorithm such as CRC (Cyclic Redundancy Check) or MD5 to ensure data integrity.

[0100] In another embodiment of the present application, a small data transmission system is built to simulate the data transmission process.

[0101] First, set up the compilation environment. You can use GoLang as the development language because of its powerful cross-platform compilation capabilities. It is suitable for building programs that can run on Windows, Linux, and macOS at the same time.

[0102] Then configure the environment, install the Go language environment on the development machine, configure GOPATH and GOROOT, and ensure that the Go compiler (go build) is available.

[0103] Then, module division is performed. According to functional requirements, the system is divided into multiple modules, such as network communication module, data encryption module, user authentication module, etc., and organized using Go's package mechanism. The modules in the above embodiments can all be implemented.

[0104] Recompile the program: For different target platforms (Windows, Linux, macOS), use Go's cross-compilation function (such as GOOS=linux GOARCH=amd64 go build) to generate the corresponding binary executable files.

[0105] Next, prepare the relay server. Hardware and software requirements: Ensure Relay Server A has a stable network connection and sufficient computing resources. Fixed IP and exposure: Configure a fixed public IP address for Server A and ensure it is accessible from the internet. Configure firewall or router rules to allow external access to designated ports (such as TCP 23589). Security hardening: Install and configure necessary security software (such as firewalls and intrusion detection systems), regularly update system and software patches, and implement a strong password policy.

[0106] When preparing client devices, prepare two computers B and C, make sure they can connect to the Internet, and can access relay server A through IP address or domain name. Install necessary software or configure the environment on B and C to run client programs, especially WAN software.

[0107] Then create a relay network and execute the following command on relay server A to create a relay network: yfsw -name A -id 1 -port 23589 -ipcidr 10.10.10.0 / 24 -ip 10.10.10.255 -passwd 123456. The meaning of each parameter is shown in the following table: Table 1

[0108] Then add the client to the network, run the client program on computers B and C, and enter the IP address, port number, network name and password of the relay server to join the relay network.

[0109] yfsw -name B -id 2 -server 43.25.345.66:23589 -ip 10.10.10.1 -passwd123456. The meaning of each parameter is shown in the following table: Table 2

[0110] All clients can access the network in this way, and only need to adjust the name, id, and ip. After connecting to the relay network, you can stop the relay service, and all other nodes have been connected to P2P.

[0111] Then check the information on the client. Execute the command: yfsw --info on the client. After running the command, you can view the current device network information, including network name, virtual IP address, virtual gateway address, subnet mask, NAT type, upstream / downstream traffic, etc. Figure 2 , Figure 2 This is a device networking information diagram proposed in one embodiment of the present application.

[0112] You can also view the network information. The client executes the command: yfsw --list. After running the command, you can view the network information of all devices in the current network, including network name, virtual IP address, connection status, network type, etc. Figure 3 , Figure 3 This is a network connection information diagram proposed in an embodiment of the present application.

[0113] The embodiment of the present application also tests the network, using iperf3 to test the upload and download speed of device B on device A (using `iperf3 -c` and `iperf3 -c -R` commands respectively), executing once every 1 minute, for a total of 5 tests. Figure 4 , Figure 4 This is a network test information diagram proposed in an embodiment of the present application.

[0114] By analyzing the network performance test results using the iperf3.exe -c command to connect to host 10.0.0.2, the following conclusions can be drawn: Network connection stability: During the test, the network connection demonstrated a high degree of stability. The bandwidth data per second shows that while the transmission rate fluctuated at different time intervals, it generally maintained a high level of stability and consistency, with a relatively small fluctuation range.

[0115] High-speed data transmission: Test results showed that data transmission rates reached peaks of 3.53 Gbits / s to 3.93 Gbits / s during certain time intervals, demonstrating the network's high-speed data transmission capabilities. The average bandwidth was 3.57 Gbits / sec, demonstrating excellent network performance capable of meeting the needs of large-scale data transmission and real-time applications.

[0116] Low latency: The latency in the test was 11 milliseconds, which is a very low latency time. This shows that the network has an extremely fast response speed during data transmission, which helps to improve the user experience and the real-time nature of applications.

[0117] Reverse Mode Test: As can be seen from the command and test results, the test was conducted in reverse mode, with the remote host 10.0.0.2 acting as the sender and the local host (IP 10.0.0.1) acting as the receiver. This test mode helps evaluate network performance under different roles.

[0118] Transmission volume gradually increases: Judging from the transmission volume in each time interval, the data volume is gradually increasing, but the bandwidth has not dropped significantly, which further proves the high performance and stability of the network.

[0119] Retransmissions: During the entire test, the number of retransmissions was 73, which is relatively low. This indicates high data transmission reliability and good network quality.

[0120] In another embodiment of the present application, reference Figure 5 , Figure 5 This is a schematic diagram of the system architecture proposed in one embodiment of the present application. Figure 5 As shown in the figure, the data transmission system consists of a network access layer, a control layer, and a network layer. The network access layer includes routers, PCs, virtual CPE (such as 5G clients and 4G clients), and a virtual gateway (GW) (gateway control software). These devices can access the entire system network through the network access layer. The core modules of the control layer include network virtualization, point-to-point transmission, adaptive quality of service policies, and a wide area network software controller. The extension modules include data encryption and decryption, multi-path load balancing, intelligent traffic management, and adaptive path selection. The network layer includes public cloud, private cloud, enterprise cloud, and home cloud.

[0121] In another embodiment of the present application, reference Figure 6 , Figure 6 This is a schematic diagram of the network architecture proposed in one embodiment of the present application. Figure 6 As shown, the network includes a relay server, which connects various client devices (LAN A, LAN B, Internet A, and Internet B). The wireless router and mobile phone are connected to LAN A, Server A and Server B are connected to Internet A, PCs and laptops are connected to LAN C, and Server A and Server B are connected to Internet B. Each client device transmits data using a point-to-point protocol. The individual terminals in the network are not limited to the devices shown in the figure; various types of terminal devices can be connected.

[0122] In another embodiment of the present application, reference Figure 7 , Figure 7 This is a flowchart of adaptive networking data transmission proposed in an embodiment of the present application, such as Figure 7 As shown, when client A needs to transmit data with client B, it needs to determine the protocol type. If the protocol type is symmetric NAT, the data needs to be transmitted through the relay server. If there is no NAT or cone NAT, client A and client B will perform point-to-point data transmission. By determining the protocol type, stable data transmission is guaranteed.

[0123] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0124] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the embodiments of the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0125] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that specifies functions in a box or multiple boxes.

[0126] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0127] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0128] Although preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic inventive concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0129] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

[0130] The above is a detailed introduction to the data transmission method, device, equipment and storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core ideas. At the same time, for those skilled in the art, according to the ideas of the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data transmission system, characterized in that: The system comprises: A client device, wherein the client device is configured with a wide area network software client and a point-to-point transmission protocol, and the wide area network software client is adapted to the point-to-point transmission protocol; A relay server, wherein the relay server is configured with a wide area network software controller and a point-to-point transmission protocol, the wide area network software controller is used for network policy configuration, real-time network monitoring, and network traffic scheduling, and the wide area network software controller is adapted to the point-to-point transmission protocol; The client device receives the network address sent by the relay server through the wide area network software client; The client device sends data to the corresponding network address through the point-to-point transmission protocol to achieve point-to-point data transmission between clients.

2. The data transmission system according to claim 1, characterized in that The wide area network software controller includes: Centralized management interface for providing a graphical user interface; An intelligent policy engine, configured to predict network status change trends based on a pre-trained neural network model and generate corresponding network policies, including at least routing policies, security policies, and quality of service policies; The operation and maintenance module is used to identify network fault points and handle the network fault points through preset scripts and pre-trained neural network models.

3. The data transmission system according to claim 1, wherein: The relay server also includes a path selection module for evaluating network performance and selecting a corresponding network transmission path based on real-time network status data, including: Network monitoring submodule, used to collect network status information in real time; An intelligent evaluation submodule, configured to evaluate the network path according to the network status information and determine a target network path by using a multi-objective optimization intelligent evaluation algorithm; The path switching submodule is used to migrate the corresponding device to a new network path when the performance of the current network path is detected to be degraded.

4. The data transmission system according to claim 1, wherein: The relay server further includes a multi-path load balancing module for adjusting the traffic distribution ratio of each network path according to the traffic load of each network path, including: A traffic monitoring and analysis submodule, configured to monitor the traffic load data of each network path in real time, and determine the traffic pattern and traffic trend of each network path based on the traffic load data; The intelligent scheduling submodule is used to adjust the traffic distribution ratio of each network path according to the traffic load of each network path.

5. The data transmission system according to claim 1, wherein: The relay server also includes an intelligent traffic management module for classifying different types of traffic and adjusting network resource allocation according to application priority and service quality requirements, including: Traffic identification and classification submodule, used to classify traffic in the network based on deep packet inspection technology, or to classify traffic in the network based on traffic signature analysis technology; The priority scheduling submodule is used to allocate corresponding bandwidth and priority to different types of traffic based on the application priority and service quality requirements.

6. The data transmission system according to claim 1, characterized in that The relay server also includes an end-to-end encryption module for encrypting data transmission, including: Encryption algorithm integration submodule, used to integrate multiple encryption algorithms; The key management and distribution submodule is used to distribute the corresponding key to each client device and regularly change the encryption algorithm.

7. The data transmission system according to claim 1, wherein: The relay server further includes an adaptive service quality policy module, which is used to adjust the service quality policy according to the current network status information, including: The dynamic service quality adjustment submodule is used to adjust the service quality strategy according to the current network status information and application requirements. The service perception submodule is used to identify the application corresponding to each service in the network and formulate a corresponding service quality strategy for the application based on the application information of the application.

8. The data transmission system according to claim 1, wherein: The system also includes a network virtualization module for constructing a virtual network layer in the physical network layer to implement allocation of network resources, including: The resource abstraction and encapsulation submodule is used to convert physical network resources into logical resources using virtualization technology, and then encapsulate and isolate them through the virtualization layer; The dynamic resource allocation submodule is used to allocate corresponding network resources to the client devices in the network according to business requirements and network status information.

9. The data transmission system according to claim 1, wherein: The data transmission system further includes a point-to-point transmission protocol integration module, including: The protocol adapter module is used to combine the control logic of the wide area network software with the mechanism of the point-to-point transmission protocol; A dynamic neighbor discovery submodule, configured to periodically broadcast presence information and monitor the presence information broadcast by other nodes; The data fragmentation and reassembly submodule is used to fragment the data packets at the data sending end, reassemble the fragmented data packets at the data receiving end, and verify the reassembled data packets.

10. The data transmission system according to claim 3, characterized in that: The dynamic path switching submodule includes: The distance initialization submodule is used to set the distance of the source node to zero and the distances of the remaining nodes to infinity; A node marking submodule is used to select a node with the smallest distance from the unprocessed nodes and mark the node as an unprocessed node; The distance update submodule is used to update the distance between each adjacent node according to a preset distance formula.

Images