A multi-modal network protocol processing end system and method

Abstract

The present invention discloses a multimodal network protocol processing end system and method. The system includes a host and a multimodal network smart network card installed on the host. The method includes a network modality data message sending process, a network modality data message receiving process and a network modality program management process. The present invention provides the end system with the ability to adapt the network modality protocol message format, so that different network modes can adopt different network message formats and protocol processing logic to meet different network service transmission requirements; supports intelligent selection of forms suitable for business applications to realize network mode encapsulation and transmission; improves the end-side ability to process custom network modality messages, and offloads the network modality processing function to the smart network card; supports the addition, unloading and query of network modes, and enhances the end-side support for multimodal networks.

Description

Technical Field

[0001] The present invention relates to the field of computer networks, and in particular to a multi-modal network protocol processing terminal system and method. Background Art

[0002] With the deep integration and development of information networks and various fields of the economy and society, various specialized and personalized business service carrying requirements have been brought about. At present, it has become a consensus in academia and industry to quickly and efficiently deploy user-defined network modes on a unified network infrastructure through SDN software-defined networks.

[0003] The deployment and operation of network modalities rely on the basic network platform of multimodal network. Multimodal network, based on the full-dimensional definability of network structure, is a network architecture that presents multimodal functions at all layers of the network. It supports full-dimensional definition and multimodal presentation of routing addressing, switching mode, interconnection mode, network element form, transmission protocol, etc. It supports the evolutionary development of the Internet and fundamentally meets the business needs of network intelligence, diversification, personalization, high robustness and high efficiency.

[0004] However, in order to support the deployment and operation of multiple network modes on the end side (host side) at the same time, the end system needs to have the processing capability of sending and receiving data packets of multiple network modes. However, the existing technology still has the following problems:

[0005] 1. Different network modes use different network message formats and protocol processing logic. The end system needs to have the ability to adapt to the network mode protocol message format;

[0006] 2. The end system needs to avoid users manually selecting which network mode to transmit specific business application data, and automatically select the form suitable for the business application to complete the encapsulation and transmission of the network mode;

[0007] 3. The processing of various network modality protocols on the terminal side is generally handled in software, resulting in low efficiency of network modality protocol processing. Therefore, it is considered to offload the network modality processing function to the multi-modal network smart network card for execution;

[0008] 4. Since the same end system has multiple different network modal identifiers, it is necessary to implement identity recognition, management and conversion. Summary of the invention

[0009] In view of the problem of lack of network modality message processing capability on the terminal side in a multimodal network environment, the present invention aims to provide a multimodal network protocol processing terminal system and method.

[0010] The object of the present invention is achieved through the following technical solutions: A multimodal network protocol processing end system, comprising: a host and a multimodal network smart network card installed on the host;

[0011] The host side is deployed with a network modality program management module, a network modality unified call interface layer, a network modality intelligent selection Agent module, and a network modality adaptation layer, which are used to realize the transmission of network modality data between network service applications and multimodal network intelligent network cards;

[0012] The network modality program management module is used to implement the installation, uninstallation and query functions of the network modality program on the end system (including the host and the multimodal network smart network card);

[0013] The network modality unified calling interface layer is used to provide a unified calling interface function for various network service applications in the upper layer;

[0014] The network mode intelligent selection Agent module is used to automatically match a certain type of network mode for each data message to be sent according to network service requirements;

[0015] The network modality adaptation layer is used to perform protocol adaptation operations on the data to be sent to meet the encapsulation format requirements of the corresponding network modality.

[0016] Furthermore, the multimodal network smart network card includes:

[0017] PCIe IP core, on-chip bus, DMA interface, network modality end system protocol control module, network modality message identification and distribution module, and data message transceiver processing module of each network modality (A, B, C, D, ...);

[0018] The PCIe IP core is a hard IP core for implementing PCIe bus functions;

[0019] The on-chip bus is a bus inside the FPGA chip, which is a common connection line between various functional modules inside the chip;

[0020] The DMA interface is used to provide an interface for direct memory access;

[0021] The network modality end system protocol control module is responsible for the installation, uninstallation and query of various network modality data message receiving and sending processing modules inside the smart network card, and updates and manages various network modality protocol information (such as protocol type value) and network modality protocol identification information;

[0022] Each network modality data message transceiver processing module is used to encapsulate / decapsulate the network modality message;

[0023] The network modality message identification and distribution module is used to identify the network modality message based on the network modality protocol information in the network modality end system protocol control module by analyzing and judging the "protocol type" field in the layer 2 Ethernet protocol message, and distribute the identified network modality message to the corresponding network modality data message transceiver processing module.

[0024] Furthermore, each of the network modality data message transceiver processing modules is composed of multiple sub-functional modules including network modality message data storage, management control data storage, network modality message sending pipeline, network modality message receiving pipeline, and sending / receiving engine.

[0025] The present invention also provides a multimodal network protocol processing method, based on the multimodal network protocol processing end system, the method includes a network modality data message sending process, a network modality data message receiving process and a network modality program management process, and the process is specifically as follows:

[0026] The network modality data message sending process is used to implement the process of sending the data message of the network service application from the end system;

[0027] The network modality data message receiving process is used to realize the process of receiving network message data from a multimodal network environment and delivering it to a network service application;

[0028] The network modality program management process is used to implement the functions of installation, uninstallation and query operations on various network modalities.

[0029] Furthermore, the network modality data message sending process includes the following steps:

[0030] The network service application issues a service data transmission request;

[0031] The network service application calls the network modality unified call interface layer to pass the required transmission data to the end system;

[0032] According to the needs of network application data transmission, the network mode intelligently selects the Agent module to automatically match a network mode;

[0033] The network modality intelligent selection Agent module transfers the data to be transmitted to the successfully matched network modality I in the network modality adaptation layer to perform protocol adaptation operations;

[0034] After the protocol adaptation is completed, the adapted service data is sent to the multimodal network smart network card through the driver module and stored in the RAM space corresponding to the network mode I;

[0035] The network modality message sending pipeline takes out the data to be sent from the specified RAM space, performs network modality identification mapping, network modality message encapsulation, generates the checksum field, and transfers it to the MAC and PHY sending modules;

[0036] Network modality messages enter the multimodal network environment from the network interface.

[0037] Furthermore, the automatic matching of a network modality by the network modality intelligent selection Agent module includes: if the matching fails, the network modality intelligent selection Agent module requests the network modality program management module to install a new network modality, the network modality program management module installs a network modality program that meets the service transmission requirements, and repeatedly matches the network modality until the matching is successful.

[0038] Furthermore, the network modality data message receiving process includes the following steps:

[0039] Waiting to receive network modality data message;

[0040] The MAC+PHY module receives the network modality data message from the multimodal network, identifies the network modality attribute according to the "protocol type" field in the Layer 2 Ethernet frame header, and sends it to the corresponding network modality data message transceiver module;

[0041] The receiving pipeline in the network modality data message transceiver processing module performs message verification check:

[0042] If the verification succeeds, proceed to the next step; if the verification fails, the received network modality message data is discarded;

[0043] Network modality message parsing, extracting each protocol field in the network modality data message, the protocol field including source / destination network modality identification, type, and network modality message payload data;

[0044] Compare the destination network modality identifier to determine whether the destination of the currently received network modality data message is the current host:

[0045] If the comparison is successful, proceed to the next step; if the comparison fails, the received network modality message data is discarded;

[0046] Temporarily storing the extracted network modality message payload data in the network modality message payload data storage area;

[0047] The calling interface notifies the network service application, and the network service application extracts the received message data from the corresponding data storage area through the unified calling interface.

[0048] Furthermore, the network modality program management process includes the following steps:

[0049] The network modality program management module receives an operation action request of a specified network modality, wherein the operation action request includes installation, uninstallation or query;

[0050] In the network modality adaptation layer, a corresponding operation is performed on the specified network modality, wherein the operation includes installation, uninstallation or query;

[0051] In a multimodal network intelligent network card, a corresponding operation is performed on a data message receiving and sending processing module corresponding to a specified network mode, wherein the operation includes installation, uninstallation or query;

[0052] In the network modality end system protocol control module, corresponding operations are performed on the network modality protocol identification information and management information corresponding to the specified network modality, and the operations include installation, uninstallation or query;

[0053] Update the protocol field information of the network modality message identification and distribution module;

[0054] Update the list of installed network modality programs for the network modality intelligent selection Agent module.

[0055] The present invention also provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the multimodal network protocol processing method.

[0056] The present invention also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the multimodal network protocol processing method is implemented.

[0057] The beneficial effects of the present invention are:

[0058] 1. The present invention can provide the multi-modal network end system with the ability to adapt the network modality protocol message format, so that different network modalities can adopt different network message formats and protocol processing logics to meet different network service transmission requirements;

[0059] 2. The end system design proposed in the present invention can support intelligent selection of a form suitable for business applications to realize network mode encapsulation and transmission, eliminating the need for users to manually select network modes;

[0060] 3. The present invention can improve the ability and efficiency of the end side to process custom network modality messages, and offload the network modality processing function to the multimodal network smart network card;

[0061] 4. The end system design provided by the present invention can support the addition, deletion and query of network modes, further enhancing the end-side support for multimodal networks. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 It is a schematic diagram of the overall structure of the multimodal network protocol processing end system;

[0063] Figure 2 It is a schematic diagram of the host composition of the multi-modal network protocol processing end system;

[0064] Figure 3 It is a schematic diagram of the composition of the intelligent network card of the multimodal network protocol processing end system;

[0065] Figure 4 It is a schematic diagram of the process of sending network modality data message;

[0066] Figure 5 This is a schematic diagram of the network modality data message receiving process. DETAILED DESCRIPTION

[0067] The following is a detailed description of the drawings in the present invention based on the drawings, and a clear and complete description of the technical solutions in the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] like Figure 1 As shown, a multimodal network protocol processing end system provided by the present invention mainly includes two parts: a host and a multimodal network smart network card installed on the host.

[0069] like Figure 2 As shown in the figure, the end system host is mainly responsible for carrying the functions of multiple network mode operation and protocol adaptation, providing a unified calling interface layer for network service applications, supporting the upper-layer network service applications to transmit various types of service data such as video, voice, instructions, and data, and realizing the transmission of network mode data between network service applications and multi-modal network smart network cards; automatically matching the appropriate network mode for transmission for network service applications, and completing the protocol adaptation to the corresponding network mode. Among them, the end system host side module composition includes: network mode program management module, network mode unified calling interface layer, network mode intelligent selection Agent module, and network mode adaptation layer.

[0070] The network modality program management module is responsible for managing the network modality program carried on the end system, maintaining the status of the network modality program, and managing the installation, uninstallation, and query functions of the network modality program on the end system (including the host and the multi-modal network smart network card);

[0071] The network modality unified call interface layer provides a unified data transmission call interface for various upper-layer network business applications, and completes the connection between network application data and network transmission requirements and other layers and modules.

[0072] The network mode intelligent selection agent module is responsible for automatically matching / selecting a certain type of network mode for message transmission for each data message to be sent or network application based on the characteristics of network application data and network transmission requirements;

[0073] The network mode adaptation layer performs protocol adaptation operations on the data to be sent to meet the encapsulation format requirements of the corresponding network mode;

[0074] like Figure 3 As shown in the figure, the intelligent network card of the multimodal network protocol processing end system is responsible for and implements the sending and receiving functions of multiple network modal messages at the same time, provides the corresponding network modal message processing pipeline; provides a storage area for network modal message data; provides the scheduling function of the sending queue and receiving queue; supports the management and control of various network modes or protocols on the network card, and maintains key content such as identification information and modal information. The entire intelligent network card includes a PCIe IP core, an on-chip bus, a DMA interface, a network modal end system protocol control module, a data message sending and receiving processing module for each network mode (A, B, C, D, ..., I), and a network modal message identification and distribution module.

[0075] Among them, the functions of the PCIe IP core, on-chip bus, and DMA interface are similar to those of the corresponding modules in a conventional network card.

[0076] The network modality end system protocol control module is responsible for the installation, uninstallation and query of various network modality data message receiving and sending processing modules inside the smart network card, updating and managing various network modality protocol information (such as the protocol type value corresponding to the network modality) and network modality protocol identification information (it is necessary to establish and maintain the mapping relationship between the unified network identification of the end system and each network modality identification), etc.

[0077] Each network mode (A, B, C, D, ...) data message sending and receiving processing module provides network mode message data storage, management and control data storage, network mode message sending pipeline, network mode message receiving pipeline, sending / receiving engine and other functional modules, responsible for network mode message encapsulation / decapsulation and other functions. (The network mode message encapsulated in the network mode adaptation layer is sent from the end system to enter the multi-modal network environment; at the same time, various network mode messages are received in real time from the multi-modal network and passed to the network mode adaptation layer for parsing and processing.)

[0078] The network modal message identification and distribution module, based on the network modal protocol information in the network modal end system protocol control module, recognizes the network modal message by analyzing and judging the "protocol type" field in the Layer 2 Ethernet protocol message, and distributes the identified network modal message to the corresponding network modal data message transceiver processing module.

[0079] Based on the architecture of the above end system, the present invention further proposes a multi-modal network protocol processing method, which mainly includes a network modality data message sending process, a network modality data message receiving process, a network modality program management process, and the like.

[0080] like Figure 4 As shown, the network modality data message sending process is used to implement the function of sending the data message of the network service application from the end system. The network modality data message sending process includes the following steps:

[0081] (1.1) A network service application "Large File Transfer and Distribution System" sends a service data transfer request for a video file named "video_segment1.mp4", requesting that the file be uploaded to the server;

[0082] (1.2) The network service application "large file transmission and distribution system" transmits the above-mentioned file data to be transmitted to the end system by calling the interface function provided by the unified call interface layer of the network mode;

[0083] (1.3) The network modality intelligent selection agent module matches the transmission of the application data of "large file transmission and distribution system" to the network modality C (i.e., content identification network modality) according to the characteristics of network application data and network transmission requirements (the current large file transmission request meets the content distribution scenario and is suitable for network transmission using the content identification modality);

[0084] (1.4) After the network modality is successfully matched, the network modality intelligent selection agent module transfers the file data to be transmitted to the successfully matched network modality C protocol adaptation module in the network modality adaptation layer to complete the relevant protocol adaptation operations;

[0085] (1.5) After the protocol adaptation is completed, the service data will be sent to the multi-modal network smart card through the driver module and stored in the RAM space corresponding to the network mode C data message transceiver processing module (network mode C message payload data storage area);

[0086] (1.6) The network modality message sending pipeline in the network modality C data message sending and receiving processing module retrieves the large file data to be sent from the network modality C message payload data storage area in the specified address space, and performs network modality identification mapping to map the end system unified network identification to the corresponding network modality identification;

[0087] (1.7) The network modality message sending pipeline completes the encapsulation of the network modality C data message, fills in the protocol type field value (0x080B) corresponding to the network modality C, and generates a checksum field and fills it in the data message;

[0088] (1.8) The network mode message sending pipeline transfers the encapsulated and packaged message data to the MAC and PHY modules for message sending;

[0089] (1.9) The network modality message encapsulating the video file data of "video_segment1.mp4" enters the multimodal network environment from the network interface;

[0090] (1.10) Complete the sending process of network mode C message.

[0091] like Figure 5 As shown, the network modality data message receiving process is used to realize the function of receiving network message data from a multimodal network environment and delivering it to a network service application. The network modality data message receiving process includes the following steps:

[0092] (2.1) Waiting to receive network modality data message;

[0093] (2.2) The MAC+PHY module receives the network mode C data message from the multimodal network;

[0094] (2.3) The network modality message identification and distribution module performs Layer 2 Ethernet analysis on the network modality C data message, reads the "protocol type" field value (0x080B) in the Ethernet frame header, and thus identifies the network modality attribute (the current network modality message belongs to network modality C);

[0095] (2.4) The network modality message identification and distribution module sends the current message data to the corresponding network modality C data message transceiver module;

[0096] (2.5) The receiving pipeline in the network mode C data message transceiver processing module first verifies and checks the message: if the verification is successful, it proceeds to the next step;

[0097] (2.6) The network modality message parsing module parses the message according to the network modality C protocol message format and extracts each protocol field in the current message;

[0098] (2.7) The network modality identification comparison module compares the extracted destination identification with the local network modality identification to determine whether the destination of the currently received protocol message is the current host: if the comparison is consistent, proceed to the next step;

[0099] (2.8) temporarily storing the extracted message payload data of network mode C in the message payload data storage area of ​​network mode C by means of DMA;

[0100] (2.9) Calling the relevant interface to notify the network service application "large file transmission and distribution system", the application further takes the received message data from the corresponding data storage area by uniformly calling the interface function;

[0101] (2.10) Complete the reception and processing of a network modal message.

[0102] The network modality program management process is responsible for managing various network modality programs on the control end system, mainly realizing the functions of installing, uninstalling and querying these network modalities, so that the end system has expandable and flexible capabilities. The network modality program management process includes the following steps:

[0103] (3.1) The network modality program management module receives an installation / uninstallation request of network modality D (IPv6 network modality);

[0104] (3.2) The network modality program management module first installs / uninstalls the network modality D protocol adaptation module in the network modality adaptation layer;

[0105] (3.3) The network modality program management module installs / uninstalls the network modality D data message receiving and sending processing module in the multimodal network smart card through the driver;

[0106] (3.4) The network modality program management module installs / uninstalls the network modality protocol identification information and management information corresponding to the network modality D in the network modality end system protocol control module through the driver;

[0107] (3.5) The network modality program management module updates the mapping information between the network modality D and the protocol type field (0x080C) by driving the network modality message identification and distribution module;

[0108] (3.6) The network modality program management module updates the list of installed network modality programs (increase / decrease network modality D in the list) of the network modality intelligent selection agent module;

[0109] (3.7) Complete the network modality program management process (installation / uninstallation).

[0110] An embodiment of the present invention also provides an electronic device, including a memory and a processor, wherein the memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement a multimodal network protocol processing method in the above embodiment.

[0111] An embodiment of the present invention further provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, a multimodal network protocol processing method in the above embodiment is implemented.

[0112] The computer-readable storage medium may be an internal storage unit of any device with data processing capability described in any of the aforementioned embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be any device with data processing capability, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash card, etc. equipped on the device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of any device with data processing capability and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by any device with data processing capability, and may also be used to temporarily store data that has been output or is to be output.

[0113] The above embodiments are only used to illustrate the design ideas and features of the present invention, and their purpose is to enable those skilled in the art to understand the content of the present invention and implement it accordingly. The protection scope of the present invention is not limited to the above embodiments. Therefore, any equivalent changes or modifications made based on the principles and design ideas disclosed by the present invention are within the protection scope of the present invention.

Claims

1. A multimodal network protocol processing end system, characterized in that: include: A host and a multimodal network smart card installed on the host; The host side is deployed with a network modality program management module, a network modality unified call interface layer, a network modality intelligent selection Agent module, and a network modality adaptation layer, which are used to realize the transmission of network modality data between network service applications and multimodal network intelligent network cards; The network modality program management module is used to implement the installation, uninstallation and query functions of the network modality program on the end system; The network modality unified calling interface layer is used to provide a unified calling interface function for various network service applications in the upper layer; The network mode intelligent selection Agent module is used to automatically match the network mode for each data message to be sent according to network service requirements; The network modality adaptation layer is used to perform protocol adaptation operations on the data to be sent to meet the encapsulation format requirements of the corresponding network modality; The multimodal network smart card includes: PCIe IP core, on-chip bus, DMA interface, network modality end system protocol control module, network modality message identification and distribution module, and each network modality data message transceiver processing module; The PCIe IP core is a hard IP core for implementing PCIe bus functions; The on-chip bus is a bus inside the FPGA chip, which is a common connection line between various functional modules inside the chip; The DMA interface is used to provide a direct memory access interface; The network modality end system protocol control module is responsible for the installation, uninstallation and query of various network modality data message receiving and sending processing modules inside the smart network card, and updates and manages various network modality protocol information and network modality protocol identification information; Each network modality data message transceiver processing module is used to encapsulate / decapsulate the network modality message; The network modality message identification and distribution module is used to identify the network modality message by analyzing and judging the "protocol type" field in the Layer 2 Ethernet protocol message based on the network modality protocol information in the network modality end system protocol control module, and distribute the identified network modality message to the corresponding network modality data message transceiver processing module.

2. The multimodal network protocol processing end system according to claim 1, characterized in that: Each of the network modality data message transceiver processing modules is composed of a plurality of sub-functional modules including a network modality message data storage, a management control data storage, a network modality message sending pipeline, a network modality message receiving pipeline, and a sending / receiving engine.

3. A multimodal network protocol processing method, based on the multimodal network protocol processing end system according to any one of claims 1 to 2, characterized in that: The method includes a network modality data message sending process, a network modality data message receiving process and a network modality program management process, and the process is specifically as follows: The network modality data message sending process is used to implement the process of sending the data message of the network service application from the end system; The network modality data message receiving process is used to realize the process of receiving network message data from a multimodal network environment and delivering it to a network service application; The network modality program management process is used to implement the functions of installation, uninstallation and query operations on various network modalities; The network modality data message sending process includes the following steps: The network service application issues a service data transmission request; The network service application calls the network modality unified call interface layer to pass the required transmission data to the end system; According to the needs of network application data transmission, the network mode intelligently selects the Agent module to automatically match a network mode; The network modality intelligent selection Agent module transfers the data to be transmitted to the successfully matched network modality I in the network modality adaptation layer to perform protocol adaptation operations; After the protocol adaptation is completed, the adapted service data is sent to the multimodal network smart network card through the driver module and stored in the RAM space corresponding to the network mode I; The network modality message sending pipeline takes out the data to be sent from the specified RAM space, performs network modality identification mapping, network modality message encapsulation, generates the checksum field, and transfers it to the MAC and PHY sending modules; Network modality messages enter the multimodal network environment from the network interface.

4. The multimodal network protocol processing method according to claim 3, characterized in that: The automatic matching of a network mode by the network mode intelligent selection Agent module includes: if the matching fails, the network mode intelligent selection Agent module requests the network mode program management module to install a new network mode, the network mode program management module installs a network mode program that meets the service transmission requirements, and repeatedly matches the network mode until the matching is successful.

5. The multimodal network protocol processing method according to claim 3, characterized in that: The network modality data message receiving process includes the following steps: Waiting to receive network modality data message; Receive the network modality data message from the multimodal network from the MAC+PHY module, identify the network modality attribute according to the "protocol type" field in the Layer 2 Ethernet frame header, and send it to the corresponding network modality data message transceiver module; The receiving pipeline in the network modality data message transceiver processing module performs message verification check: If the verification is successful, proceed to the next step; If the verification fails, the received network modality message data is discarded; Network modality message parsing, extracting each protocol field in the network modality data message, the protocol field including source / destination network modality identification, type, and network modality message payload data; Compare the destination network modality identifier to determine whether the destination of the currently received network modality data message is the current host: If the comparison is successful, proceed to the next step; if the comparison fails, the received network modality message data is discarded; Temporarily storing the extracted network modality message payload data in the network modality message payload data storage area; The calling interface notifies the network service application, and the network service application extracts the received message data from the corresponding data storage area through the unified calling interface.

6. The multimodal network protocol processing method according to claim 3, characterized in that: The network modality program management process includes the following steps: The network modality program management module receives an operation action request of a specified network modality, wherein the operation action request includes installation, uninstallation or query; In the network modality adaptation layer, a corresponding operation is performed on the specified network modality, wherein the operation includes installation, uninstallation or query; In a multimodal network intelligent network card, a corresponding operation is performed on a data message receiving and sending processing module corresponding to a specified network mode, wherein the operation includes installation, uninstallation or query; In the network modality end system protocol control module, corresponding operations are performed on the network modality protocol identification information and management information corresponding to the specified network modality, and the operations include installation, uninstallation or query; Update the protocol field information of the network modality message identification and distribution module; Update the list of installed network modality programs for the network modality intelligent selection Agent module.

7. An electronic device comprising a memory and a processor, characterized in that: The memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement a multimodal network protocol processing method as described in any one of claims 3-6.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, a multimodal network protocol processing method as described in any one of claims 3 to 6 is implemented.

Images