Multi-Protocol Compatibility Testing Method and System for Gateway Devices

Abstract

The present invention relates to the field of communication technologies, and provides a multi-protocol compatibility testing method and system for gateway devices, including: first, obtaining device specification information to clarify the adapted communication protocols, constructing and standardizing a protocol test case set; determining network access ports, simulating transmission scenarios to collect data, analyzing the preliminary compatibility performance and extracting key indicators, and accordingly evaluating the overall compatibility, tracing the root cause factors, and finding the performance balance point; then locking the resource allocation channels for multi-protocol operation, detecting the load and calculating the utilization rate, and accordingly optimizing the monitoring threshold and deviation degree; finally, generating abnormal protocol instructions according to the deviation degree, extracting compatibility factors, and generating a detailed compatibility test list. The present invention can meet the compatibility requirements of gateway devices.

Description

Technical Field

[0001] The present invention relates to the field of communication technologies, and in particular, to a multi-protocol compatibility testing method and system for gateway devices. Background Art

[0002] In the current era of rapid digital and intelligent development, the Internet of Things technology has flourished. As a key hub connecting different networks and devices, the importance of gateway devices has become increasingly prominent. Gateway devices are widely used in many fields such as smart homes, industrial automation, and smart cities, and are responsible for realizing the conversion between multiple protocols and data interaction, ensuring seamless communication and collaborative work between different devices.

[0003] Currently, a large number and various types of network protocols have emerged in the market, such as common Wi-Fi, Bluetooth, ZigBee, MQTT, CoAP, etc. These protocols have significant differences in transmission rate, power consumption, applicable scenarios, etc. However, the existing testing methods for gateway devices have many defects. Most tests are only carried out for a single protocol or a limited number of protocol combinations, and cannot comprehensively cover the numerous protocol types involved in actual applications. As a result, in complex scenarios, gateway devices are prone to compatibility problems such as communication failures, data loss, or conversion errors, and it is difficult to meet the growing demand for interconnection of Internet of Things devices. Therefore, a multi-protocol compatibility testing method for gateway devices is needed to improve the compatibility requirements of gateway devices. Summary of the Invention

[0004] The present invention provides a multi-protocol compatibility testing method and system for gateway devices, and its main purpose is to improve the compatibility requirements of gateway devices.

[0005] To achieve the above object, a multi-protocol compatibility testing method for gateway devices provided by the present invention includes:

[0006] Obtain the device specification information of the gateway device, analyze the corresponding adapted communication protocols based on the device specification information, construct a protocol test case set corresponding to the gateway device based on the adapted communication protocols, and perform standardization processing on the test cases in the protocol test case set to obtain a standard protocol test case set;

[0007] Determine the network access port corresponding to the gateway device, simulate the network transmission scenarios of the network access port under different protocols, collect the protocol interaction data in the network transmission scenarios, analyze the corresponding preliminary compatibility performance of the gateway device based on the protocol interaction data, and extract the key performance indicators in the preliminary compatibility performance;

[0008] Based on the key performance indicators, evaluate the overall compatible data corresponding to the gateway device, analyze the types of compatibility problems corresponding to the overall compatible data, trace the root causes corresponding to the gateway device based on the types of compatibility problems, and analyze the performance balance points corresponding to the root causes;

[0009] Based on the performance balance points, determine the resource allocation channels when the gateway device operates with multiple protocols, detect the channel load conditions corresponding to the resource allocation channels, calculate the channel resource utilization rates corresponding to the resource allocation channels based on the channel load conditions, optimize the monitoring thresholds during the resource monitoring process of the gateway device based on the channel resource utilization rates, and calculate the threshold deviation degrees corresponding to the monitoring thresholds;

[0010] Based on the threshold deviation degrees, generate abnormal protocol instructions during the multi - protocol operation of the gateway device, query the instruction configuration protocols corresponding to the abnormal protocol instructions, extract the protocol compatibility factors in the instruction configuration protocols, and generate a detailed compatibility test list corresponding to the gateway device based on the protocol compatibility factors.

[0011] Optionally, constructing the protocol test case set corresponding to the gateway device based on the adapted communication protocol includes:

[0012] Determine the core protocol elements in the adapted communication protocol;

[0013] Analyze the functional characteristics corresponding to the core protocol elements;

[0014] Build the protocol test architecture corresponding to the adapted communication protocol according to the functional characteristics;

[0015] Based on the protocol test architecture, determine the test data requirements corresponding to the gateway device;

[0016] Construct the protocol test case set corresponding to the gateway device based on the test data requirements.

[0017] Optionally, standardizing the test cases in the protocol test case set to obtain a standard protocol test case set includes:

[0018] Identify the content format structure corresponding to the test cases in the protocol test case set;

[0019] Based on the content format structure, determine the original use case information corresponding to the test cases in the protocol test case set;

[0020] Analyze the logical composition in the original use case information;

[0021] Determine the standard process template corresponding to the logical composition;

[0022] Map and match the data in the original use case information with the standard process template to obtain mapping difference points;

[0023] Based on the mapping difference points, standardize the test cases in the protocol test case set to obtain a standard protocol test case set.

[0024] Optionally, the analysis of the preliminary compatibility performance corresponding to the gateway device based on the protocol interaction data includes:

[0025] Extract the key interaction features in the protocol interaction data;

[0026] Analyze the communication behavior patterns corresponding to the key interaction features;

[0027] Based on the communication behavior patterns, identify the compatibility anomaly points existing in the gateway device;

[0028] Analyze the abnormal influence range corresponding to the compatibility anomaly points;

[0029] Based on the abnormal influence range, determine the potential association relationships corresponding to the compatibility anomaly points;

[0030] Based on the potential association relationships, analyze the preliminary compatibility performance corresponding to the gateway device.

[0031] Optionally, the tracing of the root causes corresponding to the gateway device based on the compatibility problem types includes:

[0032] Identify the set of behavioral performance characteristics corresponding to the compatibility problem types;

[0033] Analyze the occurrence frequencies and distribution conditions of the features in the set of behavioral performance characteristics;

[0034] Based on the occurrence frequencies and the distribution conditions, determine the operation abnormal areas corresponding to the gateway device;

[0035] Extract the operation factor segments in the operation abnormal areas;

[0036] Based on the operation factor segments, trace the root causes corresponding to the gateway device.

[0037] Optionally, the determination of the resource allocation channels of the gateway device during multi - protocol operation based on the performance balance points includes:

[0038] Analyze the key performance dimensions corresponding to the performance balance points;

[0039] Screen the core resource elements corresponding to the key performance dimensions;

[0040] Based on the resource dependence factors, determine the resource consumption patterns of the gateway device under different protocol operation scenarios;

[0041] Query the adaptation allocation ratio corresponding to the hardware resources in the resource consumption patterns;

[0042] Based on the adaptation allocation ratio, determine the resource allocation channels of the gateway device during multi - protocol operation.

[0043] Optionally, the calculating the channel resource utilization rate corresponding to the resource allocation channel based on the channel load condition includes:

[0044] Calculate the channel resource utilization rate corresponding to the resource allocation channel using the following formula:

[0045]

[0046] Wherein, The channel resource utilization rate corresponding to the resource allocation channel, Represents the total number of monitoring samples corresponding to the channel load condition, Represents the number index of the monitoring samples, Represents the Weight coefficient corresponding to the th monitoring sample, Represents the load value corresponding to the and respectively represent the start time and end time of the allocation time corresponding to the resource allocation channel, Represents at time The channel capacity index at the moment.

[0047] Optionally, the calculating the threshold deviation degree corresponding to the monitoring threshold includes:

[0048] Calculate the threshold deviation degree corresponding to the monitoring threshold using the following formula:

[0049]

[0050] Wherein, Represents the threshold deviation degree corresponding to the monitoring threshold, and respectively represent the end time and start time for calculating the threshold deviation degree, Represents the change rate of the monitoring data at time moment, Represents the number of data samples corresponding to the monitoring threshold, Represents the number index of the data samples, Represents the The sample difference between a data sample and the monitoring threshold represents the stability coefficient of the monitoring environment corresponding to the monitoring threshold.

[0051] Optionally, generating the abnormal protocol instruction of the gateway device in multi - protocol operation based on the threshold deviation includes:

[0052] Query the key deviation value in the threshold deviation;

[0053] Based on the key deviation value, analyze the deviation fluctuation trend corresponding to the threshold deviation;

[0054] Determine the abnormal deviation interval in the deviation fluctuation trend;

[0055] Extract the extreme deviation points in the abnormal deviation interval;

[0056] Based on the extreme deviation points, locate the abnormal fluctuation points of the gateway device in multi - protocol operation;

[0057] Based on the abnormal fluctuation points, generate the abnormal protocol instruction of the gateway device in multi - protocol operation.

[0058] Optionally, to solve the above problems, the present invention provides a multi - protocol compatibility test system for a gateway device, and the system includes:

[0059] A standard processing module, configured to obtain the device specification information of the gateway device, analyze the adapted communication protocol corresponding to the gateway device according to the device specification information, construct a protocol test case set corresponding to the gateway device based on the adapted communication protocol, and perform standardization processing on the test cases in the protocol test case set to obtain a standard protocol test case set;

[0060] An index extraction module, configured to determine the network access port corresponding to the gateway device, simulate the network transmission scenarios of the network access port under different protocols, collect the protocol interaction data in the network transmission scenarios, analyze the preliminary compatibility performance corresponding to the gateway device based on the protocol interaction data, and extract the key performance indicators in the preliminary compatibility performance;

[0061] An equilibrium point extraction module, configured to evaluate the overall compatibility data corresponding to the gateway device based on the key performance indicators, analyze the type of compatibility problem corresponding to the overall compatibility data, trace the root cause factors corresponding to the gateway device based on the type of compatibility problem, and analyze the performance equilibrium points corresponding to the root cause factors;

[0062] The deviation calculation module is used to determine the resource allocation channels of the gateway device during multi - protocol operation based on the performance balance point, detect the channel load conditions corresponding to the resource allocation channels, calculate the channel resource utilization rate corresponding to the resource allocation channels based on the channel load conditions, optimize the monitoring threshold during the resource monitoring process of the gateway device based on the channel resource utilization rate, and calculate the threshold deviation corresponding to the monitoring threshold;

[0063] The detailed list generation module is used to generate abnormal protocol instructions of the gateway device during multi - protocol operation based on the threshold deviation, query the instruction configuration protocol corresponding to the abnormal protocol instructions, extract the protocol compatibility factors in the instruction configuration protocol, and generate a compatibility test detailed list corresponding to the gateway device based on the protocol compatibility factors.

[0064] First, by obtaining the device specification information of the gateway device, the present invention can accurately lock the adapted communication protocol, thereby constructing a targeted protocol test case set, laying a solid foundation for subsequent multi-protocol compatibility testing, efficiently troubleshooting potential communication and conversion problems, clarifying the characteristics of the network access port through the specification information, making the simulation more in line with the actual device when simulating different scenarios, accurately collecting protocol interaction data, facilitating the rapid capture of key compatibility indicators, providing strong support for evaluating the overall compatibility and locating the root cause of problems. At the same time, by determining the network access port corresponding to the gateway device and simulating the network transmission scenarios of the network access port under different protocols, the present invention can simulate different protocol scenarios, reproduce diverse and complex real network environments, expose in advance the compatibility problems of the device during protocol conversion and data sending and receiving, greatly reduce the failure rate after actual deployment, so that the device can efficiently form a network and smoothly interconnect multiple devices in scenarios such as smart home and industrial Internet of Things. Based on the key performance indicators, the present invention evaluates the overall compatibility data corresponding to the gateway device, analyzes the types of compatibility problems corresponding to the overall compatibility data, quantitatively presents the device performance through key indicators, quickly locks the weak links, which is the key guidance for repair and optimization, can greatly reduce the troubleshooting time, facilitate the targeted investment of resources, and allocate technical, human, and material resources according to the evaluation results and problem types, avoiding blind investment and reducing the operation and maintenance costs. Based on the performance balance point, the present invention determines the resource allocation channels of the gateway device during multi-protocol operation, can achieve the efficient utilization of resources, accurately allocate hardware and software resources according to the requirements of each protocol and the performance balance requirements, avoid some protocols from over-occupying resources, make the device computing power, bandwidth, etc. fully utilized, and reduce idleness and waste. Further, based on the threshold deviation degree, the present invention generates abnormal protocol instructions for the gateway device during multi-protocol operation, can achieve accurate fault location, accurately judge the abnormal protocol through the threshold deviation degree, quickly locate the root cause of the problem, reduce the troubleshooting time, can optimize the resource allocation, and after identifying the abnormal protocol, can adjust the resource allocation of the protocol accordingly to ensure the efficiency and stability of the gateway device during multi-protocol operation. Therefore, a multi-protocol compatibility testing method and system for a gateway device proposed by the present invention can improve the compatibility requirements of the gateway device. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 FIG. 6 is a schematic flowchart of a multi-protocol compatibility testing method for a gateway device provided by an embodiment of the present invention;

[0066] Figure 2 FIG. 7 is a schematic block diagram of a module for implementing the multi-protocol compatibility testing system for a gateway device provided by an embodiment of the present invention.

[0067] The implementation, functional features, and advantages of the present invention will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0068] It should be understood that the specific embodiments described herein are merely used to explain the present invention and are not intended to limit the present invention.

[0069] The embodiments of the present application provide a multi - protocol compatibility testing method for a gateway device. The execution subject of the multi - protocol compatibility testing method for a gateway device includes, but is not limited to, at least one of electronic devices such as a server, a terminal, etc. that can be configured to execute the method provided by the embodiments of the present application. In other words, the multi - protocol compatibility testing method for a gateway device can be executed by software or hardware installed on a terminal device or a server device. The server includes, but is not limited to: a single server, a server cluster, a cloud server, or a cloud server cluster, etc.

[0070] Embodiment 1:

[0071] Refer to Figure 1 As shown, it is a flowchart of a multi - protocol compatibility testing method for a gateway device provided by an embodiment of the present invention. In this embodiment, the multi - protocol compatibility testing method for a gateway device includes:

[0072] S1. Obtain the device specification information of the gateway device, analyze the corresponding adapted communication protocol according to the device specification information, construct a protocol test case set corresponding to the gateway device based on the adapted communication protocol, and standardize the test cases in the protocol test case set to obtain a standard protocol test case set.

[0073] By obtaining the device specification information of the gateway device, the present invention can accurately lock the adapted communication protocol, thereby constructing a targeted protocol test case set, laying a solid foundation for subsequent multi - protocol compatibility testing, efficiently troubleshooting potential communication and conversion problems, clarifying the characteristics of the network access port through the specification information, making the simulation of different scenarios more in line with the actual situation of the device, accurately collecting protocol interaction data, facilitating the rapid capture of key compatibility indicators, and providing strong support for evaluating the overall compatibility and locating the root cause of problems.

[0074] Among them, the gateway device refers to a device that acts as a key connection hub between different networks and various devices in the Internet of Things architecture. It is commonly found in scenarios such as smart homes, industrial automation, and smart cities. It is responsible for connecting devices using different protocols such as Wi-Fi, Bluetooth, and ZigBee, breaking down communication barriers, and enabling smooth data interaction and conversion, allowing different devices to cooperate. The device specification information refers to the key details at the hardware and software levels of the gateway device. Hardware-wise, it includes parameters such as the processor model, memory capacity, storage specification, network interface type and quantity, which determine the basic capabilities of the device for data processing, storage, and network access. At the software level, it includes the operating system version installed on the device, built-in driver information, and details of the pre-set communication protocol stack. Optionally, the device specification information of the gateway device can be obtained through network scanning tools, such as tools like Nmap, which can scan the open ports of the gateway device and also infer the protocols supported by the device by identifying the port services, thereby obtaining the device specification information.

[0075] Furthermore, based on the device specification information, the present invention analyzes the corresponding adapted communication protocol of the gateway device, which can fit the hardware performance of the gateway, accurately match the protocol, prevent faults such as freezing and crashing caused by the protocol load exceeding the hardware capacity, and maintain the stable operation of the device. At the software level, the adapted protocol can be selected according to the operating system and protocol stack details, enabling smooth software interaction, reducing the probability of data conversion errors, and improving communication accuracy.

[0076] Among them, the adapted communication protocol refers to a set of communication protocol combinations that are screened and determined to be the most suitable for the gateway device according to its own hardware performance, software architecture, and application scenario requirements. Optionally, the analysis of the corresponding adapted communication protocol of the gateway device can be achieved through protocol analysis tools. For example, tools like Wireshark can be used to capture the communication data packets between the gateway device and the industrial controller, and observe the protocol identification fields in the packet headers to determine the best adapted communication protocol.

[0077] Furthermore, based on the adapted communication protocol, the present invention constructs a protocol test case set corresponding to the gateway device, which can guarantee the actual performance of the device, simulate the operation of the adapted protocol in a real scenario, and ensure that the gateway device can stably and smoothly connect devices in diverse application scenarios such as smart homes and industrial control, achieving efficient cooperation.

[0078] Among them, the protocol test case set is used to comprehensively verify the compatibility, functional correctness, and performance of the gateway device and the adapted communication protocol. Each test case includes a specific test scenario description, input data, expected output results, and verification methods.

[0079] As an embodiment of the present invention, constructing a protocol test case set corresponding to the gateway device based on the adapted communication protocol includes: determining the core protocol elements in the adapted communication protocol; analyzing the functional characteristics corresponding to the core protocol elements; building a protocol test architecture corresponding to the adapted communication protocol according to the functional characteristics; determining the test data requirements corresponding to the gateway device based on the protocol test architecture; and constructing a protocol test case set corresponding to the gateway device based on the test data requirements.

[0080] Among them, the core protocol elements refer to the basic components in the adapted communication protocol that play a key supporting role in realizing the communication function. For example, in the TCP / IP protocol, IP addresses, port numbers, packet format definitions, etc. are core protocol elements; the functional characteristics refer to the unique capabilities and behavioral manifestations of the core protocol elements. Taking the Bluetooth protocol as an example, its low-power consumption characteristic determines the energy consumption mode of the device in the connected state, affecting the power management strategy of the gateway device; the broadcast functional characteristic enables the device to actively send information, providing a way for the gateway device to discover surrounding Bluetooth devices. Different functional characteristics determine the specific implementation methods and ability ranges of the gateway device in aspects such as communication, connection management, and data interaction; the protocol test architecture refers to an organized test system built according to the characteristics and requirements of the adapted communication protocol. For example, for the MQTT protocol test architecture, it can be divided into a connection test layer, a message publishing and subscribing test layer, etc. In the connection test layer, the connection establishment, maintenance, and disconnection mechanisms between the gateway device and the client are checked; the message publishing and subscribing test layer focuses on functional tests such as the accurate transmission of messages and topic matching; the test data requirements refer to the various input data and their characteristic requirements necessary to fully test the performance and functions of the gateway device under the adapted communication protocol. For example, when testing the HTTP protocol, it is necessary to cover different types of request method (GET, POST, etc.) data, request contents in various formats (text, JSON, XML, etc.), and response data corresponding to different status codes.

[0081] Further, the determination of the core protocol elements in the adapted communication protocol can be achieved through protocol packet capture and analysis methods. For example, in an actual network environment, protocol data packets are captured, and fields with high occurrence frequencies and decisive effects on communication logic are statistically analyzed as core protocol elements. The analysis of the functional characteristics corresponding to the core protocol elements can be achieved through network simulators, such as tools like NS3 and OMNeT++. The construction of the protocol test architecture corresponding to the adapted communication protocol can be achieved through test management tools, such as tools like TestRail and JIRA. The determination of the test data requirements corresponding to the gateway device can be achieved through the equivalence class partitioning method. For example, the input data is partitioned into equivalence classes according to valid values, boundary values, etc. to determine the requirements. The construction of the protocol test case set corresponding to the gateway device can be achieved through automated test framework tools, such as tools like Pytest and JUnit.

[0082] By standardizing the test cases in the protocol test case set of the present invention, a standard protocol test case set is obtained, which is beneficial to the reuse and maintenance of test cases. The standardized test cases can be conveniently reused in subsequent projects or the testing of similar devices, and the modification and adjustment are more efficient, saving labor and time costs. It can enhance the standardization of the overall test process and make the connection of each link smoother.

[0083] Among them, the standard protocol test case set refers to a set in which, after standardization processing, the test cases fully meet the requirements of the standard process template in terms of content format structure, logical composition, data expression, etc., and it has a clear and unified structure, rigorous and reasonable logic, and accurate and standardized data representation.

[0084] As an embodiment of the present invention, the standardization processing of the test cases in the protocol test case set to obtain a standard protocol test case set includes: identifying the content format structure corresponding to the test cases in the protocol test case set; based on the content format structure, determining the original case information corresponding to the test cases in the protocol test case set; analyzing the logical composition in the original case information; determining the standard process template corresponding to the logical composition; mapping and matching the data in the original case information with the standard process template to obtain mapping difference points; and based on the mapping difference points, performing standardization processing on the test cases in the protocol test case set to obtain a standard protocol test case set.

[0085] Among them, the content format structure refers to the external organizational form and layout presented by test cases, covering the permutation and combination methods of sections such as titles, preconditions, operation steps, expected results, postconditions, etc., as well as the expression forms of information within each section, such as text formats, data type representations, symbol usage specifications, etc.; the original test case information refers to the specific content descriptions regarding test scenarios, operation details, data usage, expected outputs, etc. parsed from the test case set according to its content format structure. For example, in a test case for the HTTP protocol of a gateway device, the original test case information includes the requested URL, request method, request header fields and their values, the data format and content of the request body, as well as key information such as the expected HTTP status code, response headers, and response body; the logical composition refers to the internal logical associations and execution sequences among the steps, conditional judgments, data flows, function calls, etc. within the test case. For example, in a test case involving multi-protocol switching of a gateway device, the logical composition includes the conditional logic for triggering protocol switching based on network status judgments, the logic for data saving and restoration during the switching process, and the sequential logic for device connection and communication under different protocols; the standard process template refers to an idealized test case model pre-established according to industry best practices, protocol standard specifications, and project-specific requirements, clearly defining the standard expressions of test content at each stage, the standard steps of the operation process, the standard methods for data processing and result verification, etc.; the mapping difference points refer to the mismatches between the original test case information and the standard process template in terms of content, format, logic, etc., such as missing or redundant test steps, inconsistent data formats, inaccurate logical judgment conditions, etc.

[0086] Further, the content format structure corresponding to the test cases in the protocol test case set can be implemented through a text editor, such as tools like Sublime Text, Visual Studio Code, etc.; the determination of the original case information corresponding to the test cases in the protocol test case set can be implemented through a data scraping tool, such as tools like BeautifulSoup, etc., which can help parse HTML or XML documents to facilitate the extraction of original case information such as table data, text content, attribute values, etc.; the analysis of the logical composition in the original case information can be implemented through a flowchart drawing tool, such as drawing a simple flowchart based on the operation steps and conditional judgments in the original case information to visually display the logical relationship; the determination of the standard process template corresponding to the logical composition can be implemented through a standard management platform, such as Doors, Confluence, etc.; the mapping and matching of the data in the original case information with the standard process template can be implemented through a test management tool, such as using the test case association and comparison functions of tools like TestRail, etc., for data mapping and matching; the standardization processing of the test cases in the protocol test case set can be implemented through an automated test framework, such as using the template and keyword functions provided in the RobotFramework tool to reconstruct the non-compliant test cases into test cases that conform to the standard process template.

[0087] S2. Determine the network access port corresponding to the gateway device, simulate the network transmission scenarios of the network access port under different protocols, collect the protocol interaction data in the network transmission scenarios, and based on the protocol interaction data, analyze the preliminary compatibility performance corresponding to the gateway device, and extract the key performance indicators in the preliminary compatibility performance.

[0088] By determining the network access port corresponding to the gateway device and simulating the network transmission scenarios of the network access port under different protocols, the present invention can simulate different protocol scenarios, reproduce diverse and complex real network environments, expose in advance the compatibility problems of the device during protocol conversion and data sending and receiving, greatly reduce the failure rate after actual deployment, so that the device can efficiently form a network and smoothly interconnect multiple devices in scenarios such as smart home and industrial Internet of Things.

[0089] Among them, the network access port refers to the key interface for the gateway device to establish a physical or logical connection with the external network, and shoulders the important task of data inflow and outflow. In terms of physical form, it includes common Ethernet interfaces (RJ45 ports), which achieve high-speed and stable wired connections through network cables and are commonly used in enterprise-level network deployments; there are also USB interfaces that can externally connect 4G / 5G Internet access modules to broaden the mobile network access capabilities of the gateway; at the wireless level, it covers the frequency band interfaces corresponding to Wi-Fi modules, enabling the device to connect to the local area network in a wireless form. The network transmission scenario refers to various actual situations faced by the gateway device during data transmission in different communication protocol environments relying on the network access port. For example, in the Wi-Fi protocol transmission scenario of the smart home scenario, it is necessary to consider signal interference and bandwidth occupation problems when multiple devices in the home are connected at the same time; in the industrial scenario, in the wired transmission scenario using the Modbus protocol, it focuses on the accuracy and real-time performance of data transmission in a long-distance and strong electromagnetic interference environment, whether there are packet losses and error codes. Optionally, the determination of the network access port corresponding to the gateway device can be achieved through network scanning tools. For example, tools such as Nmap can scan the network where the gateway device is located and determine the network access port by identifying open ports and corresponding services. The simulation of the network transmission scenario of the network access port under different protocols can be achieved through the Monte Carlo simulation algorithm. For example, using the Monte Carlo simulation algorithm can generate a large number of corresponding network transmission scenarios through random sampling.

[0090] Furthermore, by collecting the protocol interaction data in the network transmission scenario, the present invention can accurately locate device problems. By analyzing the interaction data, it can identify abnormal points such as protocol conversion loopholes, data packet loss or disorder, quickly lock the root cause of the failure, provide key clues for repairing the gateway device, and avoid communication obstacles caused by protocol incompatibility in advance, ensuring the stable operation of the gateway device in a complex network environment.

[0091] Among them, the protocol interaction data refers to all information data generated by the gateway device when communicating with connected devices or network nodes in a specific network transmission scenario and following various communication protocols. In terms of content composition, it covers key information at the data packet level, such as the header of the data packet, which contains basic elements such as the source address, destination address, protocol type identifier, and port number, thereby clarifying the data source and destination, as well as the communication protocol used. In terms of the dynamic process, it also includes data throughout the protocol interaction process, including handshake information during connection establishment, such as requests and confirmation packets for the three-way handshake of the TCP protocol; traffic information during the data transmission stage, reflecting the transmission rate and data volume; termination signals when the connection is disconnected, etc. Optionally, the collection of the protocol interaction data in the network transmission scenario can be achieved through the DPI algorithm. For example, using the DPI algorithm can identify the application layer protocol in the data packet and extract the protocol interaction data.

[0092] Furthermore, based on the protocol interaction data, the present invention analyzes the preliminary compatibility performance corresponding to the gateway device, which can quickly identify potential problems. By analyzing abnormal information such as packet loss, latency, and error frames in the data, it can accurately identify incompatibilities between the device and the protocol, resolve communication failures in actual applications in advance, facilitate efficient allocation of resources, and allocate bandwidth and computing power according to the transmission rate and throughput performance of the device under different protocols, avoiding resource waste and ensuring the smooth operation of critical services.

[0093] Among them, the preliminary compatibility performance refers to the phased evaluation conclusion of the compatibility of the gateway device in a multi-protocol environment after comprehensively considering key interaction characteristics, communication behavior patterns, compatibility abnormal points and their influence ranges and correlation relationships. It covers judgments in dimensions such as the degree of support for each protocol (fully compatible, partially compatible, incompatible), stability in common and extreme scenarios (data transmission stability, connection reliability), and performance performance (throughput, degree of latency affected by compatibility issues).

[0094] As an embodiment of the present invention, analyzing the preliminary compatibility performance corresponding to the gateway device based on the protocol interaction data includes: extracting key interaction characteristics from the protocol interaction data; analyzing the communication behavior patterns corresponding to the key interaction characteristics; identifying compatibility abnormal points existing in the gateway device based on the communication behavior patterns; analyzing the abnormal influence ranges corresponding to the compatibility abnormal points; determining the potential correlation relationships corresponding to the compatibility abnormal points based on the abnormal influence ranges; and analyzing the preliminary compatibility performance corresponding to the gateway device based on the potential correlation relationships.

[0095] Among them, the key interaction feature refers to the information element in the protocol interaction data that has a significant indication effect on judging the compatibility of the gateway device, such as the specific field value of the data packet (such as the flag bit combination in the TCP protocol, the request method and version number of the HTTP protocol), the time interval rule of data transmission, the frequent change pattern of the device address, etc.; the communication behavior pattern refers to the habitual action logic of the gateway device in network communication presented based on the key interaction feature. For example, continuously sending small data packets at a high frequency with a fixed interval can indicate that the device is performing a timed status reporting task; another example is that after a large number of concurrent connection attempts in a certain period and no data interaction for a long time, there is an abnormal connection management or un-released resource occupation; the compatibility exception point refers to the deviation position where the gateway device does not conform to the standard protocol specification or expected behavior when interacting with other devices or networks according to a specific protocol. For example, frequent data verification errors indicate problems in the data integrity guarantee link; protocol handshake timeout means that there is an obstacle in protocol synchronization between the device and the other device at the initial stage of connection establishment; the abnormal influence range refers to the breadth and depth of the impact of the compatibility exception point on the functions of the gateway device itself, the devices connected to it, and the overall network communication ecosystem; the potential correlation relationship refers to the hidden causal, triggering or collaborative connections between different compatibility exception points. For example, a protocol parsing error caused by memory overflow leads to a series of subsequent operation anomalies that depend on the parsing result, such as the routing table cannot be updated, resulting in data forwarding chaos; another example is that frequent retransmission at a certain protocol layer and slow response of the upper-layer application affect each other, forming a vicious circle.

[0096] Further, the extraction of key interaction features from the protocol interaction data can be achieved through feature extraction tools, such as tools like Wireshark, Tcpdump, etc.; the analysis of the communication behavior patterns corresponding to the key interaction features can be achieved through time series analysis methods, such as: for the network traffic data of the gateway device (such as the number of data packets per second), using the tseries package for autocorrelation analysis, spectral analysis, etc., to reveal the communication behavior patterns behind the time series; the identification of compatibility anomaly points existing in the gateway device can be achieved through protocol analysis tools, such as: using the Wireshark tool can automatically detect some common protocol problems, such as checksum errors, excessive retransmissions, etc., and mark them as anomalies; the analysis of the impact scope of the compatibility anomaly points can be achieved through system analysis tools, such as: when a compatibility anomaly point appears, using SystemTap to view the call situation of relevant functional modules and the change of resource occupancy, and analyze the impact scope on other modules; the determination of the potential correlation relationships corresponding to the compatibility anomaly points can be achieved through system monitoring tools, such as: using tools like Zabbix can monitor various performance indicators and events of the gateway device in real time, and analyze the correlation relationships between compatibility anomaly points by viewing the event history records and the change trends of indicators; the analysis of the preliminary compatibility performance corresponding to the gateway device can be achieved through the weighted scoring method, such as: assigning weights to different compatibility factors (such as the integrity of protocol support, the number of anomaly points, the impact scope of anomalies, etc.), then scoring each factor according to the analysis results of the protocol interaction data, and finally calculating the weighted total score to evaluate the preliminary compatibility performance.

[0097] By extracting the key performance indicators from the preliminary compatibility performance, the present invention can quickly lock the weak links of the gateway device in protocol adaptation, data transmission, and connection stability, point out the direction for optimization and upgrade, and lay a solid foundation for long-term operation and maintenance. By continuously monitoring the key indicators, it can grasp the device compatibility status in real time, quickly respond to anomalies, reduce the fault downtime, and ensure the smooth and stable network communication.

[0098] Among them, the key performance indicators refer to a series of quantitative or qualitative parameters and characteristics that can accurately and effectively reflect the core compatibility characteristics of the gateway device in a multi-protocol environment. From the perspective of protocol support, it includes the number of protocol types supported and the degree of complete support for each functional subset of mainstream protocols (such as TCP / IP, Wi-Fi protocol, etc.) (such as whether it fully supports all features of HTTP / 2); in terms of data transmission, the key performance indicators include data transmission rate, throughput (the amount of data successfully transmitted per unit time), data loss rate (the proportion of data lost during transmission), data latency (the time delay of the data packet from the sender to the receiver), etc. Optionally, extracting the key performance indicators in the preliminary compatibility performance can be achieved through performance testing tools, such as tools like Iperf and JPerf.

[0099] S3. Based on the key performance indicators, evaluate the overall compatibility data corresponding to the gateway device, analyze the types of compatibility problems corresponding to the overall compatibility data, and based on the types of compatibility problems, trace the root causes corresponding to the gateway device and analyze the performance balance points corresponding to the root causes.

[0100] Based on the key performance indicators, the present invention evaluates the overall compatibility data corresponding to the gateway device, analyzes the types of compatibility problems corresponding to the overall compatibility data, quantitatively presents the device performance through key indicators, quickly locates the weak links, which is the key guidance for repair and optimization, can greatly reduce the troubleshooting time, is conducive to the targeted investment of resources, and according to the evaluation results and problem types, targets the allocation of technical, human, and material resources, avoids blind investment, and reduces the operation and maintenance costs.

[0101] Among them, the overall compatibility data refers to a series of data sets that comprehensively reflect the compatibility performance of gateway devices in various communication protocol environments, covering data at the protocol support level, such as the types and versions of protocols that enable the device to run stably and achieve full functionality, as well as the adaptation to emerging protocols; performance-related data is also included, such as data transmission rate and throughput under different protocols, which are used to measure the efficiency of data transmission and reception, as well as packet loss rate and delay time, which are used to judge the reliability and timeliness of transmission; connection stability data is also critical, including connection establishment success rate, connection interruption frequency, time required for reconnection, etc., which intuitively demonstrates the device's ability to maintain a communication link; the compatibility problem type refers to the type of problem that is summarized and divided based on the anomalies and shortcomings exposed by the overall compatibility data. There are different types of problems. From the perspective of protocol adaptation, there are problems with missing protocol functions, that is, the device fails to fully implement the functions specified in the protocol standard, such as some gateways cannot support the multiplexing characteristics of HTTP / 2; poor version compatibility is also a category, which is manifested as frequent errors when docking with a specific protocol version. Optionally, the evaluation of the overall compatibility data corresponding to the gateway device can be achieved through a fuzzy comprehensive evaluation algorithm, such as: first determine the evaluation factor set (such as protocol support, data transmission, connection stability) and the evaluation level set (such as excellent, good, medium, poor), establish a fuzzy relationship matrix, and obtain the overall compatibility data through fuzzy operations; the analysis of the compatibility problem types corresponding to the overall compatibility data can be achieved through data analysis tools, such as: Excel, SPSS and other tools.

[0102] Furthermore, based on the type of compatibility problem, the present invention traces the root factors corresponding to the gateway device, can achieve accurate repair, and quickly identify the root cause of the problem. Whether it is a protocol loophole, hardware shortcoming, or software algorithm defect, it can directly hit the key point and avoid blind debugging, greatly saving manpower and time costs, which is conducive to long-term optimization, improving equipment compatibility, and reducing the occurrence of similar problems in the future.

[0103] Among them, the root factors refer to the fundamental reasons that ultimately cause the compatibility problems of gateway devices, involving multiple levels of software, hardware and design architecture. At the software level, there are operating system kernel vulnerabilities, protocol stack code defects, driver incompatibility, etc.; at the hardware level, there are chip performance bottlenecks, insufficient memory resources, RF module failures, etc.; at the design architecture level, there are problems such as complex and error-prone protocol conversion logic, and unreasonable design of inter-module communication interfaces.

[0104] As an embodiment of the present invention, tracing the root cause factors corresponding to the gateway device based on the compatibility problem type includes: identifying the set of behavioral manifestation characteristics corresponding to the compatibility problem type; analyzing the occurrence frequency and distribution status of the characteristics in the set of behavioral manifestation characteristics; determining the abnormal operation area corresponding to the gateway device based on the occurrence frequency and the distribution status; extracting the operation factor segments in the abnormal operation area; and tracing the root cause factors corresponding to the gateway device based on the operation factor segments.

[0105] Among them, the set of behavioral manifestation characteristics refers to the set of observable and identifiable abnormal behaviors and phenomena presented from multiple dimensions when a compatibility problem occurs in the gateway device. For example, at the network protocol level, it is manifested as frequent connection timeouts, incorrect checksum of data packets, no response or incorrect response to protocol commands, etc. under a specific protocol; in terms of data transmission, it shows characteristics such as a sudden drop in data transmission rate, periodic patterns of data packet loss, and out-of-order transmission of data; the occurrence frequency refers to the statistical count of the number of times each behavioral manifestation characteristic is detected or occurs during the operation of the gateway device. For example, within a certain period of time, the data packet loss characteristic appears 50 times, while the protocol command incorrect response characteristic appears 20 times; the distribution status refers to the dispersion state of the behavioral manifestation characteristics in different operation periods, different functional modules, and different protocol interaction processes of the gateway device. For example, the characteristic of a sudden drop in data transmission rate is concentrated in the network peak period and mainly occurs in several specific data forwarding functional modules; the connection timeout characteristic frequently appears in the first few minutes after the device starts and at specific protocol switching moments after long-term operation; the abnormal operation area refers to the specific range in the gateway device where problems frequently occur and abnormalities are concentrated as determined based on the occurrence frequency and the distribution status, covering aspects such as functional modules, operation periods, and protocol processing flow segments. For example, it is determined that a specific period during which the wireless access module of the gateway device processes a large number of concurrent connection requests within a certain period of time is the abnormal operation area; the operation factor segment refers to the key operation steps, data processing flow segments, resource invocation links, etc. that are further refined and closely related to the abnormal behavior within the abnormal operation area. For example, in the abnormal operation area of the wireless access module, the execution segment of the device address allocation algorithm, the operation process segment of signal strength detection and adjustment, etc. are extracted as the operation factor segments.

[0106] Furthermore, the set of behavioral performance characteristics corresponding to the identified compatibility problem types can be achieved through network performance testing tools. For example, tools such as Iperf can help identify behavioral characteristic sets such as transmission rate being lower than expected and packet loss. The analysis of the occurrence frequency and distribution status of the characteristics in the behavioral performance characteristic set can be achieved through data visualization tools. For example, tools such as Tableau and Grafana can display the occurrence frequency and distribution status of the behavioral performance characteristics in an intuitive chart form. The determination of the abnormal operation area corresponding to the gateway device can be achieved through network diagnostic tools. For example, tools such as Ping and Traceroute are used to diagnose network connection problems and determine abnormal nodes or areas in the network path. The extraction of the operation factor segments in the abnormal operation area can be achieved through the resource call tracing method. For example, in the data forwarding function module, observe the read and write operations of data caches, the scheduling process of the CPU, the sending and receiving operations of network interfaces, etc., and regard the key links in these resource call processes as operation factor segments. The tracing of the root cause factors corresponding to the gateway device can be achieved through the fault tree analysis algorithm. For example, by analyzing the minimum cut sets of the fault tree, determine the most basic causes leading to the occurrence of the top event, that is, the root cause factors.

[0107] By analyzing the performance balance point corresponding to the root cause factors, the present invention is beneficial to efficiently allocate resources. According to the performance balance point, reasonably allocate hardware computing power, bandwidth, and software operating memory to ensure the stable and smooth operation of the gateway device under different working conditions and exert the best performance.

[0108] Among them, the performance balance point refers to a delicate performance adaptation state maintained among various key elements inside the gateway device when it operates stably and efficiently and achieves ideal compatibility. From the hardware dimension, it covers the reasonable matching among the computing speed of the chip, the read-write rate of the memory, the storage capacity, and the network interface bandwidth. For example, the network chip should be able to adapt to the inflow and outflow of high-speed data, and the response speed of the memory should keep up with the requirements of data caching and retrieval. Once there is an imbalance, compatibility problems such as data cache overflow and transmission jamming will occur. Optionally, the analysis of the performance balance point corresponding to the root cause factors can be achieved through analysis algorithms such as PSO and GA.

[0109] S4. Based on the performance balance point, determine the resource allocation channels when the gateway device operates with multiple protocols, detect the channel load conditions corresponding to the resource allocation channels, calculate the channel resource utilization rates corresponding to the resource allocation channels based on the channel load conditions, optimize the monitoring thresholds in the resource monitoring process of the gateway device based on the channel resource utilization rates, and calculate the threshold deviation degrees corresponding to the monitoring thresholds.

[0110] Based on the performance balance point, the present invention determines the resource allocation channels of the gateway device during multi-protocol operation, enabling efficient utilization of resources. It precisely allocates hardware and software resources according to the requirements of each protocol and the performance balance requirements, avoiding excessive resource occupation by some protocols, making the device's computing power, bandwidth, etc. fully utilized, and reducing idleness and waste.

[0111] Among them, the resource allocation channel refers to the resource delivery path and rule system constructed inside the gateway device from the resource pool to each protocol running instance, including the physical-level hardware resource connection and data flow path, such as the link from the network interface to the protocol processing chip; at the logical level, there are resource scheduling strategies based on the adaptation and allocation ratio, such as sorting the CPU task queue according to the protocol priority, and allocating different regions of the memory according to the protocol requirements and setting access permissions.

[0112] As an embodiment of the present invention, determining the resource allocation channels of the gateway device during multi-protocol operation based on the performance balance point includes: analyzing the key performance dimensions corresponding to the performance balance point; screening the resource core elements corresponding to the key performance dimensions; determining the resource consumption patterns of the gateway device in different protocol operation scenarios based on the resource dependency elements; querying the adaptation and allocation ratio corresponding to the hardware resources in the resource consumption patterns; and determining the resource allocation channels of the gateway device during multi-protocol operation based on the adaptation and allocation ratio.

[0113] Among them, the key performance dimension refers to the performance category that plays a key supporting role in the overall performance of the gateway device and is closely related to performance balance. From the perspective of computing power, it covers the operation speed of the CPU, instruction processing ability, and multi-core collaboration efficiency, which directly affect the parsing, encapsulation, and forwarding rate of protocol data and determine the smoothness of high-load protocol operation; the storage performance dimension involves the memory read / write speed, storage capacity, and data access stability, which are related to the storage efficiency of protocol configurations, operation logs, and temporary data; the core resource element refers to the key component that plays a leading role in the key performance dimension and directly affects resource allocation. For computing resources, the core elements are the number of CPU cores and frequency, and their configuration determines the amount and complexity of protocol tasks that can be efficiently processed simultaneously; in storage resources, the physical capacity of the memory, cache mechanism, and read / write speed of the storage chip are the cores, which affect data caching and fast access to match the protocol operation rhythm; the resource consumption pattern refers to the dynamic rules and characteristic combinations of various resources (hardware and software) consumed by the gateway device in different scenarios of individual or mixed operation of different protocols. For example, when running the lightweight MQTT protocol, which mainly transmits small data packets at a low frequency, it consumes a small amount of CPU computing resources for message distribution, the network bandwidth occupancy is stable but low, and the memory requirement is concentrated on maintaining the connection state and simple message caching; the adaptation allocation ratio refers to the precise allocation ratio determined for various hardware resources (such as CPU time slices, memory space, network bandwidth shares) after weighing the performance balance point for different protocol operation scenarios. For example, in the multi-protocol operation of a smart home gateway, to ensure the real-time ZigBee device control protocol, a higher CPU real-time scheduling priority and a certain memory fast response area are allocated, accounting for 20% of the CPU time slice and 30% of a specific memory partition.

[0114] Furthermore, the key performance dimensions corresponding to the analyzed performance balance points can be achieved through the performance index decomposition method. For example, the overall performance index of the gateway device is broken down according to functional modules and processing flows to determine the dimensions closely related to performance balance. The screening of the core resource elements corresponding to the key performance dimensions can be achieved through the performance bottleneck location method. For example, by gradually increasing the multi-protocol service load or simulating a complex network environment, observe the performance degradation of the gateway device to locate the resource elements causing the performance bottleneck. The determination of the resource consumption patterns of the gateway device under different protocol operation scenarios can be achieved through a pattern determination tool. For example, precisely simulate a variety of complex network protocols and large-scale traffic scenarios to comprehensively test the performance and resource consumption status of the gateway device when running different protocols. The query of the adaptation allocation ratio of the hardware resources corresponding to the resource consumption pattern can be achieved through an intelligent operation and maintenance platform. For example, real-time monitor the hardware resource status, protocol operation performance, and configuration information of the gateway device, and automatically analyze the resource consumption pattern based on machine learning algorithms and built-in performance models to recommend the adaptation hardware resource allocation ratio. The determination of the resource allocation channels of the gateway device when running multiple protocols can be achieved through network function virtualization tools. For example, tools such as VMware NSX and Cisco ACI.

[0115] By detecting the channel load conditions corresponding to the resource allocation channels, the present invention is conducive to precise resource scheduling, enabling real-time insight into the proportion and dynamic changes of resources occupied by each protocol, quickly detecting load imbalances, flexibly allocating as needed, preventing some protocols from stalling due to resource shortages, and improving the overall operation efficiency.

[0116] Among them, the channel load condition refers to the comprehensive state of various aspects such as the size of data traffic, the busy degree of processing tasks, and the proportion of resource occupancy in each resource allocation channel when the gateway device is running multiple protocols. It reflects the actual usage and demand levels of hardware resources such as CPU, memory, and network bandwidth by different protocols during operation. Optionally, the detection of the channel load conditions corresponding to the resource allocation channels can be achieved through performance testing tools. For example, tools such as JMeter and LoadRunner.

[0117] Furthermore, based on the channel load conditions, the present invention calculates the channel resource utilization rate corresponding to the resource allocation channels, which can achieve refined resource management, accurately grasp the actual usage efficiency of each channel's resources, quickly locate idle or over-consumed parts, timely adjust the resource allocation strategy, reduce waste, and reduce the risks of sudden device failures and performance bottlenecks.

[0118] Among them, the channel resource utilization rate refers to the degree to which the resource allocation channel is actually used within a specific time range, and it measures the resource utilization efficiency by comparing the actual load and channel capacity of the channel.

[0119] As an embodiment of the present invention, calculating the channel resource utilization rate corresponding to the resource allocation channel based on the channel load condition includes:

[0120] Calculating the channel resource utilization rate corresponding to the resource allocation channel by using the following formula:

[0121]

[0122] wherein, the channel resource utilization rate corresponding to the resource allocation channel, represents the total number of samples of the monitoring samples corresponding to the channel load condition, represents the number index of the monitoring samples, represents the th weight coefficient corresponding to the th monitoring sample, represents the load value corresponding to the th monitoring sample, and respectively represent the start time and end time of the allocation time corresponding to the resource allocation channel, represents the channel capacity index at time

[0123] Specifically, the monitoring samples refer to a series of representative data points collected during the process of measuring the channel load condition, and these data points are used to describe the load state of the channel at different times; the weight coefficient refers to a parameter used to adjust the importance of different monitoring samples in calculating the channel resource utilization rate. Different monitoring samples have different impacts on the calculation of the final utilization rate due to factors such as the collection time and collection environment, and the weight coefficient is used to quantify this impact; the load value refers to the actual workload carried on the resource allocation channel at a specific time, which can be measured in various ways, such as data traffic, the number of processing tasks, resource occupancy, etc.; the allocation time refers to the start time and end time of the resource allocation operation of the resource allocation channel, which defines the time range for calculating the channel resource utilization rate; the channel capacity index refers to the maximum load that the resource allocation channel can carry at a specific time, which reflects the theoretical maximum processing capacity of the channel.

[0124] Based on the channel resource utilization rate, the present invention optimizes the monitoring threshold of the gateway device during the resource monitoring process, which can improve the monitoring accuracy, reasonably set the threshold according to the actual resource utilization situation, avoid misjudgment caused by too high or too low threshold, accurately capture the abnormal state of resources, contribute to the reasonable allocation of resources, better understand the resource usage pattern by optimizing the threshold, allocate resources to different protocols according to demand, and reduce resource waste.

[0125] Among them, the monitoring threshold refers to one or a set of critical values preset when monitoring the resources of the gateway device. These critical values are used to determine whether the resource usage is in a normal, warning, or abnormal state. For example, when monitoring the CPU utilization rate of the gateway device, a threshold of 70% may be set. When the CPU utilization rate exceeds 70%, the monitoring system will issue a warning. Optionally, optimizing the monitoring threshold of the gateway device during the resource monitoring process can be achieved through machine learning algorithms. For example, by training a large amount of resource usage data, machine learning algorithms can automatically discover patterns and rules in the data, and then predict reasonable monitoring thresholds.

[0126] Furthermore, by calculating the threshold deviation degree corresponding to the monitoring threshold, the present invention can accurately evaluate the accuracy of monitoring. Through the deviation degree, it can be intuitively known whether the current threshold setting is reasonable, avoiding misjudgment or missed judgment caused by improper thresholds, and helping to adjust the resource strategy in a timely manner. When the deviation degree exceeds a certain range, it can be quickly detected and the threshold can be optimized specifically, thereby reasonably allocating the resources of the gateway device.

[0127] Among them, the threshold deviation degree refers to an index used to measure the deviation degree between the monitoring threshold and the actual monitoring data, which reflects the accuracy of the monitoring threshold setting.

[0128] As an embodiment of the present invention, calculating the threshold deviation degree corresponding to the monitoring threshold includes:

[0129] Calculating the threshold deviation degree corresponding to the monitoring threshold using the following formula:

[0130]

[0131] Among them, represents the threshold deviation degree corresponding to the monitoring threshold, and respectively represent the end time and start time for calculating the threshold deviation degree, represents at time the monitoring data change rate at the moment, represents the number of data samples corresponding to the monitoring threshold, represents the number index of the data samples, represents the sample difference between the nth data sample and the monitoring threshold, represents the stability coefficient of the monitoring environment corresponding to the monitoring threshold.

[0132] Specifically, the monitoring data change rate refers to at a specific time point , the speed of change of monitoring data, which describes the dynamic change of monitoring data over time. For example, it can be the change in monitoring data such as resource utilization and traffic within a unit time; the data sample refers to the actual data points collected during the monitoring process for analyzing and evaluating the monitoring threshold. These data samples can be data such as resource usage and performance indicators obtained at different time points; the sample difference refers to the difference between each data sample and the monitoring threshold, which reflects the degree to which the data sample deviates from the monitoring threshold; the monitoring environment refers to the overall environment in which data collection and monitoring operations are performed on the monitored object (such as gateway devices, network resources, etc.), which includes hardware environment, software environment, network environment and other aspects; the stability coefficient refers to an indicator used to quantify the stability of the monitoring environment, which indicates the stability of the monitoring environment over a period of time. The higher the stability coefficient, the more stable the monitoring environment and the higher the reliability of the monitoring data.

[0133] S5. Based on the threshold deviation, generate an abnormal protocol instruction of the gateway device in multi-protocol operation, query the instruction configuration protocol corresponding to the abnormal protocol instruction, extract the protocol compatibility factor in the instruction configuration protocol, and generate a compatibility test detail list corresponding to the gateway device based on the protocol compatibility factor.

[0134] The present invention generates abnormal protocol instructions for the gateway device in multi-protocol operation based on the threshold deviation, can realize accurate fault location, accurately judge the abnormal protocol through the threshold deviation, quickly locate the root cause of the problem, reduce the troubleshooting time, optimize resource allocation, and after identifying the abnormal protocol, can adjust the resource allocation of the protocol in a targeted manner to ensure the efficiency and stability of the gateway device under multi-protocol operation.

[0135] Among them, the abnormal protocol instructions refer to operation instructions generated for the protocol that has abnormalities in the multi-protocol operation. These instructions are intended to correct the abnormalities in the protocol operation, such as adjusting protocol parameters, reallocating resources, suspending or restarting specific protocols, etc.

[0136] As an embodiment of the present invention, the generation of abnormal protocol instructions for the gateway device in multi-protocol operation based on the threshold deviation includes: querying the key deviation value in the threshold deviation; analyzing the deviation fluctuation trend corresponding to the threshold deviation based on the key deviation value; determining the abnormal deviation interval in the deviation fluctuation trend; extracting the extreme deviation point in the abnormal deviation interval; locating the abnormal fluctuation point of the gateway device in multi-protocol operation based on the extreme deviation point; and generating abnormal protocol instructions for the gateway device in multi-protocol operation based on the abnormal fluctuation point.

[0137] Among them, the key deviation value refers to the value that has a significant impact on the overall deviation in the threshold deviation data. These values usually have relatively large deviation degree values or are at key turning points during the change of the deviation degree; the deviation fluctuation trend refers to the trend of the threshold deviation degree changing with time or other relevant factors (such as protocol operation cycle, data traffic change, etc.), which describes how the threshold deviation degree rises, falls, remains stable or shows periodic fluctuations; the abnormal deviation interval refers to the time period in the deviation fluctuation trend during which the threshold deviation degree exceeds the normal fluctuation range. Within these intervals, the value of the threshold deviation degree is significantly higher or lower than the normal level, indicating that there may be abnormal situations in the operation of the gateway device; the extreme deviation point refers to the point where the threshold deviation degree reaches the maximum or minimum value within the abnormal deviation interval. These points represent the most extreme situations of the deviation degree under abnormal conditions and usually correspond to the most unstable moments in the operation of the gateway device; the abnormal fluctuation point refers to the specific time point or protocol operation state point in the multi-protocol operation of the gateway device corresponding to the extreme deviation point. These points indicate that the gateway device has abnormal fluctuations at specific moments or under specific protocol operation conditions.

[0138] Furthermore, the key deviation values in the query of the threshold deviation degree can be implemented by the LOF algorithm. For example, applying the LOF algorithm to the dataset containing the threshold deviation degrees of the gateway device at different times, the algorithm will calculate a LOF value for each data point, and the data points with higher LOF values are the key deviation values. The analysis of the deviation fluctuation trend corresponding to the threshold deviation degree can be implemented by the moving average method. For example, as the time window moves, a series of average values are obtained, and by observing the change trend of these average values, the deviation fluctuation trend can be analyzed. The determination of the abnormal deviation interval in the deviation fluctuation trend can be implemented by the control chart method. For example, the commonly used Shewhart control chart is used. By calculating the center line (such as the average value) and the upper and lower control limits (such as the center line ± 3 times the standard deviation) of the threshold deviation degree data, the data interval exceeding the control limit is the abnormal deviation interval. The extraction of the extreme deviation points in the abnormal deviation interval can be implemented by the extreme value search method. For example, within the determined abnormal deviation interval, directly compare the values of the data points to find the maximum and minimum values, and these points are the extreme deviation points. The positioning of the abnormal fluctuation points of the gateway device during multi-protocol operation can be implemented by the protocol association analysis method. For example, record the relevant information of the gateway device when running different protocols. When the time corresponding to the extreme deviation point is found, check the protocols running at this time, and determine these protocols as the protocols related to the abnormal fluctuation. The generation of the abnormal protocol instructions of the gateway device during multi-protocol operation can be implemented by the decision tree algorithm. For example, by training a large amount of data on gateway device protocol anomalies and processing results, the decision tree algorithm can generate a decision model. When the abnormal fluctuation points and abnormal protocols are located, appropriate processing instructions can be generated according to the decision model.

[0139] By querying the instruction configuration protocol corresponding to the abnormal protocol instruction of the present invention and extracting the protocol compatibility factors in the instruction configuration protocol, it helps to accurately grasp the adaptation situation between the instruction and each protocol, know which protocols can better execute the instruction based on the compatibility factors, avoid the execution failure caused by applying the instruction on incompatible protocols, optimize the collaborative work of the protocols, reasonably arrange the multi-protocol operation by analyzing the compatibility factors, reduce the conflicts caused by compatibility problems, and improve the overall operation efficiency of the gateway device.

[0140] Among them, the instruction configuration protocol refers to a set of configuration rules and parameter collections set for specific abnormal protocol instructions in the multi-protocol running environment of a gateway device. For example, in a gateway device that supports multiple protocols such as TCP / IP, HTTP, and MQTT at the same time, for an abnormal protocol instruction, its instruction configuration protocol will respectively clarify the IP address allocation, port setting, data packet header format, etc. under the TCP / IP protocol; the protocol compatibility factor refers to a quantitative index or characteristic parameter used to measure and characterize the compatibility degree between the abnormal protocol instruction and different protocols in the instruction configuration protocol. For example, the value range can be a real number between 0 and 1, where 0 means completely incompatible and 1 means completely compatible. Optionally, querying the instruction configuration protocol corresponding to the abnormal protocol instruction can be achieved through an instruction parsing method. For example, deeply parse the abnormal protocol instruction, extract core elements such as the key operation code, data type, and target address in the instruction, and then search and match in the pre-established instruction-protocol mapping table to find the corresponding instruction configuration protocol; extracting the protocol compatibility factor in the instruction configuration protocol can be achieved through a rule-based method. For example, based on the clearly defined rules and standards formulated in advance, analyze and judge the instruction configuration protocol, extract key factors related to protocol compatibility, and determine the protocol compatibility factor according to the satisfaction of these factors.

[0141] Furthermore, based on the protocol compatibility factor, the present invention generates a detailed compatibility test list corresponding to the gateway device, which can achieve precise test planning. According to the compatibility factor, clarify the key test areas and key links, avoid blind testing, save time and resources, can efficiently detect compatibility hidden dangers, focus on detecting parts with low compatibility factors, resolve the risk of protocol conflicts in advance, and ensure the stable operation of the gateway device in a complex protocol environment.

[0142] Among them, the detailed compatibility test list refers to a detailed test plan and record document for the compatibility of a gateway device in a multi-protocol running environment, including but not limited to: basic function test items of each protocol, clarifying whether functions such as data transmission, connection establishment and disconnection can be normally implemented in the gateway device; performance test content of the protocol, such as test points for indicators such as data transmission rate, response time, and throughput; boundary condition test of the protocol, such as maximum connection number, minimum data volume, and operation status test under extreme network environments; and test planning for the mutual influence between protocols, checking whether there are abnormal situations caused by resource preemption and conflicts when multiple protocols run simultaneously. Optionally, generating the detailed compatibility test list corresponding to the gateway device can be achieved through a detailed list generation tool. For example, tools such as LaTeX and TestLink.

[0143] First of all, by acquiring the device specification information of the gateway device, the present invention can accurately lock the adapted communication protocol, thereby constructing a targeted set of protocol test cases, laying a solid foundation for subsequent multi-protocol compatibility testing, efficiently troubleshooting potential communication and conversion problems, clarifying the characteristics of the network access port through the specification information, and simulating different scenarios to be more in line with the actual device, accurately collecting protocol interaction data, and facilitating the rapid capture of key compatibility indicators, providing strong support for evaluating overall compatibility and locating root problems. At the same time, by determining the network access port corresponding to the gateway device and simulating the network transmission scenarios of the network access port under different protocols, the present invention can simulate different protocol scenarios, replicate diverse and complex real network environments, and expose the compatibility problems of the device during protocol conversion and data transmission and reception in advance, greatly reducing the failure rate after actual deployment, so that the device can be efficiently networked in scenarios such as smart homes and industrial Internet of Things, and smoothly interconnect multiple devices. Based on the key performance indicators, the present invention evaluates the overall compatibility data corresponding to the gateway device, analyzes the compatibility corresponding to the overall compatibility data The problem type is quantified by key indicators to present the performance of the equipment, and the weak links are quickly locked. It is a key guide for repair and optimization, which can greatly reduce the troubleshooting time and facilitate the targeted investment of resources. According to the evaluation results and the problem type, the technology, manpower and material resources are deployed in a targeted manner to avoid blind investment and reduce the operation and maintenance cost. The present invention is based on the performance balance point to determine the resource allocation channel of the gateway device when multiple protocols are running, which can achieve efficient resource utilization, accurately allocate hardware and software resources according to the requirements of each protocol and the performance balance requirements, avoid excessive occupation of resources by some protocols, make full use of the computing power and bandwidth of the equipment, and reduce idleness and waste. Further, the present invention generates the abnormal protocol instructions of the gateway device in the multi-protocol operation based on the threshold deviation, which can achieve accurate fault location, accurately judge the abnormal protocol through the threshold deviation, quickly locate the root cause of the problem, reduce the troubleshooting time, optimize resource allocation, and after identifying the abnormal protocol, the resource allocation of the protocol can be adjusted in a targeted manner to ensure the efficiency and stability of the gateway device under the multi-protocol operation. Therefore, the multi-protocol compatibility test method and system of the gateway device proposed by the present invention can improve the compatibility requirements of the gateway device.

[0144] Embodiment 2:

[0145] like Figure 2 FIG. 1 is a schematic diagram of a module of a multi-protocol compatibility testing system for a gateway device provided by an embodiment of the present invention.

[0146] The multi - protocol compatibility test system 200 of a gateway device described in the present invention can be installed in an electronic device. According to the functions achieved, the multi - protocol compatibility test system 200 of a gateway device can include a standard processing module 201, an index extraction module 202, an equilibrium point extraction module 203, a deviation calculation module 204, and a detailed list generation module 205. The modules described in the present invention can also be referred to as units, which refer to a series of computer program segments that can be executed by the processor of an electronic device and can complete fixed functions, and are stored in the memory of the electronic device.

[0147] In this embodiment, the functions of each module / unit are as follows:

[0148] The standard processing module 201 is used to obtain the device specification information of the gateway device, analyze the corresponding adapted communication protocol of the gateway device according to the device specification information, construct a protocol test case set corresponding to the gateway device based on the adapted communication protocol, and perform standardization processing on the test cases in the protocol test case set to obtain a standard protocol test case set;

[0149] The index extraction module 202 is used to determine the network access port corresponding to the gateway device, simulate the network transmission scenarios of the network access port under different protocols, collect the protocol interaction data in the network transmission scenarios, analyze the corresponding preliminary compatibility performance of the gateway device based on the protocol interaction data, and extract the key performance indicators in the preliminary compatibility performance;

[0150] The equilibrium point extraction module 203 is used to evaluate the overall compatibility data corresponding to the gateway device based on the key performance indicators, analyze the type of compatibility problems corresponding to the overall compatibility data, trace the root cause factors corresponding to the gateway device based on the type of compatibility problems, and analyze the performance equilibrium points corresponding to the root cause factors;

[0151] The deviation calculation module 204 is used to determine the resource allocation channels of the gateway device during multi - protocol operation based on the performance equilibrium points, detect the channel load conditions corresponding to the resource allocation channels, calculate the channel resource utilization rates corresponding to the resource allocation channels based on the channel load conditions, optimize the monitoring thresholds in the resource monitoring process of the gateway device based on the channel resource utilization rates, and calculate the threshold deviation corresponding to the monitoring thresholds;

[0152] The detailed list generation module 205 is used to generate abnormal protocol instructions of the gateway device during multi - protocol operation based on the threshold deviation, query the instruction configuration protocol corresponding to the abnormal protocol instructions, extract the protocol compatibility factors in the instruction configuration protocol, and generate a compatibility test detailed list corresponding to the gateway device based on the protocol compatibility factors.

[0153] Specifically, each module in the multi - protocol compatibility test system 200 of a gateway device described in the embodiments of the present invention uses the same technical means as those described in the multi - protocol compatibility test method of a gateway device shown in the accompanying drawings and can produce the same technical effects, which will not be elaborated here.

[0154] The above are only specific embodiments of the present invention, enabling those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be obvious to those skilled in the art. The general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown herein, but rather will conform to the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multi-protocol compatibility testing method for a gateway device, characterized in that: The method comprises: Acquire device specification information of a gateway device, analyze the adapted communication protocol corresponding to the gateway device according to the device specification information, construct a protocol test case set corresponding to the gateway device based on the adapted communication protocol, and standardize the test cases in the protocol test case set to obtain a standard protocol test case set; Determine the network access port corresponding to the gateway device, simulate the network transmission scenarios of the network access port under different protocols, collect protocol interaction data under the network transmission scenarios, analyze the preliminary compatibility performance corresponding to the gateway device based on the protocol interaction data, and extract key performance indicators in the preliminary compatibility performance; Based on the key performance indicators, evaluate the overall compatibility data corresponding to the gateway device, analyze the compatibility problem type corresponding to the overall compatibility data, trace the root cause of the gateway device based on the compatibility problem type, and analyze the performance balance point corresponding to the root cause; Based on the performance balance point, determine the resource allocation channel of the gateway device when multiple protocols are running, detect the channel load corresponding to the resource allocation channel, calculate the channel resource utilization corresponding to the resource allocation channel based on the channel load, optimize the monitoring threshold of the gateway device in the resource monitoring process based on the channel resource utilization, and calculate the threshold deviation corresponding to the monitoring threshold, wherein the calculation of the threshold deviation corresponding to the monitoring threshold includes: The threshold deviation corresponding to the monitoring threshold is calculated using the following formula: in, represents the threshold deviation corresponding to the monitoring threshold, and They represent the end time and start time of calculating the threshold deviation, Indicates at time The monitoring data change rate at each moment, represents the number of data samples corresponding to the monitoring threshold, Represents the number index of data samples, Indicates The sample difference between a data sample and the monitoring threshold, Indicates the stability coefficient of the monitoring environment corresponding to the monitoring threshold; Based on the threshold deviation, an abnormal protocol instruction of the gateway device in multi-protocol operation is generated, the instruction configuration protocol corresponding to the abnormal protocol instruction is queried, the protocol compatibility factor in the instruction configuration protocol is extracted, and based on the protocol compatibility factor, a compatibility test detail list corresponding to the gateway device is generated.

2. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The step of constructing a protocol test case set corresponding to the gateway device based on the adapted communication protocol includes: Determining core protocol elements in the adapted communication protocol; Analyze the functional characteristics corresponding to the core protocol elements; According to the functional characteristics, a protocol test architecture corresponding to the adapted communication protocol is constructed; Based on the protocol test architecture, determining the test data requirements corresponding to the gateway device; Based on the test data requirements, a protocol test case set corresponding to the gateway device is constructed.

3. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The step of standardizing the test cases in the protocol test case set to obtain a standard protocol test case set includes: Identify a content format structure corresponding to a test case in the protocol test case set; Based on the content format structure, determining original use case information corresponding to the test case in the protocol test case set; Analyze the logical structure of the original use case information; Determine a standard process template corresponding to the logic structure; Mapping and matching the data in the original use case information with the standard process template to obtain mapping differences; Based on the mapping difference points, the test cases in the protocol test case set are standardized to obtain a standard protocol test case set.

4. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The analyzing the preliminary compatibility performance corresponding to the gateway device based on the protocol interaction data includes: Extracting key interaction features from the protocol interaction data; Analyzing the communication behavior patterns corresponding to the key interaction features; Based on the communication behavior pattern, identifying compatibility anomalies existing in the gateway device; Analyze the abnormal impact range corresponding to the compatible abnormal point; Based on the abnormal impact range, determining the potential association relationship corresponding to the compatible abnormal point; Based on the potential association relationship, the preliminary compatibility performance corresponding to the gateway device is analyzed.

5. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The tracing back the root cause of the gateway device based on the compatibility problem type includes: Identify a set of behavioral performance characteristics corresponding to the compatibility problem type; Analyze the occurrence frequency and distribution of the characteristics of the behavioral performance characteristics; Based on the occurrence frequency and the distribution status, determining an abnormal operation area corresponding to the gateway device; Extracting the operation factor segment in the operation abnormality area; Based on the operation factor segment, the root cause factor corresponding to the gateway device is traced back.

6. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The determining, based on the performance balance point, a resource allocation channel of the gateway device when multiple protocols are running, includes: Analyze the key performance dimensions corresponding to the performance balance point; Screening the core elements of resources corresponding to the key performance dimensions; Based on the resource dependency factors, determining resource consumption patterns of the gateway device in different protocol operation scenarios; Querying the adaptation allocation ratio corresponding to the hardware resources in the resource consumption mode; Based on the adaptation allocation ratio, a resource allocation channel of the gateway device when multiple protocols are running is determined.

7. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The calculating, based on the channel load condition, the channel resource utilization rate corresponding to the resource allocation channel comprises: The channel resource utilization rate corresponding to the resource allocation channel is calculated using the following formula: in, The channel resource utilization rate corresponding to the resource allocation channel, Indicates the total number of samples of monitoring samples corresponding to the channel load condition, Indicates the number index of monitoring samples, Indicates The weight coefficient corresponding to the monitoring samples is: Indicates The load value corresponding to the monitoring sample is and Respectively represent the start time and end time of the allocation time corresponding to the resource allocation channel, Indicates at time Channel capacity indicator at the moment.

8. A multi-protocol compatibility testing method for a gateway device as claimed in claim 1, characterized in that: The generating, based on the threshold deviation, an abnormal protocol instruction of the gateway device in multi-protocol operation includes: Querying a key deviation value in the threshold deviation; Based on the key deviation value, analyzing the deviation fluctuation trend corresponding to the threshold deviation; Determining an abnormal deviation interval in the deviation fluctuation trend; Extracting extreme deviation points in the abnormal deviation interval; Based on the extreme deviation point, locate the abnormal fluctuation point of the gateway device in the multi-protocol operation; Based on the abnormal fluctuation point, an abnormal protocol instruction of the gateway device in the multi-protocol operation is generated.

9. A multi-protocol compatibility testing system for a gateway device, characterized in that: A method for performing a multi-protocol compatibility test of a gateway device according to any one of claims 1 to 8, the system comprising: A standard processing module, used to obtain device specification information of a gateway device, analyze the adapted communication protocol corresponding to the gateway device according to the device specification information, construct a protocol test case set corresponding to the gateway device based on the adapted communication protocol, and perform standardization processing on the test cases in the protocol test case set to obtain a standard protocol test case set; An indicator extraction module is used to determine the network access port corresponding to the gateway device, simulate the network transmission scenarios of the network access port under different protocols, collect protocol interaction data under the network transmission scenarios, analyze the preliminary compatibility performance corresponding to the gateway device based on the protocol interaction data, and extract key performance indicators from the preliminary compatibility performance; A balance point extraction module is used to evaluate the overall compatibility data corresponding to the gateway device based on the key performance indicators, analyze the compatibility problem type corresponding to the overall compatibility data, trace the root cause of the gateway device based on the compatibility problem type, and analyze the performance balance point corresponding to the root cause; The deviation calculation module is used to determine the resource allocation channel of the gateway device when multiple protocols are running based on the performance balance point, detect the channel load corresponding to the resource allocation channel, calculate the channel resource utilization corresponding to the resource allocation channel based on the channel load, optimize the monitoring threshold of the gateway device in the resource monitoring process based on the channel resource utilization, and calculate the threshold deviation corresponding to the monitoring threshold, wherein the calculation of the threshold deviation corresponding to the monitoring threshold includes: The threshold deviation corresponding to the monitoring threshold is calculated using the following formula: in, represents the threshold deviation corresponding to the monitoring threshold, and They represent the end time and start time of calculating the threshold deviation, Indicates at time The monitoring data change rate at each moment, represents the number of data samples corresponding to the monitoring threshold, Represents the number index of data samples, Indicates The sample difference between a data sample and the monitoring threshold, Indicates the stability coefficient of the monitoring environment corresponding to the monitoring threshold; A detailed list generation module is used to generate abnormal protocol instructions for the gateway device in multi-protocol operation based on the threshold deviation, query the instruction configuration protocol corresponding to the abnormal protocol instruction, extract the protocol compatibility factor in the instruction configuration protocol, and generate a compatibility test detailed list corresponding to the gateway device based on the protocol compatibility factor.

Images