Dual-mode communication comprehensive test method and system

Abstract

The invention discloses a dual-mode communication comprehensive test method and system, and relates to the technical field of data processing. The dual-mode communication comprehensive test method comprises the following steps: performing test scene construction on communication test seeds to generate a seed communication test scene group; respectively testing the communication test seeds according to the seed communication test scene group to obtain a plurality of communication test monitoring data sets; performing standardization processing according to the plurality of communication test monitoring data sets to obtain a plurality of communication test monitoring standard groups; and performing multi-degree-of-freedom analysis on the plurality of communication test monitoring standard groups according to the communication performance feature combing channel to obtain a seed communication test report. According to the invention, the technical effects of scientifically, rapidly and quantitatively evaluating the communication performance of the unspecific communication mode, selecting the communication mode for subsequent users according to communication requirements, and providing a high-availability communication test report are achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a dual-mode communication comprehensive testing method and system. Background Art

[0002] The development of current communication technology, especially the diversification of communication methods, makes users face challenges in choosing appropriate communication methods. However, there is a serious problem in the existing technology, that is, the accuracy of communication performance evaluation of communication methods is low, and the evaluation results have limited reference value for users to choose communication methods.

[0003] For example, some communication performance evaluations only consider simple transmission speeds, while ignoring factors such as latency, stability, and security. For example, when users choose whether to use Wi-Fi or mobile networks, in addition to transmission speed, they also need to consider network latency, because high latency may cause problems such as video freezes or game delays. However, existing evaluation methods often fail to fully consider these factors, which brings confusion to users' choice of communication methods. Summary of the invention

[0004] The present invention provides a dual-mode communication comprehensive test method and system, which are used to solve the technical problems in the prior art that the accuracy of communication performance evaluation of communication modes is low and the reference value of the evaluation results for users to select communication modes is limited.

[0005] In view of the above problems, the present invention provides a dual-mode communication comprehensive testing method and system.

[0006] According to a first aspect of the present invention, a dual-mode communication comprehensive test method is provided, the method comprising: receiving a communication test population according to a dual-mode communication test management channel, wherein the communication test population includes multiple communication test seeds; extracting a first communication test seed according to the communication test population, wherein the first communication test seed is any one of the communication test seeds in the communication test population; constructing a multi-feature communication test scenario according to the first communication test seed, and generating a first seed communication test scenario group that meets a predetermined test scenario capacity constraint; testing the first communication test seed according to the first seed communication test scenario group, respectively, to obtain multiple communication test monitoring data sets; performing standardization processing on the multiple communication test monitoring data sets to obtain multiple communication test monitoring standard groups; performing multi-degree-of-freedom analysis on the multiple communication test monitoring standard groups according to a communication performance feature combing channel, and obtaining a first seed communication test report.

[0007] According to a second aspect of the present invention, a dual-mode communication comprehensive test system is provided, the system comprising: a test population receiving module, for receiving a communication test population according to a dual-mode communication test management channel, wherein the communication test population comprises a plurality of communication test seeds; a test seed extraction module, for extracting a first communication test seed according to the communication test population, wherein the first communication test seed is any one of the communication test seeds in the communication test population; a test scenario construction module, for constructing a multi-feature communication test scenario according to the first communication test seed, and generating a first seed communication test scenario group that meets a predetermined test scenario capacity constraint; a communication test execution module, for testing the first communication test seed according to the first seed communication test scenario group, respectively, to obtain a plurality of communication test monitoring data sets; a data processing execution module, for performing standardization processing according to the plurality of communication test monitoring data sets, to obtain a plurality of communication test monitoring standard groups; a test report output module, for performing multi-degree-of-freedom analysis on the plurality of communication test monitoring standard groups according to a communication performance feature combing channel, to obtain a first seed communication test report.

[0008] One or more technical solutions provided in the present invention have at least the following technical effects or advantages:

[0009] The present invention achieves the technical effect of scientifically and rapidly quantifying and evaluating the communication performance of unspecified communication methods, enabling subsequent users to select communication methods according to communication requirements and providing a high-availability communication test report. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A schematic diagram of a dual-mode communication comprehensive test method provided by the present invention;

[0011] Figure 2 A schematic diagram of a process for generating a seed communication test scenario group in a dual-mode communication comprehensive test method provided by the present invention;

[0012] Figure 3 A schematic structural diagram of a dual-mode communication comprehensive test system provided by the present invention.

[0013] Explanation of the accompanying drawings: 1-test population receiving module, 2-test seed extraction module, 3-test scenario construction module, 4-communication test execution module, 5-data processing execution module, 6-test report output module. DETAILED DESCRIPTION

[0014] The present invention provides a dual-mode communication comprehensive test method and system, which is used to solve the technical problems in the prior art that the accuracy of communication performance evaluation of communication methods is low, and the evaluation results have limited reference value for users to select communication methods. The method achieves the technical effect of scientifically and quickly quantifying the communication performance of unspecified communication methods, and provides a highly available communication test report for subsequent users to select communication methods according to communication needs.

[0015] Below, the technical solutions in the present invention will be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments of the present invention. It should be understood that the present invention is not limited to the example embodiments described herein. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. It should also be noted that, for the convenience of description, only the parts related to the present invention are shown in the accompanying drawings, rather than all of them.

[0016] Embodiment 1

[0017] like Figure 1 As shown, the present invention provides a dual-mode communication comprehensive test method, the method comprising:

[0018] A100: receiving a communication test population according to a dual-mode communication test management channel, wherein the communication test population includes a plurality of communication test seeds;

[0019] A200: extracting a first communication test seed according to the communication test population, wherein the first communication test seed is any one communication test seed in the communication test population;

[0020] Specifically, in this embodiment, the dual-mode communication test management channel is used to manage the communication test channel, the dual-mode communication test management channel can support the number of communication modes to be managed, and the dual-mode communication test management channel can support receiving two or more different communication modes.

[0021] Specifically, the dual-mode communication test management channel can receive a communication test population, which includes multiple communication test seeds, and the communication test seeds represent different communication modes, such as carrier, micro-power wireless, 4G, 5G, Bluetooth, CAN, RS485, etc.

[0022] Since the method of performing dual-mode communication comprehensive test on multiple communication test seeds to obtain multiple seed communication test reports is consistent, this embodiment randomly extracts one communication test seed from the multiple communication test seeds of the communication test population as the first communication test seed.

[0023] The implementation method of performing a dual-mode communication comprehensive test on the first communication test seed to obtain the first seed communication test report is elaborated in detail.

[0024] A300: construct a multi-feature communication test scenario according to the first communication test seed, and generate a first seed communication test scenario group that meets the predetermined test scenario capacity constraint;

[0025] In one embodiment, Figure 2 As shown, a multi-feature communication test scenario is constructed according to the first communication test seed to generate a first seed communication test scenario group that meets the predetermined test scenario capacity constraint. The method step A300 provided by the present invention also includes:

[0026] A310: Obtain multiple communication scenario characteristic indicators, wherein the multiple communication scenario characteristic indicators include communication configuration, communication environment and communication tasks;

[0027] A320: Tracing back the communication records of the first communication test seed according to the multi-communication scenario characteristic index to generate a multi-communication scenario characteristic wide area;

[0028] A330: Divide the scheduled test scenario capacity constraints into three parts according to the scheduled capacity ratio, and obtain a first group of test scenario capacity constraints, a second group of test scenario capacity constraints, and a third group of test scenario capacity constraints;

[0029] A340: Based on the first group of test scenario capacity constraints, the second group of test scenario capacity constraints and the third group of test scenario capacity constraints, and according to the multi-communication scenario feature wide area, construct a first group of communication test scenarios, a second group of communication test scenarios and a third group of communication test scenarios;

[0030] A350: Add the first group of communication test scenarios, the second group of communication test scenarios and the third group of communication test scenarios to a first seed communication test scenario group.

[0031] In one embodiment, the communication record of the first communication test seed is traced back according to the multi-communication scenario characteristic index to generate a multi-communication scenario characteristic wide area, and the method step A320 provided by the present invention further includes:

[0032] A321: Tracing back the communication records of the first communication test seed according to the multi-communication scenario characteristic indicators to obtain a first seed communication scenario characteristic record set;

[0033] A322: performing data cleaning according to the first sub-communication scenario feature record set to obtain a first sub-communication scenario standard record set;

[0034] A323: performing sample partitioning on the first seed communication scenario standard record set according to the multi-communication scenario characteristic indicators to obtain a plurality of communication scenario characteristic sample partitions;

[0035] A324: Drawing a plurality of communication scenario feature sample graphs according to the plurality of communication scenario feature sample partitions;

[0036] A325: performing a central trend analysis according to the plurality of communication scenario feature sample graphs to obtain a plurality of communication scenario feature central domains;

[0037] A326: Add the multiple communication scenario feature concentrated domains to the multi-communication scenario feature wide domain.

[0038] In one embodiment, based on the first group of test scenario capacity constraints, the second group of test scenario capacity constraints, and the third group of test scenario capacity constraints, a first group of communication test scenarios, a second group of communication test scenarios, and a third group of communication test scenarios are constructed according to the multi-communication scenario feature wide area, and the method step A340 provided by the present invention also includes:

[0039] A341: construct dynamic variables for the first scenario using the communication configuration, and construct fixed variables for the first scenario using the communication environment and the communication task;

[0040] A342: constructing dynamic variables based on the first scenario and constructing fixed variables based on the first scenario, performing test scenario parameter modulation according to the multi-communication scenario feature wide area, and establishing a first group of communication test scenarios that meet the first group of test scenario capacity constraints;

[0041] A343: constructing dynamic variables with the communication environment as the second scenario, and constructing fixed variables with the communication configuration and the communication task as the second scenario;

[0042] A344: constructing dynamic variables based on the second scenario and constructing fixed variables based on the second scenario, performing test scenario parameter modulation according to the multi-communication scenario feature wide area, and establishing a second group of communication test scenarios that meet the second group of test scenario capacity constraints;

[0043] A345: constructing dynamic variables with the communication task as the third scenario, and constructing fixed variables with the communication configuration and communication environment as the third scenario;

[0044] A346: Construct dynamic variables based on the third scenario and construct fixed variables based on the third scenario, perform test scenario parameter modulation according to the wide area characteristics of the multi-communication scenario, and establish a third group of communication test scenarios that meet the capacity constraints of the third group of test scenarios.

[0045] In this embodiment, the multiple communication scenario characteristic indicators define the indicator standards that each communication method needs to have, and the multiple communication scenario characteristic indicators are intended to ensure that various communication methods can operate effectively in different scenarios.

[0046] Specifically, the multiple communication scenario characteristic indicators include communication configuration (such as network type, bandwidth, frequency, etc.), communication environment (such as indoor, outdoor, weather conditions, etc.) and communication tasks (such as voice calls, video transmission, data downloads, etc.).

[0047] A plurality of historical communication records are pre-stored in the first communication record of the first communication test seed, and each historical communication record is a specific environment and condition in which the communication activity of the communication mode corresponding to the first communication test seed normally occurs.

[0048] The information structure of a historical communication record in the exemplary first communication record includes the physical environment being an outdoor communication environment, a rainy day, and 25°C, the network type used being LTE, the communication task performed being a voice call, the bandwidth for performing the communication task being 52kbps, the frequency being 127Hz, the time consumed for performing the communication task, the user density record for performing the communication task, and other information.

[0049] This embodiment uses the multiple constituent indicators of the multi-communication scenario characteristic indicators as constraints to trace back the communication records of the first communication record of the first communication test seed. The communication record traceback is to call the historical communication data of the communication mode corresponding to the first communication test seed to obtain a first seed communication scenario characteristic record set. The first seed communication scenario characteristic record set is a plurality of groups of communication configuration records - communication environment records - communication task records extracted and called from multiple historical communication records.

[0050] Data cleaning is performed according to the first seed communication scenario feature record set to eliminate m groups of communication configuration records - communication environment records - communication task records with missing indicator data or repeated indicator data, and a first seed communication scenario standard record set is obtained. The data format in the first seed communication scenario standard record set is the same as several groups of communication configuration records - communication environment records - communication task records with no missing data.

[0051] The first seed communication scenario standard record set is partitioned into samples according to the multi-communication scenario characteristic indicators to obtain three communication scenario characteristic sample partitions. The first communication scenario characteristic sample partition is a plurality of communication configuration records obtained by calling data on the first seed communication scenario standard record set based on the communication configuration. The second communication scenario characteristic sample partition is a plurality of communication environment records obtained by calling data on the first seed communication scenario standard record set based on the communication environment. The third communication scenario characteristic sample partition is a plurality of communication task records obtained by calling data on the first seed communication scenario standard record set based on the communication configuration.

[0052] The first communication scenario feature sample partition is aggregated by network type to obtain multiple network types and configure multiple scatter point identification colors for the multiple network types. A two-dimensional coordinate system is then drawn with bandwidth as the horizontal axis and frequency as the vertical axis. Multiple communication configurations are recorded as multiple groups of network type-bandwidth-frequency. Scatter point positioning is performed based on bandwidth-frequency in the two-dimensional coordinate system, and scatter point color identification is performed according to the network type to obtain the first communication scenario feature sample graph.

[0053] Based on the concentration trend analysis of the first communication scenario feature sample graph, the concentration area or concentration trend of the data in terms of bandwidth and frequency is determined to obtain the first communication scenario feature concentration domain. The first communication scenario feature concentration threshold includes the network type concentration threshold, the bandwidth configuration concentration threshold and the frequency configuration concentration threshold.

[0054] By analogy, a plurality of communication scenario feature sample graphs are drawn according to the plurality of communication scenario feature sample partitions, and a central tendency analysis is performed according to the plurality of communication scenario feature sample graphs to obtain a plurality of communication scenario feature central domains.

[0055] Among them, the second communication scenario feature concentration domain corresponding to the second communication scenario feature sample partition includes the communication physical environment threshold, the communication weather threshold, and the communication temperature threshold; the third communication scenario feature concentration domain corresponding to the third communication scenario feature sample partition includes the communication task type threshold, and the multiple communication scenario feature concentration domains are added to the multi-communication scenario feature wide area.

[0056] The predetermined test scenario capacity constraint is the maximum communication capacity or data throughput that the communication scenario can support. The predetermined capacity three-part ratio is to divide the overall capacity constraint into three parts according to a specific ratio when constructing the communication test scenario. For example, the predetermined capacity three-part ratio is 3:3:4.

[0057] The predetermined test scenario capacity constraints are divided into a first group of test scenario capacity constraints, a second group of test scenario capacity constraints and a third group of test scenario capacity constraints based on the three-part ratio of the predetermined capacity.

[0058] The communication configuration is used to construct dynamic variables for the first scenario, and the communication environment and the communication task are used to construct fixed variables for the first scenario. That is, the communication network type, bandwidth and frequency of the first scenario are variable, while the communication environment and the communication task are fixed. The communication environment is preferably fixed to the communication physical environment threshold, communication weather threshold and communication temperature threshold with the highest occurrence frequency environment, weather and temperature in the domain of the second communication scenario feature set, and the communication task is preferably fixed to the communication task with the highest occurrence frequency in the domain of the third communication scenario feature set.

[0059] The first communication scenario feature concentration threshold includes a network type concentration threshold, a bandwidth configuration concentration threshold and a frequency configuration concentration threshold. A dynamic variable is constructed based on the first scenario and a fixed variable is constructed based on the first scenario. The network type concentration threshold, the bandwidth configuration concentration threshold and the frequency configuration concentration threshold in the first communication scenario feature concentration threshold of the multi-communication scenario feature wide area are randomly arranged and combined to obtain multiple groups of network types, bandwidth configurations and frequency configurations. The multiple groups of network types, bandwidth configurations and frequency configurations are used to modulate the test scenario parameters of the first scenario to establish the first group of communication test scenarios that meet the capacity constraints of the first group of test scenarios. The first group of communication test scenarios includes multiple first test scenarios, and the scenario parameters of the multiple first test scenarios are mapped to the multiple groups of network types, bandwidth configurations and frequency configurations obtained based on random arrangement and combination in the previous text.

[0060] The communication environment is used as a dynamic variable for the second scenario, and the communication configuration and the communication task are used as fixed variables for the second scenario. That is to say, the communication physical environment, communication weather, and communication temperature of the first scenario are variable, while the communication configuration and the communication task are fixed. The communication configuration is preferably fixed to the network type, bandwidth parameter, and frequency parameter with the highest occurrence frequency in the network type concentration threshold, bandwidth configuration concentration threshold, and frequency configuration concentration threshold in the first communication scenario feature concentration domain, and the communication task is preferably fixed to the communication task with the highest occurrence frequency in the third communication scenario feature concentration domain.

[0061] The domains in the second communication scenario feature set include a communication physical environment threshold, a communication weather threshold, and a communication temperature threshold, and dynamic variables are constructed based on the second scenario and fixed variables are constructed based on the second scenario.

[0062] The communication physical environment threshold, communication weather threshold, and communication temperature threshold in the second communication scenario feature concentration domain in the wide area of ​​the multi-communication scenario features are randomly arranged and combined to obtain multiple sets of communication physical environments, communication weather, and communication temperatures as test scenario parameter modulation options, and then the multiple sets of communication physical environments, communication weather, and communication temperatures obtained above are used to adjust the variables of the second scenario to obtain multiple second test scenarios, constituting the second set of communication test scenarios that meet the capacity constraints of the second set of test scenarios.

[0063] The communication task is used to construct dynamic variables for the third scenario, and the communication configuration and communication environment are used to construct fixed variables for the third scenario. That is to say, the communication task of the third scenario is variable, while the communication environment and communication configuration are fixed. The communication environment is preferably fixed to the highest frequency environment, weather and temperature of the communication physical environment threshold, communication weather threshold and communication temperature threshold in the second communication scenario feature set, and the communication configuration is preferably fixed to the highest frequency network type, bandwidth parameter and frequency parameter of the network type concentration threshold, bandwidth configuration concentration threshold and frequency configuration concentration threshold in the first communication scenario feature set.

[0064] The third communication scenario feature set domain includes a communication task type threshold, dynamic variables are constructed based on the third scenario and fixed variables are constructed based on the third scenario, and the communication task type threshold of the third communication scenario feature set domain of the multi-communication scenario feature wide area is used to modulate test scenario parameters, and multiple third test scenarios of multiple communication tasks corresponding to the communication task threshold are obtained as the third group of communication test scenarios that meet the capacity constraints of the third group of test scenarios.

[0065] The first group of communication test scenarios, the second group of communication test scenarios and the third group of communication test scenarios are added to the first seed communication test scenario group. Based on the first seed communication test scenario group, it is possible to simulate the communication conditions of different communication modes corresponding to the first communication test seeds based on adjusting the environmental characteristic indicators, thereby providing a technical effect of highly restored adjustable communication scenarios for subsequent communication tests.

[0066] A400: testing the first communication test seeds respectively according to the first seed communication test scenario group to obtain multiple communication test monitoring data sets;

[0067] A500: performing standardization processing according to the plurality of communication test monitoring data sets to obtain a plurality of communication test monitoring standard groups;

[0068] Specifically, in this embodiment, first test data of a first communication test seed is obtained interactively, and communication transmission tests are performed on the first test data of the first communication test seed respectively according to the first seed communication test scenario group to obtain multiple communication test monitoring data sets.

[0069] Standardization processing is performed on multiple communication test monitoring data sets, and communication test scenarios corresponding to communication test monitoring data with missing data are supplemented and recorded to obtain multiple communication test monitoring standard groups, wherein the multiple communication test monitoring standard groups specifically include a first communication test monitoring standard group, a second communication test monitoring standard group, and a third communication test monitoring standard group, and the first communication test monitoring standard group, the second communication test monitoring standard group, and the third communication test monitoring standard group are mapped to the first group of communication test scenarios, the second group of communication test scenarios, and the third group of communication test scenarios.

[0070] Each communication test monitoring standard data corresponds to a communication test scenario, and the data structure of each communication test monitoring standard data includes reference data for evaluating communication efficiency, including the timestamps of the start and end of the communication, the data transmission duration, and the idle time during the communication process; reference data for evaluating effective communication throughput, including the number of successfully transmitted data packets, the number of lost data packets, and the data transmission rate; reference data for evaluating communication bit error rate, including the number of received error data packets, the number of error check codes, and the number of retransmissions; reference data for evaluating communication delay, including the data transmission sending time and the data transmission receiving time.

[0071] A600: Perform multi-degree-of-freedom analysis on the multiple communication test monitoring standard groups according to the communication performance characteristics to obtain a first seed communication test report.

[0072] In one embodiment, a multi-degree-of-freedom analysis is performed on the plurality of communication test monitoring standard groups according to the communication performance characteristic combing channel to obtain a first seed communication test report. Step A600 of the method provided by the present invention further includes:

[0073] A610: inputting the plurality of communication test monitoring standard groups into a communication performance feature combing channel to obtain a plurality of communication performance feature combing results;

[0074] A620: performing a communication configuration feature correlation comparison according to the plurality of communication performance feature combing results to obtain a configuration-correlated communication performance comparison result;

[0075] A630: performing a correlation comparison of communication environment characteristics according to the plurality of communication performance characteristic combing results to obtain an environment-correlated communication performance comparison result;

[0076] A640: performing a communication task feature correlation comparison according to the plurality of communication performance feature combing results to obtain a task-correlated communication performance comparison result;

[0077] A650: Integrate the multiple communication performance feature sorting results, the configuration-related communication performance comparison results, the environment-related communication performance comparison results and the task-related communication performance comparison results to generate a first seed communication test report.

[0078] In one embodiment, the plurality of communication test monitoring standard groups are input into a communication performance feature combing channel to obtain a plurality of communication performance feature combing results. Step A610 of the method provided by the present invention further includes:

[0079] A611: extracting a first communication test monitoring standard group according to the plurality of communication test monitoring standard groups;

[0080] A612: a communication performance feature combing channel, including a multi-degree-of-freedom communication performance analysis channel and a comprehensive communication performance analysis channel, wherein the multi-degree-of-freedom communication performance analysis channel includes a communication efficiency evaluation channel, a communication effective throughput evaluation channel, a communication error evaluation channel, and a communication delay evaluation channel;

[0081] A613: inputting the first communication test monitoring standard group into the multi-degree-of-freedom communication performance analysis channel to obtain a first communication test analysis result, wherein the first communication test analysis result includes a first communication efficiency evaluation coefficient, a first communication effective throughput evaluation coefficient, a first communication error evaluation coefficient, and a first communication delay evaluation coefficient;

[0082] A614: Inputting the first communication test analysis result into the comprehensive communication performance analysis channel to obtain a first comprehensive communication performance coefficient;

[0083] A615: Generate a first communication performance feature combing result based on the first communication test analysis result and the first comprehensive communication performance coefficient, and add the first communication performance feature combing result to multiple communication performance feature combing results.

[0084] In one embodiment, the method steps provided by the present invention further include:

[0085] A6121: The comprehensive communication performance analysis channel includes a comprehensive communication performance analysis function, and the comprehensive communication performance analysis function is:

[0086]

[0087] Among them, LCP represents the comprehensive communication performance coefficient, CPA represents the communication efficiency evaluation coefficient, CPB represents the communication effective throughput evaluation coefficient, CPC represents the communication bit error evaluation coefficient, CPD represents the communication delay evaluation coefficient, PAW, PBW, PCW, and PDW are predetermined weighted constraints, and the sum of PAW, PBW, PCW, and PDW is 1.

[0088] Specifically, in this embodiment, a communication performance feature combing channel is pre-constructed, and the communication performance feature combing channel includes a multi-degree-of-freedom communication performance analysis channel and a comprehensive communication performance analysis channel. The multi-degree-of-freedom communication performance analysis channel includes a communication efficiency evaluation channel, a communication effective throughput evaluation channel, a communication error evaluation channel and a communication delay evaluation channel.

[0089] The communication efficiency evaluation channel can evaluate the communication efficiency according to the communication start and end timestamps, data transmission duration, and idle time during the communication process in the communication test monitoring standard data obtained from the unspecified communication test scenario test.

[0090] The communication effective throughput evaluation channel can evaluate the communication effective throughput according to the number of successfully transmitted data packets, the number of lost data packets and the data transmission rate in the communication test monitoring standard data obtained by testing the unspecified communication test scenario.

[0091] The communication error code assessment channel can perform communication error code assessment based on the number of received error data packets, the number of error check codes and the number of retransmissions in the communication test monitoring standard data obtained from the unspecified communication test scenario test.

[0092] The communication delay evaluation channel can perform communication delay evaluation based on the data transmission sending time and data transmission receiving time in the communication test monitoring standard data obtained by testing the unspecified communication test scenario.

[0093] This embodiment constructs a communication efficiency evaluation channel, a communication effective throughput evaluation channel, a communication error evaluation channel, and a communication delay evaluation channel based on a back propagation neural network, and then performs sample data call according to the evaluation reference data composition and evaluation results of each evaluation channel. Based on the sample data, the conventional training method of the back propagation neural network is used to optimize the evaluation accuracy of the communication efficiency evaluation channel, the communication effective throughput evaluation channel, the communication error evaluation channel, and the communication delay evaluation channel. The communication efficiency evaluation channel, the communication effective throughput evaluation channel, the communication error evaluation channel, and the communication delay evaluation channel are connected in parallel to complete the construction of a multi-degree-of-freedom communication performance analysis channel.

[0094] At the same time, the output ends of the communication efficiency evaluation channel, the communication effective throughput evaluation channel, the communication error evaluation channel and the communication delay evaluation channel in the multi-degree-of-freedom communication performance analysis channel are all connected to the input end of the comprehensive communication performance analysis channel.

[0095] The function of the comprehensive communication performance analysis channel is summation calculation. The comprehensive communication performance analysis channel includes a comprehensive communication performance analysis function. The comprehensive communication performance analysis function is:

[0096]

[0097] Among them, LCP represents the comprehensive communication performance coefficient, CPA represents the communication efficiency evaluation coefficient, CPB represents the communication effective throughput evaluation coefficient, CPC represents the communication bit error evaluation coefficient, CPD represents the communication delay evaluation coefficient, PAW, PBW, PCW, and PDW are predetermined weighted constraints, and the sum of PAW, PBW, PCW, and PDW is 1.

[0098] The first communication test monitoring standard data is randomly called from the first communication test monitoring standard group, and the first communication test monitoring standard data is split according to the evaluation reference data requirements of each evaluation channel, and the split result is synchronized to the multi-degree-of-freedom communication performance analysis channel to obtain the first communication efficiency alternative coefficient, the first communication effective throughput alternative coefficient, the first communication bit error alternative coefficient and the first communication delay alternative coefficient.

[0099] By analogy, multiple communication test monitoring standard data of the first communication test monitoring standard group are split and synchronized to the multi-degree-of-freedom communication performance analysis channel to obtain multiple first communication efficiency alternative coefficients, multiple first communication effective throughput alternative coefficients, multiple first communication error alternative coefficients and multiple first communication delay alternative coefficients.

[0100] The first communication test analysis result is formed by calculating the mean of multiple first communication efficiency candidate coefficients, multiple first communication effective throughput candidate coefficients, multiple first communication bit error candidate coefficients, and multiple first communication delay candidate coefficients to obtain a first communication efficiency evaluation coefficient, a first communication effective throughput evaluation coefficient, a first communication bit error evaluation coefficient, and a first communication delay evaluation coefficient, and inputting the first communication test analysis result into the comprehensive communication performance analysis channel to obtain a first comprehensive communication performance coefficient.

[0101] The first communication test analysis result and the first comprehensive communication performance coefficient constitute a first communication performance feature sorting result.

[0102] The first communication performance feature combing result is added to the plurality of communication performance feature combing results. Similarly, the plurality of communication performance feature combing results are obtained based on the analysis of the plurality of communication test monitoring standard groups.

[0103] It should be understood that the first communication test monitoring standard group is known to be mapped to the first group of communication test scenarios, and each communication test scenario in the first group of communication test scenarios uses the communication configuration as the first scenario to construct dynamic variables, and uses the communication environment and the communication task as the first scenario to construct fixed variables.

[0104] Therefore, this embodiment obtains the first communication performance feature combing result by mapping and calling the plurality of communication performance feature combing results based on the communication configuration.

[0105] A four-dimensional space coordinate system is constructed, wherein the dimensions of the four-dimensional space coordinate system include a communication efficiency dimension, a communication effective throughput dimension, and a communication error dimension. Multiple groups of first communication efficiency candidate coefficients, first communication effective throughput candidate coefficients, first communication error candidate coefficients, and first communication delay candidate coefficients obtained by analyzing multiple communication test monitoring standard data through the multi-degree-of-freedom communication performance analysis channel are positioned in the four-dimensional space coordinate system to obtain multiple spatial scatter points, and a central tendency evaluation is performed on the multiple spatial scatter points to obtain spatial median scatter points, and then reverse calls are made to obtain the first communication efficiency median, the first communication effective throughput median, the first communication error median, and the first communication delay median corresponding to the spatial median scatter points.

[0106] Substitute the first communication efficiency median, the first communication effective throughput median, the first communication bit error median and the first communication delay median into the comprehensive communication performance analysis function to calculate and obtain the first comprehensive communication performance median.

[0107] Calculate the data deviation between the first comprehensive communication performance median and the first communication performance feature combing result, complete the communication configuration feature correlation comparison, and obtain the data deviation as the configuration-correlated communication performance comparison result.

[0108] By analogy, a communication environment feature correlation comparison is performed based on the results of sorting out the multiple communication performance features to obtain an environment-correlated communication performance comparison result; a communication task feature correlation comparison is performed based on the results of sorting out the multiple communication performance features to obtain a task-correlated communication performance comparison result.

[0109] The plurality of communication performance feature combing results, the configuration-related communication performance comparison results, the environment-related communication performance comparison results and the task-related communication performance comparison results are integrated as the first seed communication test report.

[0110] This embodiment achieves the technical effect of scientifically and rapidly quantifying and evaluating the communication performance of unspecified communication methods, and providing a highly available communication test report for subsequent users to select a communication method based on communication needs.

[0111] Embodiment 2

[0112] Based on the same inventive concept as the dual-mode communication comprehensive test method in the aforementioned embodiment, Figure 3 As shown, the present invention provides a dual-mode communication comprehensive test system, wherein the system comprises:

[0113] A test population receiving module 1 is used to receive a communication test population according to a dual-mode communication test management channel, wherein the communication test population includes a plurality of communication test seeds;

[0114] A test seed extraction module 2, configured to extract a first communication test seed according to the communication test population, wherein the first communication test seed is any one communication test seed in the communication test population;

[0115] A test scenario construction module 3, configured to construct a multi-feature communication test scenario according to the first communication test seed, and generate a first seed communication test scenario group that meets a predetermined test scenario capacity constraint;

[0116] A communication test execution module 4 is used to test the first communication test seeds respectively according to the first seed communication test scenario group to obtain multiple communication test monitoring data sets;

[0117] A data processing execution module 5, configured to perform standardization processing according to the plurality of communication test monitoring data sets to obtain a plurality of communication test monitoring standard groups;

[0118] The test report output module 6 is used to perform multi-degree-of-freedom analysis on the multiple communication test monitoring standard groups according to the communication performance characteristics combing channels to obtain a first seed communication test report.

[0119] In one embodiment, the test scenario construction module 3 further includes:

[0120] Obtaining multiple communication scenario characteristic indicators, wherein the multiple communication scenario characteristic indicators include communication configuration, communication environment and communication task;

[0121] Perform communication record backtracking on the first communication test seed according to the multi-communication scenario characteristic index to generate a multi-communication scenario characteristic wide area;

[0122] Divide the predetermined test scenario capacity constraints into three parts according to the predetermined capacity ratio to obtain a first group of test scenario capacity constraints, a second group of test scenario capacity constraints and a third group of test scenario capacity constraints;

[0123] Based on the first group of test scenario capacity constraints, the second group of test scenario capacity constraints and the third group of test scenario capacity constraints, constructing a first group of communication test scenarios, a second group of communication test scenarios and a third group of communication test scenarios according to the multi-communication scenario feature wide area;

[0124] The first group of communication test scenarios, the second group of communication test scenarios, and the third group of communication test scenarios are added to a first seed communication test scenario group.

[0125] In one embodiment, the test scenario construction module 3 further includes:

[0126] Perform communication record backtracking on the first communication test seed according to the multi-communication scenario characteristic indicators to obtain a first seed communication scenario characteristic record set;

[0127] Perform data cleaning according to the first sub-communication scenario feature record set to obtain a first sub-communication scenario standard record set;

[0128] Performing sample partitioning on the first seed communication scenario standard record set according to the multi-communication scenario characteristic index to obtain a plurality of communication scenario characteristic sample partitions;

[0129] Drawing a plurality of communication scenario feature sample graphs according to the plurality of communication scenario feature sample partitions;

[0130] Performing a central tendency analysis according to the plurality of communication scenario feature sample graphs to obtain a plurality of communication scenario feature central domains;

[0131] The plurality of communication scenario feature concentrated domains are added to the multi-communication scenario feature wide domain.

[0132] In one embodiment, the test scenario construction module 3 further includes:

[0133] constructing dynamic variables for the first scenario using the communication configuration, and constructing fixed variables for the first scenario using the communication environment and the communication task;

[0134] Constructing dynamic variables based on the first scenario and constructing fixed variables based on the first scenario, performing test scenario parameter modulation according to the multi-communication scenario feature wide area, and establishing a first group of communication test scenarios that meet the first group of test scenario capacity constraints;

[0135] constructing dynamic variables with the communication environment as the second scenario, and constructing fixed variables with the communication configuration and the communication task as the second scenario;

[0136] Constructing dynamic variables based on the second scenario and constructing fixed variables based on the second scenario, performing test scenario parameter modulation according to the multi-communication scenario feature wide area, and establishing a second group of communication test scenarios that meet the second group of test scenario capacity constraints;

[0137] constructing dynamic variables with the communication task as the third scenario, and constructing fixed variables with the communication configuration and the communication environment as the third scenario;

[0138] Based on the dynamic variables constructed by the third scenario and the fixed variables constructed by the third scenario, the test scenario parameters are modulated according to the wide area of ​​the multi-communication scenario characteristics to establish a third group of communication test scenarios that meet the capacity constraints of the third group of test scenarios.

[0139] In one embodiment, the test report output module 6 further includes:

[0140] Inputting the plurality of communication test monitoring standard groups into a communication performance feature combing channel to obtain a plurality of communication performance feature combing results;

[0141] Performing a correlation comparison of communication configuration features according to the plurality of communication performance feature combing results to obtain a configuration-correlated communication performance comparison result;

[0142] Performing a correlation comparison of communication environment characteristics according to the plurality of communication performance characteristic sorting results to obtain an environment-correlated communication performance comparison result;

[0143] Performing a correlation comparison of communication task features according to the plurality of communication performance feature combing results to obtain a task-correlated communication performance comparison result;

[0144] The plurality of communication performance feature combing results, the configuration-related communication performance comparison results, the environment-related communication performance comparison results and the task-related communication performance comparison results are integrated to generate a first seed communication test report.

[0145] In one embodiment, the test report output module 6 further includes:

[0146] extracting a first communication test monitoring standard group according to the plurality of communication test monitoring standard groups;

[0147] A communication performance feature combing channel, including a multi-degree-of-freedom communication performance analysis channel and a comprehensive communication performance analysis channel, wherein the multi-degree-of-freedom communication performance analysis channel includes a communication efficiency evaluation channel, a communication effective throughput evaluation channel, a communication error evaluation channel, and a communication delay evaluation channel;

[0148] Inputting the first communication test monitoring standard group into the multi-degree-of-freedom communication performance analysis channel to obtain a first communication test analysis result, wherein the first communication test analysis result includes a first communication efficiency evaluation coefficient, a first communication effective throughput evaluation coefficient, a first communication error evaluation coefficient, and a first communication delay evaluation coefficient;

[0149] Inputting the first communication test analysis result into the comprehensive communication performance analysis channel to obtain a first comprehensive communication performance coefficient;

[0150] A first communication performance feature combing result is generated according to the first communication test analysis result and the first comprehensive communication performance coefficient, and the first communication performance feature combing result is added to a plurality of communication performance feature combing results.

[0151] In one embodiment, the test report output module 6 further includes:

[0152] The comprehensive communication performance analysis channel includes a comprehensive communication performance analysis function, and the comprehensive communication performance analysis function is:

[0153]

[0154] Among them, LCP represents the comprehensive communication performance coefficient, CPA represents the communication efficiency evaluation coefficient, CPB represents the communication effective throughput evaluation coefficient, CPC represents the communication bit error evaluation coefficient, CPD represents the communication delay evaluation coefficient, PAW, PBW, PCW, and PDW are predetermined weighted constraints, and the sum of PAW, PBW, PCW, and PDW is 1.

[0155] Any of the methods or steps described above may be stored as computer instructions or programs in various types of computer memories, and the computer instructions or programs may be recognized by various types of computer processors to implement any of the methods or steps described above.

[0156] Based on the above specific embodiments of the present invention, any improvements and modifications made to the present invention by those skilled in the art without departing from the principles of the present invention shall fall within the patent protection scope of the present invention.

Claims

1. A dual-mode communication comprehensive test method, characterized in that: The method comprises: According to the dual-mode communication test management channel, receiving a communication test population, wherein the communication test population includes a plurality of communication test seeds; Extracting a first communication test seed according to the communication test population, wherein the first communication test seed is any one communication test seed in the communication test population; Constructing a multi-feature communication test scenario according to the first communication test seed to generate a first seed communication test scenario group that meets a predetermined test scenario capacity constraint; Testing the first communication test seeds respectively according to the first seed communication test scenario group to obtain multiple communication test monitoring data sets; Performing standardization processing on the plurality of communication test monitoring data sets to obtain a plurality of communication test monitoring standard groups; The channels are combed according to the communication performance characteristics to perform multi-degree-of-freedom analysis on the multiple communication test monitoring standard groups to obtain a first seed communication test report.

2. The method according to claim 1, characterized in that Constructing a multi-feature communication test scenario according to the first communication test seed to generate a first seed communication test scenario group that meets a predetermined test scenario capacity constraint, including: Obtaining multiple communication scenario characteristic indicators, wherein the multiple communication scenario characteristic indicators include communication configuration, communication environment and communication task; Perform communication record backtracking on the first communication test seed according to the multi-communication scenario characteristic index to generate a multi-communication scenario characteristic wide area; Divide the predetermined test scenario capacity constraints into three parts according to the predetermined capacity ratio to obtain a first group of test scenario capacity constraints, a second group of test scenario capacity constraints and a third group of test scenario capacity constraints; Based on the first group of test scenario capacity constraints, the second group of test scenario capacity constraints and the third group of test scenario capacity constraints, constructing a first group of communication test scenarios, a second group of communication test scenarios and a third group of communication test scenarios according to the multi-communication scenario feature wide area; The first group of communication test scenarios, the second group of communication test scenarios, and the third group of communication test scenarios are added to a first seed communication test scenario group.

3. The method according to claim 2, characterized in that The communication record of the first communication test seed is traced back according to the multi-communication scenario characteristic index to generate a multi-communication scenario characteristic wide area, including: Perform communication record backtracking on the first communication test seed according to the multi-communication scenario characteristic indicators to obtain a first seed communication scenario characteristic record set; Perform data cleaning according to the first sub-communication scenario feature record set to obtain a first sub-communication scenario standard record set; Performing sample partitioning on the first seed communication scenario standard record set according to the multi-communication scenario characteristic index to obtain a plurality of communication scenario characteristic sample partitions; Drawing a plurality of communication scenario feature sample graphs according to the plurality of communication scenario feature sample partitions; Performing a central tendency analysis according to the plurality of communication scenario feature sample graphs to obtain a plurality of communication scenario feature central domains; The plurality of communication scenario feature concentrated domains are added to the multi-communication scenario feature wide domain.

4. The method according to claim 2, characterized in that Based on the first group of test scenario capacity constraints, the second group of test scenario capacity constraints and the third group of test scenario capacity constraints, and according to the multi-communication scenario feature wide area, constructing a first group of communication test scenarios, a second group of communication test scenarios and a third group of communication test scenarios, including: constructing dynamic variables for the first scenario using the communication configuration, and constructing fixed variables for the first scenario using the communication environment and the communication task; Constructing dynamic variables based on the first scenario and constructing fixed variables based on the first scenario, performing test scenario parameter modulation according to the multi-communication scenario feature wide area, and establishing a first group of communication test scenarios that meet the first group of test scenario capacity constraints; constructing dynamic variables with the communication environment as the second scenario, and constructing fixed variables with the communication configuration and the communication task as the second scenario; Constructing dynamic variables based on the second scenario and constructing fixed variables based on the second scenario, performing test scenario parameter modulation according to the multi-communication scenario feature wide area, and establishing a second group of communication test scenarios that meet the second group of test scenario capacity constraints; constructing dynamic variables with the communication task as the third scenario, and constructing fixed variables with the communication configuration and the communication environment as the third scenario; Based on the dynamic variables constructed by the third scenario and the fixed variables constructed by the third scenario, the test scenario parameters are modulated according to the wide area of ​​the multi-communication scenario characteristics to establish a third group of communication test scenarios that meet the capacity constraints of the third group of test scenarios.

5. The method according to claim 1, characterized in that The channels are combed according to the communication performance characteristics to perform multi-degree-of-freedom analysis on the multiple communication test monitoring standard groups to obtain a first seed communication test report, including: Inputting the plurality of communication test monitoring standard groups into a communication performance feature combing channel to obtain a plurality of communication performance feature combing results; Performing a correlation comparison of communication configuration features according to the plurality of communication performance feature combing results to obtain a configuration-correlated communication performance comparison result; Performing a correlation comparison of communication environment characteristics according to the plurality of communication performance characteristic sorting results to obtain an environment-correlated communication performance comparison result; Performing a correlation comparison of communication task features according to the plurality of communication performance feature combing results to obtain a task-correlated communication performance comparison result; The plurality of communication performance feature combing results, the configuration-related communication performance comparison results, the environment-related communication performance comparison results and the task-related communication performance comparison results are integrated to generate a first seed communication test report.

6. The method according to claim 5, characterized in that Inputting the plurality of communication test monitoring standard groups into the communication performance feature combing channel to obtain a plurality of communication performance feature combing results, including: extracting a first communication test monitoring standard group according to the plurality of communication test monitoring standard groups; A communication performance feature combing channel, including a multi-degree-of-freedom communication performance analysis channel and a comprehensive communication performance analysis channel, wherein the multi-degree-of-freedom communication performance analysis channel includes a communication efficiency evaluation channel, a communication effective throughput evaluation channel, a communication error evaluation channel, and a communication delay evaluation channel; Inputting the first communication test monitoring standard group into the multi-degree-of-freedom communication performance analysis channel to obtain a first communication test analysis result, wherein the first communication test analysis result includes a first communication efficiency evaluation coefficient, a first communication effective throughput evaluation coefficient, a first communication error evaluation coefficient, and a first communication delay evaluation coefficient; Inputting the first communication test analysis result into the comprehensive communication performance analysis channel to obtain a first comprehensive communication performance coefficient; A first communication performance feature combing result is generated according to the first communication test analysis result and the first comprehensive communication performance coefficient, and the first communication performance feature combing result is added to a plurality of communication performance feature combing results.

7. The method according to claim 6, characterized in that The comprehensive communication performance analysis channel includes a comprehensive communication performance analysis function, and the comprehensive communication performance analysis function is: Among them, LCP represents the comprehensive communication performance coefficient, CPA represents the communication efficiency evaluation coefficient, CPB represents the communication effective throughput evaluation coefficient, CPC represents the communication bit error evaluation coefficient, CPD represents the communication delay evaluation coefficient, PAW, PBW, PCW, and PDW are predetermined weighted constraints, and the sum of PAW, PBW, PCW, and PDW is 1.

8. A dual-mode communication comprehensive test system, characterized in that: include: A test population receiving module, used for receiving a communication test population according to a dual-mode communication test management channel, wherein the communication test population includes a plurality of communication test seeds; A test seed extraction module, configured to extract a first communication test seed according to the communication test population, wherein the first communication test seed is any one communication test seed in the communication test population; A test scenario construction module, configured to construct a multi-feature communication test scenario according to the first communication test seed, and generate a first seed communication test scenario group that meets a predetermined test scenario capacity constraint; A communication test execution module, configured to test the first communication test seeds respectively according to the first seed communication test scenario group to obtain multiple communication test monitoring data sets; A data processing execution module, used for performing standardization processing according to the plurality of communication test monitoring data sets to obtain a plurality of communication test monitoring standard groups; The test report output module is used to perform multi-degree-of-freedom analysis on the multiple communication test monitoring standard groups according to the communication performance characteristics combing channels to obtain a first seed communication test report.

9. The dual-mode communication comprehensive test system according to claim 8, characterized in that: The test scenario building module includes: Obtaining multiple communication scenario characteristic indicators, wherein the multiple communication scenario characteristic indicators include communication configuration, communication environment and communication task; Perform communication record backtracking on the first communication test seed according to the multi-communication scenario characteristic index to generate a multi-communication scenario characteristic wide area; Divide the predetermined test scenario capacity constraints into three parts according to the predetermined capacity ratio to obtain a first group of test scenario capacity constraints, a second group of test scenario capacity constraints and a third group of test scenario capacity constraints; Based on the first group of test scenario capacity constraints, the second group of test scenario capacity constraints and the third group of test scenario capacity constraints, constructing a first group of communication test scenarios, a second group of communication test scenarios and a third group of communication test scenarios according to the multi-communication scenario feature wide area; The first group of communication test scenarios, the second group of communication test scenarios, and the third group of communication test scenarios are added to a first seed communication test scenario group.

10. The dual-mode communication comprehensive test system according to claim 8, characterized in that: The test report output module includes: Inputting the plurality of communication test monitoring standard groups into a communication performance feature combing channel to obtain a plurality of communication performance feature combing results; Performing a correlation comparison of communication configuration features according to the plurality of communication performance feature combing results to obtain a configuration-correlated communication performance comparison result; Performing a correlation comparison of communication environment characteristics according to the plurality of communication performance characteristic sorting results to obtain an environment-correlated communication performance comparison result; Performing a correlation comparison of communication task features according to the plurality of communication performance feature combing results to obtain a task-correlated communication performance comparison result; The plurality of communication performance feature combing results, the configuration-related communication performance comparison results, the environment-related communication performance comparison results and the task-related communication performance comparison results are integrated to generate a first seed communication test report.

Images