Protocol consistency test system and method for vehicle-road cloud integrated platform

Abstract

The invention provides a protocol conformance test system and method for a vehicle-road cloud integrated platform, and the system comprises a cloud test end, background equipment, and tested equipment. The background equipment is used for receiving the test message output by the cloud test end, analyzing the test message and sending the test message to the corresponding tested equipment; the tested equipment is used for receiving the test message output by the cloud test end, analyzing the test message and returning a return message corresponding to the test message to the cloud test end through a corresponding air interface; the cloud test end is used for matching parameters from a pre-generated parameter library according to the tested equipment and generating parameter information; and determining a parameter needing to be tested, performing parameter value processing on the parameter, and comparing a test value with a corresponding expected value to obtain a corresponding consistency test result. The method is not influenced by a test site, supports large-scale concurrent test and time accuracy test, improves the test efficiency and accuracy, and reduces the safety risk and cost of road test.

Description

Technical Field

[0001] The present invention relates to the technical field of power system automation, and in particular to a protocol consistency testing system and method for a vehicle-road-cloud integrated platform. Background Art

[0002] The protocol consistency test and evaluation method of the vehicle-road-cloud integrated cloud control basic platform is applied in the fields of smart transportation, intelligent connected vehicles, and 5G vehicle networking, especially in the development and implementation of intelligent connected vehicle (V2X) technology, and plays an important role. The key technical areas of this test and evaluation method include: Communication protocol consistency: ensuring that the communication protocols between vehicles, roadside equipment RSU, on-board units OBU and cloud platforms comply with industry standards and achieve interoperability between devices from different manufacturers. Data exchange and processing: The test and evaluation scheme needs to verify whether the system correctly collects, processes and applies multi-source data from vehicles, road infrastructure and cloud control platforms. Security testing: Evaluate the security of data transmission to ensure the confidentiality and integrity of communication. End-side computing power evaluation: Protocol consistency testing evaluates the processing power of edge computing to ensure that it can process and respond to data from vehicles and roadside units. Cross-regional identity authentication and data interconnection and interoperability: achieve communication security and interconnection and interoperability of data transmission and reception of devices in different regions. Standardization testing: According to the relevant construction standards of vehicle-road-cloud integrated roadside equipment, standardized testing is carried out to ensure the accuracy of vehicle data collection and transmission functions. Automated testing: Testing is performed through automated test scripts to improve test efficiency while reducing the safety risks and costs of actual vehicle road testing.

[0003] In the existing technical solutions, background equipment, test equipment, and test systems are connected through UDP, and reserved interfaces are required to perform corresponding tests. The reserved interfaces will increase the size of the equipment and increase the cost. At the same time, the existing protocol consistency test is used to verify the compliance of C-V2X (Cellular-Vehicle to Everything) equipment standards, and provide C-V2X OBU (On Board Unit) / RSU (Road Side Unit) / MEC (Multi-access Edge Computing) with full protocol stack consistency testing from the access layer to the network layer, security layer, and message layer to ensure the quality of intelligent connected products. Summary of the invention

[0004] The purpose of the present invention is to propose a protocol consistency testing system and method for a vehicle-road-cloud integrated platform to solve the technical problem that traditional solutions are limited by hardware interfaces, and devices with interfaces can be tested indoors but devices without hardware interfaces cannot be tested.

[0005] On the one hand, a protocol consistency test method for a vehicle-road-cloud integrated platform is provided, comprising:

[0006] A cloud test terminal, a background device and a device under test; the cloud test terminal is respectively connected to the background device and the device under test for communication;

[0007] The background device is used to receive the test message output by the cloud test end, parse the test message and send it to the corresponding device under test, and send the return message corresponding to the test message back to the cloud test end through the corresponding air interface;

[0008] The device under test is used to receive the test message output by the cloud test end, parse the test message, and return a return message corresponding to the test message to the cloud test end through the corresponding air interface;

[0009] The cloud test end is used to match parameters from a pre-generated parameter library according to the device under test to generate parameter information; and determine the parameters to be tested according to the input selection instructions, perform parameter value processing on the parameters, and obtain corresponding test values; compare the test values ​​with the corresponding expected values ​​to obtain corresponding consistency test results.

[0010] Preferably, the cloud test end includes a test module, which is used to input a corresponding selection instruction and perform a corresponding test action according to the selection instruction, wherein the test action at least includes determining a parameter to be tested and performing parameter value processing on the parameter, and obtaining a corresponding consistency test result;

[0011] The database is used to pre-store the selected step types, step analysis items and corresponding operation information, and pre-configured control parameters, configuration preset values, message templates and verification rules, as well as pre-stored parameters in the protocol consistency when performing dynamic parameter configuration.

[0012] Preferably, the test module is also used to obtain the timestamp of the message sent by the background device when the test device receives it, and determine the corresponding transmission speed and delay accuracy based on the timestamp, and determine the protocol compliance of the test device;

[0013] When testing the device protocol compliance, determine the timestamp of the message sent by the device under test and the cloud test termination message based on the transmission speed, and calculate the corresponding timestamp average through multiple messages;

[0014] If the timestamp mean is less than the preset time threshold and the delay accuracy meets the preset accuracy threshold, the message content is parsed.

[0015] Preferably, the test module is also used to, when parsing the message content, convert the message protocol data format into a preset format and then parse it, and compare the content of the parsed test value with the content of the preset expected value. If they are consistent, the consistency test result is determined to be passed.

[0016] On the other hand, a protocol consistency test method for a vehicle-road-cloud integrated platform is also provided, which is implemented by the protocol consistency test system for the vehicle-road-cloud integrated platform, including:

[0017] Determine the corresponding test equipment information according to the input test instruction, and match parameters from a pre-generated parameter library according to the test equipment information to generate parameter information;

[0018] Determine the parameters to be tested from the parameter information according to the input selection instruction, perform parameter value processing on the parameters, and obtain corresponding test values;

[0019] Compare the test value with the corresponding expected value to obtain the corresponding consistency test result.

[0020] Preferably, the method further includes obtaining a timestamp when the test device receives a message sent by the background device, and determining a corresponding transmission speed and delay accuracy based on the timestamp, and determining the protocol compliance of the test device.

[0021] Preferably, it also includes, when testing the device protocol compliance, determining the time when the device under test sends the message and the timestamp of the cloud test termination message according to the transmission speed, and calculating the corresponding timestamp average through multiple messages;

[0022] If the timestamp mean is less than the preset time threshold and the delay accuracy meets the preset accuracy threshold, the message content is parsed.

[0023] Preferably, obtaining the corresponding consistency test result includes converting the message protocol data format into a preset format and then parsing it, and comparing the content of the parsed test value with the content of the preset expected value. If they are consistent, the consistency test result is determined to be passed.

[0024] In summary, the implementation of the embodiments of the present invention has the following beneficial effects:

[0025] The protocol consistency testing system and method for the vehicle-road-cloud integrated platform provided by the present invention are not affected by the test location and can be tested within the range of background equipment on the outdoor roadside. At the same time, they support large-scale concurrent testing, and the results obtained from time accuracy tests are more accurate and reliable. Tests can be performed through automated test scripts, which improves the efficiency and accuracy of the tests and reduces the safety risks and costs of road tests on real vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, without paying creative labor, other drawings obtained based on these drawings still belong to the scope of the present invention.

[0027] Figure 1 Schematic diagram of a protocol consistency testing system for a vehicle-road-cloud integrated platform in an embodiment of the present invention.

[0028] Figure 2 Schematic diagram of the execution of the protocol consistency testing method in an embodiment of the present invention.

[0029] Figure 3 This is a schematic diagram of the main process of a protocol consistency testing method for a vehicle-road-cloud integrated platform in an embodiment of the present invention. DETAILED DESCRIPTION

[0030] In order to make the objectives, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings.

[0031] like Figure 1 FIG. 1 is a schematic diagram of an embodiment of a protocol consistency test system for a vehicle-road-cloud integrated platform provided by the present invention. In this embodiment, it includes:

[0032] A cloud test terminal, a background device and a device under test; the cloud test terminal is communicatively connected with the background device and the device under test respectively; the background device is used to receive the test message output by the cloud test terminal, parse the test message to the corresponding device under test, and transmit the return message corresponding to the test message to the cloud test terminal through the corresponding air interface; the device under test is used to receive the test message output by the cloud test terminal, parse the test message to the corresponding other device, and transmit the return message corresponding to the test message to the cloud test terminal through the corresponding air interface; the cloud test terminal is used to match parameters from a pre-generated parameter library according to the device under test to generate parameter information; and determine the parameters to be tested according to the input selection instruction, perform parameter value processing on the parameters, and obtain the corresponding test value; compare the test value with the corresponding expected value to obtain the corresponding consistency test result. Understandably, automatically match parameters according to the selected equipment and generate parameter information; select the parameters to be tested, process the parameters, generate valid parameter values, critical values, invalid values ​​according to expected values ​​and parameter strategies, combined with dynamic random numbers, store them in the parameter values, and generate parameters; communicate with the test equipment according to the use case parameters and test steps; when executing, the system will implement the use case and output the results according to the configuration. Figure 2 As shown. Based on the test progress and real-time feedback, the dynamic adjustment engine will periodically or trigger the current test status, and automatically calculate and update the parameter values ​​according to the preset dependencies and conditional logic. The main hardware and software information includes background equipment (equipment that simulates the real environment in the test environment, such as simulated vehicles, roadside units RSU, OBU and other equipment, to help evaluate the performance and protocol consistency of the main tested equipment), test equipment, test system and data storage server.

[0033] In one embodiment, the cloud test terminal includes a test module for inputting a corresponding selection instruction and executing a corresponding test action according to the selection instruction, wherein the test action at least includes determining the parameters to be tested and performing parameter value processing on the parameters, and obtaining the corresponding consistency test results; a database for pre-storing the selected step type, step analysis items and corresponding operation information, and pre-configured control parameters, configuration preset values, message templates and verification rules, and pre-stored parameters in the protocol consistency when performing dynamic parameter configuration. It is understandable that the programs involved in protocol consistency mainly include background device programs, test device programs and test system programs, which are implemented by EMQX before each device to ensure normal outdoor testing. Since the number of use cases is very large, the protocols of the message layer, network layer, and security layer are inconsistent, so the dynamic configuration and implementation of use cases become very complicated. Use case visual configuration, select step type and step analysis to display corresponding operation information, configure control parameters (startDsmTx / startDsmRx / startSpduTx / startSpduRx / startMsgRx / startMsgTx), configure preset values ​​(mibInfo / DSM / SPDU / RSI / RSM / MAP / BSM / rsmInfo), message templates and verification rules (DSM / Indication / SPDU / BSM / DSM / RSI / RSM), select the use case configuration that needs verification, and when performing dynamic parameter configuration, prepare the parameters in the protocol consistency first to form a database parameter library.

[0034] In a specific embodiment, the test module is also used to obtain the timestamp of the message sent by the background device received by the test device, and the timestamp determines the corresponding transmission speed and delay accuracy, and determines the protocol compliance of the test device; when the protocol compliance of the test device is determined, the time when the device under test sends the message and the timestamp of the cloud test termination message are determined according to the transmission speed, and the corresponding timestamp average is calculated through multiple messages; if the timestamp average is less than the preset time threshold and the delay accuracy meets the preset accuracy threshold, the message content is parsed. When parsing the message content, the message protocol data format is converted into a preset format and then parsed, and the content of the parsed test value is compared with the content of the preset expected value. If they are consistent, the consistency test result is determined to be passed. It can be understood that various types of equipment in the test field, including RSU, OBU, and MEC equipment, are associated with the points for management, and the information of each point and equipment is displayed in the map visualization to realize the full data storage of the background equipment and the test process of the equipment under test. Through the time and space analysis of the data, the timestamp of the message sent from the background device to the time when the test device receives the message is recorded and uploaded to the cloud platform. The transmission speed and identification time accuracy are obtained by calculating the time difference. The protocol compliance of the test equipment is determined by comparing the values ​​of the use case parameters. The transmission speed is the time difference between the time when the device sends the message and the time when the platform receives the message. The average is calculated through multiple messages to calculate whether the message meets the delay accuracy requirement of less than 10 milliseconds. When the delay accuracy requirement is met, the message content is further parsed. Since the message protocol data format is ASN.1 (Abstract Syntax Notation One), ASN.1 (Abstract Syntax Notation One) is converted into JSON (JavaScript Object Notation) format and then parsed. When the content of the expected value is consistent with the content of the expected value, it is passed. The visible test results are finally obtained through passing. The test results are intuitive and downloadable. The passed equipment can be used as the feasible access of regional equipment to ensure the timeliness and correctness of the acquisition of connected car services.

[0035] like Figure 3 As shown, an embodiment of the present invention also provides a protocol consistency testing method for a vehicle-road-cloud integrated platform, comprising:

[0036] Step S1, determine the corresponding test equipment information according to the input test instruction, and match the parameters from the pre-generated parameter library according to the test equipment information to generate parameter information; understandably, the system automatically matches the parameters according to the selected equipment to generate parameter information. Among them, the programs involving protocol consistency mainly include background equipment programs, test equipment programs and test system programs. Through EMQX, each device is implemented to ensure normal outdoor testing. Due to the large number of use cases, the protocols of the message layer, network layer, and security layer are inconsistent, so the dynamic configuration and implementation of use cases become very complicated. Use case visual configuration, select step type and step analysis to display corresponding operation information, configure control parameters (startDsmTx / startDsmRx / startSpduTx / startSpduRx / startMsgRx / startMsgTx), configure preset values ​​(mibInfo / DSM / SPDU / RSI / RSM / MAP / BSM / rsmInfo), message templates and verification rules (DSM / Indication / SPDU / BSM / DSM / RSI / RSM), select the use case configuration that needs verification, and when performing dynamic parameter configuration, prepare the parameters in the protocol consistency first to form a database parameter library.

[0037] Step S2, according to the input selection instruction, determine the parameters to be tested from the parameter information, perform parameter value processing on the parameters, and obtain the corresponding test values; understandably, select the parameters to be tested, perform parameter value processing on the parameters, generate valid parameter values, critical values, and invalid values ​​based on expected values ​​and parameter strategies, combined with dynamic random numbers, store them in the parameter values, and generate parameters. During execution, the system will implement the use case and output the results according to the configuration. The execution process is as follows Figure 2 Based on the test progress and real-time feedback, the dynamic adjustment engine will check the current test status regularly or in a triggered manner, and automatically calculate and update parameter values ​​based on preset dependencies and conditional logic.

[0038] Step S3, comparing the test value with the corresponding expected value to obtain the corresponding consistency test result.

[0039] In one embodiment, the timestamp of the message sent by the background device is obtained, and the corresponding transmission speed and delay accuracy are determined by the timestamp, and the protocol compliance of the test device is determined. That is, the time and space analysis is performed on the data, from the timestamp when the background device sends the message to the timestamp when the test device receives the message, the data is recorded and uploaded to the cloud platform, the transmission speed is obtained by calculating the time difference, the time accuracy is identified, and the protocol compliance of the test device is determined by comparing the values ​​of the use case parameters.

[0040] In one embodiment, when testing the device protocol compliance, the time when the device under test sends the message and the timestamp of the cloud test termination message are determined according to the transmission speed, and the corresponding timestamp average is calculated through multiple messages; if the timestamp average is less than the preset time threshold and the delay accuracy meets the preset accuracy threshold, the message content is parsed. The message protocol data format is converted into a preset format and then parsed, and the content of the parsed test value is compared with the content of the preset expected value. If they are consistent, the consistency test result is determined to be passed. That is, the transmission speed is calculated by calculating the time difference between the time when the device sends the message and the time when the platform receives it. The average is calculated through multiple messages to calculate whether the message meets the requirement of less than 10 milliseconds. When the delay accuracy requirement is met, the message content is further parsed. Since the message protocol data format is ASN.1 (Abstract Syntax Notation One), ASN.1 (Abstract Syntax Notation One) is converted into JSON (JavaScript Object Notation) format and then parsed. When the content of the expected value is consistent with the content of the expected value, it is passed. Finally, a visible test result is obtained. The test result is intuitive and downloadable. The passed device can be used as a feasible access device for regional equipment to ensure the timeliness and correctness of the acquisition of connected car services.

[0041] It should be noted that the system described in the above embodiment corresponds to the method described in the above embodiment. Therefore, the parts not described in detail in the above embodiment can be obtained by referring to the contents of the above embodiment and will not be repeated here.

[0042] In summary, the implementation of the embodiments of the present invention has the following beneficial effects:

[0043] The protocol consistency testing system and method for the vehicle-road-cloud integrated platform provided by the present invention are not affected by the test location and can be tested within the range of background equipment on the outdoor roadside. At the same time, they support large-scale concurrent testing, and the results obtained from time accuracy tests are more accurate and reliable. Tests can be performed through automated test scripts, which improves the efficiency and accuracy of the tests and reduces the safety risks and costs of road tests on real vehicles.

[0044] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A protocol consistency test system for a vehicle-road-cloud integrated platform, characterized in that: include: A cloud test terminal, a background device and a device under test; the cloud test terminal is respectively connected to the background device and the device under test for communication; The background device is used to receive the test message output by the cloud test end, parse the test message and send it to the corresponding device under test, and send the return message corresponding to the test message back to the cloud test end through the corresponding air interface; The device under test is used to receive the test message output by the cloud test end, parse the test message, and return a return message corresponding to the test message to the cloud test end through the corresponding air interface; The cloud test end is used to match parameters from a pre-generated parameter library according to the device under test to generate parameter information; And according to the input selection instruction, the parameters to be tested are determined, and the parameter values ​​are processed to obtain the corresponding test values; the test values ​​are compared with the corresponding expected values ​​to obtain the corresponding consistency test results.

2. The system according to claim 1, characterized in that The cloud test end includes: A test module, used for inputting a corresponding selection instruction and executing a corresponding test action according to the selection instruction, wherein the test action at least includes determining a parameter to be tested and performing parameter value processing on the parameter, and obtaining a corresponding consistency test result; The database is used to pre-store the selected step types, step analysis items and corresponding operation information, and pre-configured control parameters, configuration preset values, message templates and verification rules, as well as pre-stored parameters in the protocol consistency when performing dynamic parameter configuration.

3. The system according to claim 2, characterized in that The test module is also used to obtain the timestamp of the message sent by the background device when the test device receives it, and determine the corresponding transmission speed and delay accuracy based on the timestamp, and determine the protocol compliance of the test device; When testing the device protocol compliance, determine the timestamp of the message sent by the device under test and the cloud test termination message based on the transmission speed, and calculate the corresponding timestamp average through multiple messages; If the timestamp mean is less than the preset time threshold and the delay accuracy meets the preset accuracy threshold, the message content is parsed.

4. The system according to claim 3, characterized in that The test module is also used to convert the message protocol data format into a preset format and then parse it when parsing the message content, and compare the content of the parsed test value with the content of the preset expected value. If they are consistent, the consistency test result is determined to be passed.

5. A protocol consistency test method for a vehicle-road-cloud integrated platform, implemented by a system as described in any one of claims 1 to 4, characterized in that: include, Determine the corresponding test equipment information according to the input test instruction, and match the parameters from the pre-generated parameter library according to the test equipment information to generate parameter information; Determine the parameters to be tested from the parameter information according to the input selection instruction, perform parameter value processing on the parameters, and obtain corresponding test values; Compare the test value with the corresponding expected value to obtain the corresponding consistency test result.

6. The method according to claim 5, characterized in that It also includes obtaining the timestamp of the message sent by the background device when the test device receives it, and determining the corresponding transmission speed and delay accuracy based on the timestamp, and judging the protocol compliance of the test device.

7. The method according to claim 6, characterized in that It also includes, when testing the device protocol compliance, determining the timestamp of the time when the device under test sends the message and the cloud test termination message according to the transmission speed, and calculating the corresponding timestamp average through multiple messages; If the timestamp mean is less than the preset time threshold and the delay accuracy meets the preset accuracy threshold, the message content is parsed.

8. The method according to claim 7, characterized in that Obtaining the corresponding consistency test result includes converting the message protocol data format into a preset format and then parsing it, and comparing the content of the parsed test value with the content of the preset expected value. If they are consistent, the consistency test result is determined to be passed.

Images