A method for constructing an ARINC664 network configuration test framework

Abstract

This invention discloses a method for constructing an ARINC664 network configuration testing framework, comprising the following steps: Step 1, constructing a test topology database, which includes topology configurations between ports, monitoring devices, and routing devices under three test scenarios: single switch, single network, and dual network; Step 2, constructing test stimuli and expected results, whereby data flow stimulates the ARINC664 network under test through a terminal simulated port; the expected results are used as criteria for test cases; Step 3, constructing network application request and health monitoring functions; Step 4, constructing a configuration testing system, which is responsible for constructing and executing test case sets and generating test reports. This invention significantly reduces the time and manpower costs of configuration testing, and improves testing efficiency and convenience.

Description

Technical Field

[0001] This invention belongs to the field of ARINC664 network configuration testing, and specifically relates to a method for constructing an ARINC664 network configuration testing framework. Background Technology

[0002] The ARINC664 network is an aviation full-duplex switched Ethernet based on IEEE 802.3 Ethernet technology. Due to its high determinism, high reliability, and good transmission rate, it has become the foundation for building the next generation of civil aircraft avionics systems. As an important component of the ARINC664 network, the avionics full-duplex switched Ethernet switch connects various airborne terminal equipment. It plays the role of "bridge" and "central nervous system" in the entire IMA system and undertakes the important task of avionics data transmission.

[0003] Avionics full-duplex Ethernet switches rely on configuration for port parameter settings and data forwarding. Before avionics integration, the correctness of the configuration must be ensured. With the development of domestic avionics technology, single-switch functional testing techniques are becoming increasingly mature. However, the shortcomings of existing avionics network configuration testing techniques are listed below:

[0004] 1) Switching the test topology requires engineers to manually plug and unplug network cables. A typical ARINC664 avionics network has nearly 200 ports, and the lines are complicated. Manually switching the topology results in a waste of manpower and time.

[0005] 2) The existing network configuration test environment has introduced a large number of monitoring nodes, which increases the complexity of the test environment and causes signal attenuation.

[0006] 3) High real-time monitoring requirements; civil avionics networks have zero tolerance for packet loss, but currently there is no test architecture that can achieve real-time health monitoring of the ARINC664 avionics network.

[0007] 4) During the development of complex avionics systems, network configuration versions are iterated frequently, and testing tasks are time-sensitive; traditional testing architectures cannot meet the needs of rapid automated configuration testing.

[0008] To address the shortcomings of existing technologies, there is an urgent need for a method to construct an ARINC664 network configuration testing framework. Summary of the Invention

[0009] To address the shortcomings of the existing technology, the present invention aims to provide a method for constructing an ARINC664 network configuration test framework; a more realistic network architecture on a simulator, reducing tedious and redundant manual operations, and improving the efficiency and accuracy of avionics network configuration testing.

[0010] To achieve the above objectives, the present invention adopts the following technical solution:

[0011] A method for constructing an ARINC664 network configuration testing framework includes the following steps:

[0012] Step 1: Parse the configuration file of the network under test, obtain the configuration information of each port, and build a test topology database; wherein, the topology database includes the topology configuration between ports, monitoring devices, and routing devices under three test scenarios: single switch, single network, and dual network.

[0013] Step 2: Construct test stimuli and expected results for each link in the configuration file of the ARINC664 network under test; wherein, the test stimuli and expected results are terminal simulated data streams and output port expected results that conform to the ARINC664 protocol, generated according to the test strategy; the data stream stimulates the ARINC664 network under test through the terminal simulated port; the expected results are used as the criteria for test cases;

[0014] Step 3: Apply the function port set P to the switch mon Build network application request and health monitoring functions on top of it;

[0015] Step 4: Build a configuration test system, which is responsible for building and executing test case sets and generating test reports.

[0016] Based on the above characteristics, step one includes:

[0017] Step 101: Configuration file verification;

[0018] Step 102: Parse the configuration file to obtain the port set P of the ARINC664 network under test and the switch cascading port set P. cas Switch application function port set P mon Data stimulus port set P data ;

[0019] Step 103: Complete set of ports requiring bridging in three test scenarios: single switch, single network, and dual network. top ;

[0020] Step 104: Construct topology structures for different scenarios to form the topology management library (TOP). i .

[0021] Based on the above characteristics, the configuration file verification includes: verifying the format and semantics of the configuration file; step 103 includes: if a port meets any of the following conditions, then the port is used for topology switching:

[0022] Condition 1, p∈P data ,p∈Pmon ,

[0023] Condition 2 p∈P mon ,p∈P cas ;

[0024] Condition 3, p∈P data , p∈P cas ;

[0025] Condition 4, p∈P data ,p∈P mon ,p∈P cas ;

[0026] Use these ports to construct the complete port set P for topology switching. top =P cas ∪P mon .

[0027] Based on the above characteristics, step two includes:

[0028] Step 201: Parse the configuration file to obtain the links configured between each port, forming a port connection matrix R;

[0029] Step 202: When constructing the data incentive, a policy is applied to each VL in the port connection relationship matrix R to schedule various data streams. The policies include packet protocol error, network transmission policy and network load policy.

[0030] Step 203: Build the expected results for each data stream.

[0031] Based on the above characteristics, step three includes:

[0032] Step 301: Construct the network application request interface and the network monitoring interface;

[0033] Step 302: When configuring a single switch test, continuously call the network monitoring interface according to the cycle to obtain the health status of the switch in real time from the switch application function port of the single switch; and cyclically call the application request interface to perform application request operations on the switch from the switch application function port of the single switch according to the cycle.

[0034] Step 303: When configuring single-network testing, continuously call the monitoring interface according to the cycle to obtain the health status of all switches in real time from the application function port of the single network's switches; and cyclically call the application request interface to perform application request operations on all switches from the application function port of the single network's switches.

[0035] Based on the above characteristics, step four includes:

[0036] Step 401: Load the test case sets and expected results for the three test scenarios;

[0037] Step 402: Execute the steps expected to be performed from the user-selected test case set;

[0038] Step 403: Based on the execution process, generate the final report according to the test report template.

[0039] The advantages of this invention are:

[0040] 1. Configure the test system to execute sequentially and automatically generate test reports according to the template; greatly reduce the time and manpower costs of configuring tests and improve the efficiency and convenience of testing;

[0041] 2. This invention takes into account configuration verification to ensure the correctness of the semantics and format of the configuration under test, and avoids unnecessary fault types caused by incorrect configuration;

[0042] 3. This invention constructs a test topology library, making it simple and quick to switch between different test scenarios; it avoids engineers frequently plugging and unplugging network cables, reducing human error introduced by changes in network cable connections;

[0043] 4. The test topology constructed in this invention uses the minimum set of ports to monitor the health status of the entire network in real time.

[0044] 5. This invention generates a test case set with one click according to a pre-configured test program, supports user-defined selection of test items, and flexibly meets various testing needs;

[0045] 6. This invention executes the selected test items in an automated sequence and automatically generates test reports; it is convenient and fast, and can meet the network configuration testing needs of frequent iterations in the research and development of complex avionics systems. Attached Figure Description

[0046] Figure 1 This is a flowchart of the present invention.

[0047] Figure 2 Example: Schematic diagram of a single-switch test topology.

[0048] Figure 3 Example: Schematic diagram of single-network test topology. Detailed Implementation

[0049] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments.

[0050] like Figure 1As shown in this embodiment, an ARINC664 network configuration testing framework construction method consists of four parts: constructing a test topology database, constructing test stimuli and expected results, constructing network application request and health monitoring functions, and constructing a configuration testing system. It automatically constructs a topology configuration library based on the network configuration under test, automatically constructs test stimuli, automatically constructs application and monitoring functions, and automatically generates expected results. Based on a predetermined network configuration testing program, it generates single-switch, single-network, and multi-network configuration test case sets with one click. It supports user selection of test items, automatic sequential execution of test case sets, and generation of test reports. The specific steps of this invention are as follows:

[0051] Step 1: Construct a test topology database. This database includes topology configurations (TOPs) between ports, monitoring devices, and routing devices under three test scenarios: single switch, single network, and dual network. i This step parses the configuration file of the network under test, obtains the configuration information of each port, and builds a test topology database. It includes the following steps:

[0052] Step 101: Verify the configuration file of the ARINC664 network under test.

[0053] The verification of the configuration file of the ARINC664 network under test can be divided into format verification and content verification. Format verification is performed according to the syntax specification of XML Schema and through a verification error handler. Content verification uses an automated configuration parsing tool to parse the key parameter information in the configuration and compare it with the expected database to ensure the rationality of the content. If the configuration is unreasonable, feedback is given to modify the configuration content. Finally, the correct configuration file CONFIG is obtained.

[0054] Step 102: Parse the configuration file to obtain the port set P of the ARINC664 network under test and the switch cascading port set P. cas Switch application function port set P mon Data stimulus port set P data .

[0055] by Figure 2 Taking the network structure in the example; in this ARINC664 network, the number of switches is 4, and the switch list S = {s1,…,s} m If each switch has 24 ports, then the network port set P = {p1, ..., p2} 24 ,…,p 73 ,…,p 96}; where p1,…,p 24 For port 1 of switch, p 73 ,…,p 96This refers to port 4 of the switch. Using a tool to parse the CONFIG, extract the terminal device information (including ordinary terminals or cascaded switches) connected to each port of the switch to obtain the port terminal information list ES = {es1, ...,es}. 24 ,…,es 73 ,…,es 96}

[0056] by Figure 3 Taking the network structure in the example as an example, the four switches are connected through the P of each switch. 22 、P 23 、P 24 Cascade in pairs, based on the switch list S and the terminal information list ES, if es k If ∈S, then the corresponding port p k For cascaded ports, we obtain the cascaded port set P. cas ={p 22 ,p 23 ,p 24 ,p 46 ,p 47 ,p 48 ,p 70 ,p 71 ,p 72 ,p 94 ,p 95 ,p 96}

[0057] Based on the ARINC664 network configuration test scenario and monitoring requirements, the application command set APP = {"IMA_State", "Monitor"} is defined. "IMA_State" sends commands to the switch through the receive port, and "Monitor" sends commands through the send port p. j Obtain the switch health status; the following is an example. Figure 2 Taking the network structure in the example, this paper describes two test topologies for P. mon How to obtain:

[0058] Single switch P mon1 A search in CONFIG using "IMA_State" as the keyword revealed that the command request was located on the command receiving port p of switch 1. 24 Searching CONFIG with "Monitor" as the keyword yields the monitoring status transmission port p. 22 Single switch application function port set P mon1 ={p 22 ,p 24}

[0059] Single-network architecture P mon2A search in CONFIG using "IMA_State" as the keyword revealed that this command request originated from switch 2, which is the first entry point in the network. 25 The ARINC664 board passes through p 25 The cascading port of the switch {p 46 ,p 47 ,p 48 Send the command message to the other 3 switches in the network; use "Monitor" as the keyword to query the CONFIG database for the application's last exit point in the network, which is switch 4. 78 Other switches can be connected via cascade port P. cas Finally from switch 4's p 78 Send their respective health statuses to the monitoring equipment; Single network application function port set P mon2 ={p 25 ,p 78}

[0060] To achieve automated switching between single-switch and network topologies, this method considers the application port sets under both test topologies; therefore, the final application function port set P mon =P mon1 ∪P mon2 ={p 22 ,p 24 ,p 25 ,p 78}

[0061] Port set P consists of cascaded ports P cas Composed of an external terminal port, in Figure 2 In the ARINC664 network shown, except for the cascading port, all other ports require an external ordinary terminal; P data ={p1,…,p 96}-{p 22 ,p 23 ,p 24 ,p 46 ,p 47 ,p 48 ,p 70 ,p 71 ,p 72 ,p 94 ,p 95 ,p 96}

[0062] Step 103: Complete set of ports requiring bridging in three test scenarios: single switch, single network, and dual network. top A port can be used for topology switching if it meets any of the following conditions:

[0063] ap∈P data,p∈P mon ,

[0064] b. p∈P mon ,p∈P cas ;

[0065] cp∈P data , p∈P cas ;

[0066] dp∈P data ,p∈P mon ,p∈P cas ;

[0067] Use these ports to construct a port list P for topology switching. top =P cas ∪P mon .

[0068] Step 104: Construct the Topology Management Library (TOP) i .

[0069] In actual avionics network configuration testing, different testing strategies require monitoring the network status on different ports, and the tools used are also quite diverse, including ARINC664 boards, Wireshark software and loaders, etc. Therefore, it is necessary to build various topologies for different scenarios for testing purposes. Common topologies can be divided into three types: single switch topology, ARINC664 single network topology, and ARINC664 full network topology. In this embodiment, the configuration test of switch 1 and the single network configuration test are used as examples to construct the topology.

[0070] Constructing a single-switch test topology TOP1: For the test of a single switch (switch 1) in the example, the port list for topology switching. Based on port list {p 22 ,p 23 ,p 24}, construct the topological mapping relationship; where p 22 Establish connectivity with the terminal emulation device and the monitoring port by using a routing device as a bridge: p 24 Establish connectivity with the terminal emulation device and the command port by using a routing device as a bridge: To accommodate network testing topologies, all cascaded ports of switch 1, including p 23 All are connected to the terminal emulation device via routing equipment acting as a bridge.

[0071] Constructing a Single Switch Test Topology TOP2: For testing the network topology of the example implementation, constructing a port list for topology switching. Based on the port list, construct the topology mapping relationship; where p 78 Establish connectivity with the terminal emulation device and the monitoring port by using a routing device as a bridge: p 25 Establish connectivity with the terminal emulation device and the command port by using a routing device as a bridge: All topology ports are connected to the terminal emulation device via a routing device; the remaining ports are directly connected to the terminal emulation device using network cables.

[0072] Step 2: Construct test incentives and expected results.

[0073] This step constructs test stimuli and expected results for each link in the configuration file of the ARINC664 network under test. The test stimuli and expected results are terminal simulated data streams and output port expected results automatically generated based on the configuration file and according to the test strategy, conforming to the ARINC664 P7 protocol. The data stream stimulates the ARINC664 network under test through the terminal simulated port. The expected results are used as criteria for test case evaluation. This includes the following steps:

[0074] Step 201: Parse the configuration file to obtain the links configured between each port and form a port connection matrix R.

[0075] Port link relationship matrix R = [r xy ] 96×96 x,y∈{1,…,96};r xy This indicates the link relationship between port x and port y; if 8 VL links are configured between port x and port y in CONFIG, then r xy ={vl1,…,vl8}, otherwise r xy =0.

[0076] Step 202: Build data incentives.

[0077] When generating data incentives, policies can be applied to each VL to schedule various data streams. Policies include packet protocol errors (SFD errors, Ethernet type errors, etc.), network transmission policies (latency, jitter, sending exceeding BAG limits, etc.), and network load policies (ultra-long and ultra-short frames, increasing frame length, etc.).

[0078] Step 203: Build the expected results for each data stream.

[0079] Step 3: Build network application request and health monitoring functions.

[0080] In this step, the application function port set P of the switch is... monBuilding network application request and health monitoring capabilities involves the following steps:

[0081] Step 301: Construct the network application request interface and the network monitoring interface.

[0082] Construct a network application request interface: Set the ARINC664 network 5-tuple information and application command information and automatically assemble a complete network application request data packet. The parameters of the network application request interface are the application name and the number of requests.

[0083] Build a network monitoring interface: accept application requests, return data frames and PMR data frames reported every second, automatically parse the frame content, store them according to the data types defined in ICD, and display them in an intuitive interface.

[0084] Step 302: Build flexible application request testing and real-time monitoring methods.

[0085] During single-switch configuration testing, the network monitoring interface is continuously called at a 1-second cycle to obtain the switch's health status in real time from Port 22; the IMA_State application request interface is called cyclically at a 4-second cycle to perform application request operations on the switch from Port 24.

[0086] Step 303: Construct access points for application requests and network monitoring under the network architecture.

[0087] During single-network configuration testing, the monitoring interface is continuously called at a 1-second cycle to obtain the real-time health status of all switches from Port 78 of the single network; the IMA_State application request interface is called cyclically at a 4-second cycle to perform application request operations on all switches from Port 25 of the single network.

[0088] According to the appendix Figure 3 As can be seen, the increased number of switches did not introduce more monitoring nodes. Continuously calling the monitoring and application request interfaces at fixed intervals allows for real-time traversal of the network's health status and flexible application request operations. Combined with the network cascading topology provided by this method, command requests can be made to all switches in the network through just one port to obtain the health status of all switches, resulting in a simpler testing architecture.

[0089] Step 4: Build a configuration testing system, which is responsible for building and executing test case sets and generating test reports. This includes the following steps:

[0090] Step 401: Load the test case sets and expected results for the three test scenarios.

[0091] According to the established test program configuration, test case sets for corresponding scenarios are automatically generated, including single switch, single network, and network test case sets, covering operation mode testing, configuration function testing, data loading testing, network function testing, network performance testing, and fault injection testing.

[0092] Step 402: Execute the test cases.

[0093] Based on actual needs, select the steps that are expected to be executed from the use case set.

[0094] Step 403: Generate a test report.

[0095] Based on the execution process, the final report is generated according to the test report template.

[0096] The above description is merely an embodiment of the present invention and is not intended to limit the present invention in any way. Any simple modifications, alterations, or equivalent structural changes made to the above embodiments based on the technical essence of the present invention shall still fall within the protection scope of the present invention.

Claims

1. A method for constructing an ARINC664 network configuration test framework, characterized in that, Includes the following steps: Step 1: Parse the configuration file of the network under test, obtain the configuration information of each port, and build a test topology database; wherein, the test topology database includes the topology configuration between ports, monitoring devices, and routing devices under three test scenarios: single switch, single network, and dual network; Step 2: Construct test stimuli and expected results for each link in the configuration file of the ARINC664 network under test; wherein, the test stimuli and expected results are terminal simulated data streams and output port expected results that conform to the ARINC664 protocol, generated according to the test strategy; the data stream stimulates the ARINC664 network under test through the terminal simulated port; the expected results are used as the criteria for test cases; Step 3: Apply the function port set P to the switch mon Build network application request and health monitoring functions on top of it; Step 4: Build a configuration test system, which is responsible for building and executing test case sets and generating test reports.

2. The method for constructing an ARINC664 network configuration test framework according to claim 1, characterized in that, Step one includes: Step 101: Configuration file verification; Step 102: Parse the configuration file to obtain the port set P of the ARINC664 network under test and the switch cascading port set P. cas Switch application function port set P mon Data stimulus port set P data =PP cas ; Step 103: Construct the complete set of ports P that need to be bridged in three test scenarios: single switch, single network, and dual network. top The complete set of ports P top Used for switching topology structures; Step 104: Construct topology structures for different scenarios to form a test topology database TOP. i .

3. The method for constructing an ARINC664 network configuration test framework according to claim 2, characterized in that, The configuration file verification includes: verifying the format and semantics of the configuration file; step 103 includes: if a port meets any of the following conditions, then the port is used for topology switching: Condition 1, p∈P data ,p∈P mon , Condition 2 p∈P mon ,p∈P cas ; Condition 3, p∈P data , p∈P cas ; Condition 4, p∈P data ,p∈P mon ,p∈P cas ; The complete set of ports P used to construct a bridged topology. top =P cas ∪P mon .

4. The method for constructing an ARINC664 network configuration test framework according to claim 1, characterized in that, Step two includes: Step 201: Parse the configuration file to obtain the links configured between each port, forming a port connection matrix R; Step 202: When constructing the data incentive, a policy is applied to each link in the port connection relationship matrix R to schedule various data flows. The policies include packet protocol error, network transmission policy and network load policy. Step 203: Build the expected results for each data stream.

5. The method for constructing an ARINC664 network configuration test framework according to claim 1, characterized in that, Step three includes: Step 301: Construct the network application request interface and the network monitoring interface; Step 302: When configuring a single switch test, the network monitoring interface is called periodically to obtain the health status of the switch in real time from the switch application function port of the single switch; the application request interface is called periodically to perform application request operations on the switch from the switch application function port of the single switch. Step 303: When configuring single-network testing, continuously call the monitoring interface according to the cycle to obtain the health status of all switches in real time from the application function port of the single network's switches; and cyclically call the application request interface to perform application request operations on all switches from the application function port of the single network's switches.

6. The method for constructing an ARINC664 network configuration test framework according to claim 1, characterized in that, Step four includes: Step 401: Load the test case sets and expected results for the three test scenarios; Step 402: Execute the steps expected to be performed from the user-selected test case set; Step 403: Based on the execution process, generate the final report according to the test report template.

Images