Multi-modal test platform for in-vehicle network resilience

Abstract

The present application discloses a multi-modal test platform for network resilience of an in-vehicle network. The platform includes: a guidance and control subsystem, which is used to configure a test mode for testing the in-vehicle network of an automobile in a data transmission unit according to the test requirements when receiving a test requirement for the network resilience of the in-vehicle network of the automobile; a stimulus generation subsystem, which is used to generate a stimulus event for testing the in-vehicle network of the automobile according to the test requirements, and inject the stimulus event into the automobile through the data transmission unit configured with the test mode; an evaluation and analysis subsystem, which is used to obtain test data through the data transmission unit configured with the test mode, and analyze the network resilience of the in-vehicle network of the automobile through the test data, wherein the test data is the test data obtained by the automobile executing the stimulus event; the guidance and control subsystem, the stimulus generation subsystem, and the evaluation and analysis subsystem are respectively connected to the automobile through the data transmission unit.

Description

Technical Field

[0001] The present application relates to the technical field of network resilience testing of automobile in-vehicle networks, and in particular to a multi-modal testing platform for network resilience of in-vehicle networks. Background Art

[0002] The Internet of Vehicles is a strategic emerging industry that deeply empowers the automotive and transportation industries with the new generation of information technology. Testing and evaluating the network resilience of the Internet of Vehicles, including on-board networks and off-board networks, and improving the ability to assess network resilience are in line with the needs of the national development strategy.

[0003] Specifically, different cars may have different electronic and electrical architectures. The test platforms used in related technologies to test the network security and network resilience of cars cannot be configured according to the different electronic and electrical architectures of different cars to meet the needs of testing the network resilience of cars with different electronic and electrical architectures on the same platform. Instead, different test platforms are established for cars with different electronic and electrical architectures, which is costly. At the same time, it cannot meet the requirements for concurrent driving of data when conducting endogenous security threat perception tests, and it is impossible to conduct a comprehensive analysis of the test data obtained.

[0004] Therefore, in the related technology, there is a lack of a platform that can configure the test platform into different test modes based on test requirements, realize a platform to test the network resilience of the vehicle-mounted network of vehicles with different electronic and electrical architectures, and conduct a comprehensive analysis of the obtained test data.

[0005] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0006] An embodiment of the present application provides a multi-modal test platform for network resilience of an in-vehicle network, so as to at least solve the technical problem in the related art of lacking a platform for configuring the test platform into different test modes based on test requirements, realizing a platform for testing the network resilience of the in-vehicle network of vehicles with different electronic and electrical architectures and for comprehensively analyzing the obtained test data.

[0007] According to one aspect of an embodiment of the present application, a multi-modal test platform for network resilience of an in-vehicle network is provided, including: a guidance and control subsystem, wherein the guidance and control subsystem is used to, upon receiving a test requirement for the network resilience of an in-vehicle network of an automobile, configure a test mode for testing the in-vehicle network of the automobile in accordance with the test requirement in a data transmission unit; a stimulus generation subsystem, wherein the stimulus generation subsystem is used to generate a stimulus event for testing the in-vehicle network of the automobile in accordance with the test requirement, and inject the stimulus event into the automobile through the data transmission unit configured with the test mode; an evaluation and analysis subsystem, wherein the test data is the test data obtained by the automobile executing the stimulus event; wherein the guidance and control subsystem, the stimulus generation subsystem, and the evaluation and analysis subsystem are respectively connected to the automobile through the data transmission unit.

[0008] Optionally, the guidance and control subsystem is also used to parse the test requirements when receiving the test requirements to obtain modal configuration requirements and excitation scheduling requirements; the guidance and control subsystem includes: a modal configuration module, used to configure the test mode corresponding to the electronic and electrical architecture of the vehicle in the data transmission unit according to the modal configuration requirements, wherein different types of vehicles have different corresponding electronic and electrical architectures.

[0009] Optionally, the modal configuration module is also used to parse the modal configuration requirements to obtain the configuration information of the test modality; wherein the configuration information of the test modality includes: a vehicle-mounted network topology description, an excitation injection description, and a data acquisition description; wherein the vehicle-mounted network topology description is used to describe the connection topology of the vehicle-mounted network corresponding to the electronic and electrical architecture of the vehicle; the modal configuration module is also used to configure the connection topology of the vehicle-mounted network in the data transmission unit according to the vehicle-mounted network topology description; the modal configuration module is also used to deploy an excitation injection point in the data transmission unit including the connection topology of the vehicle-mounted network according to the excitation injection description, and the excitation injection point is used for the excitation generation subsystem to inject the excitation event; the modal configuration module is also used to deploy a data acquisition point in the data transmission unit including the connection topology of the vehicle-mounted network according to the data acquisition description, and the data acquisition point is used for the evaluation and analysis subsystem to obtain the test data; wherein the test modality is the state of the data transmission unit after configuration, and the state includes the connection topology of the vehicle-mounted network, the excitation injection point, and the data acquisition point after configuration.

[0010] Optionally, the guidance and control subsystem also includes: a dynamic scheduling module, which is used to instruct the incentive generation subsystem to generate the incentive event according to the incentive scheduling requirements, and instruct the incentive generation subsystem to inject the incentive event into the vehicle's on-board network through the incentive injection point.

[0011] Optionally, the incentive generation subsystem includes: a business incentive module and an attack incentive engine, wherein the business incentive module and the attack incentive engine are respectively connected to the automobile through the data transmission unit; the business incentive module includes: a business scheduling unit and a business library connected to the business scheduling unit, wherein the business library includes: various businesses that are allowed to occur when the automobile is in normal operation, and each of the various businesses includes: business incentive events that are allowed to be generated when each business occurs, and network data for generating the business incentive events; the business scheduling unit is used to receive a first scheduling instruction generated by the dynamic scheduling module according to the incentive scheduling requirement, schedule a first business from the various businesses according to the first scheduling instruction, and inject the first business into the automobile on-board network through the incentive injection point, wherein the incentive event includes: the first business.

[0012] Optionally, the attack incentive engine is used to receive a second scheduling instruction generated by the dynamic scheduling module according to the incentive scheduling requirement, generate a second service according to the second scheduling instruction, and inject the second service into the vehicle's on-board network through the incentive injection point, wherein the incentive event includes the second service, and wherein the second service includes: a network attack event that the vehicle's on-board network is allowed to accept as indicated by the test requirement.

[0013] Optionally, the attack incentive engine includes an attack strategy library, an attack payload library and a vulnerability library respectively connected to the attack strategy library; the attack payload library includes multiple network attack events, the attack payload library records the attack payloads corresponding to the multiple network attack events, and the vulnerability library records the security vulnerabilities that the multiple network attack events are allowed to exploit; the attack incentive engine is used to schedule the network attack event from the multiple network attack events according to the second scheduling instruction; the attack incentive engine is also used to schedule the attack payload corresponding to the network attack event from the attack payload library, and / or, schedule the security vulnerability corresponding to the network attack event from the vulnerability library; the attack incentive engine is also used to encapsulate the network attack event, the attack payload corresponding to the network attack event and / or the security vulnerability corresponding to the network attack event as the second service.

[0014] Optionally, the evaluation and analysis subsystem is used to obtain first test data through the data collection point after the service incentive module injects the first service into the vehicle's on-board network through the incentive injection point according to the first scheduling instruction; the evaluation and analysis subsystem is also used to obtain second test data through the data collection point after the service incentive module injects the first service into the vehicle's on-board network through the incentive injection point according to the first scheduling instruction, and after the attack incentive engine injects the second service into the vehicle's on-board network through the incentive injection point according to the second scheduling instruction; wherein the test data includes: the first test data and the second test data.

[0015] Optionally, the evaluation and analysis subsystem is further used to generate a first analysis curve based on the first test data, and to generate a second analysis curve based on the second test data; the evaluation and analysis subsystem is further used to compare the first analysis curve and the second analysis curve to analyze the network resilience of the vehicle's in-vehicle network.

[0016] According to another aspect of an embodiment of the present application, a vehicle-mounted network network resilience multimodal testing system is provided, comprising any of the vehicle-mounted network network resilience multimodal testing platforms described above.

[0017] In an embodiment of the present application, a multi-modal test platform for network resilience of an in-vehicle network is provided, including: a guidance and control subsystem, wherein the guidance and control subsystem is used to, upon receiving a test requirement for the network resilience of an in-vehicle network of an automobile, configure a test mode for testing the in-vehicle network of the automobile in accordance with the test requirement in a data transmission unit; a stimulus generation subsystem, wherein the stimulus generation subsystem is used to generate a stimulus event for testing the in-vehicle network of the automobile in accordance with the test requirement, and inject the stimulus event into the automobile through a data transmission unit configured with the test mode; an evaluation and analysis subsystem, wherein the test data is test data obtained by executing the stimulus event by the automobile; wherein the guidance and control subsystem, the stimulus generation subsystem, and the evaluation and analysis subsystem are respectively connected to the automobile through the data transmission unit. This solves the technical problem in the related technology of lacking a platform for configuring the test platform into different test modes based on test requirements, so as to realize a platform for testing the network resilience of the on-board network of vehicles with different electronic and electrical architectures and for comprehensive analysis of the obtained test data. This achieves the technical effect of testing and comprehensively analyzing the network resilience of the on-board network of vehicles with different electronic and electrical architectures by configuring different test modes based on one platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0019] Figure 1 1 is a schematic diagram of the architecture of a multi-modal test platform for network resilience of an in-vehicle network provided according to an embodiment of the present application (I);

[0020] Figure 2 2 is a schematic diagram of the architecture of a multi-modal test platform for network resilience of an in-vehicle network provided according to an embodiment of the present application (II);

[0021] Figure 3 is a schematic diagram of the architecture of a multimodal testing environment provided according to an embodiment of the present application;

[0022] Figure 4 is a schematic diagram of injecting an excitation event according to an excitation modal diagram according to an embodiment of the present application;

[0023] Figure 5 It is a schematic diagram of data analysis according to an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0025] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0026] Figure 1 FIG. 1 is an architecture diagram of a multi-modal test platform for vehicle network resilience provided according to an embodiment of the present application. Figure 1As shown in the figure, the multi-modal test platform for vehicle network resilience includes:

[0027] A guidance control subsystem 102, wherein the guidance control subsystem 102 is used to configure a test mode for testing the vehicle in-vehicle network in the data transmission unit 108 according to a test requirement for the network resilience of the vehicle in-vehicle network;

[0028] The stimulus generation subsystem 104 is used to generate a stimulus event for testing the vehicle network according to the test requirements, and inject the stimulus event into the vehicle through the data transmission unit 108 configured with the test mode;

[0029] An evaluation and analysis subsystem 106, configured to obtain test data through a data transmission unit 108 configured with the test mode, and analyze the network resilience of the vehicle network through the test data, wherein the test data is test data obtained by the vehicle 110 executing the stimulus event;

[0030] The guidance and control subsystem 102 , the incentive generation subsystem 104 , and the evaluation and analysis subsystem 106 are connected to the automobile 110 via the data transmission unit 108 , respectively.

[0031] More specifically, the test data is the test data obtained when the car 110 executes the stimulus event after receiving the stimulus event issued by the stimulus generation subsystem 104 through the data transmission unit 108 configured with the test mode;

[0032] In an embodiment of the present application, a multi-modal test platform for network resilience of an in-vehicle network is provided, including: a guidance and control subsystem, wherein the guidance and control subsystem is used to, upon receiving a test requirement for the network resilience of an in-vehicle network of an automobile, configure a test mode for testing the in-vehicle network of the automobile in accordance with the test requirement in a data transmission unit; a stimulus generation subsystem, wherein the stimulus generation subsystem is used to generate a stimulus event for testing the in-vehicle network of the automobile in accordance with the test requirement, and inject the stimulus event into the automobile through a data transmission unit configured with the test mode; an evaluation and analysis subsystem, wherein the test data is test data obtained by executing the stimulus event by the automobile; wherein the guidance and control subsystem, the stimulus generation subsystem, and the evaluation and analysis subsystem are respectively connected to the automobile through the data transmission unit. This solves the technical problem in the related technology of lacking a platform for configuring the test platform into different test modes based on test requirements, so as to realize a platform for testing the network resilience of the on-board network of vehicles with different electronic and electrical architectures and for comprehensive analysis of the obtained test data. This achieves the technical effect of testing and comprehensively analyzing the network resilience of the on-board network of vehicles with different electronic and electrical architectures by configuring different test modes based on one platform.

[0033] Optionally, the control subsystem is further configured to parse the test requirement upon receiving the test requirement to obtain a modal configuration requirement and an excitation scheduling requirement; Figure 2 As shown, the guidance and control subsystem includes: a mode configuration module (i.e. Figure 2 The modal configuration in the data transmission unit is used to configure the test modality corresponding to the electronic and electrical architecture of the vehicle according to the modal configuration requirements, wherein different types of vehicles correspond to different electronic and electrical architectures.

[0034] It should be noted that the data transmission unit and the vehicle under test (equivalent to the vehicle in the above embodiment) can be combined to form a Figure 3 In the multimodal test environment shown, the data transmission unit is used to connect the vehicle under test with subsystems such as the guidance and control subsystem; and the data transmission unit allows the configuration of test modes corresponding to the electronic and electrical architecture of the vehicle, that is, it allows vehicles with different electronic and electrical architectures to be tested according to test requirements.

[0035] In an embodiment of the present application, the test requirements carry modal configuration requirements and excitation scheduling requirements; wherein, the modal configuration requirements are used to describe the test modalities required for the vehicle, which test modalities correspond to the electronic and electrical architecture of the vehicle; the excitation scheduling requirements are used to describe the excitation events that need to be executed in the vehicle after the test modal configuration is completed, as well as the scheduling order of the excitation events, that is, the order in which the excitation events are generated and injected into the vehicle through the excitation injection point.

[0036] In an optional embodiment, in the guidance and control subsystem, the modal configuration module configures the test modality according to the modal configuration requirements, including: the modal configuration module is also used to parse the modal configuration requirements to obtain the configuration information of the test modality; wherein the configuration information of the test modality includes: a vehicle on-board network topology description, an excitation injection description, and a data acquisition description; wherein the vehicle on-board network topology description is used to describe the connection topology of the vehicle on-board network corresponding to the electronic and electrical architecture of the vehicle; the modal configuration module is also used to configure the connection topology of the vehicle on-board network in the data transmission unit according to the vehicle on-board network topology description; The modal configuration module is also used to deploy an excitation injection point in a data transmission unit including a connection topology of the vehicle network according to the excitation injection description, and the excitation injection point is used by the excitation generation subsystem to inject the excitation event; the modal configuration module is also used to deploy a data collection point in a data transmission unit including a connection topology of the vehicle network according to the data collection description, and the data collection point is used by the evaluation and analysis subsystem to obtain the test data; wherein the test modality is the state of the data transmission unit after configuration, and the state includes the configured connection topology of the vehicle network, the excitation injection point, and the data collection point.

[0037] Optionally, the stimulus events and the scheduling order of the stimulus events can be represented in the form of a stimulus mode diagram. The stimulus injection points configured in the data transmission unit are drawn on the stimulus mode diagram. Each stimulus injection point is marked with the stimulus event to be injected according to the scheduling order.

[0038] It can be understood that the modal configuration module further analyzes the modal configuration requirements to obtain the modal configuration requirements including: vehicle network topology description, excitation injection description, and data acquisition description.

[0039] Specifically, the vehicle network topology description is used to describe the connection topology of the vehicle network corresponding to the electronic and electrical architecture of the vehicle. In general, the electronic and electrical architecture corresponding to the vehicle includes one of the following: distributed architecture, domain control architecture, central control architecture; in the embodiment of the present application, the modal configuration information in the test requirements will carry the network topology description of the vehicle's vehicle network corresponding to the electronic and electrical architecture of the vehicle, and the network topology description of the vehicle's vehicle network specifically includes: the type, nodes and edges of the vehicle's vehicle network. The modal configuration module sets the connection relationship in the data transmission unit according to the vehicle network topology description, and maps the connection topology of the vehicle network to the connection relationship in the data transmission unit.

[0040] Optionally, in an embodiment of the present application, the configuration of a multimodal test environment (mainly configuring the test mode for the data transmission unit) can be achieved through a variety of technologies, including one of the following: configuration of a vehicle network multimodal test environment based on software-defined network technology, configuration of a vehicle network multimodal test environment based on packet switching technology, configuration of a vehicle network multimodal test environment based on circuit switching technology, etc.

[0041] Specifically, for the configuration of the vehicle network test environment based on software defined network, the data transmission unit includes an SDN (software defined network) controller and basic network equipment. The guidance and control subsystem configures the SDN controller through the parameter configuration interface, and the SDN controller controls the operation of the basic network equipment. Specifically, the modal configuration module of the guidance and control subsystem parses the test requirements for testing the car, obtains the vehicle network topology description in the modal configuration requirements, specifically including the type, nodes and edges of the vehicle network of the car, and controls the connection relationship between each network interface on the basic network device according to these parameters. The basic network equipment includes CAN (controller area network bus) switches, LAN (local area network) switches and LIN (Local Interconnect Network) switches. The basic network equipment has an interface of the corresponding bus, which is connected to the in-vehicle components on the car through the interface. The in-vehicle components include vehicle gateways, domain controllers, vehicle controllers, etc. The network interface types used by different components are different, and these types include CAN network interface, LIN network interface, and LAN network interface.

[0042] Specifically, for an embodiment of a packet-switched vehicle network multimodal test environment, the data transmission unit includes a packet switch and a packet bus adapter. The guidance and control subsystem configures the packet switch through a parameter configuration interface, and configures the connection relationship between each bus adapter so that the connection relationship is consistent with the vehicle network topology description in the modal configuration requirements, and the stimulus injection points and data collection points determined according to the test requirements are deployed in the connection topology. The packet bus adapter is connected to the in-vehicle components on the car. Different in-vehicle components use different types of packet bus adapters, and the packet bus adapter converts the data used by the components into data that can be recognized and exchanged by the packet switch. Packet bus adapters include CAN bus adapters, LIN bus adapters, and LAN bus adapters.

[0043] Specifically, for the implementation example of the circuit-switched vehicle network multimodal test environment, the data transmission unit includes a circuit switch and a circuit bus adapter. The guidance and control subsystem configures the circuit switch through the parameter configuration interface, and configures the on-off relationship between the input circuit and the output circuit of the circuit switch, so that the connection topology in the circuit switch configured with the on-off relationship is consistent with the vehicle network topology description in the modal configuration requirements, and the stimulus injection points and data collection points determined according to the test requirements are deployed in the on-off relationship. The circuit bus adapter is connected to the in-vehicle components on the car. Different components use different types of circuit bus adapters, and the circuit bus adapter converts the network used by the components into a normalized circuit that can be recognized and exchanged by the circuit switch. The circuit bus adapters include CAN bus adapters, LIN bus adapters, and LAN bus adapters.

[0044] For example, when the car being tested has a distributed electrical and electronic architecture, the car's on-board network is also a distributed networking architecture. The network topology of the on-board network specifically includes: the network components in the car, that is, the nodes of the on-board network; the network types of the on-board network components, such as CAN network, LIN network or LAN network; the connection relationship between the network components in the car, that is, the edges of the on-board network, such as the vehicle controller is connected to the on-board gateway through the CAN network.

[0045] The modal configuration module configures the connection relationship between each network interface or network adapter in the data transmission unit according to the network topology of the vehicle network, so that the network architecture finally formed in the data transmission unit corresponds to the distributed network topology of the vehicle network. When the data transmission unit receives an excitation event injected from any excitation injection point, it can transmit the excitation event to the corresponding in-vehicle component according to the network topology of the distributed vehicle network.

[0046] In short, the data transmission unit can be adaptively configured to an electronic and electrical architecture corresponding to the network topology of the vehicle network of the tested vehicle.

[0047] Furthermore, the stimulus injection description is used to indicate the number and location of stimulus injection points for injecting stimulus events into the multimodal test environment when performing a test on the network resilience of the vehicle. The modality configuration module deploys the stimulus injection points in the data transmission unit of the multimodal test environment according to the stimulus injection description.

[0048] Furthermore, the data collection description is used to describe: when performing resilience testing on the vehicle network, the number and location of data collection points used to collect test data from the multimodal test environment. The modality configuration module deploys the data collection points in the data transmission unit of the multimodal test environment according to the data collection description.

[0049] After the modal configuration module completes the configuration of the data transmission unit of the multimodal test environment based on the configuration information of the test modality obtained by analyzing the test requirements, the state of the data transmission unit remains unchanged during the entire elastic test. This state includes the configured vehicle network topology, excitation injection points, and data collection points, that is, one test requirement corresponds to one test modality.

[0050] Alternatively, if Figure 2 As shown, the guidance and control subsystem also includes: a dynamic scheduling module, which is used to instruct the stimulus generation subsystem to generate the stimulus event according to the stimulus scheduling requirements, and instruct the stimulus generation subsystem to inject the stimulus event into the vehicle under test through the stimulus injection point in the data transmission unit of the multimodal test environment.

[0051] More specifically, the dynamic scheduling module is used to instruct the excitation generation subsystem to generate an excitation modal diagram and corresponding excitation events according to the excitation scheduling requirements, and to instruct the excitation generation subsystem to inject the excitation events into the vehicle under test according to the excitation modal diagram through the excitation injection point in the data transmission unit of the multimodal test environment.

[0052] Optionally, the incentive generation subsystem includes: a business incentive module and an attack incentive engine, wherein the business incentive module and the attack incentive engine are respectively connected to the car through a multimodal test environment data transmission unit; the business incentive module includes: a business scheduling unit and a business library connected to the business scheduling unit, wherein the business library includes: various businesses that are allowed to occur when the car is in normal operation, and each of the various businesses includes: business incentive events that are allowed to be generated when each business occurs, and network data for generating the business incentive events; the business scheduling unit is used to receive a first scheduling instruction generated by the dynamic scheduling module according to the incentive scheduling requirement, schedule a first business from the various businesses according to the first scheduling instruction, and inject the first business into the car's on-board network through the incentive injection point, wherein the incentive event includes: the first business.

[0053] Specifically, in the embodiment of the present application, the service library in the service incentive module includes: various services that are allowed to occur when the car is in normal operating state, and the service library specifically includes: a real service library and a simulated service library. The real service library includes: various services that are allowed to occur when the car is actually running and in normal working state; the simulated service library includes: various services that are allowed (or may) occur when the car is simulated to be actually running and in normal working state.

[0054] It should be noted that the simulated business library is used to simulate real business. Its generation process is to collect real business, analyze its data, and form simulated business. When there are no real parts of the car to cooperate with the test, it is used to simulate the real parts and complete the corresponding test work.

[0055] Then, the service scheduling unit of the service incentive module schedules the first service from the service library according to the first scheduling instruction, and injects the first service into the vehicle under test from the incentive injection point indicated by the incentive modal diagram (each incentive event has a corresponding incentive injection point, and the incentive injection points corresponding to different incentive events may be the same or different). In the specific scheduling process, the number of first services that need to be scheduled, and the order in which multiple first services are scheduled when there are multiple first services, are not specifically limited in the embodiments of the present application, and are all indicated by the first scheduling instruction, that is, by the test requirements.

[0056] Optionally, the attack incentive engine is used to receive a second scheduling instruction generated by the dynamic scheduling module according to the incentive scheduling requirement, generate a second service according to the second scheduling instruction, and inject the second service into the vehicle's on-board network through the incentive injection point, wherein the incentive event includes the second service, and wherein the second service includes: a network attack event that the vehicle's on-board network is allowed to accept as indicated by the test requirement.

[0057] Optionally, the attack incentive engine includes an attack strategy library, an attack payload library and a vulnerability library respectively connected to the attack strategy library; the attack payload library includes multiple network attack events, the attack payload library records the attack payloads corresponding to the multiple network attack events, and the vulnerability library records the security vulnerabilities that the multiple network attack events are allowed to exploit; the attack incentive engine is used to schedule the network attack event from the multiple network attack events according to the second scheduling instruction; the attack incentive engine is also used to schedule the attack payload corresponding to the network attack event from the attack payload library, and / or, schedule the security vulnerability corresponding to the network attack event from the vulnerability library; the attack incentive engine is also used to encapsulate the network attack event, the attack payload corresponding to the network attack event and / or the security vulnerability corresponding to the network attack event as the second service.

[0058] It is understandable that in the embodiment of the present application, the network attack event and its attack payload or security vulnerability indicated by the test requirement are encapsulated as a second service through the attack incentive engine and injected into the tested vehicle. Specifically, the number and order of network attack events specifically included in the second service are indicated by the second scheduling instruction, that is, by the test requirement; the specific number of network attack events is not specifically limited in the embodiment of the present application.

[0059] Optionally, the evaluation and analysis subsystem is used to obtain first test data through the data collection point after the service incentive module injects the first service into the vehicle's on-board network through the incentive injection point according to the first scheduling instruction; the evaluation and analysis subsystem is also used to obtain second test data through the data collection point after the service incentive module injects the first service into the vehicle's on-board network through the incentive injection point according to the first scheduling instruction, and after the attack incentive engine injects the second service into the vehicle's on-board network through the incentive injection point according to the second scheduling instruction; wherein the test data includes: the first test data and the second test data.

[0060] It can be understood that in the embodiment of the present application, a second service may correspond to one or more network attack events. In the specific testing process, the first service is first injected into the vehicle under test to obtain test data under the normal working state of the vehicle (i.e., the first test data); then, when the first service is executed, the second service is injected into the vehicle under test according to the injection time and injection position (i.e., the specific excitation injection point) indicated by the second scheduling instruction (and the excitation modal diagram) to obtain test data (i.e., the second test data) when the first service is executed and subjected to a network attack event.

[0061] Optionally, the evaluation and analysis subsystem is further used to generate a first analysis curve based on the first test data, and to generate a second analysis curve based on the second test data; the evaluation and analysis subsystem is further used to compare the first analysis curve and the second analysis curve to analyze the network resilience of the vehicle.

[0062] Obviously, the embodiments described above are only part of the embodiments of the present application, not all of the embodiments. In order to better understand the multi-modal test platform for vehicle network resilience of the present application, the above process is described below in conjunction with the embodiments, but it is not intended to limit the technical solutions of the embodiments of the present application, specifically:

[0063] To solve the problem in related technologies that the existing multimodal test platforms for vehicle network resilience are generally aimed at functional testing or safety testing of a certain brand of car or a certain architecture of car, the test items are single, and the obtained test data cannot be comprehensively analyzed.

[0064] The optional embodiment of the present application proposes a method for building a test platform for comprehensive evaluation of vehicle network network resilience testing (i.e., a vehicle network network multimodal test platform) to meet the needs of scenario-based testing and comprehensive scoring of the network resilience of the vehicle's on-board network. At the same time, it can adapt to different car brands and meet the vehicle network resilience testing needs of three types of automotive electronic and electrical architectures: distributed architecture, domain control architecture, and central control architecture.

[0065] The multimodal test platform for network resilience of the vehicle network in an optional embodiment of the present application, under the control of the guidance and control subsystem, controls the generation of the environment (the environment or test environment in the optional embodiment of the present application is equivalent to the test mode in the above embodiment), the generation of services (equivalent to the first service in the above embodiment) and the generation of attacks (equivalent to the second service in the above embodiment). Under the same test environment, different service generation schemes and attack generation schemes form different test scenarios, and the multimodal test platform for network resilience of the vehicle network realizes network resilience testing based on test scenarios. Environment generation, service generation and attack generation jointly complete the scenario-based comprehensive test, and at the same time, based on the automobile network performance data obtained from multiple perception points (ie, data collection points), a comprehensive quantitative evaluation of system-level network resilience is performed. It should be noted that one test requirement corresponds to one test mode, and one test mode can correspond to different test scenarios.

[0066] Specifically, in an optional embodiment of the present application, the test platform architecture is as follows: Figure 2 As shown in the figure, it includes: guidance and control subsystem, business incentive module, attack incentive engine and evaluation and analysis subsystem. The guidance and control subsystem controls mode configuration, resource management and dynamic scheduling, and combines the business incentive module and attack incentive engine to complete scenario-based network resilience comprehensive testing to meet the needs of comprehensive scoring of network resilience testing of Internet of Vehicles. At the same time, the evaluation and analysis subsystem is used to comprehensively score the entire test results, showing the record and traceability of the entire test process.

[0067] Specifically, Figure 2 The functions of each subsystem and the modules included in each subsystem are as follows:

[0068] 1. The modal configuration in the guidance and control subsystem (equivalent to the modal configuration module in the above embodiment) is responsible for managing the test environment, which mainly includes the vehicle network topology description, data injection and collection scheme (including stimulus injection description, data collection description), and scenario event scheduling process (i.e., stimulus scheduling requirements), including the generation, operation and destruction of scenario events; when the environment is generated, according to the environment generation requirements (i.e., modal configuration requirements), first parse the vehicle network topology description, map the topology to the existing hardware resources that meet its requirements, and control the generation of the test environment; according to the data injection and collection scheme, deploy data injection points, and initialize the data collector; when the scenario is generated, parse the scenario generation requirements, including business generation requirements and attack generation requirements, initialize the scenario event (equivalent to the stimulus event), and prepare for the automatic scheduling of the scenario event.

[0069] Resource management in the control subsystem mainly includes user management, simulation resource management, entity resource management, component management under test, and pseudo reference component library resource management. Among them, user management is used to manage users who are allowed to use the vehicle network elastic multimodal test platform. Simulation resource management is used to manage simulation components (such as Figure 3 Functional simulation of in-vehicle components), simulation components are used to simulate and replace real components in the case that the real components on the car cannot be connected to the vehicle network network resilience multimodal test platform. Entity resource management is used to manage all entity resources on the vehicle network network resilience multimodal test platform, and to temporarily manage the in-vehicle components of the car when the vehicle network network resilience multimodal test platform is connected to the car. Component management under test and pseudo reference component library resource management are used to manage components under test (i.e. Figure 3 The in-vehicle components to be tested in the Figure 3 In the specific test process, the component to be tested corresponds to the simulated reference component for comparative testing.

[0070] The dynamic scheduling module in the guidance and control subsystem mainly includes dynamically scheduling attack transactions (i.e., the second business), business transactions (i.e., the first business) and other tasks according to the needs of the business incentive module and the attack incentive engine.

[0071] 2. The business incentive module is mainly composed of three modules: business scheduling, simulated business library, and real business library. It can inject simulated business and real business (the first business includes simulated and real business) into the multimodal network environment of the Internet of Vehicles, and complete corresponding business scheduling and other functions.

[0072] Among them, the real business library, based on the needs of the scenario-based elasticity comprehensive scoring of the Internet of Vehicles network elasticity, analyzes the entire Internet of Vehicles system, especially the vehicle network of the intelligent connected car, and all the components connected by the vehicle network, extracts various events that occur in the vehicle network when the intelligent connected car is performing normal work, as well as the sending and response data of the event, forms a transaction, and stores it in the real business library. When conducting scenario-based comprehensive testing, transaction restoration based on the real business library is realized.

[0073] It should be noted that in the embodiment of the present application, the business includes transactions, which are composed of a collection of specific network requests, responses and other actions. Transactions include events, which refer to specific network requests and response actions.

[0074] Among them, the simulation business library, based on the needs of the scenario-based elasticity comprehensive scoring of the Internet of Vehicles network elasticity, analyzes the entire Internet of Vehicles system, especially the vehicle network of the intelligent connected car, and all the components connected by the vehicle network, and establishes a simulation of various businesses that may occur in intelligent connected cars, as well as the events and event sending and response data when these businesses occur, forming a simulation transaction and storing it in the simulation business library. When conducting scenario-based comprehensive testing, transaction restoration based on the simulation business library is realized.

[0075] Among them, the business scheduling unit, based on the scenario-based elasticity comprehensive scoring, needs to restore the real business and simulated business based on the scenario configuration, test the response of the vehicle network under various transaction drives, and conduct a comprehensive evaluation of the entire response. In order to meet the needs of comprehensive evaluation, the real business in the real business library and the simulated business in the simulated business library must be scheduled according to the evaluation requirements to form the input of the entire test.

[0076] 3. The attack incentive engine includes the corresponding test vulnerability library, attack strategy library, attack load library, test evaluation tool set, etc. Among them, the attack incentive engine is used to coordinate with the business generation subsystem to realize the automation of network resilience testing.

[0077] Among them, the attack strategy library and the attack payload library are attack libraries generated by the development department by summarizing the attack paths and attack methods of known network attacks. A large number of attack instances (each attack method has a corresponding attack instance) and their attack paths are stored in the attack strategy library; the attack payloads required in the attack, especially some loads that are variable and adjustable, are stored in the attack payload library.

[0078] The vulnerability database summarizes all the security vulnerabilities currently existing in the Internet of Vehicles system, including in-vehicle components, vehicle networks, etc., as well as the ways to exploit these vulnerabilities. The test and evaluation toolset is the corresponding tool that needs to be called during the test process.

[0079] The specific packages of the test and evaluation toolset include: vulnerability scanning and verification tools, 0Day vulnerability discovery tools, source code auditing tools, network sniffing tools, etc. These tools can be used to implement attack tests on CAN, CAN FD, NTP, ICMP, BFD, MQTT, ARP, SOMEIP ON TCP, SOME IP and other protocols.

[0080] 4. In the evaluation and analysis subsystem, the evaluation and analysis module comprehensively analyzes the network resilience capability based on the monitored vehicle network status and performance data (including the first test data and the second test data in the above embodiment) according to the network resilience index system, and evaluates whether the system meets the requirements of security, reliability, integrity, etc. The display and reproduction module is used to display the deduction based on the full process recording data, complete the recording and tracing of the entire test process, and can realize the process reproduction under the scenario test scenario.

[0081] based on Figure 2 It should be noted that the scenario-based resilience comprehensive test is a comprehensive evaluation of the external service capabilities of the vehicle network under normal business conditions and when it is attacked by a network in a certain test environment. Therefore, in the case of scenario-based resilience comprehensive test, the normal working business (i.e., the first business) is first injected into the vehicle network, and then the attack incentive engine schedules the attack strategy, selects the vulnerability that needs to be attacked and the attack payload, and injects the attack transaction (i.e., the second business) into the vehicle network.

[0082] The evaluation and analysis subsystem then monitors the entire vehicle network through monitoring points (data collection points) to obtain business data performance data at each point, including first test data for executing the first business and second test data for injecting the second business while executing the first business. The data is recorded and compared, and the working condition of the entire vehicle network is evaluated based on the corresponding comprehensive evaluation method.

[0083] Further, such as Figure 3 As shown, the multimodal test environment includes: physical device layer (including automobiles), architecture configuration layer (equivalent to data transmission unit). The physical device layer includes all ECUs, sensors, actuators and other components with different functions inside the car, and each component undertakes a relatively independent functional system. Different test modes need to be composed of different components, including some or all of the components currently in use, components to be tested, reference components and functional simulation components in the car. The architecture configuration layer is used to adapt to different automotive electronic and electrical architectures. The data collection point (i.e., monitoring point), as well as the business incentive injection point and attack incentive injection point included in the incentive injection point, are set in the data transmission unit.

[0084] based on Figure 3 The multimodal test environment shown in Figure 2 In the platform shown, the test scheme for testing the car between various subsystems, modules and units is as follows:

[0085] The guidance and control subsystem is the control center of the entire test platform for comprehensive evaluation of vehicle network resilience testing. It is used to call the modal configuration module for modal configuration according to user requirements. The parameters of the modal configuration are injected into the multimodal test environment, and the data transmission unit of the multimodal test environment is configured into a network required by the test. At the same time, the guidance and control subsystem controls the resource management and dynamic scheduling modules, manages the resources and plans during the test, and inputs the entire plan into the multimodal test environment, the attack incentive engine, and the business incentive module.

[0086] The multimodal test environment configures business injection points, attack injection points (business and attack injection points are both called stimulus injection points) and monitoring points (i.e. data collection points) according to the test requirements.

[0087] The attack incentive engine and the business incentive module generate business plans and attack plans (i.e., incentive modal diagrams and corresponding incentive events) according to the test requirements (i.e., generate or schedule the first business and the second business, and inject them into the multimodal test environment).

[0088] Specifically, the process of scheduling the first business and the second business and injecting them includes: the business incentive module calls the transactions in the simulated business library and the real business library according to the received scheme, and after adjustment by the business adjustment module, injects them into the tested vehicle through the incentive injection point of the multimodal test environment. The attack incentive engine calls the attack payload, vulnerability library, and tool set according to the received scheme and the provisions of the corresponding attack strategy, and injects the formed attack transaction into the tested vehicle through the attack injection point.

[0089] Finally, the evaluation and analysis system receives the network data and performance data of the entire system under test through the monitoring points of the multimodal test environment, and conducts elasticity evaluation on the entire system based on the comprehensive evaluation plan.

[0090] The above optional embodiment is further explained below by another optional embodiment. This specific embodiment is applied to Figure 2 In another optional embodiment of the present application, the architecture of the multimodal test environment is as follows Figure 3 shown.

[0091] The multimodal test environment receives modal configuration data from the modal configuration in the control subsystem. The core of these data is the vehicle network connection topology. The vehicle network connection topology specifies the type, nodes and connection relationships of the vehicle network. The automotive electronic and electrical architecture is generally divided into three types: distributed architecture, domain control architecture, and central control architecture. The vehicle network connection topology corresponds to the automotive electronic and electrical architecture under test. The multimodal test environment is configured into one of the modes (i.e., configured into one of the electronic and electrical architectures) based on the actual test requirements.

[0092] Further, such as Figure 4 As shown, according to the test requirements, the business transactions and attack transactions are scheduled to be injected into the multimodal test environment to execute the test.

[0093] Specifically, the service scheduling unit of the service excitation module schedules the real service and simulated service (i.e., the first service) that drive the vehicle network according to the test requirements, and injects the real service and simulated service (i.e., the first service) into the vehicle under test through different excitation injection points of the data transmission unit distributed in the multimodal test environment under the instruction of the excitation modal diagram.

[0094] According to different attack strategies (i.e., the second scheduling instructions), an attack behavior is refined into a series of attack events, and the attack events, the corresponding attack payloads or the corresponding attack vulnerabilities are encapsulated into attack transactions. Attack strategies schedule attack transactions (i.e., the second service) and inject them into the vehicle under test through different stimulus injection points of the data transmission unit distributed in the multimodal test environment.

[0095] During the test, the vehicle network of an intelligent connected vehicle, under normal working conditions, presents corresponding service performance to the outside world according to different working scenarios and driven by specific business. Therefore, during or after the test, the evaluation and analysis subsystem monitors the network performance data and network function data of the corresponding vehicle network in real time through different monitoring points (i.e., data collection points) of the data transmission unit distributed in the multimodal test environment. The data collected by the evaluation and analysis subsystem through the data collection points include: data driven by normal business (i.e., the first test data), and performance and function data driven by business and attack (i.e., the second test data).

[0096] Therefore, the evaluation and analysis subsystem can monitor the entire vehicle network of the intelligent connected vehicle through the monitoring points, and can record and compare the monitored data, such as Figure 5 As shown, the working condition of the entire Internet of Vehicles system is evaluated. Finally, based on the working condition of the entire vehicle network of the intelligent connected vehicle under the joint action of business and attack, combined with the corresponding comprehensive evaluation method, the network resilience of the entire vehicle network of the intelligent connected vehicle is comprehensively evaluated.

[0097] According to another embodiment of the embodiments of the present application, a vehicle-mounted network network resilience testing system is provided, comprising the vehicle-mounted network network resilience multimodal testing platform described in any of the above embodiments.

[0098] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0099] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0100] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0101] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0102] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A multi-modal test platform for vehicle network resilience, characterized in that: include: A guidance and control subsystem, wherein the guidance and control subsystem is used to configure a test mode for testing the vehicle in-vehicle network in a data transmission unit according to a test requirement when a test requirement for the network resilience of the vehicle in-vehicle network is received; A stimulus generation subsystem, used for generating a stimulus event for testing the vehicle-mounted network according to the test requirements, and injecting the stimulus event into the vehicle through a data transmission unit configured with the test mode; An evaluation and analysis subsystem, configured to obtain test data through a data transmission unit configured with the test mode, and analyze the network resilience of the vehicle-mounted network through the test data, wherein the test data is test data obtained by the vehicle executing the stimulus event; The guidance control subsystem, the excitation generation subsystem and the evaluation and analysis subsystem are connected to the vehicle through the data transmission unit, respectively. The guidance and control subsystem is further used to parse the test requirement and obtain the modal configuration requirement and the excitation scheduling requirement when receiving the test requirement; the guidance and control subsystem includes: a modal configuration module, which is used to configure the test mode corresponding to the electronic and electrical architecture of the vehicle in the data transmission unit according to the modal configuration requirement, wherein different types of vehicles correspond to different electronic and electrical architectures; The modal configuration module is also used to parse the modal configuration requirements to obtain the configuration information of the test modality; wherein the configuration information of the test modality includes: a vehicle-mounted network topology description, a stimulus injection description and a data acquisition description; wherein the vehicle-mounted network topology description is used to describe the connection topology of the vehicle-mounted network corresponding to the electronic and electrical architecture of the vehicle; the modal configuration module is also used to configure the connection topology of the vehicle-mounted network in the data transmission unit according to the vehicle-mounted network topology description; the modal configuration module is also used to deploy a stimulus injection point in the data transmission unit including the connection topology of the vehicle-mounted network according to the stimulus injection description, and the stimulus injection point is used for the stimulus generation subsystem to inject the stimulus event; the modal configuration module is also used to deploy a data acquisition point in the data transmission unit including the connection topology of the vehicle-mounted network according to the data acquisition description, and the data acquisition point is used for the evaluation and analysis subsystem to obtain the test data; wherein the test modality is the state of the data transmission unit after configuration, and the state includes the connection topology of the vehicle-mounted network, the stimulus injection point and the data acquisition point after configuration.

2. The vehicle network resilience multimodal testing platform according to claim 1 is characterized in that: The guidance and control subsystem also includes: a dynamic scheduling module, which is used to instruct the stimulus generation subsystem to generate the stimulus event according to the stimulus scheduling requirements, and instruct the stimulus generation subsystem to inject the stimulus event into the vehicle-mounted network through the stimulus injection point.

3. The vehicle network resilience multimodal testing platform according to claim 2 is characterized in that: The incentive generation subsystem includes: a business incentive module and an attack incentive engine, wherein the business incentive module and the attack incentive engine are respectively connected to the car through the data transmission unit; The service incentive module includes: a service scheduling unit and a service library connected to the service scheduling unit, wherein the service library includes: various services that are allowed to occur when the vehicle is in a normal operating state, each of the various services includes: a service incentive event that is allowed to be generated when each service occurs, and network data used to generate the service incentive event; The service scheduling unit is used to receive a first scheduling instruction generated by the dynamic scheduling module according to the incentive scheduling requirement, schedule a first service from the various services according to the first scheduling instruction, and inject the first service into the vehicle network through the incentive injection point, wherein the incentive event includes: the first service.

4. The vehicle network resilience multimodal testing platform according to claim 3 is characterized in that: The attack incentive engine is used to receive the second scheduling instruction generated by the dynamic scheduling module according to the incentive scheduling requirement, generate a second service according to the second scheduling instruction, and inject the second service into the vehicle network through the incentive injection point, wherein the incentive event includes the second service, and wherein the second service includes: the network attack event that the vehicle network is allowed to accept as indicated by the test requirement.

5. The vehicle network resilience multimodal testing platform according to claim 4 is characterized in that: The attack incentive engine includes an attack strategy library, an attack load library and a vulnerability library respectively connected to the attack strategy library; The attack load library includes multiple network attack events, the attack load library records the attack loads corresponding to the multiple network attack events respectively, and the vulnerability library records the security vulnerabilities that the multiple network attack events respectively allow to be exploited; The attack incentive engine is used to schedule the network attack event from the multiple network attack events according to the second scheduling instruction; The attack incentive engine is further used to schedule the attack payload corresponding to the network attack event from the attack payload library, and / or schedule the security vulnerability corresponding to the network attack event from the vulnerability library; The attack incentive engine is further used to encapsulate the network attack event, the attack payload corresponding to the network attack event and / or the security vulnerability corresponding to the network attack event as the second service.

6. The vehicle network resilience multimodal testing platform according to claim 4, characterized in that: The evaluation and analysis subsystem is used to obtain first test data through the data collection point after the service incentive module injects the first service into the vehicle-mounted network through the incentive injection point according to the first scheduling instruction; The evaluation and analysis subsystem is further configured to obtain second test data through the data collection point after the service incentive module injects the first service into the vehicle network through the incentive injection point according to the first scheduling instruction, and after the attack incentive engine injects the second service into the vehicle network through the incentive injection point according to the second scheduling instruction; The test data includes: the first test data and the second test data.

7. The vehicle network resilience multimodal testing platform according to claim 6, characterized in that: The evaluation and analysis subsystem is further used to generate a first analysis curve according to the first test data, and to generate a second analysis curve according to the second test data; The evaluation and analysis subsystem is further used to compare the first analysis curve and the second analysis curve to analyze the network resilience of the vehicle's in-vehicle network.

8. A multi-modal test system for vehicle network resilience, characterized in that: A multimodal testing platform for vehicle network resilience comprising the vehicle network described in any one of claims 1-7.

Images