Safety test analysis method and device, electronic equipment and vehicle

Abstract

The invention discloses a safety test analysis method and apparatus, an electronic device and a vehicle. The method comprises the steps of obtaining a design operation domain of a target vehicle; the design operation domain comprises a plurality of performance descriptions for the target vehicle; abstracting performance description in the design operation domain into a multi-layer scene structure; according to the target performance description in the design operation domain, a test case is constructed based on the multilayer scene structure; and based on the test case, performing a generalization safety test on the target vehicle to obtain performance boundary data of the target vehicle. According to the embodiment of the invention, the method does not depend on the function insufficiency obtained through the forward analysis, and can optimize and improve the expected function safety test verification analysis method from the function of the performance description of the design operation domain. The embodiment of the invention can conveniently perform safety test analysis of the vehicle, and can be widely applied to the technical field of data processing.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a safety testing and analysis method, device, electronic equipment and vehicle. Background Art

[0002] In the work of access and road access for intelligent connected vehicles, it is necessary to clearly define the expected functional safety capabilities of enterprises for their safety assurance capabilities, to ensure that the products do not have unreasonable risks caused by the lack of expected functions of the autonomous driving system, and to have the definition of verification and confirmation strategies. It can be seen that the expected functional safety test verification is becoming increasingly important. At present, the mainstream of the industry adopts the forward analysis method, starting from the hazard risk assessment, conducting IFTC (functional deficiencies and triggering conditions) analysis, and then conducting STPA (system theoretical process analysis), and finally writing corresponding test cases and determining test methods for functional deficiencies and possible triggering conditions. This method is oriented towards forward development, and the test content depends on the quality and number of functional deficiencies and triggering conditions obtained through analysis. In view of the aforementioned characteristics, the analysis process of the existing technology is relatively cumbersome. Summary of the invention

[0003] The present invention aims to solve the problem of related technical limitations at least to a certain extent. To this end, the present invention proposes a safety test analysis method, device, electronic equipment and vehicle, which can conveniently perform safety test analysis.

[0004] On the one hand, an embodiment of the present invention provides a security test analysis method, including:

[0005] Obtaining a design operation domain of a target vehicle; the design operation domain includes a plurality of performance descriptions for the target vehicle;

[0006] Abstract the performance description in the design operation domain into a multi-layer scenario structure;

[0007] According to the target performance description in the design operation domain, test cases are constructed based on a multi-layer scenario structure;

[0008] Based on the test cases, a generalized safety test is performed on the target vehicle to obtain the performance boundary data of the target vehicle.

[0009] In some embodiments, the multi-layer scenario structure includes road information, road signs, temporary facilities, target information, weather conditions, data information, and vehicle information; abstracting the performance description in the design operation domain into the multi-layer scenario structure includes the following steps:

[0010] A multi-layer scenario structure is constructed based on the road information, road signs, temporary facilities, target information, weather conditions, data information and vehicle information involved in the performance description;

[0011] Among them, road information includes lane lines / traffic markings, lane information, number of lanes, road shape, road surface, road slope, boundaries and intersections; road signs include road signs and curbs; temporary facilities include construction signs, fences, warning lights and reflective stickers; target information includes target vehicle type, target vehicle speed, relative information, taillights and driving lanes; weather conditions include lighting, weather, wind level and day and night; data information includes algorithm data, map data, signal data and environmental interference; vehicle information includes vehicle speed, vehicle information and driver.

[0012] In some embodiments, the method further comprises the following steps:

[0013] In response to the test requirements of the target object for the expected function, the performance description corresponding to the expected function in the design operation domain is used as the target performance description.

[0014] In some embodiments, the target performance description is determined based on the test requirements of the target object for the expected function; the test case includes a test scenario, test parameters, test methods and evaluation criteria; according to the target performance description in the design operation domain, the test case is constructed based on a multi-layer scenario structure, including the following steps:

[0015] According to the target performance description, select the target structure from the multi-layer scenario structure to establish the test scenario;

[0016] constructing test parameters in response to the setup instructions of the target object;

[0017] Determine the test method based on the test scenario and test parameters, and determine the evaluation criteria based on the expected functions.

[0018] In some embodiments, based on the test case, a generalized safety test is performed on the target vehicle to obtain performance boundary data of the target vehicle, including the following steps:

[0019] Generalize the test scenarios and test parameters in the test cases to obtain multiple groups of target test cases;

[0020] Perform safety tests on the target vehicle in sequence based on all target test cases, and obtain test results of the target vehicle in each group of target test cases;

[0021] Traverse the test results of all target tests to obtain the performance boundary data of the target vehicle;

[0022] Among them, the performance boundary data is used to quantify the performance parameters of the target vehicle.

[0023] In some embodiments, the performance boundary data is used to quantify the performance parameters of the target vehicle; the method further comprises the following steps:

[0024] Based on the performance parameters, the target performance description of the target vehicle is regressively modified.

[0025] In some embodiments, the target performance description is determined based on the test requirements of the target object for the expected function; the performance boundary data is used to quantify the performance parameters of the target vehicle, and the method further includes the following steps:

[0026] Based on the performance parameters, the expected functions of the target vehicle are optimized and improved, and then the closed-loop analysis of the target vehicle is completed through regression testing.

[0027] On the other hand, an embodiment of the present invention provides a security test analysis device, including:

[0028] The first module is used to obtain the design operation domain of the target vehicle; the design operation domain includes multiple performance descriptions for the target vehicle;

[0029] The second module is used to abstract the performance description in the design operation domain into a multi-layer scenario structure;

[0030] The third module is used to construct test cases based on a multi-layer scenario structure according to the target performance description in the design operation domain;

[0031] The fourth module is used to perform generalized safety testing on the target vehicle based on test cases to obtain performance boundary data of the target vehicle.

[0032] In some embodiments, the apparatus further comprises:

[0033] The fifth module is used to respond to the test requirements of the target object for the expected function and use the performance description corresponding to the expected function in the design operation domain as the target performance description.

[0034] In some embodiments, the performance boundary data is used to quantify the performance parameters of the target vehicle; the device further comprises:

[0035] The sixth module is used to regressively modify the target performance description of the target vehicle based on the performance parameters.

[0036] In some embodiments, the target performance description is determined based on the test requirements of the target object for the expected function; the performance boundary data is used to quantify the performance parameters of the target vehicle; and the device further includes:

[0037] The seventh module is used to optimize and improve the expected functions of the target vehicle based on performance parameters, and then complete the closed-loop analysis of the target vehicle through regression testing.

[0038] On the other hand, an embodiment of the present invention provides an electronic device, including: a processor and a memory; the memory is used to store programs; the processor executes the program to implement the above-mentioned security testing and analysis method.

[0039] On the other hand, an embodiment of the present invention provides a computer storage medium, in which a program executable by a processor is stored. The program executable by the processor is used to implement the above-mentioned security testing and analysis method when executed by the processor.

[0040] On the other hand, an embodiment of the present invention provides a vehicle, which includes the above-mentioned safety testing and analysis device or the above-mentioned electronic device.

[0041] The embodiment of the present invention obtains the design operation domain of the target vehicle; the design operation domain includes multiple performance descriptions for the target vehicle; the performance descriptions in the design operation domain are abstracted into a multi-layer scenario structure; according to the target performance description in the design operation domain, a test case is constructed based on the multi-layer scenario structure; based on the test case, a generalized safety test is performed on the target vehicle to obtain the performance boundary data of the target vehicle. The embodiment of the present invention does not rely on the functional deficiencies obtained by forward analysis, and can optimize and improve the expected functional safety test verification analysis method based on the function of the performance description of the design operation domain itself. The embodiment of the present invention can conveniently perform vehicle safety test analysis. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings are used to provide a further understanding of the technical solution of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the technical solution of the present invention and do not constitute a limitation on the technical solution of the present invention.

[0043] Figure 1 This is a schematic diagram of an implementation environment for security testing and analysis provided by an embodiment of the present invention;

[0044] Figure 2 It is a flowchart of a security test analysis method provided by an embodiment of the present invention;

[0045] Figure 3 A schematic diagram of a multi-layer scene structure provided by an embodiment of the present invention;

[0046] Figure 4 A schematic diagram of a first extended process of the security test analysis method provided by an embodiment of the present invention;

[0047] Figure 5 A schematic diagram of the expansion process of constructing a test case provided by an embodiment of the present invention;

[0048] Figure 6 A schematic diagram of the development process of a generalized security test provided by an embodiment of the present invention;

[0049] Figure 7 A schematic diagram of a second extended process of the security test analysis method provided in an embodiment of the present invention;

[0050] Figure 8 A schematic diagram of a third extended process of the security test analysis method provided in an embodiment of the present invention;

[0051] Fig. 9 A schematic diagram of the structure of a security testing and analysis device provided by an embodiment of the present invention;

[0052] Fig.10 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0054] It should be noted that, although the functional modules are divided in the system schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the system or the order in the flowchart. The terms "first / S100", "second / S200", etc. in the specification, claims and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0055] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0056] To facilitate the understanding of the technical solution of the present invention, the proprietary technical terms that may be cited in the embodiments of the present invention are first explained:

[0057] ODD, or Operational Design Domain, is the external environmental conditions applicable to the functional operation of the autonomous driving system determined when the system is designed. These conditions include but are not limited to factors such as road type, driving area, speed, and environment. ODD defines the conditions under which the autonomous driving system can work properly, and is crucial to ensuring the reliability and safety of the system. For example, if the ODD defines that a system can only operate on highways, the system may not be guaranteed to work properly on urban roads or under complex road conditions. Therefore, the wider the scope of the ODD, the higher the applicability of the autonomous driving system, but it also means that more complex system design and higher technical requirements are required.

[0058] It is understandable that the security test analysis method provided in the embodiment of the present invention can be applied to any computer device with data processing and computing capabilities, and this computer device can be various types of terminals or servers. When the computer device in the embodiment is a server, the server is an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, the terminal is a smart phone, a tablet computer, a laptop computer, and a desktop computer, but is not limited to this.

[0059] like Figure 1 FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present invention. Figure 1 The implementation environment includes at least one terminal 102 and a server 101. The terminal 102 and the server 101 can be connected to a network wirelessly or wired to complete data transmission and exchange.

[0060] Server 101 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0061] In addition, the server 101 can also be a node server in the blockchain network. Blockchain is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, and encryption algorithm.

[0062] The terminal 102 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc. The terminal 102 may also be a vehicle-mounted terminal of various device types described above, but is not limited thereto. The terminal 102 and the server 101 may be directly or indirectly connected via wired or wireless communication, which is not limited in this embodiment of the present invention.

[0063] Based on the example Figure 1In the implementation environment shown, an embodiment of the present invention provides a security test analysis method, which is described below using the security test analysis method applied in the server 101 as an example. It can be understood that the security test analysis method can also be applied in the terminal 102.

[0064] Reference Figure 2 , Figure 2 The flowchart of the security test analysis method applied to the server provided by the embodiment of the present invention, the execution subject of the security test analysis method can be any of the aforementioned computer devices (including servers or terminals). Figure 2 , the method comprises the following steps:

[0065] S100, obtaining a design operation domain of a target vehicle;

[0066] Among them, the design operation domain includes multiple performance descriptions for the target vehicle;

[0067] Exemplarily, in some specific implementations, the present invention starts from ODD (design operation domain), takes the operation scenarios and system boundaries of the function definition as analysis objects, and derives test cases and determines test methods.

[0068] S200, abstracting the performance description in the design operation domain into a multi-layer scenario structure;

[0069] It should be noted that the multi-layer scene structure includes road information, road signs, temporary facilities, target information, weather conditions, data information and vehicle information; in some embodiments, step S200 may include the following steps: constructing a multi-layer scene structure based on the road information, road signs, temporary facilities, target information, weather conditions, data information and vehicle information involved in the performance description;

[0070] Among them, Figure 3 As shown, road information includes lane lines / traffic markings, lane information, number of lanes, road shape, road surface, road slope, boundaries and intersections; road signs include road signs and curbs; temporary facilities include construction signs, fences, warning lights and reflective stickers; target information includes target vehicle type, target vehicle speed, relative information, taillights and driving lanes; weather conditions include lighting, weather, wind level and day and night; data information includes algorithm data, map data, signal data and environmental interference; vehicle information includes vehicle speed, vehicle information and driver.

[0071] For example, in some specific implementations, the present invention abstracts the performance description of natural language in ODD into Figure 3 The 7-layer scenario structure shown is made into a test case.

[0072] S300, according to the target performance description in the design operation domain, a test case is constructed based on a multi-layer scenario structure;

[0073] Among them, in some embodiments, such as Figure 4 As shown, the method may further include the following steps: S500, in response to the test requirements of the target object for the expected function, taking the performance description corresponding to the expected function in the design operation domain as the target performance description.

[0074] It should be noted that the target performance description is determined based on the target object's test requirements for the expected functions; the test case includes the test scenario, test parameters, test method and evaluation criteria; Figure 5 As shown, in some embodiments, step S300 may include the following steps: S301, based on the target performance description, select a target structure from a multi-layer scenario structure to establish a test scenario; S302, construct test parameters in response to the setting instructions of the target object; S303, determine the test method based on the test scenario and test parameters, and determine the evaluation criteria based on the expected function.

[0075] Exemplarily, in some specific implementations, take a performance description in ODD as an example: Under the functional operation environment, the system should recognize traffic signs (such as construction signs / construction signs) in the road topology and operate normally. Corresponding to the test case, the "temporary facilities" construction signs (i.e. construction signs) in the 7-layer scenario architecture are selected to establish a test scenario. Test scenario: three lanes, the autonomous driving vehicle cruises in lanes 1 and 3 at the functional speed limit (120kph), and construction signs and speed limit signs are arranged on the far outside, for a total of 6 groups of tests. Evaluation criteria: The autonomous driving function should recognize the signs and actively reduce the speed to the expected speed. Test method: field test, the lane width is 3.2-3.5 meters, and the test is carried out in good daylight.

[0076] Of course, for this scenario, only a single ODD scenario is targeted. So let's take another example: in the functional operation environment, the system should operate normally in the rain. For the corresponding test case, select the "weather conditions" weather and rain in the 7-layer scenario architecture to establish the test scenario. Test scenario: straight road, two-way 4 lanes, there is a target vehicle in front of the lane, 100 meters away. The test vehicle keeps driving in the lane at 90km / h (increase or decrease in steps of 5km / h), the target vehicle is stationary, and the rainfall levels are small, medium, and heavy, with a total of 3 groups of tests. Evaluation criteria: The autonomous driving function should identify the stationary vehicle in front and actively change lanes or slow down to stop. Test method: field test, lane width is 3.2-3.5 meters, rain simulation field, and the human driver model in R157 is used as the test benchmark. For the ODD condition of rain, it is not meaningful to test it alone, so the scene of a stationary vehicle in front is superimposed. Superimpose the environmental conditions with the functional scenarios (only one is listed in this example, other scenarios such as construction signs can also be superimposed) to fully explore the performance boundaries of the functions and transform the unknown scenarios in the sotif into known scenarios.

[0077] Among them, the parameter data involved (i.e., test parameters, such as upper speed limit, number of lanes, setting position of each structure in the scene, rainfall level, etc.) can be adaptively adjusted according to the tester (i.e., target object) based on the actual application scenario.

[0078] S400: Based on the test case, perform a generalized safety test on the target vehicle to obtain performance boundary data of the target vehicle.

[0079] It should be noted that in some embodiments, Figure 6 As shown, step S400 may include the following steps: S401, generalize the test scenarios and test parameters in the test cases to obtain multiple groups of target test cases; S402, perform safety tests on the target vehicle in turn based on all target test cases to obtain the test results of the target vehicle in each group of target test cases; S403, traverse the test results of all target tests to obtain the performance boundary data of the target vehicle; wherein the performance boundary data is used to quantify the performance parameters of the target vehicle.

[0080] In some embodiments, the performance boundary data is used to quantify the performance parameters of the target vehicle; Figure 7 As shown, the method may further include the following steps: S600, regressively modifying the target performance description of the target vehicle based on the performance parameters.

[0081] In some embodiments, the target performance description is determined based on the test requirements of the target object for the expected function; the performance boundary data is used to quantify the performance parameters of the target vehicle, such as Figure 8As shown, the method may further include the following steps: S700, based on the performance parameters, optimizing and improving the expected functions of the target vehicle, and then completing the closed-loop analysis of the target vehicle through regression testing.

[0082] For example, in some specific implementations, it can be seen from the two examples mentioned above that the ODD does not clearly describe the style of construction signs, speed limit, rainfall and other elements. Then for the SOTIF (safety of intended functionality) test, it is impossible to formulate definite and quantified test content, so when formulating test cases, one part is based on the ODD description, and one part is generalized (such as specifying different speed limits, different styles of construction signs, and different rainfall). While verifying whether the functions in the ODD are implemented, find the performance boundaries of the functions and quantify the performance parameters. On the one hand, regress and modify the content defined by the ODD to clarify the ODD area of ​​the function. On the other hand, optimize and improve the functions, and then perform regression testing to complete the closed loop.

[0083] In order to explain the principle of the technical solution of the present invention in detail, the overall process of the present invention is described below in combination with some specific embodiments. It is easy to understand that the following is an explanation of the technical principle of the present invention and cannot be regarded as a limitation of the present invention.

[0084] First of all, it should be noted that at present, the mainstream of the industry adopts the forward analysis method, starting from the hazard risk assessment, conducting IFTC (functional deficiencies and triggering conditions) analysis, and then conducting STPA (system theoretical process analysis), and finally writing corresponding test cases and determining test methods for functional deficiencies and possible triggering conditions. This method is oriented to forward development, and the test content depends on the quality and number of functional deficiencies and triggering conditions obtained by analysis.

[0085] In view of this, the present invention provides an expected functional safety analysis and testing method based on ODD, which can optimize and improve the expected functional safety test verification and analysis method. The present invention provides an expected functional safety analysis and testing method based on ODD. Different from the test cases obtained by the forward analysis of the expected functional safety, the present invention does not rely on the functional deficiencies obtained by the forward analysis, and can optimize and improve the expected functional safety test verification and analysis method based on the function itself. The present invention can be implemented as follows:

[0086] The present invention provides an expected functional safety analysis and testing method based on ODD, which can optimize and improve the expected functional safety test verification and analysis method. At present, the mainstream of the industry adopts the forward analysis method, starting from the hazard risk assessment, and conducting IFTC (functional deficiencies and triggering conditions) analysis, and then conducting STPA (system theoretical process analysis), and finally writing corresponding test cases and determining test methods for functional deficiencies and possible triggering conditions. Starting from ODD (design operation domain), the present invention takes the operation scenarios and system boundaries of the function definition as the analysis objects, and derives test cases and determines test methods.

[0087] Abstract the performance description of natural language in ODD into Figure 3 The 7-layer scenario structure shown is used to make test cases. Here, one of the ODD is taken as an example: Under the functional operation environment, the system should recognize the traffic signs (such as construction signs / construction signs) in the road topology and operate normally. Corresponding to the test case, the "temporary facilities" construction signs (i.e. construction signs) in the 7-layer scenario architecture are selected to establish the test scenario. Test scenario: three lanes, the autonomous driving vehicle cruises in lanes 1 and 3 at the functional speed limit (120kph), and construction signs and speed limit signs are arranged on the far side, for a total of 6 groups of tests. Evaluation criteria: The autonomous driving function should recognize the signs and actively reduce the speed to the expected speed. Test method: field test, the lane width is 3.2-3.5 meters, and the test is carried out in good daylight.

[0088] Of course, for this scenario, only a single ODD scenario is targeted. So let's take another example: in the functional operation environment, the system should operate normally in the rain. For the corresponding test case, select the "weather conditions" weather and rain in the 7-layer scenario architecture to establish the test scenario. Test scenario: straight road, two-way 4 lanes, there is a target vehicle in front of the lane, 100 meters away. The test vehicle keeps driving in the lane at 90km / h (increase or decrease in steps of 5km / h), the target vehicle is stationary, and the rainfall levels are small, medium, and heavy, with a total of 3 groups of tests. Evaluation criteria: The autonomous driving function should identify the stationary vehicle in front and actively change lanes or slow down to stop. Test method: field test, lane width is 3.2-3.5 meters, rain simulation field, and the human driver model in R157 is used as the test benchmark. For the ODD condition of rain, it is not meaningful to test it alone, so the scene of a stationary vehicle in front is superimposed. Superimpose the environmental conditions with the functional scenarios (only one is listed in this example, other scenarios such as construction signs can also be superimposed) to fully explore the performance boundaries of the functions and transform the unknown scenarios in the sotif into known scenarios.

[0089] From the above two examples, it can be seen that the ODD does not clearly describe the style of construction signs, speed limit, rainfall and other elements. Therefore, for SOTIF testing, it is impossible to formulate definite and quantified test content. Therefore, when formulating test cases, part of it is based on the ODD description, and part of it is generalized (such as specifying different speed limits, different styles of construction signs, and different rainfall). While verifying whether the functions in the ODD are implemented, find the performance boundaries of the functions and quantify the performance parameters. On the one hand, regress and modify the content defined in the ODD to clarify the ODD area of ​​the function. On the other hand, optimize and improve the functions, and then perform regression testing to complete the closed loop.

[0090] In summary, the invention starts from ODD (design operation domain), takes the operation scenarios and system boundaries of the function definition as the analysis objects, derives test cases and determines the test methods, does not rely on the functional deficiencies obtained by analysis, starts from the function itself, first finds the performance boundary of the function, that is, the functional deficiency, and reversely helps the forward analysis, helps the regression modification of the content defined by ODD, clarifies the ODD area of ​​the function, and secondly helps to optimize and improve the function, and then performs regression testing to complete the closed loop.

[0091] On the other hand, Fig. 9 As shown, an embodiment of the present invention provides a security test analysis device 900, which may include:

[0092] The first module 910 is used to obtain a design operation domain of a target vehicle; the design operation domain includes a plurality of performance descriptions for the target vehicle;

[0093] The second module 920 is used to abstract the performance description in the design operation domain into a multi-layer scenario structure;

[0094] The third module 930 is used to construct test cases based on a multi-layer scenario structure according to the target performance description in the design operation domain;

[0095] The fourth module 940 is used to perform a generalized safety test on the target vehicle based on the test case to obtain performance boundary data of the target vehicle.

[0096] In some embodiments, the apparatus may further include:

[0097] The fifth module is used to respond to the test requirements of the target object for the expected function and use the performance description corresponding to the expected function in the design operation domain as the target performance description.

[0098] In some embodiments, the performance boundary data is used to quantify the performance parameters of the target vehicle; the apparatus may further include:

[0099] The sixth module is used to regressively modify the target performance description of the target vehicle based on the performance parameters.

[0100] In some embodiments, the target performance description is determined based on the test requirements of the target object for the expected function; the performance boundary data is used to quantify the performance parameters of the target vehicle; the device may also include:

[0101] The seventh module is used to optimize and improve the expected functions of the target vehicle based on performance parameters, and then complete the closed-loop analysis of the target vehicle through regression testing.

[0102] The contents of the method embodiments of the present invention are all applicable to the device embodiments. The functions specifically implemented by the device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0103] On the other hand, an embodiment of the present invention further provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the above-mentioned security test analysis method when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a vehicle-mounted computer, etc.

[0104] It can be understood that the contents of the above method embodiments are all applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0105] like Fig.10 As shown, Fig.10 The hardware structure of an electronic device 1000 of another embodiment is illustrated. The electronic device 1000 includes:

[0106] The processor 1001 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present invention.

[0107] The memory 1002 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1002 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 1002, and the processor 1001 calls and executes the network node population optimization method of the embodiment of the present invention;

[0108] Input / output interface 1003, used to implement information input and output;

[0109] The communication interface 1004 is used to realize the communication interaction between the device and other devices. The communication can be realized through a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.);

[0110] A bus 1005 , which transmits information between various components of the device (e.g., the processor 1001 , the memory 1002 , the input / output interface 1003 , and the communication interface 1004 );

[0111] The processor 1001 , the memory 1002 , the input / output interface 1003 and the communication interface 1004 are connected to each other in communication within the device via the bus 1005 .

[0112] The electronic device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0113] The contents of the method embodiments of the present invention are all applicable to the electronic device embodiments. The functions specifically implemented by the electronic device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0114] Another aspect of an embodiment of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a program, and the program is executed by a processor to implement the above method.

[0115] It should be noted that the computer-readable medium shown in the embodiment of the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (Compact Disc Read to Only Memory, CD to ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0116] The contents of the method embodiments of the present invention are all applicable to the computer-readable storage medium embodiments. The functions specifically implemented by the computer-readable storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0117] The embodiment of the present invention also discloses a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device can read the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the above method.

[0118] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0119] It should be noted that, although several modules of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0120] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD to ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation of the present invention.

[0121] In some selectable embodiments, the function / operation mentioned in the block diagram may not occur in the order mentioned in the operation diagram. For example, depending on the function / operation involved, the two boxes shown in succession can actually be executed substantially simultaneously or the boxes can sometimes be executed in reverse order. In addition, the embodiment presented and described in the flow chart of the present invention is provided by way of example, for the purpose of providing a more comprehensive understanding of technology. The disclosed method is not limited to the operation and logic flow presented herein. Selectable embodiments are expected, wherein the order of various operations is changed and the sub-operation of a part for which is described as a larger operation is performed independently.

[0122] In addition, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise specified, one or more of the functions and / or features can be integrated into a single physical device and / or software module, or one or more functions and / or features can be implemented in a separate physical device or software module. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary for understanding the present invention. More specifically, in view of the properties, functions and internal relationships of the various functional modules in the device disclosed herein, the actual implementation of the module will be understood within the conventional skills of the engineer. Therefore, those skilled in the art can implement the present invention set forth in the claims without excessive experimentation using ordinary techniques. It is also understood that the specific concepts disclosed are merely illustrative and are not intended to limit the scope of the present invention, which is determined by the full scope of the appended claims and their equivalents.

[0123] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0124] The logic and / or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer-readable medium for use by an instruction execution device, apparatus or device (such as a computer-based device, a device including a processor, or other device that can fetch instructions from an instruction execution device, apparatus or device and execute the instructions), or in conjunction with such instruction execution device, apparatus or device. For purposes of this specification, "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution device, apparatus or device, or in conjunction with such instruction execution device, apparatus or device.

[0125] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0126] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution device. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0127] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0128] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

[0129] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present invention.

Claims

1. A security test analysis method, characterized in that: The following steps are involved: Acquire a design operation domain of a target vehicle; the design operation domain includes a plurality of performance descriptions for the target vehicle; Abstracting the performance description in the design operation domain into a multi-layer scenario structure; According to the target performance description in the design operation domain, a test case is constructed based on the multi-layer scenario structure; Based on the test case, a generalized safety test is performed on the target vehicle to obtain performance boundary data of the target vehicle.

2. The safety test analysis method according to claim 1, characterized in that: The multi-layer scenario structure includes road information, road signs, temporary facilities, target information, weather conditions, data information and vehicle information; abstracting the performance description in the design operation domain into a multi-layer scenario structure includes the following steps: The multi-layer scenario structure is constructed based on the road information, road signs, temporary facilities, target information, weather conditions, data information and vehicle information involved in the performance description; Among them, the road information includes lane lines / traffic markings, lane information, number of lanes, road shape, road surface, road slope, boundaries and intersections; the road signs include road signs and curbs; temporary facilities include construction signs, fences, warning lights and reflective stickers; the target information includes target vehicle type, target vehicle speed, relative information, taillights and driving lanes; the weather conditions include lighting, weather, wind level and day and night; the data information includes algorithm data, map data, signal data and environmental interference; the vehicle information includes vehicle speed, vehicle information and driver.

3. The safety test analysis method according to claim 1, characterized in that: The method further comprises the following steps: In response to the test requirements of the target object for the expected function, the performance description corresponding to the expected function in the design operation domain is used as the target performance description.

4. The safety test analysis method according to claim 1, characterized in that: The target performance description is determined based on the test requirements of the target object for the expected function; the test case includes a test scenario, test parameters, test method and evaluation criteria; the test case is constructed based on the multi-layer scenario structure according to the target performance description in the design operation domain, including the following steps: According to the target performance description, selecting a target structure from the multi-layer scenario structure to establish a test scenario; constructing test parameters in response to the setting instructions of the target object; A test method is determined based on the test scenario and the test parameters, and an evaluation criterion is determined based on the expected function.

5. The safety test analysis method according to claim 1, characterized in that: The method of performing a generalized safety test on the target vehicle based on the test case to obtain performance boundary data of the target vehicle includes the following steps: Generalizing the test scenarios and the test parameters in the test cases to obtain multiple groups of target test cases; Performing safety tests on the target vehicle in sequence based on all the target test cases, and obtaining test results of the target vehicle in each group of the target test cases; Traversing the test results of all the target tests to obtain performance boundary data of the target vehicle; The performance boundary data is used to quantify the performance parameters of the target vehicle.

6. The safety test analysis method according to claim 1, characterized in that: The performance boundary data is used to quantify the performance parameters of the target vehicle; the method further comprises the following steps: Based on the performance parameters, the target performance description of the target vehicle is regressively modified.

7. The safety test analysis method according to claim 1, characterized in that: The target performance description is determined based on the test requirements of the target object for the expected function; the performance boundary data is used to quantify the performance parameters of the target vehicle, and the method further includes the following steps: Based on the performance parameters, the expected functions of the target vehicle are optimized and improved, and then a closed-loop analysis of the target vehicle is completed through regression testing.

8. A safety test and analysis device, characterized in that: include: The first module is used to obtain the design operation domain of the target vehicle; The design operation domain includes a plurality of performance descriptions for the target vehicle; The second module is used to abstract the performance description in the design operation domain into a multi-layer scenario structure; The third module is used to construct a test case based on the multi-layer scenario structure according to the target performance description in the design operation domain; The fourth module is used to perform a generalized safety test on the target vehicle based on the test case to obtain performance boundary data of the target vehicle.

9. An electronic device, characterized in that: including a processor and a memory; The memory is used to store programs; The processor executes the program to implement the method according to any one of claims 1 to 7.

10. A vehicle, characterized in that: The vehicle includes the safety test and analysis device as claimed in claim 8 or the electronic device as claimed in claim 9.

Images