Method and system for testing advanced driver assistance functions

By using a dual-test-channel approach to test the warning and control functions of advanced driver assistance systems in parallel, the testing process is optimized, solving the problems of long testing and verification cycles and high costs in existing technologies, and achieving efficient functional testing and safe function release.

CN114416577BActive Publication Date: 2025-12-30NIO TECH ANHUI CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210079643.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-24
Publication Date
2025-12-30
Estimated Expiration
2042-01-24

AI Technical Summary

Technical Problem

The testing and verification of existing advanced driver assistance functions are time-consuming, costly, and inefficient, requiring multiple driving tests to be conducted on road surfaces in each test scenario.

Method used

A dual-channel testing approach is adopted to test warning functions and control functions separately. Warning functions are tested through the first test channel and released in the third test mode, while control functions are tested through the second test channel and tested in shadow mode. The testing process is optimized by utilizing software-in-the-loop, hardware-in-the-loop, and real vehicle testing.

Benefits of technology

It shortens the release time of warning functions, reduces the testing cost of control functions, improves the efficiency of functional testing and user experience, and ensures that function release complies with design specifications and security requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114416577B_ABST
    Figure CN114416577B_ABST
Patent Text Reader

Abstract

The present application relates to a method, system, computer storage medium and computer device for testing advanced driver assistance functions. According to one aspect of the present application, a method for testing advanced driver assistance functions is proposed, the advanced driver assistance functions including warning type functions and control type functions, the method comprising the following steps: testing the warning type functions through a first test channel, and releasing the warning type functions to a third test mode in response to the warning type functions passing the test in a first test mode and a second test mode; and testing the control type functions through a second test channel, and pushing the control type functions to the third test mode in the first test channel to be tested simultaneously with the released warning type functions while entering the second test mode in response to the control type functions passing the test in the first test mode.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of vehicle control, and more specifically to a method, system, computer storage medium, and computer device for testing advanced driver assistance functions. Background Technology

[0002] Advanced driver assistance systems (ADAS) utilize various sensors installed on the vehicle to sense the surrounding environment in real time, collect data, identify static and dynamic objects, and perform calculations and analyses in conjunction with navigation map data. This allows the driver to anticipate potential dangers, thereby improving driving comfort and safety.

[0003] Before advanced driver assistance features (ADAS) are actually delivered and put into use, they typically need to undergo various testing processes, such as software simulation testing, track simulation testing, and public road testing, to fully verify their usability and ensure that they meet the requirements for safety, comfort, and other aspects.

[0004] However, current testing and verification methods require deploying corresponding road ranges in each test scenario and then conducting repeated driving tests on each algorithm, resulting in long testing and verification cycles, high testing costs, and low testing efficiency. Summary of the Invention

[0005] To address or at least alleviate one or more of the above problems, the following technical solutions are provided.

[0006] According to a first aspect of the present invention, a method for testing advanced driver assistance functions (ADAS) including warning functions and control functions is provided. The method includes the following steps: testing the warning functions through a first test channel, and releasing the warning functions to a third test mode in response to the warning functions passing tests in a first test mode and a second test mode; and testing the control functions through a second test channel, and simultaneously pushing the control functions to the third test mode in the first test channel for testing concurrently with the released warning functions in response to the control functions passing tests in the first test mode and entering the second test mode.

[0007] According to an embodiment of the present invention, a method for testing advanced driver assistance functions, wherein in the third test mode in the first test channel: the released warning function is run to cause the vehicle to respond to the warning function to perform a warning operation associated with the warning function; and the control function is tested in shadow mode.

[0008] According to one embodiment or any of the above embodiments of the present invention, the method for testing advanced driver assistance functions includes one or more of the following: forward collision warning function, rear collision warning function, lane departure warning function, blind spot collision warning function, door opening warning function, parking distance warning function, and driver status monitoring function.

[0009] According to one embodiment or any of the above embodiments of the present invention, the method for testing advanced driver assistance functions includes one or more of the following: automatic emergency braking function, adaptive cruise control function, cruise control function, automatic parking function, and pedestrian emergency braking function.

[0010] According to one embodiment or any of the above embodiments of the present invention, the method for testing advanced driver assistance functions, wherein testing the control function in shadow mode includes: running the control function but causing the vehicle not to respond to the control function to perform control operations associated with the control function.

[0011] According to one embodiment or any of the above embodiments of the present invention, the method for testing advanced driver assistance functions further includes: in the third test mode of the first test channel, determining that the control function passes the shadow mode test in response to the accuracy of the control function reaching a preset accuracy rate and the recall rate of the control function reaching a preset recall rate; in the second test mode of the second test channel, determining that the control function passes the test in the second test mode in response to the accuracy of the control function reaching a preset accuracy rate and the recall rate of the control function reaching a preset recall rate; and determining that the control function passes verification in response to the control function passing the shadow mode test and passing the test in the second test mode.

[0012] According to one or more embodiments of the present invention, the method for testing advanced driver assistance functions is provided, wherein the following differs for one or more of the test parameters of the warning functions and the control functions: test duration, test scenario parameters, mileage, and fault tolerance.

[0013] According to one or more embodiments of the present invention, the method for testing advanced driver assistance functions includes performing one or more of software-in-the-loop testing and hardware-in-the-loop testing in a first test mode, and performing real vehicle testing in a second test mode.

[0014] According to one embodiment or any of the above embodiments of the present invention, the method for testing advanced driver assistance functions is wherein the step of testing the warning function through the first test channel and the step of testing the control function through the second test channel are performed in parallel.

[0015] According to a second aspect of the invention, a system for testing advanced driver assistance functions (ADAS) including warning functions and control functions is provided. The system includes: a first testing unit configured to test the warning functions via a first testing channel, and to release the warning functions to a third testing mode in response to the warning functions passing tests in a first testing mode and a second testing mode; and a second testing unit configured to test the control functions via a second testing channel, and to push the control functions to the third testing mode in the first testing channel for simultaneous testing with the released warning functions in response to the control functions passing tests in the first testing mode and entering the second testing mode.

[0016] According to an embodiment of the present invention, a system for testing advanced driver assistance functions is provided, wherein the first test unit is further configured to: run the released warning function in the third test mode in the first test channel such that the vehicle responds to the warning function to perform a warning operation associated with the warning function; and test the control function in shadow mode.

[0017] According to one embodiment or any of the above embodiments of the present invention, the system for testing advanced driver assistance functions includes one or more of the following warning functions: forward collision warning function, rear collision warning function, lane departure warning function, blind spot collision warning function, door opening warning function, parking distance warning function, and driver status monitoring function.

[0018] According to one embodiment or any of the above embodiments of the present invention, the system for testing advanced driver assistance functions includes one or more of the following: automatic emergency braking function, adaptive cruise control function, cruise control function, automatic parking function, and pedestrian emergency braking function.

[0019] According to one embodiment or any of the above embodiments of the present invention, the system for testing advanced driver assistance functions, wherein the first test unit is configured to test the control function in shadow mode by running the control function but causing the vehicle not to respond to the control function to perform control operations associated with the control function.

[0020] According to one embodiment or any of the above embodiments of the present invention, the system for testing advanced driver assistance functions, wherein the first test unit is further configured to: determine that the control function has passed the shadow mode test in the third test mode in the first test channel in response to the accuracy of the control function reaching a preset accuracy and the recall of the control function reaching a preset recall; and send a signal to the second test unit indicating that the control function has passed the shadow mode test.

[0021] According to one embodiment or any of the above embodiments of the present invention, the system for testing advanced driver assistance functions, wherein the second testing unit is further configured to: determine that the control function passes the test in the second testing mode in the second testing channel in response to the accuracy of the control function reaching a preset accuracy rate and the recall rate of the control function reaching a preset recall rate; receive from the first testing unit a signal indicating that the control function passes the shadow mode test; and determine that the control function passes the verification in response to the control function passing the shadow mode test and passing the test in the second testing mode.

[0022] According to one or more embodiments of the present invention, the system for testing advanced driver assistance functions is provided, wherein the following differ for one or more of the test parameters of the warning functions and the control functions: test duration, test scenario parameters, mileage, and fault tolerance.

[0023] According to one embodiment or any of the above embodiments of the present invention, the system for testing advanced driver assistance functions, wherein the first test unit and the second test unit are configured to: perform one or more of software-in-the-loop testing and hardware-in-the-loop testing in the first test mode; and perform real vehicle testing in the second test mode.

[0024] According to a third aspect of the present invention, a computer storage medium is provided, the computer storage medium including instructions that, when executed, perform the steps of the method for testing advanced driver assistance functions according to a first aspect of the present invention.

[0025] According to a fourth aspect of the present invention, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program to implement the steps of the method for testing advanced driver assistance functions according to a first aspect of the present invention.

[0026] The scheme for testing advanced driver assistance functions according to one or more embodiments of the present invention can optimize the development, deployment, and testing and verification process according to different functional and performance requirements during the testing and verification process. It can test control functions while warning functions are actually running, thereby shortening the release time of warning functions and reducing the testing cost of control functions. It improves the efficiency of functional testing while ensuring that the function release complies with design specifications and safety. Attached Figure Description

[0027] The above and / or other aspects and advantages of the present invention will become clearer and more readily understood from the following description taken in conjunction with the accompanying drawings, in which the same or similar elements are denoted by the same reference numerals. In the drawings:

[0028] Figure 1 This is a flowchart of a method for testing advanced driver assistance functions according to an embodiment of the present invention.

[0029] Figure 2 This is a system block diagram for testing advanced driver assistance functions according to an embodiment of the present invention.

[0030] Figure 3 This is a flowchart of a method for testing advanced driver assistance functions according to an embodiment of the present invention.

[0031] Figure 4 This is a block diagram of a computer device according to an embodiment of the present invention. Detailed Implementation

[0032] The following detailed description is merely exemplary in nature and is not intended to limit the disclosed technology or its application and use. Furthermore, it is not intended to be bound by any express or implied theory presented in the foregoing technical fields, background art, or the following detailed description.

[0033] In the following detailed description of the embodiments, numerous specific details are set forth in order to provide a more thorough understanding of the disclosed technology. However, it will be apparent to those skilled in the art that the disclosed technology can be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.

[0034] Terms such as "comprising" and "including" indicate that, in addition to the units and steps that are directly and explicitly stated in the specification, the technical solution of the present invention does not exclude the presence of other units and steps that are not directly or explicitly stated. Terms such as "first" and "second" do not indicate the order of the units in terms of time, space, size, etc., but are merely used to distinguish the units.

[0035] It should be noted that, in the context of this invention, the term "shadow mode" refers to a situation where, during manual driving, the advanced driver assistance system and various sensors on the vehicle operate normally, but do not send commands to the vehicle actuators to actually control them.

[0036] In the following, various exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0037] Figure 1 This is a flowchart of a method for testing advanced driver assistance functions according to an embodiment of the present invention.

[0038] Optionally, advanced driver assistance (ADA) functions can be categorized into warning functions and control functions based on the maturity and validation level of the functional algorithms. It should be noted that the functional algorithm here represents a strategy mechanism that uses ADADA methods to describe a problem, which can be used to calculate vehicle control signals during ADADA function testing. For example, the functional algorithm may include an automatic emergency braking algorithm, which calculates brake cylinder pressure and controls vehicle speed based on that pressure; or an adaptive cruise control algorithm, which calculates vehicle acceleration and controls speed based on that acceleration. Optionally, the maturity of the functional algorithm can be determined based on accuracy and recall, where accuracy indicates the probability of false alarms and recall indicates the probability of missed alarms.

[0039] As examples, warning functions may include, but are not limited to, forward collision warning, rear collision warning, lane departure warning, blind spot collision warning, door opening warning, parking distance warning, and driver status monitoring. As examples, control functions may include, but are not limited to, automatic emergency braking, adaptive cruise control, cruise control, automatic parking, and pedestrian emergency braking.

[0040] like Figure 1 As shown, in step 101, the alert function is tested through the first test channel, and in response to the alert function passing the test in the first and second test modes, the alert function is released to the third test mode. In step 103, the control function is tested through the second test channel, and in response to the control function passing the test in the first test mode and entering the second test mode, the control function is pushed to the third test mode in the first test channel for simultaneous testing with the released alert function. Optionally, steps 101 and 103 can be executed in parallel. By simultaneously testing the released alert function and the control function that passed the test in the first test mode in the third test mode in the first test channel, the release time of the alert function can be shortened and the testing cost of the control function can be reduced.

[0041] Optionally, in step 101, releasing the alert function to the third test mode in response to the alert function passing the test in the first test mode and the second test mode may include: in the first test mode, determining that the alert function has passed the test in the first test mode in response to the accuracy rate of the alert function reaching a preset accuracy rate and the recall rate of the alert function reaching a preset recall rate; in the second test mode, determining that the alert function has passed the test in the second test mode in response to the accuracy rate of the alert function reaching a preset accuracy rate and the recall rate of the alert function reaching a preset recall rate; and releasing the alert function to the third test mode in response to determining that the alert function has passed the test in the first test mode and the second test mode.

[0042] By promptly releasing warning functions that pass the tests in the first and second test modes to the third test mode, and enabling the vehicle to respond to the warning function and execute the warning operation associated with it, the release time of the warning function can be shortened and the user's safety experience in extreme scenarios can be improved.

[0043] Optionally, one or more of software-in-the-loop testing and hardware-in-the-loop testing can be performed in the first test mode, real vehicle testing can be performed in the second test mode, and real vehicle operation can be performed in the third test mode. However, the testing methods performed in the first, second, and third test modes can be changed without departing from the spirit and scope of the invention.

[0044] In one embodiment, software-in-the-loop testing can be performed in a first test mode. In software-in-the-loop testing, the consistency between the automatically generated code and the algorithmic model used for code generation is verified. For example, the consistency between the automatically generated code and the algorithmic model used for code generation can be verified by providing the same input to both and comparing their outputs.

[0045] In another embodiment, hardware-in-the-loop testing can be performed in the first test mode. Hardware-in-the-loop testing tests the controller system, which includes hardware, underlying software, and application-layer software. For example, by connecting the controller under test to an industrial computer and running a model of the controlled object on the industrial computer, it can be verified whether the controller under test meets the design requirements.

[0046] In yet another embodiment, both software-in-the-loop testing and hardware-in-the-loop testing can be performed in the first test mode.

[0047] Optionally, during the process of pushing control functions to the third test mode in the first test channel for simultaneous testing with released warning functions, the released warning functions are run, causing the vehicle to respond to the warning functions and execute warning operations associated with them; and the control functions are tested in shadow mode. It should be noted that testing control functions in shadow mode means running the control functions but causing the vehicle not to respond to them and execute control operations associated with them. Optionally, during the shadow mode testing of control functions, the accuracy and recall rate of the control functions are monitored in the background. If the accuracy or recall rate of the control functions does not reach a preset accuracy or recall rate, scenarios of false alarms (accuracy not reaching the preset accuracy) or missed alarms (recall rate not reaching the preset recall rate) are identified. Then, through big data retrieval, the scenarios of false alarms or missed alarms are extracted and relevant sensor data is analyzed to optimize the internal algorithm and further improve the current accuracy or recall rate to the preset accuracy or recall rate.

[0048] Optionally, for alert functions, control functions can be pushed to the third test mode in the first test channel for simultaneous testing with the released alert functions. In response to the control function's accuracy reaching a preset accuracy rate and its recall reaching a preset recall rate, the control function is determined to have passed the shadow mode test.

[0049] Optionally, in step 101, the alert functions that passed the tests in the first and second test modes can be released to the third test mode via over-the-air download, thereby improving the release efficiency of the alert functions and saving the release cost. For example, the alert functions that passed the tests in the first and second test modes can be sent to the third test mode via a mobile communication over-the-air interface (e.g., via SMS, browser, etc.).

[0050] Optionally, in step 103, in the second test mode of the second test channel, the control function is determined to pass the test in the second test mode in response to the control function's accuracy reaching a preset accuracy and the control function's recall reaching a preset recall; and the control function is determined to pass the verification in response to the control function passing the shadow mode test and passing the test in the second test mode.

[0051] It is understandable that the preset accuracy and preset recall rates for alert functions can be set to be less than or equal to the preset accuracy and preset recall rates for control functions.

[0052] Optionally, different test parameters can be determined for warning functions and control functions to model the test process. These test parameters may include, but are not limited to, test duration, test scenario parameters, mileage, and fault tolerance. For example, test scenario parameters may include, but are not limited to, weather parameters (e.g., sunny, cloudy, rainy, snowy), time of day parameters (e.g., early morning, daytime, evening, night), and driving environment parameters (e.g., road geometry, road facility limitations, traffic participants, etc.).

[0053] Optionally, the fault tolerance rate for alert-type function testing can be set to be greater than that for control-type function testing, the test duration for alert-type functions can be set to be less than that for control-type functions, and the test mileage for alert-type functions can be set to be less than that for control-type functions. By determining different test parameters for alert-type and control-type functions, the release time of alert-type functions can be shortened, thereby improving testing efficiency.

[0054] The method for testing advanced driver assistance (ADA) functions according to one aspect of the present invention can classify ADADA functions into warning functions and control functions based on the maturity and verification level of the functional algorithms during the testing and verification process. It utilizes dual test channels to test both warning and control functions in parallel, thereby improving the development, deployment, and testing / verification process. By testing control functions simultaneously with the actual operation of warning functions, the release time of warning functions is shortened and the testing cost of control functions is reduced. This improves functional testing efficiency while ensuring that function release complies with design specifications and safety, and enhances the user experience of ADADA functions in actual use.

[0055] Figure 2 This is a system block diagram for testing advanced driver assistance functions according to an embodiment of the present invention. Optionally, advanced driver assistance functions can be divided into warning functions and control functions based on the maturity and verification level of the functional algorithms.

[0056] like Figure 2 As shown, the system 200 for testing advanced driver assistance functions includes a first test unit 201 and a second test unit 203. The first test unit 201 is configured to test warning functions through a first test channel and release the warning functions to a third test mode in response to the warning functions passing the test in the first test mode and the second test mode. The second test unit 203 is configured to test the control functions through a second test channel and, in response to the control functions passing the test in the first test mode and entering the second test mode, push the control functions to the third test mode in the first test channel for simultaneous testing with the released warning functions.

[0057] Optionally, the first test unit 201 can be configured to: in a first test mode, determine that the warning function passes the test in the first test mode in response to the accuracy of the warning function reaching a preset accuracy and the recall of the warning function reaching a preset recall; in a second test mode, determine that the warning function passes the test in the second test mode in response to the accuracy of the warning function reaching a preset accuracy and the recall of the warning function reaching a preset recall; and release the warning function to a third test mode in response to the determination that the warning function passes the test in the first test mode and the second test mode.

[0058] By promptly releasing warning functions that pass the tests in the first and second test modes to the third test mode, the vehicle responds to the warning function and executes the warning operation associated with it. This shortens the release time of warning functions and improves the user's safety experience in extreme scenarios.

[0059] Optionally, the first test unit 201 and the second test unit 203 can be configured to perform one or more of software-in-the-loop testing and hardware-in-the-loop testing in the first test mode, perform real-vehicle testing in the second test mode, and perform real-vehicle operation in the third test mode. However, the testing methods performed by the first test unit 201 and the second test unit 203 in the first test mode, the second test mode, and the third test mode can be changed without departing from the spirit and scope of the invention.

[0060] In one embodiment, the first test unit 201 and the second test unit 203 can perform software-in-the-loop testing in a first test mode. In software-in-the-loop testing, the consistency between automatically generated code and the algorithmic model used for code generation is verified. For example, the consistency between the automatically generated code and the algorithmic model used for code generation can be verified by providing the same input to both and comparing their outputs.

[0061] In another embodiment, the first test unit 201 and the second test unit 203 can perform hardware-in-the-loop testing in the first test mode. Hardware-in-the-loop testing tests the controller system, which includes hardware, underlying software, and application-layer software. For example, by connecting the controller under test to an industrial computer and running a model of the controlled object on the industrial computer, it can be verified whether the controller under test meets the design requirements.

[0062] In yet another embodiment, the first test unit 201 and the second test unit 203 can perform both software-in-the-loop testing and hardware-in-the-loop testing in the first test mode.

[0063] Optionally, the first test unit 201 can be configured to, in the third test mode of the first test channel,: run the released warning function to cause the vehicle to respond to the warning function and execute the warning operation associated with the warning function; and test the control function in shadow mode. It should be noted that testing the control function in shadow mode means running the control function but causing the vehicle not to respond to the control function and execute the control operation associated with the control function. Optionally, during the shadow mode testing of the control function, the accuracy and recall rate of the control function are monitored in the background. If the accuracy or recall rate of the control function does not reach the preset accuracy or recall rate, a scenario of false alarm (accuracy not reaching the preset accuracy) or missed alarm (recall rate not reaching the preset recall rate) is identified. Then, the scenarios of false alarm or missed alarm are extracted through big data retrieval and related sensor data is analyzed to optimize the internal algorithm to further improve the current accuracy or recall rate to the preset accuracy or recall rate for the warning function.

[0064] Optionally, the first test unit 201 can be configured to: in the third test mode of the first test channel, determine that the control function has passed the shadow mode test in response to the control function's accuracy reaching a preset accuracy and the control function's recall reaching a preset recall; and send a signal to the second test unit 203 indicating that the control function has passed the shadow mode test.

[0065] Optionally, the second test unit 203 can be configured to: in the second test mode of the second test channel, determine that the control function passes the test in the second test mode in response to the control function's accuracy reaching a preset accuracy and the control function's recall reaching a preset recall; receive a signal from the first test unit 201 indicating that the control function passes the shadow mode test; and determine that the control function passes the verification in response to the control function passing the shadow mode test and passing the test in the second test mode.

[0066] Optionally, the first test unit 201 can use an over-the-air download method to release the alert functions that have passed the tests in the first and second test modes to the third test mode, thereby improving the release efficiency of the alert functions and saving the release cost. For example, the first test unit 201 can send the alert functions that have passed the tests in the first and second test modes to the third test mode via a mobile communication over-the-air interface (e.g., via SMS, browser, etc.).

[0067] It is understandable that the preset accuracy and preset recall rates for alert functions can be set to be less than or equal to the preset accuracy and preset recall rates for control functions.

[0068] Optionally, the first test unit 201 and the second test unit 203 can determine different test parameters for warning functions and control functions, respectively, to model the test process. These test parameters may include, but are not limited to, test duration, test scenario parameters, mileage, and fault tolerance. For example, test scenario parameters may include, but are not limited to, weather parameters (e.g., sunny, cloudy, rainy, snowy), time of day parameters (e.g., early morning, daytime, evening, night), and driving environment parameters (e.g., road geometry, road infrastructure limitations, traffic participants, etc.).

[0069] Optionally, the fault tolerance rate for alert-type function testing can be set to be greater than that for control-type function testing, the test duration for alert-type functions can be set to be less than that for control-type functions, and the test mileage for alert-type functions can be set to be less than that for control-type functions. By determining different test parameters for alert-type and control-type functions, the release time of alert-type functions can be shortened, thereby improving testing efficiency.

[0070] The system for testing advanced driver assistance (ADA) functions according to one aspect of the present invention can classify ADADA functions into warning functions and control functions based on the maturity and verification level of the functional algorithms during the testing and verification process. It utilizes dual test channels to test both warning and control functions in parallel, thereby improving the development, deployment, and testing / verification process. By testing control functions simultaneously with the actual operation of warning functions, the release time of warning functions and the testing cost of control functions are shortened. This improves functional testing efficiency while ensuring that function release complies with design specifications and safety, and enhances the user experience of ADADA functions in actual use.

[0071] Figure 3 This is a flowchart of a method for testing advanced driver assistance functions according to an embodiment of the present invention.

[0072] Optionally, advanced driver assistance functions can be categorized into warning functions and control functions based on the maturity and validation level of their algorithms. For example, warning functions may include, but are not limited to, forward collision warning, rear collision warning, lane departure warning, blind spot collision warning, door opening warning, parking distance warning, and driver status monitoring. For example, control functions may include, but are not limited to, automatic emergency braking, adaptive cruise control, cruise control, automatic parking, and pedestrian emergency braking.

[0073] like Figure 3As shown, steps 301, 303, and 305 illustrate the process of testing alert-type functions through the first test channel, while steps 301' and 303' illustrate the process of testing control-type functions through the second test channel. Optionally, steps 301, 303, and 305 can be executed in parallel with steps 301' and 303'.

[0074] In step 301, the alert function is tested in the first test mode, and in response to the alert function's accuracy reaching a preset accuracy rate and its recall rate reaching a preset recall rate, it is determined that the alert function has passed the test in the first test mode, and then proceeds to step 303.

[0075] In step 303, the alert function is tested in the second test mode, and in response to the alert function's accuracy reaching a preset accuracy rate and its recall rate reaching a preset recall rate, it is determined that the alert function has passed the test in the second test mode, and then proceeds to step 305.

[0076] Optionally, in step 303, the alert functions that passed the tests in the first and second test modes can be released to the third test mode via over-the-air download, thereby improving the release efficiency of the alert functions and saving the release cost. For example, the alert functions that passed the tests in the first and second test modes can be sent to the third test mode via a mobile communication over-the-air interface (e.g., via SMS, browser, etc.).

[0077] In step 305, the warning function is tested in the third test mode, such that running the warning function causes the vehicle to respond to the warning function and perform a warning operation associated with the warning function.

[0078] Optionally, one or more of software-in-the-loop testing and hardware-in-the-loop testing can be performed in the first test mode, real vehicle testing can be performed in the second test mode, and real vehicle operation can be performed in the third test mode. However, the testing methods performed in the first, second, and third test modes can be changed without departing from the spirit and scope of the invention.

[0079] In step 301', the control function is tested in the first test mode, and in response to the control function's accuracy reaching a preset accuracy and the alert function's recall reaching a preset recall, it is determined that the control function has passed the test in the first test mode, and then proceeds to step 303'.

[0080] In step 303', the control functions are tested in the second test mode, and at the same time, the control functions are pushed to the third test mode in the first test channel to be tested simultaneously with the released warning functions.

[0081] In step 305, during the testing of control functions in the third test mode, the control functions are tested in shadow mode. It should be noted that testing control functions in shadow mode means running the control function but causing the vehicle not to respond to the control function in order to perform control operations associated with it. Optionally, during the shadow mode testing of control functions, the accuracy and recall rate of the control functions are monitored in the background. If the accuracy or recall rate of the control functions does not reach a preset accuracy or recall rate, it is determined that there are false alarms (accuracy not reaching the preset accuracy) or missed alarms (recall rate not reaching the preset recall rate). Then, through big data retrieval, the false alarm or missed alarm scenarios are extracted and relevant sensor data is analyzed to optimize the internal algorithm to further improve the current accuracy or recall rate to the preset accuracy or recall rate, thus alerting the relevant function.

[0082] Optionally, in step 303', in response to the control function's accuracy reaching a preset accuracy and the control function's recall reaching a preset recall, it is determined that the control function has passed the test in the second test mode.

[0083] Optionally, in step 305, the control function is determined to have passed the shadow mode test in response to the control function's accuracy reaching a preset accuracy and its recall reaching a preset recall.

[0084] Optionally, the above method further includes determining that the control class function has passed verification in response to the control class function passing the shadow mode test and passing the test in the second test mode.

[0085] For example, Figure 3 The method shown for testing advanced driver assistance functions can be applied to cone recognition and response functions, where cone recognition is a warning function and cone response is a control function.

[0086] For example, the cone recognition function can be tested through the first test channel using steps 301, 303, and 305. After the test is passed, the cone recognition function can be released and deployed to the user's vehicle in advance. This allows the vehicle to respond to the cone recognition function and perform corresponding warning operations, such as notifying the user of the presence of cones in front of the vehicle through a warning signal, thereby improving the user's safety experience in scenarios where there are cones in front of the vehicle.

[0087] For example, the cone response function can be tested via a second test channel using steps 301' and 303'. In step 301', the cone response function is tested in a first test mode, and proceeds to step 303' after the cone response function passes the test in the first test mode. In step 303', the cone response function is tested in a second test mode, and simultaneously pushed to a third test mode in the first test channel for testing concurrently with the released cone recognition function. In step 305, during the cone response function test in the third test mode, the cone response function is tested in a shadow mode, where the cone response function is activated but the vehicle does not respond to the cone response function to perform corresponding control operations. Simultaneously, during the cone response function test in shadow mode, the performance metrics of the background monitoring algorithm are analyzed, and the warning signals generated by the cone recognition function are analyzed using big data and post-hoc information to aid in internal algorithm optimization and iteration. Furthermore, the response function to the cones is verified by passing the shadow mode test and the second test mode test. At this point, the response function to the cones can be applied to actual vehicle control so that the vehicle responds to the response function to the cones to perform corresponding response operations, such as early braking.

[0088] The above methods are used to test the cone recognition and response functions. While the cone recognition function is actually running, the cone response function can be tested simultaneously, shortening the release time of the cone recognition function and reducing the testing cost of the cone response function. Therefore, this testing method improves the user experience while enabling rapid iteration and secure deployment of the cone recognition and response functions.

[0089] Figure 4 This is a block diagram of a computer device according to an embodiment of the present invention. Figure 4 As shown, the computer device 400 includes a memory 410, a processor 420, and a computer program 430 stored in the memory 410 and executable on the processor 420. When the processor 420 executes the computer program 430, it implements, for example... Figure 1 or Figure 3 The steps of a method for testing advanced driver assistance functions according to an embodiment of the present invention are shown.

[0090] Additionally, as described above, the present invention can also be implemented as a computer storage medium storing a program for causing a computer to execute a method for testing advanced driver assistance functions according to one aspect of the present invention.

[0091] Here, computer storage media can be various types, such as disks (e.g., hard disks, optical disks, etc.), cards (e.g., memory cards, optical cards, etc.), semiconductor memory (e.g., ROM, non-volatile memory, etc.), and tapes (e.g., magnetic tape, cassette tape, etc.).

[0092] Where applicable, the various embodiments provided by the present invention may be implemented using hardware, software, or a combination of hardware and software. Furthermore, where applicable, without departing from the scope of the invention, the various hardware and / or software components described herein may be combined into composite components comprising software, hardware, and / or both. Where applicable, without departing from the scope of the invention, the various hardware and / or software components described herein may be divided into sub-components comprising software, hardware, or both. Additionally, where applicable, it is contemplated that software components may be implemented as hardware components, and vice versa.

[0093] The software (such as program code and / or data) according to the invention can be stored on one or more computer storage media. It is also contemplated that the software identified herein can be implemented using one or more networked and / or otherwise general-purpose or special-purpose computers and / or computer systems. Where applicable, the order of the various steps described herein can be changed, combined into compound steps, and / or divided into sub-steps to provide the features described herein.

[0094] The embodiments and examples presented herein are provided to best illustrate embodiments of the invention and its particular applications, thereby enabling those skilled in the art to practice and use the invention. However, those skilled in the art will understand that the above description and examples are provided merely for ease of illustration and example. The descriptions presented are not intended to cover all aspects of the invention or to limit the invention to the precise forms disclosed.

Claims

1. A method for testing an advanced driver assistance function, characterized in that, The advanced driving assistance functions include warning type functions and control type functions, and the method comprises the following steps: testing the warning type functions through a first test channel, and releasing the warning type functions to a third test mode in response to the warning type functions passing the test in a first test mode and a second test mode; and testing the control type functions through a second test channel, and pushing the control type functions to the third test mode in the first test channel to be tested simultaneously with the released warning type functions while entering the second test mode in response to the control type functions passing the test in the first test mode, wherein one or more of software-in-the-loop testing and hardware-in-the-loop testing are performed in the first test mode, real vehicle testing is performed in the second test mode, and real vehicle running is performed in the third test mode.

2. The method of claim 1, wherein in the third test mode in the first test channel: running the released warning type functions to cause a vehicle to perform a warning operation associated with the warning type functions in response to the warning type functions; and testing the control type functions in shadow mode.

3. The method of claim 1, wherein the warning type functions include one or more of: a forward collision warning function, a rearward collision warning function, a lane departure warning function, a blind spot collision warning function, a door opening warning type function, a parking distance warning function, and a driver state monitoring function.

4. The method of claim 1, wherein the control type functions include one or more of: an automatic emergency braking function, an adaptive cruise control function, a cruise control function, an automatic parking function, and a pedestrian emergency braking function.

5. The method of claim 2, wherein testing the control type functions in shadow mode comprises: running the control type functions but causing a vehicle to not perform a control operation associated with the control type functions in response to the control type functions.

6. The method of claim 2, wherein the method further comprises: in the third test mode in the first test channel, determining that the control type functions pass shadow mode testing in response to an accuracy rate of the control type functions reaching a preset accuracy rate and a recall rate of the control type functions reaching a preset recall rate; in the second test mode in the second test channel, determining that the control type functions pass the test in the second test mode in response to the accuracy rate of the control type functions reaching the preset accuracy rate and the recall rate of the control type functions reaching the preset recall rate; and in response to the control type functions passing shadow mode testing and passing the test in the second test mode, determining that the control type functions pass verification.

7. The method of claim 1, wherein one or more of the following are different for one or more of the test parameters of the warning type functions and the control type functions: test duration, test scenario parameters, mileage, fault tolerance rate.

8. The method of claim 1, wherein the step of testing the warning-type function through the first test lane is performed in parallel with the step of testing the control-type function through the second test lane.

9. A system for testing advanced driver assistance functions, characterized in that the advanced driving assistance function includes a warning-type function and a control-type function, the system includes: a first test unit configured to test the warning-type function through a first test lane and release the warning-type function to a third test mode in response to the warning-type function passing a test in a first test mode and a second test mode; and a second test unit configured to test the control-type function through a second test lane and push the control-type function to the third test mode in the first test lane for testing concurrently with the released warning-type function while entering the second test mode in response to the control-type function passing a test in the first test mode, wherein one or more of a software-in-the-loop test and a hardware-in-the-loop test are performed in the first test mode, a real vehicle test is performed in the second test mode, and a real vehicle run is performed in the third test mode.

10. The system of claim 9, wherein the first test unit is further configured to, in the third test mode in the first test lane: run the released warning-type function to cause a vehicle to perform a warning operation associated with the warning-type function in response to the warning-type function; and test the control-type function in a shadow mode.

11. The system of claim 9, wherein the warning-type function includes one or more of: a forward collision warning function, a rearward collision warning function, a lane departure warning function, a blind spot collision warning function, a door opening warning-type function, a following distance warning function, and a driver state monitoring function.

12. The system of claim 9, wherein the control-type function includes one or more of: an automatic emergency braking function, an adaptive cruise control function, a set-speed cruise control function, an automatic parking function, and a pedestrian emergency braking function.

13. The system of claim 10, wherein the first test unit is configured to test the control-type function in a shadow mode by: running the control-type function but causing a vehicle to not perform a control operation associated with the control-type function in response to the control-type function.

14. The system of claim 10, wherein the first test unit is further configured to: in the third test mode in the first test lane, determine that the control-type function passes a shadow mode test in response to an accuracy rate of the control-type function reaching a preset accuracy rate and a recall rate of the control-type function reaching a preset recall rate; and send a signal to the second test unit indicating that the control-type function passes the shadow mode test.

15. The system of claim 14, wherein the second test unit is further configured to: in response to receiving the signal, release the control-type function to a fourth test mode in the second test lane. in the second test mode, determining that the control class function passes the test in the second test mode in response to the accuracy of the control class function reaching a preset accuracy and the recall rate of the control class function reaching a preset recall rate; receiving the signal from the first test unit indicating that the control class function passes the shadow mode test; and determining that the control class function passes the verification in response to the control class function passing the shadow mode test and passing the test in the second test mode. 16.The system of claim 9, wherein one or more of the following test parameters are different for the alert class function and the control class function: test duration, test scenario parameters, mileage, fault tolerance rate. 17.The system of claim 9, wherein the first test unit and the second test unit are configured to: perform one or more of a software-in-the-loop test and a hardware-in-the-loop test in the first test mode; and perform a real vehicle test in the second test mode.

18. A computer storage medium, comprising, The computer storage medium includes instructions, which when executed, perform the method of any one of claims 1-8.

19. A computer device, comprising: The computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and wherein the processor implements the method of any one of claims 1-8 when executing the program.

Citation Information

Patent Citations

  • Port-environment-oriented man-machine hybrid automatic driving test method and test platform thereof

    CN111006879A

  • Automatic driving automobile test field test scene library

    CN112541258A