Vehicle vision module testing system and vehicle
By automating image capture and analysis through the vehicle vision module testing system, the problem of low efficiency in manual testing in existing technologies has been solved, achieving efficient and accurate vision module testing, and meeting the needs of modern vehicle production capacity.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-10
- Publication Date
- 2026-03-24
AI Technical Summary
In existing technologies, the testing of vehicle vision modules relies on manual operation, which suffers from problems such as large subjective errors, low efficiency, and long time consumption, making it difficult to meet the needs of the rapidly increasing production capacity of modern vehicles.
A vehicle vision module testing system is provided, including a control module, a vision module, a screen module, a simulation module, and an analysis module. It achieves automated testing of the vision module through automated image capture, display, comparison, and analysis.
It automates the testing process, improves testing efficiency and accuracy, generates detailed test reports, reduces manual intervention, and adapts to the needs of modern vehicle production capacity.
Smart Images
Figure CN116112659B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to a vehicle vision module testing system; in addition, the present application also relates to a vehicle comprising the vehicle vision module testing system. BACKGROUND
[0002] Modern vehicles are often equipped with vision modules (e.g. cameras). With the assistance of the vision modules, the operation of the vehicles by the drivers is more convenient and safer. Especially in the situations of reversing, the recognition of the surrounding environment during the driving of the vehicles and the identification of possible accidents, the vision modules equipped in the vehicles play a decisive role.
[0003] Therefore, it is necessary to test the cameras of the vehicles during the testing process of the vehicles.
[0004] However, in the prior art, the testing of the vision modules of the vehicles often needs to rely on manual operation and professional experience. Generally, experienced test engineers need to adjust the vehicles to various scenes to be tested on the actual vehicles. Then, the test engineers observe the static features and dynamic features displayed on the screen in the corresponding scenes respectively, and judge whether the pictures displayed on the screen are correct according to the professional experience. Finally, the test engineers record the test results and write the test reports.
[0005] This traditional manual testing of the cameras of the vehicles has many defects, such as large subjective error, low efficiency and long time consumption. Especially in recent years, the production capacity of the vehicles has rapidly increased, and this manual testing method has far failed to reach the expected efficiency level, and often cannot complete the testing tasks on time and in quantity.
[0006] In view of but not limited to the above, it is desirable to provide a vehicle vision module testing system to solve at least the above problems. SUMMARY
[0007] The present application aims to provide a vehicle vision module testing system, which is advantageous in at least one aspect over the prior art.
[0008] To this end, the present application provides, in one aspect, a vehicle vision module testing system, comprising: a control module, at least one vision module, a screen module, a simulation module and an analysis module; wherein the control module is configured to send a first test signal to the simulation module; the simulation module is configured to generate a test scene upon receiving the first test signal; the control module is further configured to send a first capture signal to the at least one vision module; the at least one vision module is configured to capture a first image upon receiving the first capture signal; the control module is further configured to send a first display signal to the screen module; the screen module is configured to display the first image captured by the at least one vision module upon receiving the first display signal from the control module; the control module is further configured to send a screen capture signal to the screen module; the screen module is further configured to capture the first image in real time upon receiving the screen capture signal from the control module; the analysis module is configured to obtain the first image and compare the first image with a pre-stored reference first image; the analysis module is further configured to determine that the at least one vision module passes the scene test if the first image matches the reference first image.
[0009] In an optional embodiment, the control module is configured to send a shooting signal to the vision module when sending the screen capture signal to the screen module.
[0010] In an optional embodiment, the vision module is configured to shoot a first shooting image corresponding to the first image upon receiving the shooting signal from the control module.
[0011] In an optional embodiment, the analysis module is further configured to store the first shooting image and notify the control module if the first image and the first shooting image do not match.
[0012] In an optional embodiment, the at least one vision module comprises three or more vision modules, each vision module being configured to form a 360-degree surround view of the vehicle.
[0013] In an optional embodiment, the control module is further configured to send a screen sliding signal to the screen module; and wherein the screen module is further configured to switch the first image captured by the at least one vision module displayed on the screen to a first image captured by another vision module upon receiving the sliding signal from the control module.
[0014] In an optional embodiment, the test scene comprises a lane departure warning, a pedestrian collision warning, a traffic sign recognition, a blind spot monitoring, a parking, a night vision assistance and a lane keeping assistance.
[0015] In an optional embodiment, the analysis module is further configured to record the testing process and generate a testing report.
[0016] In an optional embodiment, the at least one vision module is arranged in the simulation module.
[0017] The present application also provides, in another aspect, a vehicle comprising: a vision module; wherein the vehicle is configured to be tested by the vehicle vision module testing system as described above.
[0018] The present application provides an automatic testing system, which not only completely removes the manual testing process, but also can flexibly simulate the testing scene, and has faster testing efficiency, higher accuracy, and automatically generates intuitive, detailed, and reliable testing reports. BRIEF DESCRIPTION OF DRAWINGS
[0019] Figure 1A A schematic diagram of a vehicle vision module testing system according to an embodiment of the present application is shown.
[0020] Figure 1B A possible implementation of the vehicle vision module testing system is shown.
[0021] Figure 2 A preparation stage according to an embodiment of the present application is shown.
[0022] Figure 3 A first testing stage according to an embodiment of the present application is shown.
[0023] Figure 4 A first testing stage according to another embodiment of the present application is shown, in which both screen module grabbing and vision module shooting are used to obtain images.
[0024] Figure 5 A first testing stage according to still another embodiment of the present application is shown, in which multiple vision modules are used.
[0025] Figure 6 A second testing stage according to an embodiment of the present application is shown.
[0026] Figure 7 A second testing stage according to an embodiment of the present application is shown, in which multiple vision modules are used. DETAILED DESCRIPTION
[0027] Some possible embodiments of the present application are described below with reference to the accompanying drawings. It should be noted that the drawings are not drawn to scale. Some details can be exaggerated to clearly show, and some unnecessary details are omitted.
[0028] AsFigure 1A As shown, the vehicle vision module testing system 100 disclosed in the present application can include a control module 1, at least one vision module 2, a screen module 3, a simulation module 4 and an analysis module 5.
[0029] The control module 1 is configured to run a testing program and send instructions for testing. The at least one vision module 2 is used to capture images. The screen module 3 is configured to display images. The simulation module 4 is configured to be able to arrange a dark box in which the vision module is arranged. In this way, the interference of ambient light can be avoided, and the accuracy of the test can be improved. The analysis module 5 is configured to determine whether the vision module of the vehicle passes the test.
[0030] As shown in the following figure, a possible implementation of the vehicle vision module testing system is shown. The vehicle vision module testing system includes an industrial computer, a power supply assembly, a communication interface, a repeater, a dark box and a camera. Figure 1B
[0031] The industrial computer can be configured to be physically connected with the repeater. The industrial computer and the power supply assembly are connected with strong electricity. The industrial computer is configured to be able to control the power supply assembly to supply power to the dark box via the repeater and to the camera through the dark box. The industrial computer and the communication interface are connected with weak electricity. The industrial computer is configured to be able to communicate with the dark box via the repeater and the camera through the dark box through the communication interface.
[0032] The camera is arranged in the dark box. The backlight of the dark box can be adjusted. When the backlight is turned off, a black background can be created, which can facilitate the detection of the display of the simulated lane lines and the reverse warning color block.
[0033] The screen assembly is supplied with power by the power supply assembly via the repeater. The screen assembly communicates with the industrial computer via the communication interface.
[0034] In this vehicle vision module testing system, the industrial computer is used as the control module and the analysis module. The camera is used as the vision module. The screen assembly is used as the screen module. The dark box is used as the simulation module.
[0035] Optionally, the camera can be implemented as a wide-angle camera. More preferably, the camera can be implemented as a 360-degree surround view camera. Optionally, the 360-degree surround view camera can be a plurality of cameras regularly arranged to form an image stitching. For example, 4 cameras arranged respectively in front, back, left and right, or 3 cameras arranged at 120 degrees.
[0036] As shown in the following figure, the specific implementation of the preparation stage before testing is described. Figure 2
[0037] S101: The control module 1 sends a pre-test capture signal to the at least one vision module 2;
[0038] S102: Upon receiving a pre-test capture signal from the control module 1, the at least one vision module 2 captures a pre-test image;
[0039] S103: Control module 1 sends a pre-test display signal to screen module 3;
[0040] S104: Upon receiving a pre-test display signal from the control module 1, the screen module 3 displays the pre-test image captured by the at least one vision module 2;
[0041] S105: Control module 1 sends a screen capture signal to screen module 3;
[0042] S106: A screen capture signal is received from the control module 1, and the screen module 3 captures the pre-test image in real time;
[0043] S107: The pre-test image is transmitted to the analysis module 5;
[0044] S108: In the analysis module 5, the pre-test image is compared with a pre-stored benchmark pre-test image;
[0045] S109: If the pre-test image matches the reference pre-test image (i.e., within a reasonable pre-test error range), then it is determined that the at least one vision module 2 is ready and can enter the testing phase.
[0046] In another embodiment, at least one vision module 2 may include four vision modules: a front vision module, a rear vision module, a left vision module, and a right vision module. In this case, the four pre-test images generated by the four vision modules can be compared with four pre-stored reference pre-test images. When the four pre-test images match the corresponding reference pre-test images, it is determined that the corresponding vision module is ready and the viewing angle of the corresponding vision module is determined, and then the testing phase begins.
[0047] The at least one vision module 2 is installed and fixed in the simulation module 4. The specific implementation of the testing phase is described below. The testing phase may include at least a first testing phase and a second testing phase.
[0048] like Figure 3 As shown, in the first testing phase, tests are conducted for the first test scenario.
[0049] S201: Control module 1 sends the first test signal to analog module 4.
[0050] S202: Upon receiving the first test signal, simulation module 4 generates the first test scenario.
[0051] Then, S203: the control module 1 sends a first capture signal to the at least one vision module 2.
[0052] S204: upon receiving the first capture signal, the at least one vision module 2 captures a first image.
[0053] S205: the control module 1 sends a first display signal to the screen module 3.
[0054] S206: upon receiving the first display signal from the control module 1, the screen module 3 displays the first image captured by the at least one vision module 2.
[0055] S207: the control module 1 sends a screen capture signal to the screen module 3.
[0056] S208: upon receiving the screen capture signal from the control module 1, the screen module 3 captures the first image in real time.
[0057] Then, S209: the first image is transmitted to the analysis module 5.
[0058] In the analysis module 5, S210: the first image is compared with a pre-stored reference first image.
[0059] S211: if the first image matches the reference first image (i.e. within a reasonable first error range), it is determined that the at least one vision module 2 passes the first scene test.
[0060] In one embodiment, the vehicle vision module test system 100 can be configured to acquire images in one aspect by screen capture and in another aspect by vision module shooting. As shown, specifically for example, it can be as follows. Figure 4
[0061] S201: the control module 1 sends a first test signal to the simulation module 4.
[0062] S202: upon receiving the first test signal, the simulation module 4 generates a first test scene.
[0063] Then, S203: the control module 1 sends a first capture signal to the at least one vision module 2.
[0064] S204: upon receiving the first capture signal, the at least one vision module 2 captures a first image.
[0065] S205: the control module 1 sends a first display signal to the screen module 3.
[0066] S206: Upon receiving the first display signal from the control module 1, the screen module 3 displays the first image captured by the at least one vision module 2.
[0067] S207: The control module 1 sends a screen capture signal to the screen module 3.
[0068] S208: Upon receiving the screen capture signal from the control module 1, the screen module 3 captures the first image in real time.
[0069] S300: Upon sending the screen capture signal to the screen module 3, the control module 1 sends a shooting signal to the vision module.
[0070] S301: Upon receiving the shooting signal from the control module 1, the vision module shoots a first shot image corresponding to the first image.
[0071] S302: The first shot image is stored in the analysis module 5.
[0072] Then, S209: The first image is transmitted to the analysis module 5.
[0073] In the analysis module 5, S303: The first image is compared with the first shot image.
[0074] S304: If the first image and the first shot image match (i.e., within a reasonable capture-shooting error range), the first image is compared with a pre-stored reference first image; if the first image and the first shot image do not match (i.e., beyond the reasonable capture-shooting error range), the control module 1 is notified.
[0075] S211: If the first image matches the reference first image (i.e., within a reasonable first error range), it is determined that the at least one vision module 2 passes the first scene test.
[0076] In another embodiment, the at least one vision module 2 can include a plurality of vision modules, for example, four vision modules. The four vision modules can be a front vision module, a rear vision module, a left vision module, and a right vision module. In this case, as shown, the specific embodiment of the test phase can be described as follows. Figure 5
[0077] S201: The control module 1 sends a first test signal to the simulation module 4.
[0078] S202: Upon receiving the first test signal, the simulation module 4 generates a first test scene.
[0079] Then, S400: The control module 1 sends a first capture signal to the four vision modules, respectively.
[0080] S401: receiving the first capture signal, the four vision modules respectively capture a first image corresponding to each vision module.
[0081] S205: control module 1 sends a first display signal to screen module 3.
[0082] S402: receiving the first display signal from control module 1, screen module 3 displays the first image captured by one of the four vision modules (first vision module).
[0083] S207: control module 1 sends a screen capture signal to screen module 3.
[0084] S403: receiving the screen capture signal from control module 1, screen module 3 captures the first image captured by the first vision module in real time.
[0085] Then, S404: the first image captured by the first vision module is transmitted to analysis module 5.
[0086] In analysis module 5, S405: the first image captured by the first vision module is compared with the pre-stored reference first image corresponding to the first vision module.
[0087] S406: if the first image captured by the first vision module matches the reference first image corresponding to the first vision module (i.e. within a reasonable first error range), it is determined that the first vision module passes the first scene test.
[0088] Then, S407: control module 1 sends a screen slide signal to screen module 3.
[0089] S408: receiving the slide signal from control module 1, screen module 3 displays the first image captured by another of the four vision modules (second vision module).
[0090] S409: control module 1 sends a screen capture signal to screen module 3.
[0091] S410: receiving the screen capture signal from control module 1, screen module 3 captures the first image captured by the second vision module in real time.
[0092] Then, S411: the first image captured by the second vision module is transmitted to analysis module 5.
[0093] In analysis module 5, S412: the first image captured by the second vision module is compared with the pre-stored reference first image corresponding to the second vision module.
[0094] S413: If the first image captured by the second vision module matches the reference first image corresponding to the second vision module (i.e. within a reasonable first error range), it is determined that the second vision module passes the first scene test.
[0095] By analogy with the above description, the first scene test process of the other two vision modules (the third vision module and the fourth vision module) among the four vision modules.
[0096] Optionally, the first test scene can be a parking scene.
[0097] As shown in the second test phase, the test is carried out for the second test scene. Figure 6
[0098] S501: The control module 1 sends a second test signal to the simulation module 4.
[0099] S502: Upon receiving the second test signal, the simulation module 4 generates a second test scene.
[0100] Then, S503: The control module 1 sends a second capture signal to the at least one vision module 2.
[0101] S504: Upon receiving the second capture signal, the at least one vision module 2 captures a second image.
[0102] S505: The control module 1 sends a second display signal to the screen module 3.
[0103] S506: Upon receiving the second display signal from the control module 1, the screen module 3 displays the second image captured by the at least one vision module 2.
[0104] S507: The control module 1 sends a screen grabbing signal to the screen module 3.
[0105] S508: Upon receiving the screen grabbing signal from the control module 1, the screen module 3 grabs the second image in real time.
[0106] Then, S509: The second image is transmitted to the analysis module 5.
[0107] In the analysis module 5, S510: The second image is compared with a pre-stored reference second image.
[0108] S511: If the second image matches the reference second image (i.e. within a reasonable second error range), it is determined that the at least one vision module 2 passes the second scene test.
[0109] In one embodiment, the at least one vision module 2 can comprise a plurality of vision modules, for example, four vision modules. The four vision modules can be a front vision module, a rear vision module, a left vision module and a right vision module. In this case, as shown in Figure 7 The specific implementation of the second test phase can be described as follows.
[0110] S501 : The control module 1 sends a second test signal to the simulation module 4.
[0111] S502: Upon receiving the second test signal, the simulation module 4 generates a second test scene.
[0112] Then, S600: The control module 1 sends a second capture signal to each of the four vision modules.
[0113] S601 : Upon receiving the second capture signal, the four vision modules capture a second image corresponding to each vision module, respectively.
[0114] S505: The control module 1 sends a second display signal to the screen module 3.
[0115] S602: Upon receiving the second display signal from the control module 1, the screen module 3 displays the second image captured by one of the four vision modules (the first vision module).
[0116] S507: The control module 1 sends a screen capture signal to the screen module 3.
[0117] S603: Upon receiving the screen capture signal from the control module 1, the screen module 3 captures the second image captured by the first vision module in real time.
[0118] Then, S604: The second image captured by the first vision module is transmitted to the analysis module 5.
[0119] In the analysis module 5, S605: The second image captured by the first vision module is compared with a pre-stored reference second image corresponding to the first vision module.
[0120] S606: If the second image captured by the first vision module matches the reference second image corresponding to the first vision module (i.e., within a reasonable second error range), it is determined that the first vision module passes the second scene test.
[0121] Then, S607: The control module 1 sends a screen sliding signal to the screen module 3.
[0122] S608: receiving the sliding signal from the control module 1, the screen module 3 displays a second image captured by another of the four vision modules (second vision module).
[0123] S609: the control module 1 sends a screen capture signal to the screen module 3.
[0124] S610: receiving the screen capture signal from the control module 1, the screen module 3 captures the second image captured by the second vision module in real time.
[0125] Then, S611: the second image captured by the second vision module is transmitted to the analysis module 5.
[0126] In the analysis module 5, S612: the second image captured by the second vision module is compared with the pre-stored reference second image corresponding to the second vision module.
[0127] S613: if the second image captured by the second vision module matches the reference second image corresponding to the second vision module (i.e. within a reasonable second error range), it is determined that the second vision module passes the second scene test.
[0128] By analogy with the above description, the second scene test process of the other two vision modules (third vision module and fourth vision module) in the four vision modules.
[0129] Optionally, the second test scene can be a lane departure warning scene.
[0130] By analogy with the above description, the test process of more test scenes can be obtained. Other test scenes include but are not limited to pedestrian collision warning, traffic sign recognition, blind spot monitoring, night vision assistance and lane keeping assistance, etc.
[0131] The vehicle vision module test system 100 disclosed in the present application is configured to record the test process and generate a test report. Such a test report can include whether the vision module of the vehicle passes the test, the captured image, the taken image, the error value, the error range and other parameters.
[0132] The vehicle referred to in the present application can include a gasoline car, a pure electric car, a hybrid car and a fuel cell car.
[0133] It is expressly intended that in the claim set out above, all of the various aspects, embodiments, examples and alternatives set out in the foregoing description and shown in the accompanying drawings can be claimed independently, or in any combination with one another. That is, all of the embodiments and / or features of any embodiment can be claimed in any combination with any of the other embodiments and / or features, unless such features are incompatible. Applicant reserves the right to change any originally filed claim, or a claim during prosecution, including the substitution of an alternate statement of the application as originally filed or during prosecution. All claims may, in one or several aspects, be presented in independent form or in combination with other claims in a dependent form.
[0134] While the application has been described herein with reference to particular embodiments thereof, a latitude of modification, various changes and substitutions are intended in the foregoing description, and in some instances some features of the application will be employed without a corresponding use of other features. Accordingly, it is intended that the application be construed broadly and encompass all alternatives falling within the spirit and scope of the application.
Claims
1. A vehicle vision module testing system, comprising: The control module (1), at least one vision module (2), screen module (3), simulation module (4) and analysis module (5), wherein the simulation module (4) is configured to house the vision module (2) in a dark box to avoid interference from ambient light; wherein the control module (1) is configured to send a first test signal to the simulation module (4); The simulation module (4) is configured to generate a test scenario upon receiving the first test signal; The control module (1) is also configured to send a first capture signal to the at least one vision module (2); The at least one vision module (2) is configured to capture a first image upon receiving a first capture signal; The control module (1) is also configured to send a first display signal to the screen module (3); The screen module (3) is configured to display a first image captured by the at least one visual module (2) when it receives a first display signal from the control module (1); The control module (1) is also configured to send a screen capture signal to the screen module (3); The screen module (3) is also configured to capture the first image in real time when it receives a screen capture signal from the control module (1); The control module (1) is configured to send a capture signal to the vision module when a screen capture signal is sent to the screen module (3); The vision module is configured to capture a first image corresponding to the first image when it receives a capture signal from the control module (1). The analysis module (5) is configured to acquire a first image, wherein the first image is compared with a first captured image in the analysis module (5), and if the first image and the first captured image match, the first image is compared with a pre-stored reference first image; The analysis module (5) is also configured to determine that the at least one vision module (2) passes the scene test if the first image matches the reference first image.
2. The vehicle vision module testing system according to claim 1, wherein, The analysis module (5) is also configured to store the first captured image and to notify the control module (1) if the first image and the first captured image do not match.
3. The vehicle vision module testing system according to claim 1 or 2, wherein, The at least one vision module (2) includes three or more vision modules, each vision module being configured to form a 360-degree surround view of the vehicle.
4. The vehicle vision module testing system according to claim 3, wherein, The control module (1) is also configured to send a screen sliding signal to the screen module (3); and wherein the screen module (3) is also configured to, upon receiving a sliding signal from the control module (1), switch the first image captured by the at least one visual module (2) displayed on the screen to a first image captured by another visual module.
5. The vehicle vision module testing system according to any one of claims 1-4, wherein, The test scenarios include lane departure warning, pedestrian collision warning, traffic sign recognition, blind spot monitoring, parking, night vision assist, and lane keeping assist.
6. The vehicle vision module testing system according to any one of claims 1-5, wherein, The analysis module (5) is also configured to record the test process and generate test reports.
7. The vehicle vision module testing system according to claim 1, wherein, The at least one vision module (2) is arranged in the simulation module (4).
8. A vehicle comprising: A vision module; wherein the vehicle is configured to test the vehicle's vision module using a vehicle vision module testing system according to any one of claims 1-7.
Citation Information
Patent Citations
Methods and systems for calibrating vehicle vision systems
CN101786439A
Unmanned vehicle-mounted intelligent camera in-loop test method and device
CN110677640A