Multi-source sensor integrated calibration method and device for autonomous vehicle

By detecting and controlling the autonomous vehicle to enter the calibration mode, obtaining and calibrating multiple sensor items, the problem of dispersed calibration functions and long time of multi-source sensor calibration methods is solved, which improves calibration efficiency and reduces costs, and meets the multi-source sensor Calibrate requirements.

CN118960819APending Publication Date: 2024-11-15CHERY INTELLIGENT AUTOMOTIVE TECHNOLOGY (HEFEI) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411049100.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

The calibration function of the multi-source sensor calibration method of existing autonomous driving vehicles is relatively scattered and the calibration time is long, which reduces the calibration efficiency of vehicle sensors and increases R&D costs, which cannot meet the calibration needs of multi-source sensors.

Method used

Provide a multi-source sensor integrated calibration method for autonomous driving vehicles. By detecting whether the vehicle is in a calibration station that meets preset conditions, the vehicle is controlled to enter the calibration mode, and obtain and calibrate multiple items to be calibrated separately to obtain multi-source The sensor integrates calibration results and generates calibration reports and reminders.

Benefits of technology

It effectively improves the calibration efficiency of vehicle sensors, meets the calibration needs of multi-source sensors, solves the problems of dispersed calibration functions and long time, and reduces R&D costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118960819A_ABST
    Figure CN118960819A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of automatic driving, in particular to a multi-source sensor integrated calibration method and device for an automatic driving vehicle, and the method comprises the steps: detecting whether a target to-be-calibrated vehicle is located at a calibration station meeting a preset condition or not; when it is detected that the target to-be-calibrated vehicle is located at the calibration station, the target to-be-calibrated vehicle is controlled to enter a vehicle calibration mode; and based on the vehicle calibration mode, obtaining a plurality of to-be-calibrated items of the target to-be-calibrated vehicle, and calibrating the plurality of to-be-calibrated items to obtain a multi-source sensor integrated calibration result of the target to-be-calibrated vehicle. Therefore, the problems that the calibration function of a multi-source sensor calibration mode in the prior art is relatively dispersed, the calibration time is relatively long, the calibration efficiency of the vehicle sensor is reduced, the research and development cost is increased, and the calibration requirement of the multi-source sensor cannot be met are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of autonomous driving technology, and in particular to a multi-source sensor integrated calibration method and device for an autonomous driving vehicle. Background Art

[0002] In an autonomous driving system, sensors are the decisive factor in the system's ability to perceive the surrounding environment. After the sensors are installed on the vehicle, sensor calibration is required to eliminate installation errors so that the autonomous driving system can accurately locate where each sensor is installed. Sensor calibration lays a solid foundation for subsequent mapping, positioning, perception, and control. It is the core part and prerequisite for the stable operation of the autonomous driving system. The accuracy of calibration will affect the upper limit accuracy of the sensor's use, and ultimately affect the driving status of the vehicle.

[0003] The autonomous driving domain controller has the capabilities of multi-sensor fusion, positioning, path planning, decision control, wireless communication, and high-speed communication. It is usually connected to multiple cameras, millimeter-wave radars, lidars, and IMUs (Inertial Measurement Units). The functions it completes include image recognition and data processing. Therefore, the peripheral interfaces can be expanded and increased as needed according to the application scenarios. It needs to perceive the environment and realize information fusion, logical operations and decision control, adapt to the large computing power requirements of deep learning algorithms, respond to functional safety and redundant monitoring of vehicle control, and maintain reliability to meet the functional safety requirements of ISO26262. Therefore, multiple sensors can be calibrated through the autonomous driving sensor calibration function distributed in each distributed ECU (Electronic Control Unit).

[0004] However, the calibration function of the multi-source sensor calibration method in the related technology is relatively scattered, and the calibration time is long, which reduces the calibration efficiency of vehicle sensors. In addition, there are many calibration devices and workstations, which affects the overall calibration function of autonomous driving and increases R&D costs. It cannot meet the calibration needs of multi-source sensors and needs to be solved urgently. Summary of the invention

[0005] The present application provides a multi-source sensor integrated calibration method and device for an autonomous driving vehicle to solve the problem that the calibration functions of the multi-source sensor calibration method in the related art are relatively scattered, and the calibration time is long, which reduces the calibration efficiency of the vehicle sensor, increases the research and development cost, and cannot meet the calibration needs of the multi-source sensor.

[0006] The first aspect of the present application provides a multi-source sensor integrated calibration method for an autonomous driving vehicle, comprising the following steps: detecting whether a target vehicle to be calibrated is in a calibration station that meets preset conditions; when it is detected that the target vehicle to be calibrated is in the calibration station, controlling the target vehicle to be calibrated to enter a vehicle calibration mode; based on the vehicle calibration mode, acquiring multiple items to be calibrated of the target vehicle to be calibrated, and calibrating the multiple items to be calibrated respectively, so as to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0007] Optionally, in one embodiment of the present application, the acquiring multiple items to be calibrated of the target vehicle to be calibrated includes: collecting a vehicle identification code of the target vehicle to be calibrated; and acquiring multiple items to be calibrated of the target vehicle to be calibrated according to the vehicle identification code.

[0008] Optionally, in one embodiment of the present application, the calibrating the multiple items to be calibrated separately to obtain the multi-source sensor integrated calibration result of the target vehicle to be calibrated includes: acquiring a target calibration task for the target vehicle to be calibrated; and calibrating the multiple items to be calibrated of the target vehicle to be calibrated separately according to the target calibration task to obtain the multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0009] Optionally, in one embodiment of the present application, before controlling the target vehicle to be calibrated to enter a vehicle calibration mode, it includes: using a target positioning device to perform target positioning on the target vehicle to be calibrated to obtain the positioned position of the target vehicle to be calibrated; judging whether the positioned position satisfies a preset positioning condition; if the positioned position satisfies the preset positioning condition, controlling the target vehicle to be calibrated to enter a vehicle calibration mode, otherwise not entering the vehicle calibration mode.

[0010] Optionally, in one embodiment of the present application, after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, it also includes: generating a calibration report based on the multi-source sensor integrated calibration result; sending the calibration report to a preset terminal, and displaying the calibration report on the preset terminal.

[0011] Optionally, in one embodiment of the present application, after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, it also includes: judging whether the calibration completion reminder is turned on for the target vehicle to be calibrated, wherein the calibration completion reminder method includes a voice reminder method and a pop-up screen reminder method; if the calibration completion reminder is turned on for the target vehicle to be calibrated, the calibration completion reminder is sent to a preset terminal.

[0012] The second aspect of the present application provides a multi-source sensor integrated calibration device for an autonomous driving vehicle, comprising: a detection module, used to detect whether a target vehicle to be calibrated is in a calibration station that meets preset conditions; a processing module, used to control the target vehicle to be calibrated to enter a vehicle calibration mode when it is detected that the target vehicle to be calibrated is in the calibration station; a calibration module, used to obtain multiple items to be calibrated of the target vehicle to be calibrated based on the vehicle calibration mode, and calibrate the multiple items to be calibrated respectively, so as to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0013] Optionally, in one embodiment of the present application, the calibration module includes: a collection unit, used to collect the vehicle identification code of the target vehicle to be calibrated; and an acquisition unit, used to acquire multiple items to be calibrated of the target vehicle to be calibrated according to the vehicle identification code.

[0014] Optionally, in one embodiment of the present application, the calibration module includes: a determination unit, used to obtain a target calibration task of the target vehicle to be calibrated; a calibration unit, used to calibrate multiple items to be calibrated of the target vehicle to be calibrated according to the target calibration task, so as to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0015] Optionally, in one embodiment of the present application, the device of the embodiment of the present application also includes: a determination module, used to perform target positioning on the target vehicle to be calibrated using a target positioning device before controlling the target vehicle to be calibrated to enter a vehicle calibration mode, so as to obtain the positioned position of the target vehicle to be calibrated; a first judgment module, used to judge whether the positioned position meets a preset positioning condition before controlling the target vehicle to be calibrated to enter a vehicle calibration mode; a processing module, used to control the target vehicle to be calibrated to enter a vehicle calibration mode if the positioned position meets the preset positioning condition before controlling the target vehicle to be calibrated to enter a vehicle calibration mode, otherwise, the vehicle calibration mode will not be entered.

[0016] Optionally, in one embodiment of the present application, the device of the embodiment of the present application also includes: a generation module, which is used to generate a calibration report according to the multi-source sensor integrated calibration result after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated; a first sending module, which is used to send the calibration report to a preset terminal after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, and display the calibration report on the preset terminal.

[0017] Optionally, in one embodiment of the present application, the device of the embodiment of the present application also includes: a second judgment module, which is used to judge whether the target vehicle to be calibrated has turned on the calibration completion reminder after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, wherein the calibration completion reminder method includes a voice reminder method and a pop-up screen reminder method; a second sending module, which is used to send the calibration completion reminder to a preset terminal after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, if the target vehicle to be calibrated has turned on the calibration completion reminder.

[0018] The third aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the multi-source sensor integrated calibration method for an autonomous driving vehicle as described in the above embodiment.

[0019] The fourth aspect embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and when the program is executed by a processor, it implements the multi-source sensor integrated calibration method for an autonomous driving vehicle as described above.

[0020] The fifth aspect of the present application provides a computer program product, including a computer program, which, when executed, is used to implement the multi-source sensor integrated calibration method for an autonomous driving vehicle as described above.

[0021] The embodiment of the present application can control the vehicle to be calibrated to enter the vehicle calibration mode when it is detected that the vehicle to be calibrated is in the calibration station, and obtain multiple items to be calibrated of the vehicle to be calibrated, and calibrate the multiple items to be calibrated respectively to obtain the multi-source sensor integrated calibration result of the vehicle to be calibrated, which effectively improves the calibration efficiency of the vehicle sensor and meets the calibration requirements of the multi-source sensor. Therefore, the problem that the calibration function of the multi-source sensor calibration method in the related art is relatively scattered, and the calibration time is long, which reduces the calibration efficiency of the vehicle sensor, increases the research and development cost, and cannot meet the calibration requirements of the multi-source sensor is solved.

[0022] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0024] Figure 1 A flowchart of a multi-source sensor integrated calibration method for an autonomous driving vehicle provided according to an embodiment of the present application;

[0025] Figure 2 A schematic diagram of the alignment accuracy of a specific embodiment of the present application;

[0026] Figure 3 A schematic diagram of a positioning (centering) device according to a specific embodiment of the present application;

[0027] Figure 4 A schematic diagram of a calibration program integration for a specific embodiment of the present application;

[0028] Figure 5 A schematic diagram of a target according to a specific embodiment of the present application;

[0029] Figure 6 A schematic diagram of a corner radar calibration device according to a specific embodiment of the present application;

[0030] Figure 7 This is a multi-source sensor integrated calibration framework diagram for an autonomous driving vehicle according to a specific embodiment of the present application;

[0031] Figure 8 This is a schematic diagram of the multi-source sensor integration calibration principle of an autonomous driving vehicle according to a specific embodiment of the present application;

[0032] Fig. 9 A schematic diagram of the structure of a multi-source sensor integrated calibration device for an autonomous driving vehicle provided according to an embodiment of the present application;

[0033] Fig.10 It is a schematic diagram of the structure of an electronic device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0034] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0035] The following describes the multi-source sensor integrated calibration method and device of the autonomous driving vehicle of the embodiment of the present application with reference to the accompanying drawings. In view of the problem that the calibration function of the multi-source sensor calibration method in the related art mentioned in the above background technology is relatively scattered, and the calibration time is long, which reduces the calibration efficiency of the vehicle sensor, increases the research and development cost, and cannot meet the calibration requirements of the multi-source sensor, the present application provides a multi-source sensor integrated calibration method for an autonomous driving vehicle, in which, when it is detected that the vehicle to be calibrated is in the calibration station, the vehicle to be calibrated can be controlled to enter the vehicle calibration mode, and multiple items to be calibrated of the vehicle to be calibrated can be obtained, and the multiple items to be calibrated can be calibrated respectively to obtain the multi-source sensor integrated calibration result of the vehicle to be calibrated, which effectively improves the calibration efficiency of the vehicle sensor and meets the calibration requirements of the multi-source sensor. Thus, the problem that the calibration function of the multi-source sensor calibration method in the related art is relatively scattered, and the calibration time is long, which reduces the calibration efficiency of the vehicle sensor, increases the research and development cost, and cannot meet the calibration requirements of the multi-source sensor is solved.

[0036] Specifically, Figure 1 A flowchart of a multi-source sensor integrated calibration method for an autonomous driving vehicle provided in an embodiment of the present application.

[0037] like Figure 1 As shown, the multi-source sensor integrated calibration method of the autonomous driving vehicle includes the following steps:

[0038] In step S101, it is detected whether the target vehicle to be calibrated is in a calibration station that meets preset conditions.

[0039] In the embodiment of the present application, the calibration station with preset conditions is that the ground, lighting, station type, etc. all meet the calibration requirements.

[0040] It can be understood that the embodiments of the present application can detect whether the target vehicle to be calibrated is in a calibration station that meets certain conditions, such as a flat ground, non-reflective ground, a stable light source, single-station calibration, etc., which effectively improves the feasibility of multi-source sensor integrated calibration.

[0041] For example, the floor of the calibration station in the embodiment of the present application can be designed to be self-leveling and epoxy-protected, without local depressions and protrusions, to ensure that the four wheels of the vehicle are at the same level, for example, the overall flatness error of the floor does not exceed 2 mm; in addition, the floor is non-reflective and can be matte treated to achieve diffuse reflection, that is, the reflectivity for visible light is less than 12.5% ​​and the reflectivity for lasers with a wavelength of 905 nanometers is 10%.

[0042] Secondly, for lighting requirements, it is necessary to avoid stray light in the environment, such as interference from direct sunlight, headlights, etc. In addition, the top light source is stable and controllable, and uniform light or light sources after a light-diffusing plate can be used to avoid point light sources or direct light sources that easily cause surface glare, and ensure that no high light reflections are produced when observing from all angles. Thirdly, the illumination at each target position is ≥500lux, and it is relatively uniform, that is, the illumination ratio on both sides of the light and dark boundary is less than 2:1, that is, the dark area also needs to be ≥250lux; when the production line in the embodiment of this application does not meet the above conditions, it is necessary to evaluate the installation of additional light sources.

[0043] In some embodiments, in order to meet the requirements of different factories for calibration room cycle and equipment reuse, the calibration room can be built as a single station or multiple stations as needed. Table 1 is a comparison table of the space and cycle differences between a single station and multiple stations. The specific table 1 is as follows:

[0044] Table 1

[0045]

[0046] It should be noted that the calibration room can be built as a single station or multiple stations as needed, which can be specifically set up by relevant technical personnel and is not specifically limited here.

[0047] Optionally, in one embodiment of the present application, before controlling the target vehicle to be calibrated to enter the vehicle calibration mode, it includes: using a target positioning device to perform target positioning on the target vehicle to be calibrated to obtain the positioned position of the target vehicle to be calibrated; judging whether the positioned position meets the preset positioning conditions; if the positioned position meets the preset positioning conditions, controlling the target vehicle to be calibrated to enter the vehicle calibration mode, otherwise not entering the vehicle calibration mode.

[0048] During the actual implementation process, the embodiment of the present application can start the positioning device after the vehicle to be calibrated enters the calibration room, and use the positioning device to position the vehicle to be calibrated to obtain the positioned position of the vehicle to be calibrated, and judge whether the positioned position meets the positioning conditions, for example, the position accuracy of the vehicle relative to the calibration equipment, the angular deviation of the vehicle's front and rear directions, the left and right directions, the relative position of the vehicle and other objects, etc. When the positioned position meets the positioning conditions, the vehicle to be calibrated is controlled to enter the vehicle calibration mode, otherwise it does not enter the vehicle calibration mode, thereby effectively improving the accuracy of the multi-source sensor integrated calibration.

[0049] For example, sensor production line calibration, namely EOL (End of Line) means using the known relative position of the vehicle and the calibration object to calculate the actual installation position and angle of the sensor on the vehicle. Therefore, there are strict requirements for the vehicle positioning (centering) accuracy. Table 2 is a table of vehicle positioning accuracy requirements. The specific table 2 is as follows:

[0050] Table 2

[0051] X direction ±2mm Y direction ±2mm Z direction ±2mm

[0052] Among them, the alignment accuracy is ≤±0.1°, the positioning (centering) time is ≤2s. During the static calibration procedure, the vehicle needs to have completed four-wheel alignment, be in a stationary state, only have one driver on board, the vehicle tire pressure is normal, the adaptive suspension must be at the default standard height, and it is prohibited to respond to the driver's triggering of height adjustment during the calibration process.

[0053] It should be noted that if Figure 2 As shown, the alignment accuracy is the deviation between the x-axis and the driving axis between calibration (determined by the toe angle of the non-steering wheel and has nothing to do with the steering wheel). The deviation value between the driving axis and the x-axis between calibration is required to be measurable, and the value must be guaranteed to be within 0.1° before sensor calibration. It should be noted that if the vehicle changes the driving axis when adjusting its own parameters (such as adjusting the toe), it is necessary to re-drum before the calibration begins to ensure that the deviation between the driving axis and the x-axis between calibration is within 0.1°.

[0054] For example, Figure 3 As shown, in the vehicle positioning of the embodiment of the present application, the positioning (centering) device can quickly position the vehicle to be calibrated, wherein the front wheel positioning adopts an embedded clamping position to fix the front wheel and keep the front and rear directions of the vehicle stationary; the rear wheel positioning adopts a transversely movable roller; the front and rear of the positioning device are provided with longitudinal guide wheels on both sides along the driving direction of the wheels to prevent the vehicle from deviating; two groups of opposing photoelectric switches are provided on the left and right cover plates of the front wheel part of the positioning (centering) device to determine whether the front wheels of the vehicle are placed on the transverse center line of the front wheel part of the positioning device; two front and rear transverse positioning blocks are provided at the left front wheel position of the front wheel part of the centering device to preliminarily position the front wheels of the vehicle; when the left front wheel of the vehicle drives between the transverse positioning blocks, the electrical control system controls the positioning device to center and align the vehicle so that the longitudinal center line of the vehicle coincides with the longitudinal center line of the positioning device.

[0055] In step S102, when it is detected that the target vehicle to be calibrated is in the calibration station, the target vehicle to be calibrated is controlled to enter a vehicle calibration mode.

[0056] It can be understood that the embodiment of the present application can control the vehicle to be calibrated to enter the vehicle calibration mode when it is detected that the vehicle to be calibrated is in the calibration station. For example, the embodiment of the present application can use a diagnostic instrument to connect to the calibration vehicle through the OBD interface and choose to enter the calibration mode, which effectively improves the accuracy of the multi-source sensor integrated calibration.

[0057] In step S103, based on the vehicle calibration mode, multiple items to be calibrated of the target vehicle to be calibrated are obtained, and the multiple items to be calibrated are calibrated respectively to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0058] It can be understood that the embodiments of the present application can obtain multiple items to be calibrated of the vehicle to be calibrated in the following steps based on the vehicle calibration mode, such as all sensors and other related components that need to be calibrated on the vehicle, and calibrate the multiple items to be calibrated in the following steps respectively to obtain the multi-source sensor integrated calibration results of the target vehicle to be calibrated, such as the position offset and angle deviation of each sensor, which effectively improves the calibration efficiency of the vehicle sensor and meets the calibration requirements of the multi-source sensor.

[0059] In one embodiment of the present application, obtaining multiple items to be calibrated of a target vehicle to be calibrated includes: collecting a vehicle identification code of the target vehicle to be calibrated; and obtaining multiple items to be calibrated of the target vehicle to be calibrated according to the vehicle identification code.

[0060] For example, the embodiment of the present application can scan the vehicle identification code of the vehicle to be calibrated by using a scanning gun, so as to obtain the specific information of the vehicle to be calibrated by querying the internal database or the remote server, so as to obtain all the items to be calibrated of the vehicle to be calibrated, such as the specific models and parameters of sensors such as the surround view camera, peripheral view camera, rear view camera, front view camera, lidar, millimeter wave radar, etc., thereby effectively improving the efficiency of calibration.

[0061] Among them, in one embodiment of the present application, multiple items to be calibrated are calibrated separately to obtain a multi-source sensor integrated calibration result of a target vehicle to be calibrated, including: obtaining a target calibration task of the target vehicle to be calibrated; and calibrating multiple items to be calibrated of the target vehicle to be calibrated according to the target calibration task to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0062] In some embodiments, the embodiments of the present application can obtain target calibration tasks for the vehicle to be calibrated, such as calibration tasks such as field of view angle correction of the camera, maximum detection distance test of the radar, and point cloud density adjustment of the lidar. Then, the embodiments of the present application can calibrate multiple items to be calibrated of the vehicle to be calibrated according to the target calibration tasks. For example, adjust the position and angle of the camera to ensure that the field of view of the camera covers a predetermined area and the image is clear and undistorted; test the maximum detection distance and angular resolution of the radar to ensure that the radar can accurately detect surrounding obstacles; adjust the point cloud density of the lidar to ensure that the lidar can generate high-quality point cloud data for subsequent data processing, etc., so as to obtain the multi-source sensor integrated calibration results of the vehicle to be calibrated, effectively ensuring the accuracy and completeness of the calibration process.

[0063] For example, Figure 4 As shown, the embodiments of the present application can innovatively integrate the surround view camera, perimeter camera, rear view camera, front view camera, lidar, and millimeter wave radar targets around a calibration room; integrate the sensor calibration algorithm into the autonomous driving domain controller, which uniformly schedules and controls the calibration of each sensor; integrate the camera image target and the laser circular hole target into one target, assisted by the movement of the gantry and the front and rear radar angle reflection for calibration; integrate the calibration program in the order of lidar, surround view camera, perimeter camera, front view camera, front millimeter wave radar, rear corner radar, and inertial navigation.

[0064] Among them, Figure 5 and Figure 6 As shown, Figure 5 This is the overall target layout diagram for a single station. Figure 6 This is a schematic diagram of the corner radar calibration device, in which laser and camera calibration use targets ①-⑩, forward millimeter-wave calibration uses calibration plate ⑨ (which can be moved by the gantry), and backward angle millimeter-wave calibration uses angle reflectors ⑿⒀ (which can be moved by the gantry). Millimeter-wave calibration requires shielding with absorbing cotton (indicated by the triangle block in the figure).

[0065] Optionally, in one embodiment of the present application, after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, it also includes: generating a calibration report based on the multi-source sensor integrated calibration result; sending the calibration report to a preset terminal, and displaying the calibration report on the preset terminal.

[0066] For example, the embodiment of the present application can generate a detailed calibration report with the calibration results of each sensor, such as the calibration data of cameras, radars, lidars and other sensors, and the calibration process and technical parameters of each sensor. The report is sent to the engineer's laptop computer, which is installed with an application specifically for viewing calibration reports. When the engineer opens the application, he can see the detailed calibration results, including charts, text descriptions, etc. If there are results that do not meet the standards, they will be clearly pointed out in the report and correction suggestions will be given, which effectively improves the intelligence of multi-source sensor integrated calibration.

[0067] It should be noted that the preset terminal can be specifically set by relevant technical personnel and is not specifically limited here.

[0068] Optionally, in one embodiment of the present application, after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, it also includes: determining whether the target vehicle to be calibrated has turned on the calibration completion reminder, wherein the calibration completion reminder method includes a voice reminder method and a pop-up screen reminder method; when the target vehicle to be calibrated has turned on the calibration completion reminder, the calibration completion reminder is sent to a preset terminal.

[0069] For another example, the embodiment of the present application can determine whether the target vehicle to be calibrated has turned on the calibration completion reminder. If the target vehicle to be calibrated has turned on the calibration completion reminder, if the user selects the voice reminder method, the system will play the voice reminder through the vehicle audio immediately after the calibration is completed. If the user selects the pop-up screen reminder method, the system will display a message on the vehicle's display screen to inform the user that the calibration is completed. In addition, if the user sets the reminder to be sent to a smartphone or tablet, a reminder notification will also be sent to the smartphone or tablet, effectively improving the interactivity of the autonomous driving vehicle.

[0070] For example, combining Figure 7 and Figure 8 As shown in the figure, before the vehicle is offline, the vehicle can enter a specially designed and constructed calibration room. After the vehicle is accurately positioned, the calibration procedure is started to calibrate various sensors in sequence. After the calibration is completed, the vehicle leaves the calibration room. The specific steps are as follows:

[0071] In the first step, the operator can drive the calibration vehicle in the embodiment of the present application to the positioning device of the static calibration site and successfully complete the positioning (centering). During the centering, the vehicle needs to be in N gear, and after the vehicle is centered, it is shifted to P gear;

[0072] The second step is to use the diagnostic instrument to connect the vehicle through the OBD interface and select to enter the calibration mode. The calibration device of each sensor runs to the predetermined position.

[0073] The third step is to scan the vehicle VIN (Vehicle Identification Number) with a scanner, associate the vehicle information, and obtain the vehicle items to be calibrated;

[0074] In the fourth step, the host computer repeats N.1, N.2 and N.3 to complete all the calibration tasks and return the results. Figure 6 In the process, all cameras, lidar, front millimeter-wave radar, corner millimeter-wave radar, etc. are calibrated in sequence;

[0075] The fifth step is to feedback the calibration status and results through the diagnostic instrument. After the calibration is completed, the calibration device of each sensor returns to its position, the expansion mechanism of the positioning device returns to its position, and the vehicle drives away from the calibration station, which effectively improves the calibration efficiency of the vehicle sensor and meets the calibration requirements of multi-source sensors.

[0076] It should be noted that the embodiment of the present application can also design a functional safety test system for an autonomous driving domain controller, wherein a test platform that simulates multiple faults such as electrical faults, signal faults, communication faults, and power supply faults in the domain controller has the testing capabilities of functional safety requirement testing, interface testing, safety mechanism testing, and robustness testing. It can perform virtual simulation verification in the early stage of research and development, and can also perform real vehicle fusion fault injection testing in the later stage to perform functional safety verification on the autonomous driving domain controller.

[0077] According to the multi-source sensor integrated calibration method for an autonomous driving vehicle proposed in the embodiment of the present application, when it is detected that the vehicle to be calibrated is in the calibration station, the vehicle to be calibrated can be controlled to enter the vehicle calibration mode, and multiple items to be calibrated of the vehicle to be calibrated can be obtained, and the multiple items to be calibrated can be calibrated respectively to obtain the multi-source sensor integrated calibration result of the vehicle to be calibrated, which effectively improves the calibration efficiency of the vehicle sensor and meets the calibration requirements of the multi-source sensor. Thus, the problem that the calibration function of the multi-source sensor calibration method in the related art is relatively scattered, and the calibration time is long, which reduces the calibration efficiency of the vehicle sensor, increases the R&D cost, and cannot meet the calibration requirements of the multi-source sensor is solved.

[0078] Next, a multi-source sensor integrated calibration device for an autonomous driving vehicle proposed in accordance with an embodiment of the present application will be described with reference to the accompanying drawings.

[0079] Fig. 9 It is a block diagram of a multi-source sensor integrated calibration device for an autonomous driving vehicle according to an embodiment of the present application.

[0080] like Fig. 9 As shown, the multi-source sensor integrated calibration device 10 of the autonomous driving vehicle includes: a detection module 100, a processing module 200 and a calibration module 300.

[0081] Specifically, the detection module 100 is used to detect whether the target vehicle to be calibrated is in a calibration station that meets preset conditions.

[0082] The processing module 200 is used to control the target vehicle to be calibrated to enter a vehicle calibration mode when it is detected that the target vehicle to be calibrated is in a calibration station.

[0083] The calibration module 300 is used to obtain multiple items to be calibrated of the target vehicle to be calibrated based on the vehicle calibration mode, and calibrate the multiple items to be calibrated respectively to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0084] Optionally, in one embodiment of the present application, the calibration module 300 includes: a collection unit and an acquisition unit.

[0085] Among them, the collection unit is used to collect the vehicle identification code of the target vehicle to be calibrated.

[0086] The acquisition unit is used to acquire multiple items to be calibrated of the target vehicle to be calibrated according to the vehicle identification code.

[0087] Optionally, in one embodiment of the present application, the calibration module 300 includes: a determination unit and a calibration unit.

[0088] The determination unit is used to obtain a target calibration task for a target vehicle to be calibrated.

[0089] The calibration unit is used to calibrate multiple items to be calibrated of the target vehicle to be calibrated according to the target calibration task, so as to obtain the multi-source sensor integrated calibration result of the target vehicle to be calibrated.

[0090] Optionally, in one embodiment of the present application, the device 10 of the embodiment of the present application further includes: a determination module, a first judgment module and a processing module.

[0091] The determination module is used to perform target positioning on the target vehicle to be calibrated by using a target positioning device before controlling the target vehicle to be calibrated to enter a vehicle calibration mode, so as to obtain a positioned position of the target vehicle to be calibrated.

[0092] The first judgment module is used to judge whether the positioned position meets the preset positioning condition before controlling the target vehicle to be calibrated to enter the vehicle calibration mode.

[0093] The processing module is used to control the target vehicle to be calibrated to enter the vehicle calibration mode before the vehicle to be calibrated is controlled to enter the vehicle calibration mode if the positioned position meets the preset positioning condition, otherwise the vehicle calibration mode is not entered.

[0094] Optionally, in one embodiment of the present application, the device 10 of the embodiment of the present application further includes: a generating module and a first sending module.

[0095] Among them, the generation module is used to generate a calibration report according to the multi-source sensor integration calibration result after obtaining the multi-source sensor integration calibration result of the target vehicle to be calibrated.

[0096] The first sending module is used to send the calibration report to a preset terminal after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, and display the calibration report on the preset terminal.

[0097] Optionally, in an embodiment of the present application, the device 10 of the embodiment of the present application further includes: a second judgment module and a second sending module.

[0098] Among them, the second judgment module is used to determine whether the target vehicle to be calibrated has turned on the calibration completion reminder after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, wherein the calibration completion reminder method includes a voice reminder method and a pop-up screen reminder method.

[0099] The second sending module is used to send a calibration completion reminder to a preset terminal after obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated and when the calibration completion reminder is turned on for the target vehicle to be calibrated.

[0100] It should be noted that the aforementioned explanation of the embodiment of the multi-source sensor integrated calibration method for an autonomous driving vehicle is also applicable to the multi-source sensor integrated calibration device for an autonomous driving vehicle of this embodiment, and will not be repeated here.

[0101] According to the multi-source sensor integrated calibration device for an autonomous driving vehicle proposed in the embodiment of the present application, when it is detected that the vehicle to be calibrated is in the calibration station, the vehicle to be calibrated can be controlled to enter the vehicle calibration mode, and multiple items to be calibrated of the vehicle to be calibrated can be obtained, and the multiple items to be calibrated can be calibrated respectively to obtain the multi-source sensor integrated calibration result of the vehicle to be calibrated, which effectively improves the calibration efficiency of the vehicle sensor and meets the calibration requirements of the multi-source sensor. Thus, the problem that the calibration function of the multi-source sensor calibration method in the related art is relatively scattered, and the calibration time is long, which reduces the calibration efficiency of the vehicle sensor, increases the R&D cost, and cannot meet the calibration requirements of the multi-source sensor is solved.

[0102] Fig.10 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device may include:

[0103] A memory 1001 , a processor 1002 , and a computer program stored in the memory 1001 and executable on the processor 1002 .

[0104] When the processor 1002 executes the program, the multi-source sensor integrated calibration method for the autonomous driving vehicle provided in the above embodiment is implemented.

[0105] Furthermore, the electronic device further comprises:

[0106] The communication interface 1003 is used for communication between the memory 1001 and the processor 1002 .

[0107] The memory 1001 is used to store computer programs that can be executed on the processor 1002 .

[0108] The memory 1001 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0109] If the memory 1001, the processor 1002 and the communication interface 1003 are implemented independently, the communication interface 1003, the memory 1001 and the processor 1002 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.10 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0110] Optionally, in a specific implementation, if the memory 1001, the processor 1002 and the communication interface 1003 are integrated on a chip, the memory 1001, the processor 1002 and the communication interface 1003 can communicate with each other through an internal interface.

[0111] The processor 1002 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0112] This embodiment also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the multi-source sensor integrated calibration method for an autonomous driving vehicle as described above.

[0113] This embodiment also provides a computer program product, including a computer program, which, when executed, is used to implement the multi-source sensor integrated calibration method for an autonomous driving vehicle as described above.

[0114] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0115] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0116] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0117] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways as necessary and then storing it in a computer memory.

[0118] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0119] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0120] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0121] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A multi-source sensor integrated calibration method for an autonomous driving vehicle, characterized in that: The following steps are involved: Detect whether the target vehicle to be calibrated is in a calibration station that meets preset conditions; When it is detected that the target vehicle to be calibrated is in the calibration station, controlling the target vehicle to be calibrated to enter a vehicle calibration mode; Based on the vehicle calibration mode, a plurality of items to be calibrated of the target vehicle to be calibrated are acquired, and the plurality of items to be calibrated are calibrated respectively to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

2. The method according to claim 1, characterized in that The step of obtaining a plurality of items to be calibrated of the target vehicle to be calibrated comprises: Collecting the vehicle identification code of the target vehicle to be calibrated; A plurality of items to be calibrated of the target vehicle to be calibrated are obtained according to the vehicle identification code.

3. The method according to claim 1, characterized in that The step of respectively calibrating the plurality of items to be calibrated to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated includes: Obtaining a target calibration task for the target vehicle to be calibrated; According to the target calibration task, multiple items to be calibrated of the target vehicle to be calibrated are calibrated respectively to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

4. The method according to claim 1, characterized in that: Before controlling the target vehicle to be calibrated to enter a vehicle calibration mode, the method includes: Using a target positioning device to position the target vehicle to be calibrated, so as to obtain a positioned position of the target vehicle to be calibrated; Determining whether the located position meets a preset positioning condition; If the positioned position meets the preset positioning condition, the target vehicle to be calibrated is controlled to enter a vehicle calibration mode, otherwise the vehicle calibration mode is not entered.

5. The method according to claim 1, characterized in that After obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, the method further includes: Generating a calibration report according to the multi-source sensor integrated calibration result; The calibration report is sent to a preset terminal, and the calibration report is displayed on the preset terminal.

6. The method according to claim 5, characterized in that After obtaining the multi-source sensor integrated calibration result of the target vehicle to be calibrated, the method further includes: Determine whether the target vehicle to be calibrated has activated a calibration completion reminder, wherein the calibration completion reminder includes a voice reminder and a pop-up screen reminder; When the target vehicle to be calibrated turns on the calibration completion reminder, the calibration completion reminder is sent to a preset terminal.

7. A multi-source sensor integrated calibration device for an autonomous driving vehicle, characterized in that: include: A detection module, used to detect whether the target vehicle to be calibrated is in a calibration station that meets preset conditions; A processing module, configured to control the target vehicle to be calibrated to enter a vehicle calibration mode when it is detected that the target vehicle to be calibrated is in the calibration station; The calibration module is used to obtain multiple items to be calibrated of the target vehicle to be calibrated based on the vehicle calibration mode, and calibrate the multiple items to be calibrated respectively to obtain a multi-source sensor integrated calibration result of the target vehicle to be calibrated.

8. The device according to claim 7, characterized in that The calibration module comprises: A collection unit, used for collecting the vehicle identification code of the target vehicle to be calibrated; An acquisition unit is used to acquire a plurality of items to be calibrated of the target vehicle to be calibrated according to the vehicle identification code.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement a multi-source sensor integrated calibration method for an autonomous driving vehicle as described in any one of claims 1 to 6.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement a multi-source sensor integrated calibration method for an autonomous driving vehicle as described in any one of claims 1 to 6.