Vehicle three-dimensional coordinate true value determination method, device and equipment, medium and vehicle

Through the coordinated work of the main acquisition vehicle and the auxiliary acquisition vehicle, the coordinate conversion matrix is ​​calculated and the position information is projected, which solves the problem that lidar cannot detect the three-dimensional coordinates of ultra-long-distance vehicles, and achieves high-precision three-dimensional coordinate perception.

CN119063624APending Publication Date: 2024-12-03MOMENTA (SUZHOU) TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310636369.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The existing lidar can detect the three-dimensional coordinates of surrounding vehicles within a range of 60 meters to 120 meters, but cannot detect them at a long distance, resulting in the inability to obtain the true value of the three-dimensional coordinates of the vehicle.

Method used

Through the mutual cooperation between the main acquisition vehicle and the auxiliary acquisition vehicle, data is collected using inertia sensors and vehicle-end sensors, the coordinate conversion matrix is ​​calculated, and the position information of the auxiliary acquisition vehicle is projected into the vehicle coordinate system of the main acquisition vehicle, and the ultra-far results are obtained The truth value of the three-dimensional coordinates of the vehicle.

Benefits of technology

It achieves the accurate three-dimensional coordinate truth value of ultra-long-distance vehicles without adding new sensors, solving the problem of lidar detection distance limitation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119063624A_ABST
    Figure CN119063624A_ABST
Patent Text Reader

Abstract

The invention discloses a vehicle three-dimensional coordinate true value determination method, device and equipment, a medium and a vehicle. The method comprises the following steps: acquiring K groups of own vehicle position information acquired by an inertial sensor of an auxiliary acquisition vehicle during K times of parking and K groups of main sensing data packets acquired by a main acquisition vehicle; according to the K groups of own vehicle position information and the K groups of main sensing data packets, calculating to obtain a coordinate transformation matrix between a start-up vehicle coordinate system of the main acquisition vehicle and a start-up vehicle coordinate system of the auxiliary acquisition vehicle; according to the coordinate transformation matrix and vehicle position information collected by an inertial sensor of the auxiliary collection vehicle at a preset distance position, projection coordinate information of the auxiliary collection vehicle in a vehicle coordinate system of the main collection vehicle is obtained through calculation, and the projection coordinate information serves as a three-dimensional coordinate true value of the auxiliary collection vehicle, the distance between the preset distance position and the main acquisition vehicle is greater than a preset distance threshold value. By applying the scheme provided by the invention, the three-dimensional coordinate true value of the vehicle in an ultra-long distance can be obtained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent driving technology, and in particular to a method, device, equipment, medium and vehicle for determining the true value of a vehicle's three-dimensional coordinates. Background Art

[0002] During the driving process of an unmanned vehicle, it needs to detect vehicles on the road so as to avoid accidents such as collisions and ensure its driving safety.

[0003] Specifically, a vehicle-side sensor, such as a laser radar, may be installed on the unmanned vehicle. The laser radar is used to sense the surrounding environment of the unmanned vehicle during its driving process to obtain the true value of the three-dimensional coordinates of each sensed vehicle.

[0004] The perception distance of conventional lidar is only 60 meters to 120 meters. When the distance exceeds the upper limit of 120 meters, the lidar cannot obtain any three-dimensional perception results. Therefore, it is currently impossible to obtain the true value of the three-dimensional coordinates of vehicles at ultra-long distances. Summary of the invention

[0005] The present invention provides a method, device, equipment, medium and vehicle for determining the true value of the three-dimensional coordinates of a vehicle, which can obtain the true value of the three-dimensional coordinates of a vehicle at an ultra-long distance. The specific technical solution is as follows.

[0006] In a first aspect, an embodiment of the present invention provides a method for determining the true value of a vehicle's three-dimensional coordinates. In an initial state, a main collection vehicle and an auxiliary collection vehicle are both located at an initial point and vehicle-side sensors of the two vehicles are facing the front of the vehicle. When the auxiliary collection vehicle travels forward, the main collection vehicle is stationary. Vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset duration when the auxiliary collection vehicle stops at a preset distance interval. When the number of stops reaches K times, the auxiliary collection vehicle continues to travel to a preset distance position and stops. At this time, the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of the preset duration. The method includes:

[0007] Obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, each group of main perception data packets is composed of perception data with multiple frames of timestamps, and each frame of perception data with timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle;

[0008] A coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle is calculated based on the K groups of vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's onboard computer when it is started as the origin of the coordinate system;

[0009] The projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than a preset distance threshold.

[0010] Optionally, the step of calculating a coordinate conversion matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle according to the K groups of ego-vehicle position information and the K groups of main perception data packets includes:

[0011] The first group of main perception data packets in the K groups of main perception data packets is used as the current group of main perception data packets, and the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets is traversed according to the nearest neighbor algorithm to calculate the first relative distance error with the first self-vehicle position information in the first group of self-vehicle position information, and the three-dimensional coordinate information of the perception vehicle corresponding to the smallest first relative distance error is determined as the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets, and the first self-vehicle position information is determined as the self-vehicle position information of the auxiliary collection vehicle corresponding to the first frame timestamp in the current group of main perception data packets;

[0012] For each frame timestamp in the current group of main perception data packets except the first frame timestamp, the three-dimensional coordinate information of the perception vehicle corresponding to the frame timestamp is calculated with the first three-dimensional coordinate information to obtain a second relative distance error, the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than a preset distance error threshold is determined as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp, the first group of ego vehicle position information and the second three-dimensional coordinate information are traversed according to the nearest neighbor algorithm to calculate a third relative distance error, and the ego vehicle position information corresponding to the smallest third relative distance error is determined as the ego vehicle position information of the auxiliary collection vehicle corresponding to the frame timestamp;

[0013] The conversion matrix corresponding to the current group of main perception data packets is calculated according to the three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at each frame timestamp, the position information of the auxiliary collection vehicle corresponding to each frame timestamp, and a preset general graph optimization formula, and the conversion matrix is ​​used as the current conversion matrix;

[0014] The next group of main perception data packets of the current group of main perception data packets is used as the current group of main perception data packets, and the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets is calculated according to the next group of ego-vehicle position information of the first group of ego-vehicle position information and the current transformation matrix, and the step of calculating the second relative distance error by performing the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information is returned to be executed, until the transformation matrix corresponding to the last group of main perception data packets in the K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle.

[0015] Optionally, the step of calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position includes:

[0016] The coordinate conversion matrix is ​​calculated and multiplied on the left by the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position to obtain the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle.

[0017] Optionally, after the step of calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, the above-mentioned method for determining the true value of the vehicle three-dimensional coordinates further includes:

[0018] Receive the two-dimensional annotation box of the auxiliary collection vehicle manually annotated in the target main perception data packet, perform two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional boundary box corresponding to the projection coordinate information, and when the match is successful, execute the step of using the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the target main perception data packet is the main perception data packet collected by the vehicle-side sensor of the main collection vehicle when the auxiliary collection vehicle continues to travel to a preset distance position and stops.

[0019] Optionally, the step of performing two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional bounding box corresponding to the projection coordinate information includes:

[0020] Projecting the three-dimensional bounding box corresponding to the projection coordinate information onto the image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box;

[0021] A first area of ​​the intersection and a second area of ​​the union between the two-dimensional annotation box and the two-dimensional projection boundary box are calculated, and a quotient of the first area and the second area is calculated. When the quotient is greater than a preset value, it is determined that the match is successful.

[0022] Optionally, after the step of using the projection coordinate information as the three-dimensional coordinate true value of the auxiliary data collection vehicle, the above-mentioned method for determining the three-dimensional coordinate true value of the vehicle further includes:

[0023] An adjustment made to the vehicle height in the three-dimensional coordinate true value of the auxiliary data collection vehicle is received to obtain the adjusted three-dimensional coordinate true value of the auxiliary data collection vehicle.

[0024] Optionally, after the step of using the projection coordinate information as the three-dimensional coordinate true value of the auxiliary data collection vehicle, the above-mentioned method for determining the three-dimensional coordinate true value of the vehicle further includes:

[0025] The three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-side sensor of the auxiliary collection vehicle at the preset distance position.

[0026] In a second aspect, an embodiment of the present invention provides a device for determining the true value of a vehicle's three-dimensional coordinates. In an initial state, the main collection vehicle and the auxiliary collection vehicle are both located at an initial point and the vehicle-side sensors of the two vehicles are facing the front of the vehicle. When the auxiliary collection vehicle travels forward, the main collection vehicle is stationary. The vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset time length when the auxiliary collection vehicle stops at a preset distance interval. When the number of stops reaches K times, the auxiliary collection vehicle continues to travel to a preset distance position and stops. At this time, the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of the preset time length. The device includes:

[0027] An acquisition module, used to obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, each group of main perception data packets is composed of perception data of multiple frames of timestamps, and each frame of perception data of timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle;

[0028] A coordinate conversion matrix determination module is used to calculate the coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle according to the K groups of ego vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's onboard computer when it is started as the origin of the coordinate system;

[0029] The first coordinate true value determination module is used to calculate the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and use the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than a preset distance threshold.

[0030] Optionally, the coordinate transformation matrix determination module includes:

[0031] A first calculation submodule is used to use the first group of main perception data packets in the K groups of main perception data packets as the current group of main perception data packets, traverse the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets according to the nearest neighbor algorithm and calculate the first self-vehicle position information in the first group of self-vehicle position information to obtain a first relative distance error, determine the three-dimensional coordinate information of the perception vehicle corresponding to the minimum first relative distance error as the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets, and determine the first self-vehicle position information as the self-vehicle position information of the auxiliary collection vehicle corresponding to the first frame timestamp in the current group of main perception data packets;

[0032] A second calculation submodule is used to calculate, for each frame timestamp in the current group of main perception data packets except the first frame timestamp, the three-dimensional coordinate information of the perception vehicle corresponding to the frame timestamp and the first three-dimensional coordinate information to obtain a second relative distance error, determine the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than a preset distance error threshold as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp, traverse the first group of ego vehicle position information and the second three-dimensional coordinate information according to the nearest neighbor algorithm to calculate a third relative distance error, and determine the ego vehicle position information corresponding to the smallest third relative distance error as the ego vehicle position information of the auxiliary collection vehicle corresponding to the frame timestamp;

[0033] The current conversion matrix determination submodule is used to calculate the conversion matrix corresponding to the current group of main perception data packets according to the three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at each frame timestamp, the vehicle position information of the auxiliary collection vehicle corresponding to each frame timestamp and a preset general graph optimization formula, and use the conversion matrix as the current conversion matrix;

[0034] The third calculation submodule is used to use the next group of main perception data packets of the current group of main perception data packets as the current group of main perception data packets, calculate the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets according to the next group of ego vehicle position information of the first group of ego vehicle position information and the current transformation matrix, return to execute the step of calculating the second relative distance error between the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information, until the transformation matrix corresponding to the last group of main perception data packets in the K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle.

[0035] Optionally, the first coordinate true value determining module is specifically used to:

[0036] The coordinate conversion matrix is ​​calculated and multiplied on the left by the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position to obtain the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle.

[0037] Optionally, the above-mentioned vehicle three-dimensional coordinate true value determination device further includes:

[0038] A receiving module is used to receive a two-dimensional annotation box of the auxiliary collection vehicle manually annotated in a target main perception data packet, after calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the self-vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and perform two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional boundary box corresponding to the projection coordinate information. When the match is successful, trigger the use of the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the target main perception data packet is a main perception data packet collected by the vehicle-side sensor of the main collection vehicle when the auxiliary collection vehicle continues to travel to the preset distance position and stops.

[0039] Optionally, the receiving module includes:

[0040] A projection submodule, configured to project a three-dimensional bounding box corresponding to the projection coordinate information onto an image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box;

[0041] The matching submodule is used to calculate the first area of ​​the intersection and the second area of ​​the union between the two-dimensional annotation box and the two-dimensional projection boundary box, calculate the quotient of the first area and the second area, and determine that the match is successful when the quotient is greater than a preset value.

[0042] Optionally, the above-mentioned vehicle three-dimensional coordinate true value determination device further includes:

[0043] The adjustment module is used to receive the adjustment of the vehicle height in the three-dimensional coordinate true value of the auxiliary collection vehicle after the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, so as to obtain the adjusted three-dimensional coordinate true value of the auxiliary collection vehicle.

[0044] Optionally, the above-mentioned vehicle three-dimensional coordinate true value determination device further includes:

[0045] The second coordinate true value determination module is used to calculate the three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle according to the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-end sensor of the auxiliary collection vehicle at the preset distance position after the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle.

[0046] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for determining a true value of a vehicle's three-dimensional coordinates as provided in any embodiment of the present invention.

[0047] In a fourth aspect, an embodiment of the present invention provides an electronic device, the electronic device comprising:

[0048] one or more processors;

[0049] The processor is coupled to a storage device, and the storage device is used to store one or more programs;

[0050] When the one or more programs are executed by the one or more processors, the electronic device implements the method for determining the true value of the three-dimensional coordinates of a vehicle as provided in any embodiment of the present invention.

[0051] In a fifth aspect, an embodiment of the present invention provides a vehicle, which includes a device for determining a true value of a vehicle three-dimensional coordinate as provided in any embodiment of the present invention, or includes an electronic device as provided in any embodiment of the present invention.

[0052] As can be seen from the above content, a method, device, equipment, medium and vehicle for determining the true value of the three-dimensional coordinates of a vehicle provided by an embodiment of the present invention can obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, each group of main perception data packets is composed of perception data with multiple frames of timestamps, and the perception data with each frame of timestamps includes the three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle; the coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle is calculated based on the K groups of vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's on-board computer when it is powered on as the origin of the coordinate system; the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at a preset distance position, and the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than the preset distance threshold. In the embodiment of the present invention, the main collection vehicle and the auxiliary collection vehicle cooperate with each other, and the coordinate conversion matrix between the main collection vehicle's start-up vehicle coordinate system and the auxiliary collection vehicle's start-up vehicle coordinate system is calculated based on K groups of self-vehicle position information and K groups of main perception data packets, and then the auxiliary collection vehicle's self-vehicle position information is projected into the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix to obtain the three-dimensional coordinate true value of the auxiliary collection vehicle. Since the distance between the preset distance position and the main collection vehicle is greater than the preset distance threshold, the obtained three-dimensional coordinate true value of the auxiliary collection vehicle is the three-dimensional coordinate true value of the ultra-long distance, which realizes the three-dimensional coordinate true value perception of the ultra-long distance vehicle of the main collection vehicle. Of course, any product or method implementing the present invention does not necessarily need to achieve all the advantages described above at the same time.

[0053] The innovative features of the embodiments of the present invention include:

[0054] 1. Through the cooperation between the main collection vehicle and the auxiliary collection vehicle, the coordinate conversion matrix between the main collection vehicle's start-up vehicle coordinate system and the auxiliary collection vehicle's start-up vehicle coordinate system is calculated according to K groups of ego vehicle position information and K groups of main perception data packets, and then the ego vehicle position information of the auxiliary collection vehicle is projected into the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix to obtain the three-dimensional coordinate true value of the auxiliary collection vehicle. Since the distance between the preset distance position and the main collection vehicle is greater than the preset distance threshold, the obtained three-dimensional coordinate true value of the auxiliary collection vehicle is the three-dimensional coordinate true value of the ultra-long distance, realizing the three-dimensional coordinate true value perception of the ultra-long distance vehicle of the main collection vehicle.

[0055] 2. In the embodiment of the present invention, only through the cooperation between the main data collection vehicle and the auxiliary data collection vehicle, the accurate three-dimensional coordinate true value of the vehicle at an ultra-long distance can be obtained without adding additional sensors.

[0056] 3. Based on K groups of ego-vehicle position information, K groups of main perception data packets and the nearest neighbor algorithm, the coordinate transformation matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle is calculated.

[0057] 4. By receiving the adjustment of the vehicle height in the three-dimensional coordinate true value of the auxiliary collection vehicle, the accuracy of the three-dimensional coordinate true value of the auxiliary collection vehicle after adjustment in the height direction is improved.

[0058] 5. By means of coordinate conversion, the three-dimensional coordinate information of each sensing vehicle in the auxiliary sensing data packet collected by the auxiliary collection vehicle at a preset distance is converted to the vehicle coordinate system of the main collection vehicle, and the three-dimensional coordinate true value of the three-dimensional coordinate information of each sensing vehicle sensed by the auxiliary collection vehicle at an ultra-long distance in the vehicle coordinate system of the main collection vehicle is obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative work.

[0060] Figure 1 A schematic flow chart of a method for determining the true value of a vehicle's three-dimensional coordinates provided in an embodiment of the present invention.

[0061] Figure 2 A schematic diagram of the vehicle-side sensor of the main data collection vehicle and the vehicle-side sensor of the auxiliary data collection vehicle respectively collecting the perception data packets provided by the embodiment of the present invention;

[0062] Figure 3 A schematic diagram of a structure of a device for determining a true value of a vehicle three-dimensional coordinate provided by an embodiment of the present invention;

[0063] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention;

[0064] Figure 5 A schematic structural diagram of a vehicle provided in an embodiment of the present invention.

[0065] Figure 2 In the figure, 1 is the main collection vehicle, 2 is the auxiliary collection vehicle, 3 is other vehicles, and h is the preset distance interval. DETAILED DESCRIPTION

[0066] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0067] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present invention and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0068] The embodiment of the present invention discloses a method, device, equipment, medium and vehicle for determining the true value of the three-dimensional coordinates of a vehicle, which can obtain the true value of the three-dimensional coordinates of a vehicle at an ultra-long distance. The embodiment of the present invention is described in detail below.

[0069] Figure 1 A schematic flow chart of a method for determining the true value of a vehicle's three-dimensional coordinates provided by an embodiment of the present invention. The method is applied to electronic equipment.

[0070] Figure 2 The schematic diagram of the vehicle-side sensor of the main data collection vehicle 1 and the vehicle-side sensor of the auxiliary data collection vehicle 2 respectively collecting the perception data packets provided by the embodiment of the present invention is shown in FIG. Figure 2 In the initial state, the main collection vehicle 1 and the auxiliary collection vehicle 2 are both located at the initial point and the vehicle-end sensors of the two vehicles are facing the front of the vehicle, that is, Figure 2 In the direction of the arrow in the figure, when the auxiliary collection vehicle 2 moves forward, that is, moves in the direction of the arrow, the main collection vehicle 1 is stationary.

[0071] The vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset time length when the auxiliary collection vehicle 2 stops at a preset distance interval h. When the number of stops reaches K times, the auxiliary collection vehicle 2 continues to travel to the preset distance position point A and stops. At this time, the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset time length, and when the auxiliary collection vehicle 2 stops at point A, there is another vehicle 3 passing by point A, and the main collection vehicle 1 is not in P gear when it is stationary.

[0072] On this basis, the above method specifically includes the following steps.

[0073] S110: Obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, and each group of main perception data packets consists of perception data with multiple frames of timestamps, and each frame of perception data with a timestamp includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle includes at least the auxiliary collection vehicle.

[0074] During the driving process, the auxiliary collection vehicle 2 uses its own inertial sensor to collect the ego position information of the auxiliary collection vehicle 2 in real time. Since the auxiliary collection vehicle 2 stops at a preset distance interval h, and the vehicle-side sensor of the auxiliary collection vehicle 2 collects the perception data packet of the preset time length, the inertial sensor of the auxiliary collection vehicle 2 can also collect a set of ego position information corresponding to the preset time length each time it stops, so K sets of ego position information are obtained after K stops.

[0075] Since the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset duration when the auxiliary collection vehicle 2 stops at a preset distance interval h, although the main collection vehicle 1 has been stationary, the main collection vehicle 1 also obtains K groups of main perception data packets when it stops K times, where each group of main perception data packets is composed of perception data with multiple frames of timestamps, and the perception data with each frame of timestamps includes the three-dimensional coordinate information of the perceived vehicle, and K is greater than the preset number of times. For example, the preset number of times is 3.

[0076] Since the auxiliary collection vehicle 2 moves forward and the main collection vehicle 1 remains stationary, the vehicle-side sensor of the main collection vehicle 1 can always sense the auxiliary collection vehicle 2. Therefore, the sensed vehicles sensed by the main collection vehicle 1 at least include the auxiliary collection vehicle.

[0077] In order to obtain the true value of the three-dimensional coordinates of the vehicle at an ultra-long distance, the electronic device obtains K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle.

[0078] The main collection vehicle 1 is a vehicle that needs to obtain the true value of the three-dimensional coordinates of the vehicle at an ultra-long distance, and the auxiliary collection vehicle 2 is a vehicle that assists the main collection vehicle 1 in obtaining the true value of the three-dimensional coordinates of the vehicle at an ultra-long distance.

[0079] S120: Calculate the coordinate conversion matrix between the powered-on vehicle coordinate system of the main collection vehicle and the powered-on vehicle coordinate system of the auxiliary collection vehicle based on K groups of ego-vehicle position information and K groups of main perception data packets, wherein the powered-on vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's onboard computer when it is powered on as the origin of the coordinate system.

[0080] After obtaining K groups of ego-vehicle position information and K groups of main perception data packets, the electronic device needs to calculate the coordinate conversion matrix between the power-on vehicle coordinate system of the main collection vehicle 1 and the power-on vehicle coordinate system of the auxiliary collection vehicle 2 based on the K groups of ego-vehicle position information and the K groups of main perception data packets, wherein the power-on vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's on-board computer when it is turned on as the origin of the coordinate system.

[0081] Specifically, step S120 may include:

[0082] The first group of main perception data packets in the K groups of main perception data packets is used as the current group of main perception data packets, and the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets is traversed according to the nearest neighbor algorithm to calculate the first relative distance error with the first ego vehicle position information in the first group of ego vehicle position information, and the three-dimensional coordinate information of the perception vehicle corresponding to the smallest first relative distance error is determined as the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets, and the first ego vehicle position information is determined as the ego vehicle position information of the auxiliary collection vehicle corresponding to the first frame timestamp in the current group of main perception data packets;

[0083] For each frame timestamp except the first frame timestamp in the current group of main perception data packets, the three-dimensional coordinate information of the perception vehicle corresponding to the frame timestamp is calculated with the first three-dimensional coordinate information to obtain a second relative distance error, the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than the preset distance error threshold is determined as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp, the first group of ego vehicle position information and the second three-dimensional coordinate information are traversed according to the nearest neighbor algorithm to calculate the third relative distance error, and the ego vehicle position information corresponding to the smallest third relative distance error is determined as the ego vehicle position information of the auxiliary collection vehicle corresponding to the frame timestamp;

[0084] The conversion matrix corresponding to the main perception data packet of the current group is calculated based on the three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at each frame timestamp, the position information of the auxiliary collection vehicle corresponding to each frame timestamp, and the preset general graph optimization formula, and the conversion matrix is ​​used as the current conversion matrix;

[0085] The next group of main perception data packets of the current group of main perception data packets is used as the current group of main perception data packets, and the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets is calculated according to the next group of ego vehicle position information of the first group of ego vehicle position information and the current transformation matrix, and the step of calculating the second relative distance error by the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information is returned until the transformation matrix corresponding to the last group of main perception data packets in the K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle.

[0086] When the main collection vehicle 1 is collecting the first group of main perception data packets, it is relatively close to the auxiliary collection vehicle 2. At this time, in order to obtain the three-dimensional coordinate information of the auxiliary collection vehicle 2 in the main collection vehicle 1, the first group of main perception data packets in the K groups of main perception data packets is used as the current group of main perception data packets. The three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets is traversed according to the nearest neighbor algorithm. The first self-vehicle position information in the first group of self-vehicle position information is calculated to obtain the first relative distance error. The three-dimensional coordinate information of the perception vehicle corresponding to the smallest first relative distance error is determined as the first three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1 at the first frame timestamp in the current group of main perception data packets. The first group of self-vehicle position information is a group of self-vehicle position information that ranks first in the K groups of self-vehicle position information.

[0087] That is to say, the three-dimensional coordinate information corresponding to the minimum first relative distance error is the three-dimensional coordinate information collected by the auxiliary collection vehicle 2 at the first frame timestamp in the main collection vehicle 1, and then the first ego vehicle position information is determined as the ego vehicle position information of the auxiliary collection vehicle 2 corresponding to the first frame timestamp in the current group of main perception data packets.

[0088] At present, only the three-dimensional coordinate information of the auxiliary collection vehicle 2 at the first frame timestamp in the first group of main perception data packets is obtained. In order to obtain the three-dimensional coordinate information of the auxiliary collection vehicle 2 at other timestamps, it is necessary to calculate the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information to obtain a second relative distance error, and the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than the preset distance error threshold is determined as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp. In this way, the three-dimensional coordinate information of the auxiliary collection vehicle 2 at other timestamps in the first group of main perception data packets is obtained. Exemplarily, the preset distance error threshold can be 1m.

[0089] Then, according to the nearest neighbor algorithm, the first set of ego-vehicle position information and the second three-dimensional coordinate information are traversed to calculate the third relative distance error, and the ego-vehicle position information corresponding to the smallest third relative distance error is determined as the ego-vehicle position information of the auxiliary collection vehicle 2 corresponding to the frame timestamp. Finally, the three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1 at each frame timestamp and the ego-vehicle position information of the auxiliary collection vehicle 2 corresponding to each frame timestamp are obtained.

[0090] After obtaining the three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1 at each frame timestamp and the vehicle position information of the auxiliary collection vehicle 2 corresponding to each frame timestamp, the transformation matrix corresponding to the current group of main perception data packets is calculated according to the three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1 at each frame timestamp, the vehicle position information of the auxiliary collection vehicle 2 corresponding to each frame timestamp and the preset general graph optimization formula, and the transformation matrix is ​​used as the current transformation matrix. Exemplarily, the current transformation matrix is ​​a 4x4 transformation matrix.

[0091] In this way, the first group of main perception data packets are processed, and the current conversion matrix representing the conversion relationship between the three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1 and the vehicle position information of the auxiliary collection vehicle 2 is obtained.

[0092] The three-dimensional coordinate information of the auxiliary collection vehicle 2 in the vehicle coordinate system of the main collection vehicle 1 and the vehicle position information of the auxiliary collection vehicle 2 satisfy the following formula:

[0093]

[0094] Among them, ξ * is the general graph optimization error, ξ is the Lie algebra corresponding to the special Euclidean group of se3, B is the vehicle coordinate system of the auxiliary collection vehicle, A is the vehicle coordinate system of the main collection vehicle, is the 4x4 transformation matrix from A to B, For point p bi The three-dimensional coordinate information in the vehicle coordinate system of the main collection vehicle is the three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1. argmin is the value of the number that satisfies the minimum value of the formula. For point p bi The three-dimensional coordinate information in the vehicle coordinate system of the auxiliary collection vehicle is the vehicle position information of vehicle B, i is the counting point, b is vehicle B, is the i-th position of car B, is a skew-symmetric matrix, exp is the exponential mapping, and ||||2 is the two-norm.

[0095] Next, the main perception data packets of other groups except the first group of main perception data packets in the K groups are processed, and the next group of main perception data packets of the current group of main perception data packets is used as the current group of main perception data packets. When the main collection vehicle 1 collects the second group of main perception data packets, it is far away from the auxiliary collection vehicle 2. Therefore, there is an error between the second group of ego vehicle position information and the three-dimensional coordinate information of the auxiliary collection vehicle 2 in the main collection vehicle 1. Therefore, it is necessary to use the current transformation matrix calculated above to bring into the second group of ego vehicle position information to obtain the three-dimensional coordinate information of the auxiliary collection vehicle 2 in the main collection vehicle 1 at this time.

[0096] Specifically, the first three-dimensional coordinate information of the auxiliary collection vehicle 2 collected by the main collection vehicle 1 at the first frame timestamp in the current group of main perception data packets is calculated according to the next group of self-vehicle position information of the first group of self-vehicle position information and the current transformation matrix, and the step of calculating the second relative distance error between the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information is returned until the transformation matrix corresponding to the last group of main perception data packets in K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the startup vehicle coordinate system of the main collection vehicle 1 and the startup vehicle coordinate system of the auxiliary collection vehicle 2.

[0097] Therefore, the coordinate conversion matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle is calculated based on K groups of ego-vehicle position information, K groups of main perception data packets and the nearest neighbor algorithm.

[0098] S130: Calculate the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle based on the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and use the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than a preset distance threshold.

[0099] Since the main collection vehicle 1 is stationary when the auxiliary collection vehicle 2 is moving forward, the vehicle coordinate system of the main collection vehicle 1 is the starting vehicle coordinate system, so the coordinate conversion matrix can be considered as the transformation matrix of the starting vehicle coordinate system of the auxiliary collection vehicle 2 relative to the starting vehicle coordinate system of the main collection vehicle 1. Therefore, at this time, the three-dimensional coordinate information of the auxiliary collection vehicle 2 in the main collection vehicle 1 at the preset distance position is the coordinate information of the auxiliary collection vehicle 2 in the starting vehicle coordinate system of the main collection vehicle 1.

[0100] Therefore, after obtaining the coordinate conversion matrix, the projection coordinate information of the auxiliary collection vehicle 2 in the vehicle coordinate system of the main collection vehicle 1 can be calculated based on the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle 2 at the preset distance position point A, and the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle 2, wherein the distance between the preset distance position and the main collection vehicle 1 is greater than the preset distance threshold, illustratively, the preset distance threshold is 300m.

[0101] Since the distance between the preset distance position and the main collection vehicle 1 is greater than the preset distance threshold, it means that the preset distance position is far away from the main collection vehicle 1. Therefore, the obtained three-dimensional coordinate true value of the auxiliary collection vehicle 2 is the three-dimensional coordinate true value of the ultra-long distance.

[0102] Specifically, the projection coordinate information of the auxiliary collection vehicle 2 in the vehicle coordinate system of the main collection vehicle 1 is calculated based on the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle 2 at a preset distance, which may include:

[0103] The coordinate conversion matrix is ​​calculated and multiplied by the position information of the vehicle collected by the inertial sensor of the auxiliary collection vehicle 2 at the preset distance position to obtain the projection coordinate information of the auxiliary collection vehicle 2 in the vehicle coordinate system of the main collection vehicle 1.

[0104] As can be seen from the above content, the embodiment of the present invention can obtain K groups of ego vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, and each group of main perception data packets is composed of perception data with multiple frames of timestamps, and the perception data with each frame of timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle; the coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle is calculated based on the K groups of ego vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's on-board computer when it is powered on as the origin of the coordinate system; the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the coordinate conversion matrix and the ego vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at a preset distance position, and the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than the preset distance threshold. In the embodiment of the present invention, the main collection vehicle and the auxiliary collection vehicle cooperate with each other, and the coordinate conversion matrix between the main collection vehicle's startup vehicle coordinate system and the auxiliary collection vehicle's startup vehicle coordinate system is calculated according to K groups of ego vehicle position information and K groups of main perception data packets. Then, according to the coordinate conversion matrix, the ego vehicle position information of the auxiliary collection vehicle is projected into the vehicle coordinate system of the main collection vehicle to obtain the three-dimensional coordinate true value of the auxiliary collection vehicle. Since the distance between the preset distance position and the main collection vehicle 1 is greater than the preset distance threshold, the obtained three-dimensional coordinate true value of the auxiliary collection vehicle 2 is the three-dimensional coordinate true value of the ultra-long distance, thereby realizing the three-dimensional coordinate true value perception of the ultra-long distance vehicle of the main collection vehicle.

[0105] Furthermore, in the embodiment of the present invention, only through the cooperation between the main data collection vehicle and the auxiliary data collection vehicle, the accurate three-dimensional coordinate true value of the vehicle at an ultra-long distance can be obtained without adding additional sensors.

[0106] In one implementation, after step S130, the above-mentioned method for determining the true value of the three-dimensional coordinates of the vehicle may further include:

[0107] An adjustment made to the vehicle height in the three-dimensional coordinate true value of the auxiliary collection vehicle is received to obtain the adjusted three-dimensional coordinate true value of the auxiliary collection vehicle.

[0108] Since the road surface is not completely free of height, the obtained three-dimensional coordinate true value of the auxiliary collection vehicle 2 has a certain offset in the height direction, and the height needs to be adjusted manually. The electronic device receives the adjustment of the vehicle height in the three-dimensional coordinate true value of the auxiliary collection vehicle 2, and obtains the adjusted three-dimensional coordinate true value of the auxiliary collection vehicle 2.

[0109] Therefore, by receiving the adjustment of the vehicle height in the three-dimensional coordinate true value of the auxiliary data collection vehicle, the accuracy of the adjusted three-dimensional coordinate true value of the auxiliary data collection vehicle in the height direction is improved.

[0110] In another implementation, after step S130, the above-mentioned method for determining the true value of the three-dimensional coordinates of the vehicle may further include:

[0111] The three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-side sensor of the auxiliary collection vehicle at a preset distance position.

[0112] The above-mentioned use of the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle 2 only obtains the three-dimensional coordinate true value of the auxiliary collection vehicle 2 sensed at an ultra-long distance by the main collection vehicle 1, and the three-dimensional coordinate information of each sensing vehicle in the auxiliary sensing data packet collected by the auxiliary collection vehicle 2 at a preset distance position can be further converted to the vehicle coordinate system of the main collection vehicle 1. That is, the three-dimensional coordinate true value of each sensing vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the projection coordinate information and the three-dimensional coordinate information of each sensing vehicle in the auxiliary sensing data packet collected by the vehicle-side sensor of the auxiliary collection vehicle at a preset distance position.

[0113] Specifically, the three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-side sensor of the auxiliary collection vehicle at a preset distance position, which may include:

[0114] The three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-side sensor of the auxiliary collection vehicle at a preset distance position is calculated and multiplied by the projection coordinate information to obtain the three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle.

[0115] Therefore, by means of coordinate conversion, the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the auxiliary collection vehicle 2 at a preset distance position is converted into the vehicle coordinate system of the main collection vehicle 1, and the three-dimensional coordinate true value of the three-dimensional coordinate information of each perception vehicle perceived by the auxiliary collection vehicle 2 at an ultra-long distance in the vehicle coordinate system of the main collection vehicle 1 is obtained.

[0116] In another implementation, after calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at a preset distance, the above-mentioned vehicle three-dimensional coordinate true value determination method may further include:

[0117] Receive the two-dimensional annotation box of the auxiliary collection vehicle manually annotated in the target main perception data packet, perform two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional boundary box corresponding to the projection coordinate information, and when the match is successful, execute the step of using the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the target main perception data packet is the main perception data packet collected by the vehicle-side sensor of the main collection vehicle when the auxiliary collection vehicle continues to travel to a preset distance position and stops.

[0118] Since the obtained projection coordinate information may not be accurate, it is necessary to determine whether the projection coordinate information is accurate. Specifically, the two-dimensional annotation box of the auxiliary collection vehicle 2 manually annotated in the target main perception data packet is received, and the two-dimensional annotation box is matched with the three-dimensional boundary box corresponding to the projection coordinate information. When the match is successful, it means that the obtained projection coordinate information is accurate. At this time, the step of using the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle is executed, wherein the target main perception data packet is the main perception data packet collected by the vehicle-side sensor of the main collection vehicle 1 when the auxiliary collection vehicle 2 continues to travel to the preset distance position A and stops.

[0119] Specifically, performing 2D-3D matching between the 2D annotation box and the 3D bounding box corresponding to the projection coordinate information may include:

[0120] Projecting the three-dimensional bounding box corresponding to the projection coordinate information onto the image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box;

[0121] A first area of ​​the intersection between the two-dimensional annotation box and the two-dimensional projection boundary box and a second area of ​​the union are calculated, and a quotient of the first area and the second area is calculated. When the quotient is greater than a preset value, it is determined that the match is successful.

[0122] The method of performing two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional bounding box corresponding to the projection coordinate information is to first reduce the three-dimensional to two-dimensional, and then match it with the two-dimensional annotation box, that is, to project the three-dimensional bounding box corresponding to the projection coordinate information to the image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box, calculate the first area of ​​the intersection between the two-dimensional annotation box and the two-dimensional projection bounding box and the second area of ​​the union, calculate the quotient of the first area and the second area, and when the quotient is greater than the preset value, it means that the two are relatively similar, and it is determined that the match is successful.

[0123] Therefore, whether the two-dimensional annotation box matches the three-dimensional bounding box corresponding to the projection coordinate information is determined by a two-dimensional-three-dimensional matching method.

[0124] Figure 3 A schematic diagram of a structure of a device for determining the true value of a vehicle three-dimensional coordinate provided by an embodiment of the present invention, see Figure 3In the initial state, the main collection vehicle and the auxiliary collection vehicle are both located at the initial point and the vehicle-side sensors of the two vehicles are facing the front of the vehicle. When the auxiliary collection vehicle moves forward, the main collection vehicle is stationary. The vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset time length when the auxiliary collection vehicle stops at a preset distance interval. When the number of stops reaches K times, the auxiliary collection vehicle continues to travel to a preset distance position and stops. At this time, the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of the preset time length. The device may include:

[0125] The acquisition module 310 is used to obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, each group of main perception data packets is composed of perception data of multiple frames of timestamps, and each frame of perception data of timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle;

[0126] A coordinate conversion matrix determination module 320 is used to calculate the coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle according to the K groups of ego vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's onboard computer when it is started as the origin of the coordinate system;

[0127] The first coordinate true value determination module 330 is used to calculate the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and use the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than a preset distance threshold.

[0128] The device provided by the embodiment of the present invention can obtain K groups of ego vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, and each group of main perception data packets is composed of perception data with multiple frames of timestamps, and the perception data with each frame of timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle; the coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle is calculated based on the K groups of ego vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's on-board computer when it is powered on as the origin of the coordinate system; the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the coordinate conversion matrix and the ego vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at a preset distance position, and the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than the preset distance threshold. In the embodiment of the present invention, the main collection vehicle and the auxiliary collection vehicle cooperate with each other, and the coordinate conversion matrix between the main collection vehicle's start-up vehicle coordinate system and the auxiliary collection vehicle's start-up vehicle coordinate system is calculated according to K groups of ego vehicle position information and K groups of main perception data packets. Then, according to the coordinate conversion matrix, the ego vehicle position information of the auxiliary collection vehicle is projected into the vehicle coordinate system of the main collection vehicle to obtain the three-dimensional coordinate true value of the auxiliary collection vehicle. Since the distance between the preset distance position and the main collection vehicle is greater than the preset distance threshold, the obtained three-dimensional coordinate true value of the auxiliary collection vehicle is the three-dimensional coordinate true value of the ultra-long distance, thereby realizing the three-dimensional coordinate true value perception of the ultra-long distance vehicle of the main collection vehicle.

[0129] In one implementation, the coordinate transformation matrix determination module 320 may include:

[0130] A first calculation submodule is used to use the first group of main perception data packets in the K groups of main perception data packets as the current group of main perception data packets, traverse the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets according to the nearest neighbor algorithm and calculate the first self-vehicle position information in the first group of self-vehicle position information to obtain a first relative distance error, determine the three-dimensional coordinate information of the perception vehicle corresponding to the minimum first relative distance error as the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets, and determine the first self-vehicle position information as the self-vehicle position information of the auxiliary collection vehicle corresponding to the first frame timestamp in the current group of main perception data packets;

[0131] A second calculation submodule is used to calculate, for each frame timestamp in the current group of main perception data packets except the first frame timestamp, the three-dimensional coordinate information of the perception vehicle corresponding to the frame timestamp and the first three-dimensional coordinate information to obtain a second relative distance error, determine the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than a preset distance error threshold as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp, traverse the first group of ego vehicle position information and the second three-dimensional coordinate information according to the nearest neighbor algorithm to calculate a third relative distance error, and determine the ego vehicle position information corresponding to the smallest third relative distance error as the ego vehicle position information of the auxiliary collection vehicle corresponding to the frame timestamp;

[0132] The current conversion matrix determination submodule is used to calculate the conversion matrix corresponding to the current group of main perception data packets according to the three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at each frame timestamp, the vehicle position information of the auxiliary collection vehicle corresponding to each frame timestamp and a preset general graph optimization formula, and use the conversion matrix as the current conversion matrix;

[0133] The third calculation submodule is used to use the next group of main perception data packets of the current group of main perception data packets as the current group of main perception data packets, calculate the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets according to the next group of ego vehicle position information of the first group of ego vehicle position information and the current transformation matrix, return to execute the step of calculating the second relative distance error between the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information, until the transformation matrix corresponding to the last group of main perception data packets in the K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle.

[0134] Optionally, the first coordinate true value determining module 330 may be specifically used for:

[0135] The coordinate conversion matrix is ​​calculated and multiplied on the left by the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position to obtain the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle.

[0136] Optionally, the above-mentioned vehicle three-dimensional coordinate true value determination device further includes:

[0137] A receiving module is used to receive a two-dimensional annotation box of the auxiliary collection vehicle manually annotated in a target main perception data packet, after calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the self-vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and perform two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional boundary box corresponding to the projection coordinate information. When the match is successful, trigger the use of the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the target main perception data packet is a main perception data packet collected by the vehicle-side sensor of the main collection vehicle when the auxiliary collection vehicle continues to travel to the preset distance position and stops.

[0138] Optionally, the receiving module may include:

[0139] A projection submodule, configured to project a three-dimensional bounding box corresponding to the projection coordinate information onto an image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box;

[0140] The matching submodule is used to calculate the first area of ​​the intersection and the second area of ​​the union between the two-dimensional annotation box and the two-dimensional projection boundary box, calculate the quotient of the first area and the second area, and determine that the match is successful when the quotient is greater than a preset value.

[0141] Optionally, the above-mentioned vehicle three-dimensional coordinate true value determination device may also include:

[0142] The adjustment module is used to receive the adjustment of the vehicle height in the three-dimensional coordinate true value of the auxiliary collection vehicle after the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, so as to obtain the adjusted three-dimensional coordinate true value of the auxiliary collection vehicle.

[0143] Optionally, the above-mentioned vehicle three-dimensional coordinate true value determination device may also include:

[0144] The second coordinate true value determination module is used to calculate the three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle according to the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-end sensor of the auxiliary collection vehicle at the preset distance position after the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle.

[0145] The above device embodiment corresponds to the method embodiment and has the same technical effect as the method embodiment. For specific description, please refer to the method embodiment. The device embodiment is obtained based on the method embodiment. For specific description, please refer to the method embodiment part, which will not be repeated here.

[0146] Figure 4A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention is shown in FIG. Figure 4 As shown, the electronic device includes:

[0147] one or more processors 410;

[0148] The processor 410 is coupled to a storage device 420, and the storage device 420 is used to store one or more programs;

[0149] When the one or more programs are executed by the one or more processors 410, the electronic device implements the method for determining the true value of the three-dimensional coordinates of a vehicle as provided in any embodiment of the present invention.

[0150] Based on the above embodiments, another embodiment of the present invention provides a vehicle, which includes a device for determining a true value of a vehicle three-dimensional coordinate as provided in any embodiment of the present invention, or includes an electronic device as provided in any embodiment of the present invention.

[0151] Figure 5 A schematic diagram of a vehicle provided by an embodiment of the present invention. Figure 5 As shown, the vehicle includes a speed sensor 51, an ECU (Electronic Control Unit) 52, a GPS (Global Positioning System) positioning device 53, and a T-Box (Telematics Box) 54. The speed sensor 51 is used to measure the vehicle speed and use the vehicle speed as an empirical speed for model training; the GPS positioning device 53 is used to obtain the current geographical location of the vehicle; the T-Box 54 can communicate with the server as a gateway; and the ECU 52 can execute the above-mentioned vehicle three-dimensional coordinate true value determination method.

[0152] In addition, the vehicle may also include: a V2X (Vehicle-to-Everything) module 55, a radar 56 and a camera 57. The V2X module 55 is used to communicate with other vehicles, roadside equipment, etc.; the radar 56 or the camera 57 is used to sense the road environment information in the front and / or other directions to obtain original point cloud data; the radar 56 and / or the camera 57 can be configured at the front and / or rear of the vehicle body.

[0153] Based on the above method embodiments, another embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for determining the true value of a vehicle's three-dimensional coordinates as provided in any embodiment of the present invention.

[0154] Those skilled in the art can understand that the accompanying drawings are only schematic diagrams of an embodiment, and the modules or processes in the accompanying drawings are not necessarily required to implement the present invention.

[0155] Those skilled in the art can understand that the modules in the device in the embodiment can be distributed in the device in the embodiment according to the description of the embodiment, or can be changed accordingly and located in one or more devices different from the embodiment. The modules in the above embodiment can be combined into one module, or can be further divided into multiple sub-modules.

[0156] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for determining the true value of a vehicle's three-dimensional coordinates, characterized in that: In the initial state, the main collection vehicle and the auxiliary collection vehicle are both located at the initial point and the vehicle-side sensors of the two vehicles are facing the front of the vehicle. When the auxiliary collection vehicle moves forward, the main collection vehicle is stationary. The vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset time length when the auxiliary collection vehicle stops at a preset distance interval. When the number of stops reaches K times, the auxiliary collection vehicle continues to travel to a preset distance position and stops. At this time, the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of the preset time length. The method includes: Obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, each group of main perception data packets is composed of perception data with multiple frames of timestamps, and each frame of perception data with timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle; A coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle is calculated based on the K groups of vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's onboard computer when it is started as the origin of the coordinate system; The projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than a preset distance threshold.

2. The method according to claim 1, characterized in that The step of calculating the coordinate conversion matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle according to the K groups of ego-vehicle position information and the K groups of main perception data packets comprises: The first group of main perception data packets in the K groups of main perception data packets is used as the current group of main perception data packets, and the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets is traversed according to the nearest neighbor algorithm to calculate the first relative distance error with the first self-vehicle position information in the first group of self-vehicle position information, and the three-dimensional coordinate information of the perception vehicle corresponding to the smallest first relative distance error is determined as the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets, and the first self-vehicle position information is determined as the self-vehicle position information of the auxiliary collection vehicle corresponding to the first frame timestamp in the current group of main perception data packets; For each frame timestamp in the current group of main perception data packets except the first frame timestamp, the three-dimensional coordinate information of the perception vehicle corresponding to the frame timestamp is calculated with the first three-dimensional coordinate information to obtain a second relative distance error, the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than a preset distance error threshold is determined as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp, the first group of ego vehicle position information and the second three-dimensional coordinate information are traversed according to the nearest neighbor algorithm to calculate a third relative distance error, and the ego vehicle position information corresponding to the smallest third relative distance error is determined as the ego vehicle position information of the auxiliary collection vehicle corresponding to the frame timestamp; The conversion matrix corresponding to the current group of main perception data packets is calculated according to the three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at each frame timestamp, the position information of the auxiliary collection vehicle corresponding to each frame timestamp, and a preset general graph optimization formula, and the conversion matrix is ​​used as the current conversion matrix; The next group of main perception data packets of the current group of main perception data packets is used as the current group of main perception data packets, and the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets is calculated according to the next group of ego-vehicle position information of the first group of ego-vehicle position information and the current transformation matrix, and the step of calculating the second relative distance error by performing the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information is returned to be executed, until the transformation matrix corresponding to the last group of main perception data packets in the K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle.

3. The method according to claim 1 or 2, characterized in that The step of calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position comprises: The coordinate conversion matrix is ​​calculated and multiplied on the left by the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position to obtain the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle.

4. The method according to claim 1, characterized in that After the step of calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, the method further includes: Receive the two-dimensional annotation box of the auxiliary collection vehicle manually annotated in the target main perception data packet, perform two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional boundary box corresponding to the projection coordinate information, and when the match is successful, execute the step of using the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the target main perception data packet is the main perception data packet collected by the vehicle-side sensor of the main collection vehicle when the auxiliary collection vehicle continues to travel to a preset distance position and stops.

5. The method according to claim 4, characterized in that The step of performing two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional bounding box corresponding to the projection coordinate information comprises: Projecting the three-dimensional bounding box corresponding to the projection coordinate information onto the image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box; A first area of ​​the intersection and a second area of ​​the union between the two-dimensional annotation box and the two-dimensional projection boundary box are calculated, and a quotient of the first area and the second area is calculated. When the quotient is greater than a preset value, it is determined that the match is successful.

6. The method according to claim 1, characterized in that After the step of using the projection coordinate information as the true value of the three-dimensional coordinates of the auxiliary data collection vehicle, the method further includes: An adjustment made to the vehicle height in the three-dimensional coordinate true value of the auxiliary data collection vehicle is received to obtain the adjusted three-dimensional coordinate true value of the auxiliary data collection vehicle.

7. The method according to claim 1, characterized in that After the step of using the projection coordinate information as the true value of the three-dimensional coordinates of the auxiliary data collection vehicle, the method further includes: The three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle is calculated based on the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-side sensor of the auxiliary collection vehicle at the preset distance position.

8. A device for determining the true value of a vehicle's three-dimensional coordinates, characterized in that: In the initial state, the main collection vehicle and the auxiliary collection vehicle are both located at the initial point and the vehicle-side sensors of the two vehicles are facing the front of the vehicle. When the auxiliary collection vehicle moves forward, the main collection vehicle is stationary. The vehicle-side sensors of the two vehicles simultaneously collect perception data packets of a preset time length when the auxiliary collection vehicle stops at a preset distance interval. When the number of stops reaches K times, the auxiliary collection vehicle continues to travel to a preset distance position and stops. At this time, the vehicle-side sensors of the two vehicles simultaneously collect perception data packets of the preset time length. The device includes: An acquisition module, used to obtain K groups of vehicle position information collected by the inertial sensor of the auxiliary collection vehicle during K stops and K groups of main perception data packets collected by the main collection vehicle, wherein K is greater than a preset number of times, each group of main perception data packets is composed of perception data of multiple frames of timestamps, and each frame of perception data of timestamps includes three-dimensional coordinate information of the perception vehicle, and the perception vehicle at least includes the auxiliary collection vehicle; A coordinate conversion matrix determination module is used to calculate the coordinate conversion matrix between the startup vehicle coordinate system of the main collection vehicle and the startup vehicle coordinate system of the auxiliary collection vehicle according to the K groups of ego vehicle position information and the K groups of main perception data packets, wherein the startup vehicle coordinate system refers to a vehicle coordinate system with the position of the vehicle's onboard computer when it is started as the origin of the coordinate system; The first coordinate true value determination module is used to calculate the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and use the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the distance between the preset distance position and the main collection vehicle is greater than a preset distance threshold.

9. The device according to claim 8, characterized in that The coordinate transformation matrix determination module comprises: A first calculation submodule is used to use the first group of main perception data packets in the K groups of main perception data packets as the current group of main perception data packets, traverse the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp in the current group of main perception data packets according to the nearest neighbor algorithm and calculate the first self-vehicle position information in the first group of self-vehicle position information to obtain a first relative distance error, determine the three-dimensional coordinate information of the perception vehicle corresponding to the minimum first relative distance error as the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets, and determine the first self-vehicle position information as the self-vehicle position information of the auxiliary collection vehicle corresponding to the first frame timestamp in the current group of main perception data packets; A second calculation submodule is used to calculate, for each frame timestamp in the current group of main perception data packets except the first frame timestamp, the three-dimensional coordinate information of the perception vehicle corresponding to the frame timestamp and the first three-dimensional coordinate information to obtain a second relative distance error, determine the three-dimensional coordinate information of the perception vehicle corresponding to the second relative distance error less than a preset distance error threshold as the second three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the frame timestamp, traverse the first group of ego vehicle position information and the second three-dimensional coordinate information according to the nearest neighbor algorithm to calculate a third relative distance error, and determine the ego vehicle position information corresponding to the smallest third relative distance error as the ego vehicle position information of the auxiliary collection vehicle corresponding to the frame timestamp; The current conversion matrix determination submodule is used to calculate the conversion matrix corresponding to the current group of main perception data packets according to the three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at each frame timestamp, the vehicle position information of the auxiliary collection vehicle corresponding to each frame timestamp and a preset general graph optimization formula, and use the conversion matrix as the current conversion matrix; The third calculation submodule is used to use the next group of main perception data packets of the current group of main perception data packets as the current group of main perception data packets, calculate the first three-dimensional coordinate information of the auxiliary collection vehicle collected by the main collection vehicle at the first frame timestamp in the current group of main perception data packets according to the next group of ego vehicle position information of the first group of ego vehicle position information and the current transformation matrix, return to execute the step of calculating the second relative distance error between the three-dimensional coordinate information of the perception vehicle corresponding to each frame timestamp except the first frame timestamp in the current group of main perception data packets and the first three-dimensional coordinate information, until the transformation matrix corresponding to the last group of main perception data packets in the K groups of main perception data packets is obtained, and the transformation matrix corresponding to the last group of main perception data packets is used as the coordinate transformation matrix between the start-up vehicle coordinate system of the main collection vehicle and the start-up vehicle coordinate system of the auxiliary collection vehicle.

10. The device according to claim 8 or 9, characterized in that The first coordinate true value determination module is specifically used for: The coordinate conversion matrix is ​​calculated and multiplied on the left by the vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position to obtain the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle.

11. The device according to claim 8, characterized in that The device also includes: A receiving module is used to receive a two-dimensional annotation box of the auxiliary collection vehicle manually annotated in a target main perception data packet, after calculating the projection coordinate information of the auxiliary collection vehicle in the vehicle coordinate system of the main collection vehicle according to the coordinate conversion matrix and the self-vehicle position information collected by the inertial sensor of the auxiliary collection vehicle at the preset distance position, and perform two-dimensional-three-dimensional matching between the two-dimensional annotation box and the three-dimensional boundary box corresponding to the projection coordinate information. When the match is successful, trigger the use of the projection coordinate information as the three-dimensional coordinate true value of the auxiliary collection vehicle, wherein the target main perception data packet is a main perception data packet collected by the vehicle-side sensor of the main collection vehicle when the auxiliary collection vehicle continues to travel to the preset distance position and stops.

12. The device according to claim 11, characterized in that The receiving module comprises: A projection submodule, configured to project a three-dimensional bounding box corresponding to the projection coordinate information onto an image plane where the two-dimensional annotation box is located to obtain a two-dimensional projection bounding box; The matching submodule is used to calculate the first area of ​​the intersection and the second area of ​​the union between the two-dimensional annotation box and the two-dimensional projection boundary box, calculate the quotient of the first area and the second area, and determine that the match is successful when the quotient is greater than a preset value.

13. The device according to claim 8, characterized in that The device also includes: The adjustment module is used to receive the adjustment of the vehicle height in the three-dimensional coordinate true value of the auxiliary collection vehicle after the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle, so as to obtain the adjusted three-dimensional coordinate true value of the auxiliary collection vehicle.

14. The device according to claim 1, characterized in that The device also includes: The second coordinate true value determination module is used to calculate the three-dimensional coordinate true value of each perception vehicle in the vehicle coordinate system of the main collection vehicle according to the projection coordinate information and the three-dimensional coordinate information of each perception vehicle in the auxiliary perception data packet collected by the vehicle-end sensor of the auxiliary collection vehicle at the preset distance position after the projection coordinate information is used as the three-dimensional coordinate true value of the auxiliary collection vehicle.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

16. An electronic device, characterized in that: The electronic device comprises: one or more processors; The processor is coupled to a storage device, and the storage device is used to store one or more programs; When the one or more programs are executed by the one or more processors, the electronic device implements the method as described in any one of claims 1 to 7.

17. A vehicle, characterized in that: The vehicle comprises the apparatus according to any one of claims 8 to 14, or comprises the electronic device according to claim 16.