High-precision map generation method and device, electronic equipment and storage medium
By optimizing the external parameters of the lidar and inertial measurement unit and combining the correlation between surface features, high-precision maps are generated, which solves the problem of high dependence on the global satellite navigation system in existing technologies, improves the success rate and accuracy of map generation, and reduces costs.
Patent Information
- Application Number
- CN202211341533.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-28
- Publication Date
- 2025-10-24
- Estimated Expiration
- 2042-10-28
AI Technical Summary
Existing technologies rely heavily on global satellite navigation systems when generating high-precision maps, resulting in errors that affect accuracy and success rate. Furthermore, the instability of external parameters and differences between vehicle models lead to increased errors during the generation process, making it difficult to guarantee map accuracy and success rate.
By utilizing the point cloud data and motion trajectory information of lidar and inertial measurement units, external parameters are optimized and dependence on the global satellite navigation system is reduced. By combining inertial measurement data and the correlation between surface features, external parameters and motion trajectory information are adjusted to generate high-precision maps.
显著提高了高精地图的生成成功率和精度,降低了对全球卫星导航系统的误差影响,提高了地图生成的效率和降低了成本。
Smart Images

Figure CN115658833B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of artificial intelligence, and in particular, to the technical field of high-definition map, autonomous driving and intelligent transportation. More specifically, the present disclosure provides a map generation method, device, electronic device and storage medium. BACKGROUND
[0002] The high-definition map, also known as high-precision map, can be a map used by an autonomous vehicle. The high-definition map has accurate vehicle position information and rich road element data information, which can help the vehicle to predict complex road information such as slope, curvature, heading, etc., and better avoid potential risks. With the development of artificial intelligence technology and high-definition map technology, the application scenarios of autonomous driving technology and assisted driving technology are increasing. In the autonomous driving mode or assisted driving mode, the position of the vehicle or other obstacles can be determined by using the high-definition map, so as to control the vehicle to travel. SUMMARY
[0003] The present disclosure provides a map generation method, device, equipment and storage medium.
[0004] According to an aspect of the present disclosure, a map generation method is provided, which includes: generating an initial map according to initial point cloud data and initial motion trajectory information; determining association relationship information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map; determining distance information between the face features corresponding to the initial points and the initial points according to initial external parameters, the initial motion trajectory information and the association relationship information; adjusting the initial external parameters and the initial motion trajectory information according to a plurality of distance information to obtain target motion trajectory information and target external parameters; and generating a target map according to the target motion trajectory information and the target external parameters.
[0005] According to another aspect of the present disclosure, a map generation device is provided, which includes: a first generation module configured to generate an initial map according to initial point cloud data and initial motion trajectory information; a first determination module configured to determine association relationship information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map; a second determination module configured to determine distance information between the face features corresponding to the initial points and the initial points according to initial external parameters, the initial motion trajectory information and the association relationship information; an adjustment module configured to adjust the initial external parameters and the initial motion trajectory information according to a plurality of distance information to obtain target motion trajectory information and target external parameters; and a second generation module configured to generate a target map according to the target motion trajectory information and the target external parameters.
[0006] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method provided by the present disclosure.
[0007] According to another aspect of the present disclosure, a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method provided by the present disclosure is provided.
[0008] According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the method provided by the present disclosure.
[0009] It should be understood that the content described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS
[0010] The accompanying drawings are used to better understand the present scheme, and do not limit the present disclosure. Among them:
[0011] Figure 1 is an exemplary system architecture schematic diagram of an example system to which the map generation method and device according to one embodiment of the present disclosure can be applied;
[0012] Figure 2 is a flowchart of a map generation method according to one embodiment of the present disclosure;
[0013] Figure 3 is a flowchart of a map generation method according to another embodiment of the present disclosure;
[0014] Figure 4 is an exemplary schematic diagram of a target map according to one embodiment of the present disclosure;
[0015] Figure 5 is a block diagram of a map generation device according to one embodiment of the present disclosure; and
[0016] Figure 6 is a block diagram of an electronic device to which the map generation method according to one embodiment of the present disclosure can be applied. DETAILED DESCRIPTION
[0017] Exemplary embodiments of the present disclosure are described herein with reference to the accompanying drawings, which are cited as illustrative examples. Various details of the embodiments of the present disclosure are described herein in order to provide a thorough understanding of the present disclosure. It will be understood by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Also, the descriptions of known functions and constructions are omitted herein for clarity and conciseness.
[0018] A laser radar (LiDAR) can collect data of a target area and send the data to a server after pre-processing. For example, the laser radar emits a laser scanning beam, and when the laser scanning beam encounters an object and is reflected back, it is received by the laser radar, completing one emission and reception of the laser scanning beam. In this way, a large amount of point cloud data can be continuously collected.
[0019] An inertial measurement unit (IMU) can determine a trajectory of a target object. The target object can be, for example, a vehicle or other device that is equipped with a laser radar and an inertial measurement unit.
[0020] Extrinsics parameters between the laser radar and the inertial measurement unit can include a space-time parameter relationship between the two. The space parameter can be a conversion relationship between a point cloud coordinate system related to the laser radar and an inertial coordinate system related to the inertial measurement unit. The time parameter can be a synchronization error of sensor measurement time. This error is caused by signal processing delay and communication delay between the laser radar and the inertial measurement unit. For example, at the same time, the timestamp of the point cloud data output by the laser radar and the timestamp of the inertial measurement data output by the inertial measurement unit are inconsistent.
[0021] In some embodiments, trajectory information related to the inertial measurement unit can be determined according to inertial measurement data and global navigation satellite data determined by a global navigation satellite system (GNSS). In combination with the extrinsics parameters described above, the trajectory information can be used to determine motion trajectory information related to the laser radar. According to the motion trajectory information, motion compensation can be performed on the point cloud data. According to the compensated point cloud data and initial trajectory information related to the laser radar, corrected trajectory information can be obtained. According to the corrected trajectory information, a plurality of point cloud data can be spliced to obtain a point cloud map. According to the point cloud map, a high-definition map can be generated.
[0022] The precision of the external parameters and the initial trajectory information related to the lidar have a direct impact on the precision and mapping success rate of the high-definition map. For example, in the process of generating a high-definition map of a certain area, if the rotation error of the external parameters exceeds 0.8 degrees, a large range of ghosting problems can be caused, resulting in mapping failure.
[0023] The data collection environment and working conditions are difficult to accurately control, resulting in certain instability of the external parameters. For example, after the data collection vehicle is towed to the repair shop by the tow truck due to a breakdown, the external parameters thereof can change. However, the changed external parameters are often not updated in time, resulting in an increase in the error of the external parameters used when generating the map.
[0024] The models of the data collection vehicles are different, and the sources of the external parameters in different data collection processes are not easy to control. For example, the data collection vehicle can be a level 4 (L4) autonomous driving collection vehicle. The maintenance methods of the external parameters of different models of vehicles are different, and the precisions are also different.
[0025] The global navigation satellite data and the point cloud data of the lidar can be used to optimize the external parameters to obtain optimized external parameters. However, this optimization method has a strong dependence on the precision of the global satellite navigation system, and the error of the global satellite navigation system will affect the optimization result.
[0026] The point cloud data and the inertial measurement data can also be used to optimize the external parameters. However, the precision of this optimization method is limited.
[0027] Figure 1 is an exemplary system architecture schematic diagram to which the map generation method and device according to an embodiment of the present disclosure can be applied. It should be noted that, Figure 1 The diagram shown is only an example of a system architecture to which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure cannot be applied to other devices, systems, environments or scenarios.
[0028] As Figure 1 shown, the system architecture 100 according to the embodiment can include sensors 101, 102, 103, a network 120, a server 130 and a road side unit (RSU) 140. The network 120 is used to provide a communication link medium between the sensors 101, 102, 103 and the server 130. The network 120 can include various connection types, such as wired and / or wireless communication links, etc.
[0029] The sensors 101, 102, 103 can interact with the server 130 through the network 120 to receive or send messages, etc.
[0030] The sensors 101, 102, 103 can be functional elements integrated on the vehicle 110, such as infrared sensors, ultrasonic sensors, millimeter wave radars, information collection devices, laser radars, inertial measurement units, etc. The sensors 101, 102, 103 can be used to collect state data of perceived objects (such as pedestrians, vehicles, obstacles, etc.) around the vehicle 110 and surrounding road data.
[0031] The vehicle 110 can communicate with the road side unit 140, receive information from the road side unit 140, or send information to the road side unit.
[0032] The road side unit 140 can be deployed on a signal light, for example, to adjust the duration or frequency of the signal light.
[0033] The server 130 can be disposed at a remote end capable of establishing communication with the vehicle terminal, can be implemented as a distributed server cluster composed of multiple servers, or can be implemented as a single server.
[0034] The server 130 can be a server providing various services. For example, a map application, a data processing application, etc. can be installed on the server 130. Taking the case where the server 130 runs the data processing application as an example: the state data of the obstacle and the map data transmitted by the sensors 101, 102, 103 are received through the network 120. One or more of the state data of the obstacle and the map data can be used as to-be-processed data. The to-be-processed data is processed to obtain target data.
[0035] It should be noted that the map generation method provided by the embodiments of the present disclosure can generally be executed by the server 130. Correspondingly, the map generation apparatus provided by the embodiments of the present disclosure can also be disposed in the server 130. However, it is not limited thereto. The map generation method provided by the embodiments of the present disclosure can also generally be executed by the sensors 101, 102, or 103. Correspondingly, the map generation apparatus provided by the embodiments of the present disclosure can also be disposed in the sensors 101, 102, or 103.
[0036] It can be understood that the number of sensors, networks, and servers in the above embodiments is only illustrative. According to the needs of implementation, there can be any number of sensors, networks, and servers. Figure 1 It should be noted that the number of sensors, networks, and servers in the above embodiments is only illustrative. According to the needs of implementation, there can be any number of sensors, networks, and servers.
[0037] It should be noted that the sequence numbers of the various operations in the following method are only used to represent the operations and are not intended to represent the execution sequence of the various operations. Unless specifically indicated, the method does not need to be executed in the order shown.
[0038] Figure 2 is a flowchart of a map generation method according to one embodiment of the present disclosure.
[0039] As Figure 2 shown, the method 200 can include operation S210 to operation S250.
[0040] In operation S210, an initial map is generated according to initial point cloud data and initial motion trajectory information.
[0041] In embodiments of the present disclosure, the initial motion trajectory information can be motion trajectory information of an inertial measurement unit. For example, the initial motion trajectory information can be used to adjust the point cloud data to obtain adjusted point cloud data. According to the adjusted point cloud data, a point cloud map can be generated as the initial map.
[0042] In operation S220, association relationship information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map is determined.
[0043] In embodiments of the present disclosure, the target plane can be at least one. For example, a plurality of target planes can be perpendicular to each other. In one example, the target plane can be three. The three target planes can also be referred to as orthogonal faces.
[0044] In embodiments of the present disclosure, various ways can be used to extract the face features of the target plane. For example, the face features of the target plane can be extracted based on a laser radar odometry and mapping in real time (LOAM) algorithm.
[0045] In operation S230, distance information between the face features corresponding to the initial points and the initial points is determined according to the initial external parameters, the initial motion trajectory information and the association relationship information.
[0046] In embodiments of the present disclosure, according to the initial external parameters, coordinate system conversion can be performed so that the initial motion trajectory information and the association relationship information are in the same coordinate system. For example, the association relationship information can be in an initial map coordinate system of the initial map. The initial motion trajectory information can be from an inertial coordinate system. According to the initial external parameters, the initial motion trajectory information can be converted to the initial map coordinate system, so as to determine the distance information between the initial points and the face features in the same coordinate system.
[0047] In operation S240, the initial external parameters and the initial motion trajectory information are adjusted according to a plurality of distance information to obtain target motion trajectory information and target external parameters.
[0048] In the embodiments of the present disclosure, according to the distance information, the external parameters and the initial motion trajectory information can be adjusted in various ways. For example, the goal of the adjustment can be to reduce the distance indicated by the distance information. For another example, the adjusted initial trajectory information and the initial external parameters can be taken as the target motion trajectory information and the target external parameters respectively.
[0049] In operation S250, a target map is generated according to the target motion trajectory information and the target external parameters.
[0050] For example, the point cloud data can be adjusted by using the target motion trajectory information. According to the point cloud data adjusted by the target motion trajectory information, a point cloud map can be generated as the target map.
[0051] By the embodiments of the present disclosure, when the external parameters are optimized according to the point cloud data and the inertial data, the dependence on the global satellite navigation system is reduced or even eliminated. Thus, the influence of the error of the global satellite navigation system on the precision of the high-precision map is reduced, and the success rate and the precision of generating the high-precision map are significantly improved.
[0052] In addition, by the embodiments of the present disclosure, the initial motion trajectory information and the initial external parameters are adjusted according to the distance information, which can also reduce the precision requirements for the initial motion trajectory information or the initial external parameters, and help to improve the efficiency of map generation and reduce the cost required for map generation.
[0053] Some embodiments of generating the initial map will be described in detail below in combination with related embodiments.
[0054] In some embodiments, in some embodiments of operation S210 described above, generating the initial map according to the initial point cloud data and the initial motion trajectory information can include: determining point cloud compensation information according to the initial motion trajectory information and the initial external parameters. Adjusting the initial point cloud data by using the point cloud compensation information to obtain adjusted point cloud data. Performing point cloud stitching on the plurality of adjusted point cloud data to obtain initial map data. Generating the initial map according to the initial map data.
[0055] For example, according to the initial external parameters and the initial motion trajectory information of the inertial measurement unit, the motion trajectory information related to the lidar can be determined. Based on the motion trajectory information, the point cloud compensation information can be determined. The initial point cloud data is compensated by using the point cloud compensation information to adjust the plurality of point cloud data, and the adjusted point cloud data is obtained. The initial point cloud data can be multiple. Thus, the adjusted point cloud data can also be multiple. The adjusted point cloud data is subjected to point cloud stitching to obtain stitched point cloud data as the initial map data. According to the initial map data, the initial map can be generated.
[0056] It can be understood that some embodiments of generating the initial map are described in detail above, and some embodiments of determining the association relationship will be described in detail below in combination with relevant embodiments.
[0057] In some embodiments, in some embodiments of operation S220 described above, determining the association relationship information between the plurality of initial points in the initial point cloud data and the plurality of face features of the target plane in the initial map includes: determining at least one target plane in the initial map. Extracting a plurality of face features of the target plane. Determine the association sub-relationship information between the initial point and the face feature, wherein the association sub-relationship is used to indicate the face feature corresponding to the initial point. According to the plurality of association sub-relationship information, the association relationship information is determined.
[0058] For example, the target plane can be 3. The 3 target planes can be perpendicular to each other. The 3 target planes can also be referred to as 3 orthogonal faces. Based on the laser radar odometry and the real-time mapping algorithm, the face features in the target plane can be extracted (for example, more than or equal to 80 face features are extracted from each target plane). The association sub-relationship information between the initial point and the face feature can be determined, so that the initial point corresponds to one face feature. It can be understood that one face feature can correspond to a plurality of initial points. The association sub-relationship information of the plurality of initial points is used as the association relationship information.
[0059] It can be understood that some ways of determining the association relationship information are described in detail above, and some embodiments of determining the distance information between the face feature corresponding to the initial point and the initial point will be described in detail below in combination with relevant embodiments.
[0060] In some embodiments, in some embodiments of operation S230 described above, determining the distance information between the face feature corresponding to the initial point and the initial point according to the initial external parameter, the initial motion trajectory information and the association relationship information can include: determining the initial rotation estimation information and the initial displacement estimation information according to the initial motion trajectory information. According to the initial external parameter, the point cloud coordinate data of the initial point, the initial rotation estimation information and the initial displacement estimation information, the initial map coordinate data of the initial point is obtained. According to the initial map coordinate data and the face feature corresponding to the initial point, the distance information is determined.
[0061] In the embodiments of the present disclosure, the initial rotation estimation information can include an initial rotation estimation value. The initial displacement estimation information can include an initial displacement estimation value. For example, according to the initial motion trajectory information traj, the initial rotation estimation value and the initial displacement estimation value
[0062] In the embodiments of the present disclosure, the point cloud coordinate data is used to indicate the position of the initial point in the initial point cloud coordinate system, and the initial map coordinate data is used to indicate the position of the initial point in the initial map coordinate system of the initial map.
[0063] In the embodiments of the present disclosure, obtaining the initial map coordinate data of the initial point according to the initial extrinsic parameter, the point cloud coordinate data of the initial point, the initial rotation estimation information and the initial displacement estimation information can include: obtaining inertial coordinate data of the initial point according to the initial extrinsic parameter and the point cloud coordinate data, the inertial coordinate data being used to indicate the position of the initial point in the inertial coordinate system; determining conversion information according to the initial rotation estimation information and the initial displacement estimation information; and processing the inertial coordinate data by using the conversion information to obtain the initial map coordinate data.
[0064] For example, according to the initial extrinsic parameter and the point cloud data of the initial point i the inertial coordinate data of the initial point i can be obtained The inertial coordinate data can indicate the position of the initial point i in the inertial coordinate system. For another example, according to the initial rotation estimation value and the initial displacement estimation value the conversion matrix The conversion matrix can be used as the conversion information. For another example, multiplying the conversion matrix and the inertial coordinate data can obtain the initial map coordinate data of the initial point i
[0065] For example, according to the initial map coordinate data and the feature parameters of the surface feature the distance measurement residual can be determined as the distance information. In one example, according to the laser radar odometry and the real-time mapping algorithm described above, the distance measurement residual can be determined.
[0066] It can be understood that some embodiments of determining the distance information are described in detail above. In order to adjust the initial extrinsic parameter and the initial motion trajectory information, acceleration information and angular velocity information can also be obtained, which will be described in detail below.
[0067] In some embodiments, in some embodiments of operation S240, adjusting the initial extrinsic parameter and the initial motion trajectory information according to the plurality of distance information can include: adjusting the initial extrinsic parameter and the initial motion trajectory information according to the acceleration information, the angular velocity information and the plurality of distance information.
[0068] In some embodiments, the inertial measurement data collected by the inertial measurement unit can include inertial rotation data and inertial translation data.
[0069] In some embodiments, the acceleration information can be determined according to the inertial translation data and the initial motion trajectory information.
[0070] In embodiments of the present disclosure, the initial rotation estimation information and the initial acceleration estimation information can be determined according to the initial motion trajectory information. For example, the initial acceleration estimation information can include an initial acceleration estimation value
[0071] In embodiments of the present disclosure, the initial acceleration measurement information can be determined according to the inertial translation data. For example, the initial acceleration measurement information can include an initial acceleration measurement value
[0072] In embodiments of the present disclosure, the acceleration information can be determined according to the initial rotation estimation information, the initial acceleration estimation information and the initial acceleration measurement information.
[0073] In embodiments of the present disclosure, the first acceleration estimation information can be obtained by performing a first operation processing on the initial acceleration estimation information using first preset acceleration information. For example, the first preset acceleration information can include a gravity acceleration value g G . For another example, the first operation processing can include a subtraction operation processing. In one example, a difference between the gravity acceleration value g G and the initial acceleration estimation value can be taken as the first acceleration estimation information.
[0074] In embodiments of the present disclosure, the second acceleration estimation information can be obtained by performing a second operation processing on the initial acceleration estimation value using the initial acceleration estimation information. For example, the second operation processing can include a multiplication operation processing. For another example, the initial acceleration estimation value can be converted to obtain an inverse of the initial acceleration estimation value , and a product obtained by multiplying the inverse with the difference described above can be taken as the second acceleration estimation information.
[0075] In embodiments of the present disclosure, the acceleration difference information can be determined between the initial acceleration measurement information and the second acceleration estimation information. For example, the acceleration difference value can be obtained by subtracting the product described above from the initial acceleration measurement value , and taken as the acceleration difference information.
[0076] In embodiments of the present disclosure, the acceleration information can be obtained by adjusting the acceleration difference information using a preset translation bias. For example, the acceleration measurement residual can be obtained by adding the acceleration difference value described above and the preset translation bias b a , and taken as the acceleration information.
[0077] In one example, the acceleration measurement residual can be determined by the following equation
[0078]
[0079] The first acceleration estimate can be determined as The second acceleration estimate can be determined as The initial acceleration estimate can be determined as The initial acceleration estimate can be determined as The initial acceleration measurement can be determined as a The preset translation bias can be determined as G The gravity acceleration value can be determined as
[0080] In some embodiments, the angular velocity information can be determined according to the inertial rotation data and the initial motion trajectory information.
[0081] In embodiments of the present disclosure, the initial angular velocity estimation information can be determined according to the initial motion trajectory information. For example, the initial angular velocity estimation information can include an initial angular velocity estimation value
[0082] In embodiments of the present disclosure, the initial angular velocity measurement information can be determined according to the inertial rotation data. For example, the initial angular velocity measurement information can include an initial angular velocity measurement value
[0083] In embodiments of the present disclosure, the angular velocity information can be determined according to the initial angular velocity estimation information and the initial angular velocity measurement information.
[0084] In embodiments of the present disclosure, the angular velocity difference information between the initial angular velocity measurement information and the initial angular velocity estimation information can be determined. For example, the initial angular velocity measurement value minus the initial angular velocity estimation value yields an angular velocity difference value as the angular velocity difference information.
[0085] In embodiments of the present disclosure, the angular velocity difference information is adjusted by a preset rotation bias to obtain the angular velocity information. For example, the angular velocity measurement residual is obtained by subtracting the preset rotation bias from the angular velocity difference value, as the angular velocity information.
[0086] In one example, the acceleration measurement residual can be determined by the following equation
[0087]
[0088] The angular velocity difference value can be determined as The initial angular velocity estimate value can be obtained. The initial angular velocity measurement value can be obtained. g The preset rotation deviation can be obtained.
[0089] It can be understood that the above describes in detail the way of obtaining acceleration information, angular velocity information and distance information. Some embodiments of adjusting initial external parameters and initial trajectory information will be described in detail below.
[0090] In some embodiments, adjusting the initial external parameters and the initial motion trajectory information according to the acceleration information, the angular velocity information and the plurality of distance information to obtain target trajectory information and target external parameters can include: determining fusion information according to the acceleration information, the angular velocity information and the plurality of distance information. Adjusting the initial motion trajectory information and the initial external parameters to make the fusion information converge to obtain the target motion trajectory information and the target external parameters.
[0091] For example, the fusion information can be implemented as a target function shown in the following formula:
[0092]
[0093] The variable value can be obtained for minimizing the function value of the target function. traj * The target motion trajectory information can be obtained. The target external parameters can be obtained. b a * b g * The target gravity acceleration value, the target translation deviation and the target rotation deviation can be obtained respectively, which can be consistent with the gravity acceleration value g G , the preset translation deviation b a , and the preset rotation deviation b g , respectively, and can be regarded as invariable values. For example, adjusting the initial motion trajectory information and the initial external parameters to obtain the target motion trajectory information and the target external parameters. The target is to make the function value of the target function shown in formula three calculated according to the target motion trajectory information and the target external parameters decrease or converge.
[0094] It can be understood that the above describes in detail the manner of adjusting the initial motion trajectory information and the initial external parameter. In the embodiments of the present disclosure, the original motion trajectory information and the original external parameter can be iterated for N times to realize the convergence of fused information. The initial motion trajectory information and the initial external parameter described above can be taken as the initial motion trajectory information of the nth iteration and the initial external parameter of the nth iteration respectively. The target motion trajectory information and the target external parameter described above can be taken as the target motion trajectory information of the nth iteration and the target external parameter of the nth iteration respectively. The following will be described in detail in combination with related embodiments.
[0095] Figure 3 is a flowchart of a map generation method according to an embodiment of the present disclosure.
[0096] As shown in Figure 3 , each operation in the method 300 is used to perform the nth iteration, n is an integer greater than or equal to 1. n is an integer less than or equal to N. N is an integer greater than or equal to 1. In the embodiments of the present disclosure, before the first iteration is performed, an initialization operation can be performed to determine the original motion trajectory information and the original external parameter. For example, the original motion trajectory information can be taken as the initial motion trajectory information of the first iteration. The original external parameter can also be determined as the initial external parameter of the first iteration. For another example, the initialization can be performed according to various manners to obtain the original motion trajectory information and the original external parameter. In one example, the local trajectory output by the laser radar relationship inertial odometer (LiDAR Inertial Odometry, LIO) or the trajectory output by the vehicle end positioning module can be taken as the original motion trajectory information.
[0097] In operation S310, the initial map of the nth iteration is generated according to the initial motion trajectory information of the nth iteration and the initial point cloud data.
[0098] For another example, according to the initial external parameter of the nth iteration and the initial motion trajectory information of the nth iteration, the nth level laser radar related motion trajectory information can be determined. Based on the nth level laser radar related motion trajectory information, the nth level point cloud compensation information can be determined. The initial point cloud data is motion compensated by using the nth level point cloud compensation information to realize the adjustment of the multiple point cloud data, and the nth level adjusted point cloud data is obtained. The initial point cloud data can be multiple. Therefore, the nth level adjusted point cloud data can also be multiple. The point cloud splicing is performed on the nth level adjusted point cloud data, and the nth level spliced point cloud data can be obtained as the nth level initial map data. According to the nth level initial map data, the initial map of the nth iteration can be generated.
[0099] In operation S320, the n-th level association relationship information between the plurality of initial points and the plurality of face features of the target planes in the initial map of the n-th iteration is determined.
[0100] For example, three target planes can be determined in the initial map of the n-th iteration, the face features of the target planes are extracted, and the n-th level association sub-relationship information between the initial points in the initial point cloud data that is not compensated and the face features is determined. The n-th level association sub-relationship information of the plurality of initial points is taken as the n-th level association relationship information.
[0101] In operation S330, the n-th level acceleration information, the n-th level angular velocity information and the plurality of n-th level distance information are determined according to the inertial measurement data, the initial external parameters of the n-th iteration, the initial motion trajectory information of the n-th iteration and the n-th level association relationship information.
[0102] For example, according to the inertial translation data and the initial motion trajectory information of the n-th iteration, the n-th level acceleration measurement residual can be determined as the n-th level acceleration information.
[0103] For example, according to the inertial rotation data and the initial motion estimation information of the n-th iteration, the n-th level angular velocity measurement residual can be determined as the n-th level angular velocity information.
[0104] For example, according to the initial external parameters of the n-th iteration, the initial motion trajectory information of the n-th iteration and the plurality of n-th level association sub-relationship information, the plurality of distance measurement residuals can be respectively determined as the plurality of n-th level distance information.
[0105] In operation S341, the n-th level fusion information is determined according to the n-th level acceleration information, the n-th level angular velocity information and the plurality of n-th level distance information.
[0106] For example, the n-th level function value is obtained by processing the n-th level acceleration measurement residual, the n-th level angular velocity measurement residual and the plurality of n-th level distance measurement residuals by using the objective function shown in Formula Three, as the n-th level fusion information.
[0107] In operation S342, it is determined whether the n-th level fusion information converges.
[0108] For example, it can be determined whether the difference between the n-th level function value and the (n-1)-th level function value is less than a preset difference threshold. If it is less than the preset difference threshold, it can be determined that the n-th level fusion information converges. It can be understood that other ways can also be used to determine whether the fusion information converges. For example, in the case of n=1, it can be determined that the first level fusion information does not converge.
[0109] In the embodiments of the present disclosure, in response to determining that the n-th level fusion information converges, operation S350 is performed.
[0110] In the embodiments of the present disclosure, in response to determining that the n-level fused information does not converge, operation S343 is performed.
[0111] In operation S343, the initial external parameter of the n-th iteration and the initial motion trajectory information of the n-th iteration are adjusted to obtain the target external parameter of the n-th iteration and the target motion trajectory information of the n-th iteration.
[0112] For example, the initial external parameter of the n-th iteration and the initial motion trajectory information of the n-th iteration can be adjusted in various ways to obtain the target external parameter of the n-th iteration and the target motion trajectory information of the n-th iteration.
[0113] In operation S344, the target external parameter of the n-th iteration and the target motion trajectory information of the n-th iteration are taken as the initial external parameter of the (n+1)-th iteration and the initial motion trajectory information of the (n+1)-th iteration respectively, and the process returns to operation S310.
[0114] For example, the (n+1)-th iteration is performed according to the initial external parameter of the (n+1)-th iteration and the initial motion trajectory information of the (n+1)-th iteration.
[0115] In operation S350, a target map is generated according to the motion trajectory information and the external parameter corresponding to the converged fused information.
[0116] For example, in the case where the n-level fused information converges, the target motion trajectory information of the (n-1)-th iteration and the target external parameter of the (n-1)-th iteration can be used to generate the target map. For another example, in the case where the fused information converges, the target motion trajectory information of the n-th iteration and the target external parameter of the n-th iteration can be used to generate the target map. It can be understood that, in the process of the two iterations before and after the convergence of the fused information, the difference between the two related motion trajectory information is small, and at least one of the trajectory information can be used to generate the target map. It can also be understood that, in the process of the two iterations before and after the convergence of the fused information, the difference between the two related external parameters is small, and can be used to generate the target map.
[0117] In the embodiments of the present disclosure, if the N-level fused information converges after N iterations, the N-level laser radar related motion trajectory information can be determined. Based on the N-level laser radar related motion trajectory information, the N-level point cloud compensation information can be determined. The initial point cloud data is compensated by using the N-level point cloud compensation information, so as to adjust the point cloud data and obtain the N-level adjusted point cloud data. The initial point cloud data can be multiple. Therefore, the N-level adjusted point cloud data can also be multiple. The N-level adjusted point cloud data is spliced to obtain the N-level spliced point cloud data as the target map data. According to the target map data, the target map can be generated.
[0118] It can be understood that some embodiments of generating a map are described in detail above. In order to improve the accuracy of the generated map, some information or data can be checked in each operation process described above, which will be described in detail below.
[0119] In some embodiments, determining the associated sub-relationship information between the initial point and the surface feature comprises: in response to determining that the data of the surface feature is greater than or equal to a preset surface feature quantity threshold, determining the associated sub-relationship information between the initial point and the surface feature. For example, the preset surface feature quantity threshold can be 80. If the surface feature quantity is less than 80, the last iteration can be re-executed, and the initial trajectory information and / or the initial external parameter of the last iteration can be re-adjusted.
[0120] In some embodiments, the acceleration measurement residual, the angular velocity measurement residual, and the distance measurement residual described above can also be checked.
[0121] It can be understood that the map generation method and the checking method of related data in the map generation process are described in detail above. The data required for map generation will be described in detail below.
[0122] In some embodiments, the initial point cloud data and the original motion trajectory information come from a target object that travels along a preset travel route, and the preset travel route includes at least one preset travel sub-route with an arc greater than or equal to a preset arc threshold. For example, the target object can be a data collection vehicle. For another example, the preset travel route can be an 8-shaped travel route. For another example, the preset travel route can indicate that the vehicle turns around.
[0123] As described above, the external parameter includes a time external parameter and a space external parameter. The space external parameter can include six degrees of freedom components, which are translation x, translation y, translation z, rotation x, rotation y, and rotation z, respectively. According to the embodiments of the present disclosure, in the case of traveling along the preset travel route, the translation z component in the space external parameter related to the data collection vehicle is unobservable, and it can be considered that the component is constant and does not need to be optimized. “Unobservable” is a control theory term, which indicates whether the data can be mined or estimated from existing data. In the embodiments of the present disclosure, the true value change of the translation z component does not cause the change of other components, that is, other components are not sensitive to the true value change of the translation z. Therefore, the difficulty of map generation can be reduced.
[0124] In the embodiments of the present disclosure, the theoretical basis of the method described above can be a B-spline curve.
[0125] As mentioned above, the inertial measurement data can include inertial translation data and inertial rotation data. Thus, based on the inertial translation data and the inertial rotation data, two B-spline curves can be utilized to model the continuous-time trajectory of the translation process and the continuous-time trajectory of the rotation process of the inertial measurement unit, respectively. The two B-spline curves can be fitted with 4th order linear functions.
[0126] The control nodes of the B-spline curve of the trajectory are evenly distributed in time, which is highly related to the shape of the B-spline curve. Based on the B-spline curve, the first and second derivatives of the state with respect to time can be determined. For the B-spline curve of the translation process, the first and second derivatives are the velocity state and the acceleration state, respectively. For the B-spline curve of the rotation process, the first and second derivatives are the angular velocity state and the angular acceleration state, respectively.
[0127] Figure 4 is an exemplary schematic diagram of a target map according to an embodiment of the present disclosure.
[0128] As Figure 4 shown, the target map M400 has a high accuracy. Most of the points of the target map M400 are at positions corresponding to objects (e.g., office buildings) in the real scene. There are fewer points that are not aligned with the objects in the real scene.
[0129] Figure 5 is a block diagram of a map generation apparatus according to an embodiment of the present disclosure.
[0130] As Figure 5 shown, the apparatus 500 can include a first generation module 510, a first determination module 520, a second determination module 530, an adjustment module 540, and a second generation module 550.
[0131] The first generation module 510 is configured to generate an initial map according to initial point cloud data and initial motion trajectory information.
[0132] The first determination module 520 is configured to determine association relationship information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map.
[0133] The second determination module 530 is configured to determine distance information between the face features corresponding to the initial points and the initial points according to the initial extrinsic parameters, the initial motion trajectory information, and the association relationship information.
[0134] The adjustment module 540 is configured to adjust the initial extrinsic parameters and the initial motion trajectory information according to the plurality of distance information to obtain target motion trajectory information and target extrinsic parameters.
[0135] The second generation module 550 is configured to generate a target map according to the target motion trajectory information and the target extrinsic parameters.
[0136] In some embodiments, the second determining module comprises: a first determining sub-module, configured to determine initial rotation estimation information and initial displacement estimation information according to the initial motion trajectory information; a first obtaining sub-module, configured to obtain initial map coordinate data of the initial point according to the initial extrinsic parameter, the point cloud coordinate data of the initial point, the initial rotation estimation information and the initial displacement estimation information, the point cloud coordinate data being used to indicate a position of the initial point in an initial point cloud coordinate system, and the initial map coordinate data being used to indicate a position of the initial point in an initial map coordinate system of an initial map; and a second determining sub-module, configured to determine the distance information according to the initial map coordinate data and the association relationship.
[0137] In some embodiments, the first obtaining sub-module comprises: a first obtaining unit, configured to obtain inertial coordinate data of the initial point according to the initial extrinsic parameter and the point cloud coordinate data, the inertial coordinate data being used to indicate a position of the initial point in an inertial coordinate system; a first determining unit, configured to determine conversion information according to the initial rotation estimation information and the initial displacement estimation information; and a first processing unit, configured to process the inertial coordinate data by using the conversion information to obtain the initial map coordinate data.
[0138] In some embodiments, the adjusting module comprises: a third determining sub-module, configured to determine acceleration information according to the inertial translation data and the initial motion trajectory information; a fourth determining sub-module, configured to determine angular velocity information according to the inertial rotation data and the initial motion trajectory information; and a first adjusting sub-module, configured to adjust the initial extrinsic parameter and the initial motion trajectory information according to the acceleration information, the angular velocity information and the plurality of distance information to obtain target trajectory information and target extrinsic parameter.
[0139] In some embodiments, the third determining sub-module comprises: a second determining unit, configured to determine initial rotation estimation information and initial acceleration estimation information according to the initial motion trajectory information; a third determining unit, configured to determine initial acceleration measurement information according to the inertial translation data; and a fourth determining unit, configured to determine the acceleration information according to the initial rotation estimation information, the initial acceleration estimation information and the initial acceleration measurement information.
[0140] In some embodiments, the fourth determining unit comprises: a first operation processing sub-unit, configured to perform first operation processing on the initial acceleration estimation information by using first preset acceleration information to obtain first acceleration estimation information; a second operation processing sub-unit, configured to perform second operation processing on the first acceleration estimation information by using the initial rotation estimation information to obtain second acceleration estimation information; a first determining sub-unit, configured to determine acceleration difference information between the initial acceleration measurement information and the second acceleration estimation information; and a first adjusting sub-unit, configured to adjust the acceleration difference information by using a preset translation bias to obtain the acceleration information.
[0141] In some embodiments, the fourth determining sub-module comprises: a fifth determining unit, configured to determine initial angular velocity estimation information according to the initial motion trajectory information; a sixth determining unit, configured to determine initial angular velocity measurement information according to the inertial rotation data; and a seventh determining unit, configured to determine the angular velocity information according to the initial angular velocity estimation information and the initial angular velocity measurement information.
[0142] In some embodiments, the seventh determining unit comprises: a second determining sub-unit, configured to determine angular velocity difference information between the initial angular velocity measurement information and the initial angular velocity estimation information; and a second adjusting sub-unit, configured to adjust the angular velocity difference information by using a preset rotation deviation to obtain the angular velocity information.
[0143] In some embodiments, the first adjusting sub-module comprises: an eighth determining unit, configured to determine fusion information according to the acceleration information, the angular velocity information and the plurality of distance information; and an adjusting unit, configured to adjust the initial motion trajectory information and the initial external parameter to make the fusion information converge to obtain the target motion trajectory information and the target external parameter.
[0144] In some embodiments, the first generating module comprises: a fifth determining sub-module, configured to determine point cloud compensation information according to the initial motion trajectory information and the initial external parameter; a second adjusting sub-module, configured to adjust the initial point cloud data by using the point cloud compensation information to obtain adjusted point cloud data; a point cloud splicing sub-module, configured to perform point cloud splicing on the plurality of adjusted point cloud data to obtain initial map data; and a first generating sub-module, configured to generate the initial map according to the initial map data.
[0145] In some embodiments, the first initial motion trajectory information is the initial motion trajectory information of the n th iteration, the first generating module comprises: a second generating sub-module, configured to generate the initial map of the n th iteration according to the initial motion trajectory information of the n th iteration and the initial point cloud data, n is an integer greater than or equal to 1, n is an integer less than or equal to N, and N is an integer greater than 1.
[0146] In some embodiments, the initial external parameter is the initial external parameter of the n th iteration, the first determining module comprises: a sixth determining sub-module, configured to determine n th level association relationship information between a plurality of initial points and a plurality of face features of a target plane in the initial map of the n th iteration; the adjusting module comprises: a third adjusting sub-module, configured to adjust the initial external parameter of the n th iteration and the initial motion trajectory information of the n th iteration to obtain the target motion trajectory information of the n th iteration and the target external parameter of the n th iteration; a seventh determining sub-module, configured to take the target motion trajectory information of the n th iteration as the initial motion trajectory information of the n+1 th iteration; and an eighth determining sub-module, configured to take the target external parameter of the n th iteration as the initial external parameter of the n+1 th iteration.
[0147] In some embodiments, the first generating module comprises: a ninth determining submodule, configured to determine the original motion trajectory information and the original external parameter; and a tenth determining submodule, configured to determine the original motion trajectory information as initial motion trajectory information of the first iteration, and to determine the original external parameter as initial external parameter of the first iteration.
[0148] In some embodiments, the first determining module comprises: an eleventh determining submodule, configured to determine at least one target plane in the initial map; an extracting submodule, configured to extract a plurality of plane features of the target plane; a twelfth determining submodule, configured to determine associated sub-relation information between the initial point and the plane features, wherein the associated sub-relation is used to indicate a plane feature corresponding to the initial point; and a thirteenth determining submodule, configured to determine the associated relation information according to the plurality of associated sub-relation information.
[0149] In some embodiments, the twelfth determining submodule comprises: a ninth determining unit, configured to determine the associated sub-relation information between the initial point and the plane features in response to determining that the data of the plane features is greater than or equal to a preset plane feature quantity threshold.
[0150] In some embodiments, the initial point cloud data and the original motion trajectory information are from a target object driving along a preset driving route, and the preset driving route comprises at least one preset driving sub-route with an arc greater than or equal to a preset arc threshold.
[0151] In the technical scheme of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved in the technical scheme comply with relevant laws and regulations and do not violate public order and good customs.
[0152] According to the embodiments of the present disclosure, the present disclosure further provides an electronic device, a readable storage medium and a computer program product.
[0153] Figure 6 A schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the present disclosure described and / or claimed in this document.
[0154] As Figure 6As shown, the device 600 includes a computing unit 601 that can perform various appropriate actions and processes in accordance with a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from the storage unit 608 into a random access memory (RAM) 603. Various programs and data required for the operation of the device 600 can also be stored in the RAM 603. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0155] Various components in the device 600 are connected to the I / O interface 605, including an input unit 606 such as a keyboard, a mouse, etc., an output unit 607 such as various types of displays, speakers, etc., a storage unit 608 such as a magnetic disk, an optical disk, etc., and a communication unit 609 such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0156] The computing unit 601 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 601 performs various methods and processes described above, such as the map generation method. For example, in some embodiments, the map generation method can be implemented as a computer software program that is tangibly embodied in a machine-readable medium, such as the storage unit 608. In some embodiments, part or all of the computer program can be loaded and / or installed on the device 600 via the ROM 602 and / or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the map generation method described above can be performed. Alternatively, in other embodiments, the computing unit 601 can be configured to perform the map generation method by any other appropriate means, such as by means of firmware.
[0157] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a complex programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
[0158] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces the functions / operations specified in the flowcharts and / or the block diagrams. The program code can be executed entirely on a machine, partially on a machine, partially on a machine as a stand-alone software package, partially on a machine and partially on a remote machine or entirely on a remote machine or server.
[0159] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0160] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) monitor or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
[0161] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.
[0162] The computer system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
[0163] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the spirit and scope of the present disclosure. For example, the steps recited in the disclosure can be executed in parallel, executed in series, or executed in different orders, as long as the desired results of the technology disclosed in the present disclosure are achieved, and the present disclosure is not limited herein.
[0164] The specific embodiments described above have been shown by way of example, and anyone skilled in the art should understand that various modifications, combinations, sub-combinations, and alternatives can be made to the specific embodiments without departing from the spirit and principles of the present disclosure. Any further modifications, equivalent substitutions, improvements, and the like, which are apparent to one skilled in the art, are intended to be included within the scope of the present disclosure.
Claims
1. A method for generating a map, comprising: generating an initial map according to initial point cloud data and initial motion trajectory information; determining association information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map; determining initial rotation estimation information and initial displacement estimation information according to the initial motion trajectory information; obtaining initial map coordinate data of the initial points according to initial extrinsic parameters, point cloud coordinate data of the initial points, the initial rotation estimation information and the initial displacement estimation information, wherein the point cloud coordinate data is used to indicate a position of the initial points in an initial point cloud coordinate system, and the initial map coordinate data is used to indicate a position of the initial points in an initial map coordinate system of the initial map; determining distance information according to the initial map coordinate data and the association information; adjusting the initial extrinsic parameters and the initial motion trajectory information according to a plurality of the distance information to obtain target motion trajectory information and target extrinsic parameters; and generating a target map according to the target motion trajectory information and the target extrinsic parameters. The obtaining of the initial map coordinate data of the initial points according to the initial extrinsic parameters, the point cloud coordinate data of the initial points, the initial rotation estimation information and the initial displacement estimation information comprises: obtaining inertial coordinate data of the initial points according to the initial extrinsic parameters and the point cloud coordinate data, wherein the inertial coordinate data is used to indicate a position of the initial points in an inertial coordinate system; determining conversion information according to the initial rotation estimation information and the initial displacement estimation information; and processing the inertial coordinate data by using the conversion information to obtain the initial map coordinate data. The adjusting of the initial extrinsic parameters and the initial motion trajectory information according to a plurality of the distance information to obtain the target motion trajectory information and the target extrinsic parameters comprises: determining acceleration information according to inertial translation data and the initial motion trajectory information; determining angular velocity information according to inertial rotation data and the initial motion trajectory information; and adjusting the initial extrinsic parameters and the initial motion trajectory information according to the acceleration information, the angular velocity information and a plurality of the distance information to obtain the target motion trajectory information and the target extrinsic parameters. The determining of the acceleration information according to the inertial translation data and the initial motion trajectory information comprises: determining initial rotation estimation information and initial acceleration estimation information according to the initial motion trajectory information; determining initial acceleration measurement information according to the inertial translation data; and determining the acceleration information according to the initial rotation estimation information, the initial acceleration estimation information and the initial acceleration measurement information. The determining of the acceleration information according to the initial rotation estimation information, the initial acceleration estimation information and the initial acceleration measurement information comprises: performing first operation processing on the initial acceleration estimation information by using first preset acceleration information to obtain first acceleration estimation information; performing second operation processing on the first acceleration estimation information by using second preset acceleration information to obtain second acceleration estimation information; and determining the acceleration information according to the initial rotation estimation information, the second acceleration estimation information and the initial acceleration measurement information. 2. The method of claim 1, wherein, 3. The method of claim 1, wherein, 4. The method of claim 3, wherein, 5. The method of claim 4, wherein, performing a second operation on the first acceleration estimation information by using the initial rotation estimation information to obtain second acceleration estimation information; determining acceleration difference information between the initial acceleration measurement information and the second acceleration estimation information; and adjusting the acceleration difference information by using a preset translation bias to obtain the acceleration information.
6. The method of claim 3, wherein, The determining the angular velocity information according to the inertial rotation data and the initial motion trajectory information comprises: determining initial angular velocity estimation information according to the initial motion trajectory information; determining initial angular velocity measurement information according to the inertial rotation data; and determining the angular velocity information according to the initial angular velocity estimation information and the initial angular velocity measurement information.
7. The method of claim 6, wherein, The determining the angular velocity information according to the initial angular velocity estimation information and the initial angular velocity measurement information comprises: determining angular velocity difference information between the initial angular velocity measurement information and the initial angular velocity estimation information; adjusting the angular velocity difference information by using a preset rotation bias to obtain the angular velocity information.
8. The method of claim 3, wherein, The adjusting the initial external parameter and the initial motion trajectory information according to the acceleration information, the angular velocity information and a plurality of the distance information to obtain the target motion trajectory information and the target external parameter comprises: determining fusion information according to the acceleration information, the angular velocity information and a plurality of the distance information; and adjusting the initial motion trajectory information and the initial external parameter to make the fusion information converge to obtain the target motion trajectory information and the target external parameter.
9. The method of claim 1, wherein, The generating an initial map according to initial point cloud data and the initial motion trajectory information comprises: determining point cloud compensation information according to initial motion trajectory information and the initial external parameter; adjusting the initial point cloud data by using the point cloud compensation information to obtain adjusted point cloud data; performing point cloud splicing on a plurality of the adjusted point cloud data to obtain initial map data; and generating the initial map according to the initial map data.
10. The method of claim 1, wherein, The initial motion trajectory information is initial motion trajectory information of the n th iteration, The generating an initial map according to initial point cloud data and the initial motion trajectory information comprises: generating an initial map of the n th iteration according to the initial motion trajectory information of the n th iteration and the initial point cloud data, wherein n is an integer greater than or equal to 1, n is an integer less than or equal to N, and N is an integer greater than 1.
11. The method of claim 10, wherein, The initial external parameter is initial external parameter of the n th iteration, The determining the association relationship information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map comprises: determining n th level association relationship information between a plurality of the initial points and a plurality of face features of a target plane in the initial map of the n th iteration; The adjusting the initial external parameter and the initial motion trajectory information to obtain target motion trajectory information and target external parameter comprises: adjust the initial external parameter of the n th iteration and the initial motion trajectory information of the n th iteration to obtain target motion trajectory information of the n th iteration and target external parameter of the n th iteration; use the target motion trajectory information of the n th iteration as initial motion trajectory information of the n+1 th iteration; and use the target external parameter of the n th iteration as initial external parameter of the n+1 th iteration.
12. The method of claim 10, wherein, The generating an initial map according to initial point cloud data and initial motion trajectory information comprises: determining original motion trajectory information and original external parameter; using the original motion trajectory information as initial motion trajectory information of the 1 st iteration; and determining the original external parameter as initial external parameter of the 1 st iteration.
13. The method of claim 1, wherein, The determining the association relationship information between the plurality of initial points in the initial point cloud data and the plurality of face features of the target plane in the initial map comprises: determining at least one target plane in the initial map; extracting a plurality of face features of the target plane; determining association sub-relationship information between the initial point and the face feature, wherein the association sub-relationship is used to indicate the face feature corresponding to the initial point; and determining the association relationship information according to a plurality of association sub-relationship information.
14. The method of claim 13, wherein, The determining the association sub-relationship information between the initial point and the face feature comprises: in response to determining that the data of the face feature is greater than or equal to a preset face feature quantity threshold, determining the association sub-relationship information between the initial point and the face feature.
15. The method of claim 12, wherein, The initial point cloud data and the original motion trajectory information are from a target object driving according to a preset driving route, and the preset driving route comprises at least one preset driving sub-route with an arc greater than or equal to a preset arc threshold.
16. A map generation apparatus, comprising: a first generation module configured to generate an initial map according to initial point cloud data and initial motion trajectory information; a first determination module configured to determine association relationship information between a plurality of initial points in the initial point cloud data and a plurality of face features of a target plane in the initial map; a first determination submodule configured to determine initial rotation estimation information and initial displacement estimation information according to the initial motion trajectory information; a first obtaining submodule configured to obtain initial map coordinate data of the initial point according to initial external parameter, point cloud coordinate data of the initial point, the initial rotation estimation information and the initial displacement estimation information, wherein the point cloud coordinate data is used to indicate a position of the initial point in an initial point cloud coordinate system, and the initial map coordinate data is used to indicate a position of the initial point in an initial map coordinate system of the initial map; a second determination submodule configured to determine distance information according to the initial map coordinate data and the association relationship information; an adjustment module configured to adjust the initial external parameter and the initial motion trajectory information according to a plurality of distance information to obtain target motion trajectory information and target external parameter; and a second generation module configured to generate a target map according to the target motion trajectory information and the target external parameter.
17. An electronic device, comprising: at least one processor; and a memory in communication with the at least one processor; wherein the memory has stored instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 15.
18. A non-transitory computer readable storage medium having stored thereon computer instructions, wherein, the computer instructions are for causing the computer to perform the method of any one of claims 1 to 15.
19. A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1 to 15.
Citation Information
Patent Citations
High-precision three-dimensional point cloud acquisition method, system, device and storage medium
CN109509208A
Radar calibration method and device, electronic equipment and storage medium
CN112462350A