Hybrid solid-state laser radar simulation method and device, storage medium and electronic equipment

By acquiring and processing the angle distribution table and attribute information of mixed solid-state lidar, generating laser beams and rendering point cloud data, the problem of difficulty in simulating mixed solid-state lidar point clouds in the existing technology is solved, and high-precision simulation tests and demonstrations are achieved , meets the simulation needs of the Zhijia domain.

CN118940464APending Publication Date: 2024-11-12BEIJING JINGWEI HIRAIN TECH CO INC
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202410921518.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-10
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing lidar simulation methods are difficult to achieve point cloud simulation of hybrid solid-state lidar, especially because of its irregular scanning trajectory, which is difficult to meet the needs of custom simulations.

Method used

By obtaining the angle distribution table of the hybrid solid-state lidar, determining the exit angle of its emitted light, and generating a laser beam based on the attribute information, calculating the point cloud data when the light beam hits the target object, rendering it into the simulation scene, realizing the hybrid solid-state Point cloud simulation of lidar.

Benefits of technology

It realizes point cloud simulation and visualization of hybrid solid-state lidar, meets the simulation test and demonstration needs of high-level intelligent domain controllers for HIL systems, improves the accuracy and security of simulation tests, and reduces the development iteration cycle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118940464A_ABST
    Figure CN118940464A_ABST
Patent Text Reader

Abstract

The invention discloses a hybrid solid-state laser radar simulation method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining an angle distribution table corresponding to a hybrid solid-state laser radar, and the angle distribution table comprises angle parameters of all light rays emitted by the hybrid solid-state laser radar scanning a frame of point cloud; according to the angle distribution table, determining an emergent angle of each light emitted by the mixed solid state laser radar; reading attribute information of the hybrid solid-state laser radar in a simulation scene, and generating a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emergent angle; determining point cloud data generated when the laser beam hits the surface of a target object; and rendering the point cloud data into a simulation scene to realize point cloud simulation of the mixed solid state laser radar. According to the invention, the point cloud simulation of the mixed solid-state laser radar can be realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of laser radar simulation modeling, and in particular to a hybrid solid-state laser radar simulation method, device, storage medium and electronic device. Background Art

[0002] With the continuous development of intelligent driving technology, LiDAR has become an important sensor for intelligent driving solutions of major automakers due to its advantages such as accuracy in sensing the surrounding environment, high detection accuracy, and long detection distance. Previously, the most commonly used type of LiDAR was mechanical LiDAR. Currently, with the improvement of the level of intelligent driving solutions, hybrid solid-state LiDAR is being used more and more widely. In order to conveniently and quickly verify the reliability of intelligent driving control algorithms, many OEMs use HIL (hardware-in-the-loop) to test controllers. Due to the particularity of its working principle, LiDAR has not yet connected real samples to the HIL test system for testing. Instead, it simulates real point clouds by building LiDAR models.

[0003] At present, the mainstream laser radar model is mechanical radar. However, the scanning rules of mechanical laser radar are relatively simple and easy to simulate, while the scanning track of hybrid solid-state laser radar is irregular and requires higher custom simulation. Therefore, it is difficult to achieve point cloud simulation of hybrid solid-state laser radar with existing simulation methods. Summary of the invention

[0004] The present application provides a hybrid solid-state laser radar simulation method, device, storage medium and electronic device, which are mainly capable of realizing point cloud simulation of a hybrid solid-state laser radar.

[0005] The specific technical solutions are as follows:

[0006] The present application provides a hybrid solid-state laser radar simulation method, the method comprising:

[0007] Obtain an angle distribution table corresponding to a hybrid solid-state laser radar, wherein the angle distribution table includes angle parameters of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud;

[0008] According to the angle distribution table, determining the exit angle of each light ray emitted by the hybrid solid-state laser radar;

[0009] Reading the attribute information of the hybrid solid-state laser radar in the simulation scene, and generating a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle;

[0010] determining point cloud data generated when the laser beam hits the surface of the target object;

[0011] The point cloud data is rendered into a simulation scene to achieve point cloud simulation of the hybrid solid-state laser radar.

[0012] Optionally, the obtaining of the angle distribution table corresponding to the hybrid solid-state laser radar includes:

[0013] Obtaining angle information of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud;

[0014] Convert the angle information of each light ray into a format according to the format requirements of the preset simulation software to obtain the angle parameters of each light ray;

[0015] The angle distribution table is generated according to the angle parameters of each light ray.

[0016] Optionally, when the angle parameters of each light ray include the horizontal angle and the vertical angle of each light ray in the laser radar coordinate system, determining the exit angle of each light ray emitted by the hybrid solid-state laser radar according to the angle distribution table includes:

[0017] According to the horizontal angle and vertical angle of each light ray in the angle distribution table in the laser radar coordinate system, the emission angle of each light ray emitted by the hybrid solid-state laser radar is determined.

[0018] Optionally, when the attribute information includes a reference point position, a position offset, an angle offset, and a detection range of the hybrid solid-state laser radar, generating a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle includes:

[0019] Determining a light emission point corresponding to the hybrid solid-state laser radar according to the reference point position and the position offset;

[0020] Determining the actual emission angle of each light ray according to the emission angle and the angle offset;

[0021] Generate a laser beam corresponding to the hybrid solid-state laser radar according to the light emission point, the actual emission angle of each light beam and the detection range;

[0022] Optionally, determining point cloud data generated when the laser beam hits the surface of the target object includes:

[0023] Calculating the intersection coordinates and the detection distance between the laser beam and the target object, and the reflection intensity corresponding to the laser beam;

[0024] The point cloud data is determined according to the intersection coordinates, the detection distance and the reflection intensity.

[0025] Optionally, calculating the reflection intensity corresponding to the laser beam includes:

[0026] Respectively determine the total incident energy, reflected energy ratio, material diffuse reflectivity, echo angle energy attenuation coefficient and echo path attenuation coefficient corresponding to the laser beam;

[0027] The total incident energy, the reflected energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient are multiplied to obtain the reflection intensity corresponding to the laser beam.

[0028] Optionally, determining the total incident energy corresponding to the laser beam includes:

[0029] The initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the light exit point to the surface of the target object are obtained respectively;

[0030] The total incident energy is calculated according to the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object.

[0031] Optionally, determining the reflection energy ratio corresponding to the laser beam includes:

[0032] Obtaining respectively the reflectivity of the material and the cosine value of the angle between the light and the normal line of the plane where the target object is located;

[0033] The reflected energy ratio is calculated according to the reflectivity of the material and the cosine value of the angle between the light and the normal of the plane where the target object is located.

[0034] Optionally, determining an echo angle energy attenuation coefficient corresponding to the laser beam includes:

[0035] Obtaining the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, as well as the speed at which the energy decays along the incident angle;

[0036] The echo angle energy attenuation coefficient is determined according to the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, and the speed at which the energy decays along the incident angle.

[0037] Optionally, determining an echo path attenuation coefficient corresponding to the laser beam includes:

[0038] Acquire the distance that the light travels from the contact point of the target object back to the sensor;

[0039] The echo path attenuation coefficient corresponding to the laser beam is determined according to the distance of the light beam returning from the contact point of the target object to the sensor.

[0040] Optionally, the method further comprises:

[0041] Reorganize and package the point cloud data according to the laser radar protocol to obtain reorganized and packaged point cloud data;

[0042] The reorganized and packaged point cloud data is sent to the controller via Ethernet.

[0043] Optionally, the method further comprises:

[0044] When there are multiple hybrid solid-state laser radars, different threads are opened to achieve communication between different hybrid solid-state laser radars and the controller.

[0045] In a second aspect, an embodiment of the present application provides a hybrid solid-state laser radar simulation device, the device comprising:

[0046] An acquisition unit, used to acquire an angle distribution table corresponding to the hybrid solid-state laser radar, wherein the angle distribution table includes angle parameters of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud;

[0047] A first determining unit, configured to determine, according to the angle distribution table, an emission angle of each light ray emitted by the hybrid solid-state laser radar;

[0048] A generating unit, configured to read the attribute information of the hybrid solid-state laser radar in the simulation scene, and generate a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle;

[0049] A second determining unit, configured to determine point cloud data generated when the laser beam hits a surface of a target object;

[0050] A rendering unit is used to render the point cloud data into a simulation scene to achieve point cloud simulation of the hybrid solid-state laser radar.

[0051] Optionally, the acquisition unit is specifically used to obtain the angle information of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud; convert the angle information of each light ray according to the format requirements of a preset simulation software to obtain the angle parameters of each light ray; and generate the angle distribution table based on the angle parameters of each light ray.

[0052] Optionally, when the angle parameters of each light ray include horizontal angle and vertical angle information of each light ray in the laser radar coordinate system, the first determination unit is specifically used to determine the exit angle of each light ray emitted by the hybrid solid-state laser radar according to the horizontal angle and vertical angle of each light ray in the laser radar coordinate system in the angle distribution table.

[0053] Optionally, when the attribute information includes the reference point position, position offset, angle offset and detection range of the hybrid solid-state laser radar, the generation unit is specifically used to determine the light exit point corresponding to the hybrid solid-state laser radar based on the reference point position and the position offset; determine the actual exit angle of each light ray based on the exit angle and the angle offset; and generate a laser beam corresponding to the hybrid solid-state laser radar based on the light exit point, the actual exit angle of each light ray and the detection range.

[0054] Optionally, the second determining unit includes: a calculation module and a determination module;

[0055] The calculation module is used to respectively calculate the intersection coordinates and the detection distance between the laser beam and the target object, and the reflection intensity corresponding to the laser beam.

[0056] The determination module is used to determine the point cloud data according to the intersection coordinates, the detection distance and the reflection intensity.

[0057] Optionally, the calculation module includes: a determination submodule and a multiplication submodule;

[0058] The determination submodule is used to respectively determine the total incident energy, the reflected energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient corresponding to the laser beam;

[0059] The multiplication submodule is used to multiply the total incident energy, the reflected energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient to obtain the reflection intensity corresponding to the laser beam.

[0060] Optionally, the determination submodule is specifically used to respectively obtain the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object; and calculate the total incident energy based on the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object.

[0061] Optionally, the determination submodule is further specifically used to obtain the material reflectivity and the cosine value of the angle between the light and the normal line of the plane where the target object is located; and calculate the reflection energy ratio based on the material reflectivity and the cosine value of the angle between the light and the normal line of the plane where the target object is located.

[0062] Optionally, the determination submodule is further specifically used to obtain the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal of the plane where the target object is located, and the rate at which the energy decays along the incident angle; and determine the echo angle energy attenuation coefficient based on the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal of the plane where the target object is located, and the rate at which the energy decays along the incident angle.

[0063] Optionally, the determination submodule is further specifically used to obtain the distance from the contact point of the target object to the sensor; and determine the echo path attenuation coefficient corresponding to the laser beam according to the distance from the contact point of the target object to the sensor.

[0064] Optionally, the device further comprises: a packaging unit and a sending unit;

[0065] The packaging unit is used to reorganize and package the point cloud data according to the laser radar protocol to obtain reorganized and packaged point cloud data;

[0066] The sending unit is used to send the reorganized and packaged point cloud data to the controller via Ethernet.

[0067] Optionally, the device further comprises: an opening unit;

[0068] The opening unit is used to open different threads when there are multiple hybrid solid-state laser radars, so as to realize communication between different hybrid solid-state laser radars and the controller.

[0069] In a third aspect, another embodiment of the present application provides a storage medium having executable instructions stored thereon, which, when executed by a processor, enables the processor to implement the method described in any embodiment of the first aspect.

[0070] In a fourth aspect, another embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the processor implements the method described in any embodiment of the first aspect.

[0071] From the above content, it can be seen that the present invention is aimed at the urgent need for hybrid solid-state laser radar simulation modules in the current intelligent driving domain control HIL test system, combined with the simulation characteristics of the complex scanning rules of the hybrid solid-state laser radar, and generates the laser beam of the hybrid solid-state laser radar through the angle distribution table, and renders the point cloud data generated when the laser beam hits the surface of the target object into the simulation scene, which can realize the point cloud simulation of the hybrid solid-state laser radar. Since the simulation module provided by the present invention adds a point cloud visualization part, it is possible to render the point cloud image of the hybrid solid-state laser radar in real time in the simulation scene, thereby meeting the simulation test and demonstration requirements of the high-level intelligent driving domain controller for the HIL system. BRIEF DESCRIPTION OF THE DRAWINGS

[0072] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art description are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative work.

[0073] Figure 1 A schematic diagram of a flow chart of a hybrid solid-state laser radar simulation method provided in an embodiment of the present application;

[0074] Figure 2 A schematic diagram of the overall architecture of a hybrid solid-state laser radar simulation test provided in an embodiment of the present application;

[0075] Figure 3 A block diagram of the composition of a hybrid solid-state lidar simulation device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0076] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0077] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0078] Figure 1A flow chart of a hybrid solid-state laser radar simulation method provided in an embodiment of the present application, the method comprising:

[0079] S110: Obtain an angle distribution table corresponding to the hybrid solid-state laser radar.

[0080] Among them, the angle distribution table contains the angle parameters of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud, and the angle parameters include the horizontal angle and vertical angle of each light ray in the laser radar coordinate system.

[0081] The embodiment of the present invention is mainly applicable to the scenario of simulating a hybrid solid-state laser radar. The execution subject of the embodiment of the present invention is a device or equipment capable of simulating a hybrid solid-state laser radar.

[0082] The overall architecture of the hybrid solid-state laser radar simulation test provided by the embodiment of the present invention is as follows: Figure 2 As shown, in the simulation scheme provided by an embodiment of the present invention, it is first necessary to obtain the angle information of all light rays emitted by the hybrid solid-state laser radar when scanning a frame of point cloud, and then input the angle information into the angle distribution table generation program, which will process the angle information and finally generate an angle distribution table corresponding to the hybrid solid-state laser radar.

[0083] For this process, as an optional implementation, step S110 specifically includes: obtaining the angle information of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud; converting the angle information of each light ray according to the format requirements of the preset simulation software to obtain the angle parameters of each light ray; and generating the angle distribution table according to the angle parameters of each light ray.

[0084] The preset simulation software may specifically be VTD simulation test software, which is mainly used to develop and test the autonomous driving vehicle system. It should be noted that the preset simulation software used in the embodiment of the present invention is not limited to VTD simulation test software, and may also be other simulation test software.

[0085] Specifically, the developed angle distribution table generation program can convert the angle information of each light ray into angle parameters that meet the requirements of the preset simulation software format, that is, Figure 2 Based on the angle distribution matrix, the angle distribution table corresponding to the hybrid solid-state laser radar can be determined, and then the angle distribution table file is saved to the corresponding path.

[0086] S120: Determine the emission angle of each light ray emitted by the hybrid solid-state laser radar according to the angle distribution table.

[0087] For an embodiment of the present invention, after generating the angle distribution table of the hybrid solid-state laser radar, the exit angle of each light ray emitted by the hybrid solid-state laser radar is determined according to the horizontal angle and vertical angle of each light ray in the angle distribution table in the laser radar coordinate system.

[0088] Specifically, in order to realize the point cloud simulation of the hybrid solid-state laser radar, the embodiment of the present invention conducts secondary development of the Optix Plugin plug-in of the VTD simulation test software. The C++ point cloud data writing module in the developed VTD Optix Plugin module component will read the angle distribution table file under the corresponding path and call the Cuda ray tracing module, that is, under NVIDIA's ray tracing framework, based on the angle distribution table, restore the exit angles of each light ray emitted by the hybrid solid-state laser radar.

[0089] S130: Read the attribute information of the hybrid solid-state laser radar in the simulation scene, and generate a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle.

[0090] The attribute information of the hybrid solid-state laser radar includes: the reference point position, position offset, angle offset and detection range of the hybrid solid-state laser radar. The reference point position is the projection position of the rear axle center of the vehicle on the ground, the position offset is the position offset of the hybrid solid-state laser radar relative to the reference point when it is actually installed, the angle offset is the offset of the hybrid solid-state laser radar relative to the light emission angle when it is actually installed, and the detection range is the distance range that the hybrid solid-state laser radar can actually detect.

[0091] For an embodiment of the present invention, after determining the exit angle of each light ray emitted by the hybrid solid-state laser radar, the reference point position, position offset, angle offset and detection range in the simulation scene (VTD scene) are read, and then based on the reference point position, position offset, angle offset and detection range, as well as the determined exit angles of each light ray, the interface function of the Cuda ray tracing module is called to generate a laser beam.

[0092] For this process, as an optional implementation, step S130 specifically includes: determining the light exit point corresponding to the hybrid solid-state laser radar according to the reference point position and the position offset; determining the actual exit angle of each light ray according to the exit angle and the angle offset; generating a laser beam corresponding to the hybrid solid-state laser radar according to the light exit point, the actual exit angle of each light ray and the detection range.

[0093] Specifically, since the emission of a laser beam requires determining factors such as the light exit point, the actual light exit angle, and the detection range of the light, in an embodiment of the present invention, it is necessary to determine the actual light exit point of the hybrid solid-state laser radar based on the reference point position of the hybrid solid-state laser radar and the position offset during actual installation. At the same time, it is also necessary to determine the actual exit angle of each light ray based on the exit angle (absolute angle) of each light ray determined above and the angular offset of the light ray when the hybrid solid-state laser radar is actually installed. Finally, based on the three factors of the light exit point, the actual exit angle of each light ray and the detection range, the laser beam of the hybrid solid-state laser radar is generated.

[0094] Since the embodiment of the present invention takes into account the position offset and angle offset of the hybrid solid-state laser radar during actual installation when generating the laser beam, the simulation process can be made more consistent with the actual radar detection process, thereby improving the simulation test accuracy of the hybrid solid-state laser radar.

[0095] S140: Determine point cloud data generated when the laser beam hits the surface of the target object.

[0096] The target object can be a pedestrian, a vehicle, an obstacle, etc., and the target object is the object that the laser beam hits first or is closest to the hybrid solid-state lidar. The point cloud data includes the intersection coordinates and detection distance between the laser beam and the target object, as well as the reflection intensity after the laser beam hits the target object.

[0097] For the embodiment of the present invention, after the laser beam is generated, if there are multiple objects in the surrounding environment, the distances between the hybrid solid-state laser radar and the multiple objects are calculated respectively. Then, the minimum distance is determined from the multiple calculated distances, and the object corresponding to the minimum distance is determined as the target object that the laser beam hits first or is closest to the hybrid solid-state laser radar. Then, the intersection coordinates and detection distance between the laser beam and the target object, as well as the reflection intensity after the laser beam hits the target object are calculated respectively, and finally the intersection coordinates, detection distance and reflection intensity are determined as point cloud data, and the point cloud data is output to the GPU's video memory, and the point cloud data is written to the shared memory SHM at the same time.

[0098] Because the embodiment of the present invention takes into account the existence of multiple objects in the surrounding environment during the simulation process, and selects the target object that the laser beam will hit first or is closest to the hybrid solid-state laser radar from the multiple objects, the simulation process can be made more consistent with the actual detection process of the hybrid solid-state laser radar, thereby improving the simulation test accuracy of the hybrid solid-state laser radar.

[0099] Furthermore, for the process of calculating the reflection intensity corresponding to the laser beam, as an optional implementation, the method includes: respectively determining the total incident energy, reflection energy ratio, material diffuse reflectivity, echo angle energy attenuation coefficient and echo path attenuation coefficient corresponding to the laser beam; multiplying the total incident energy, the reflection energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient to obtain the reflection intensity corresponding to the laser beam. The specific formula is as follows:

[0100] intensityDiffuse=intensity*(1.0-reflectionRayIntensity)*backReflectivity*

[0101] powf(hitToEyeAngle,uBackWidth)*tenPercentBackIntensity

[0102] Among them, intensityDiffuse is the reflection intensity, intensity is the total incident energy, reflectionRayIntensity is the reflection energy ratio, backReflectivity is the material diffuse reflectivity, powf(hitToEyeAngle,uBackWidth) is the echo angle energy attenuation coefficient, and tenPercentBackIntensity is the echo path attenuation coefficient.

[0103] Furthermore, for the determination process of the total incident energy corresponding to the laser beam, as an optional implementation, the method includes: respectively obtaining the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object; and calculating the total incident energy according to the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object. The specific formula is as follows:

[0104] intensity=prd.intensity*1.0 / (R*t_hit+1.0) 4

[0105] R = 0.7782794 / tenPercentDist

[0106] Among them, intensity is the total incident energy, which mainly considers the energy attenuation of the light from the exit point to the surface of the target object; prd.intensity is the initial energy of the light, and the initial value is 1; tenPercentDist is the distance traveled when the light intensity remains at the preset intensity, such as the distance traveled when the light intensity is only 10%; t_hit is the distance from the exit point to the surface of the target object.

[0107] Furthermore, as an optional implementation method for determining the reflected energy ratio corresponding to the laser beam, the method includes: respectively obtaining the material reflectivity and the cosine value of the angle between the light and the normal line of the plane where the target object is located; and calculating the reflected energy ratio according to the material reflectivity and the cosine value of the angle between the light and the normal line of the plane where the target object is located. The specific formula is as follows:

[0108] reflectionRayIntensity=reflectivity+(1-reflectivity)*(1-incidentAngle)

[0109] Among them, reflectionRayIntensity is the reflection energy ratio, reflectivity is the material reflectivity; incidentAngle is the cosine value of the angle between the light and the normal of the plane where the target object is located.

[0110] Furthermore, for the process of determining the echo angle energy attenuation coefficient corresponding to the laser beam, as an optional implementation, the method includes: obtaining the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, and the speed at which the energy decays along the incident angle; according to the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, and the speed at which the energy decays along the incident angle, determining the echo angle energy attenuation coefficient. The specific formula is as follows:

[0111] powf(hitToEyeAngle,uBackWidth)

[0112] Among them, hitToEyeAngle is the cosine value of the angle between the direction of light returning from the surface of the target object to the sensor and the normal of the plane where the target object is located, and uBackWidth is the speed at which energy decays along the incident angle. In the current project, both are set to 1 in the material file.

[0113] Furthermore, as an optional implementation, for the process of determining the echo path attenuation coefficient corresponding to the laser beam, the method includes: obtaining the distance from the contact point of the target object to the sensor; and determining the echo path attenuation coefficient corresponding to the laser beam according to the distance from the contact point of the target object to the sensor. The specific formula is as follows:

[0114] tenPercentBackIntensity=1.0 / (R*hitToEyeDistance+1.0) 4

[0115] R = 0.7782794 / tenPercentDist

[0116] Among them, tenPercentBackIntensity is the echo path attenuation coefficient; hitToEyeDistance is the distance that the light travels from the contact point of the target object back to the sensor; tenPercentDist is the distance traveled when the light intensity remains at the preset intensity, such as the distance traveled when the light intensity is only 10%.

[0117] Therefore, according to the above method, the reflection intensity of the laser beam after hitting the target object can be accurately calculated, thereby improving the rendering effect.

[0118] S150: Rendering the point cloud data into a simulation scene to implement point cloud simulation of the hybrid solid-state laser radar.

[0119] For the embodiment of the present invention, the developed point cloud visualization module is used to read the point cloud data from the shared memory, that is, the intersection coordinates between the laser beam and the target object, the detection distance, and the reflection intensity of the laser beam, and render the above data into the scene, so that the point cloud simulation effect of the laser radar can be intuitively seen, that is, the point cloud visualization is realized simultaneously with the simulation.

[0120] Furthermore, the embodiment of the present invention can also package and reorganize the point cloud data in the shared memory, and send the packaged and reorganized point cloud data to the controller for testing. For this process, the method includes: reorganizing and packaging the point cloud data according to the laser radar protocol to obtain the reorganized and packaged point cloud data; sending the reorganized and packaged point cloud data to the controller via Ethernet.

[0121] Specifically, the developed point cloud forwarding program module is used to read point cloud data from the shared memory, and the data header, data body, and data tail fields of the point cloud data packet are filled according to the point cloud data packaging rules in the transmission protocol of the hybrid solid-state laser radar. Then, the point cloud data is sent to the controller according to the transmission frequency specified in the transmission protocol. It can be seen that the embodiment of the present invention can not only realize the point cloud simulation of the hybrid solid-state laser radar, but also realize the point cloud data transmission of the hybrid solid-state laser radar.

[0122] Furthermore, an embodiment of the present invention can also simulate multiple hybrid solid-state laser radars at the same time. For this process, the method includes: when there are multiple hybrid solid-state laser radars, opening different threads to achieve communication between different hybrid solid-state laser radars and the controller.

[0123] Specifically, the embodiment of the present invention also supports the simulation of multiple hybrid solid-state laser radars. The simulation of multiple hybrid solid-state laser radars is achieved by opening different threads in the point cloud forwarding program. Each hybrid solid-state laser radar and the controller communicate with each other through Ethernet, so that multiple hybrid solid-state laser radars can detect environmental information at different locations around the vehicle, and the synchronization of detection information of multiple laser radars can be ensured.

[0124] The embodiment of the present invention is aimed at the urgent need for hybrid solid-state laser radar simulation modules in the current intelligent driving domain control HIL test system, combined with the simulation characteristics of the complex scanning rules of the hybrid solid-state laser radar, and generates the laser beam of the hybrid solid-state laser radar through the angle distribution table, and renders the point cloud data generated when the laser beam hits the surface of the target object into the simulation scene, which can realize the point cloud simulation of the hybrid solid-state laser radar. Since the simulation module provided by the present invention adds a point cloud visualization part, it is possible to render the point cloud image of the hybrid solid-state laser radar in real time in the simulation scene, thereby meeting the simulation test and demonstration requirements of the HIL system of the high-level intelligent driving domain controller. In addition, the embodiment of the present invention can replace the actual vehicle test and field test, with high test safety and short test cycle, which can greatly reduce the controller development iteration cycle.

[0125] Based on the above method embodiment, another embodiment of the present application further provides a hybrid solid-state laser radar simulation device, such as Figure 3 As shown, the device includes: an acquisition unit 21, a first determination unit 22, a generation unit 23, a second determination unit 24 and a rendering unit 25.

[0126] The acquisition unit 21 can be used to acquire an angle distribution table corresponding to a hybrid solid-state laser radar, wherein the angle distribution table contains angle parameters of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud.

[0127] The first determination unit 22 can be used to determine the emission angle of each light beam emitted by the hybrid solid-state laser radar according to the angle distribution table.

[0128] The generating unit 23 may be used to read the attribute information of the hybrid solid-state laser radar in the simulation scene, and generate a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle.

[0129] The second determining unit 24 may be used to determine point cloud data generated when the laser beam hits the surface of the target object.

[0130] The rendering unit 25 can be used to render the point cloud data into a simulation scene to achieve point cloud simulation of the hybrid solid-state laser radar.

[0131] In a specific application scenario, the acquisition unit 21 can be specifically used to obtain the angle information of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud; convert the angle information of each light ray according to the format requirements of the preset simulation software to obtain the angle parameters of each light ray; and generate the angle distribution table based on the angle parameters of each light ray.

[0132] In a specific application scenario, when the angle parameters of each light ray include the horizontal angle and the vertical angle of each light ray in the laser radar coordinate system, the first determination unit 22 can be specifically used to determine the exit angle of each light ray emitted by the hybrid solid-state laser radar according to the horizontal angle and the vertical angle of each light ray in the laser radar coordinate system in the angle distribution table.

[0133] In a specific application scenario, when the attribute information includes the reference point position, position offset, angle offset and detection range of the hybrid solid-state laser radar, the generation unit 23 can be specifically used to determine the light exit point corresponding to the hybrid solid-state laser radar based on the reference point position and the position offset; determine the actual exit angle of each light ray based on the exit angle and the angle offset; generate a laser beam corresponding to the hybrid solid-state laser radar based on the light exit point, the actual exit angle of each light ray and the detection range.

[0134] In a specific application scenario, the second determining unit 24 includes: a calculation module and a determination module.

[0135] The calculation module can be used to respectively calculate the intersection coordinates and the detection distance between the laser beam and the target object, and the reflection intensity corresponding to the laser beam.

[0136] The determination module may be configured to determine the point cloud data according to the intersection coordinates, the detection distance, and the reflection intensity.

[0137] In a specific application scenario, the calculation module includes: a determination submodule and a multiplication submodule.

[0138] The determination submodule can be used to respectively determine the total incident energy, the reflected energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient corresponding to the laser beam.

[0139] The multiplication submodule can be used to multiply the total incident energy, the reflected energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient to obtain the reflection intensity corresponding to the laser beam.

[0140] In a specific application scenario, the determination submodule can be specifically used to respectively obtain the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object; and calculate the total incident energy based on the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object.

[0141] In a specific application scenario, the determination submodule can also be used to obtain the material reflectivity and the cosine value of the angle between the light and the normal of the plane where the target object is located; and calculate the reflection energy ratio based on the material reflectivity and the cosine value of the angle between the light and the normal of the plane where the target object is located.

[0142] In a specific application scenario, the determination submodule can also be used to obtain the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, as well as the rate at which the energy decays along the incident angle; determine the echo angle energy attenuation coefficient based on the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, as well as the rate at which the energy decays along the incident angle.

[0143] In a specific application scenario, the determination submodule can also be used to obtain the distance from the contact point of the target object to the sensor; based on the distance from the contact point of the target object to the sensor, determine the echo path attenuation coefficient corresponding to the laser beam.

[0144] In a specific application scenario, the device further includes: a packaging unit and a sending unit.

[0145] The packaging unit can be used to reorganize and package the point cloud data according to the laser radar protocol to obtain reorganized and packaged point cloud data.

[0146] The sending unit can be used to send the reorganized and packaged point cloud data to the controller via Ethernet.

[0147] In a specific application scenario, the device further includes: an opening unit.

[0148] The opening unit can be used to open different threads when there are multiple hybrid solid-state laser radars to achieve communication between different hybrid solid-state laser radars and the controller.

[0149] It should be noted that for other corresponding descriptions of the functional modules involved in the hybrid solid-state laser radar simulation device provided in the embodiment of the present invention, reference can be made to Figure 1 The corresponding description of the method shown will not be repeated here.

[0150] Based on the above Figure 1 The method shown, accordingly, an embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method as described above is implemented.

[0151] Based on the above Figure 1 The method shown and Figure 3 An embodiment of the device shown, an embodiment of the present invention also provides an electronic device, which includes: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the memory and the processor are both arranged on a bus, and the processor implements the above method when executing the program.

[0152] The above-mentioned system and device embodiments correspond to the method embodiments and have the same technical effects as the method embodiments. For specific descriptions, please refer to the method embodiments. The device embodiments are obtained based on the method embodiments. For specific descriptions, please refer to the method embodiment part, which will not be repeated here. A person of ordinary skill in the art can understand that the accompanying drawings are only schematic diagrams of one embodiment, and the modules or processes in the accompanying drawings are not necessarily required to implement the present application.

[0153] Those skilled in the art can understand that the modules in the device in the embodiment can be distributed in the device in the embodiment according to the description of the embodiment, or can be changed accordingly and located in one or more devices different from the embodiment. The modules in the above embodiment can be combined into one module, or can be further divided into multiple sub-modules.

[0154] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A hybrid solid-state laser radar simulation method, characterized in that: The method comprises: Obtain an angle distribution table corresponding to a hybrid solid-state laser radar, wherein the angle distribution table includes angle parameters of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud; According to the angle distribution table, determining the exit angle of each light ray emitted by the hybrid solid-state laser radar; Reading the attribute information of the hybrid solid-state laser radar in the simulation scene, and generating a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle; determining point cloud data generated when the laser beam hits the surface of the target object; The point cloud data is rendered into a simulation scene to achieve point cloud simulation of the hybrid solid-state laser radar.

2. The method according to claim 1, characterized in that The obtaining of the angle distribution table corresponding to the hybrid solid-state laser radar includes: Obtaining angle information of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud; Convert the angle information of each light ray into a format according to the format requirements of the preset simulation software to obtain the angle parameters of each light ray; The angle distribution table is generated according to the angle parameters of each light ray.

3. The method according to claim 1, characterized in that When the angle parameters of each light ray include the horizontal angle and the vertical angle of each light ray in the laser radar coordinate system, determining the exit angle of each light ray emitted by the hybrid solid-state laser radar according to the angle distribution table includes: According to the horizontal angle and vertical angle of each light ray in the angle distribution table in the laser radar coordinate system, the emission angle of each light ray emitted by the hybrid solid-state laser radar is determined.

4. The method according to claim 1, characterized in that: When the attribute information includes the reference point position, position offset, angle offset and detection range of the hybrid solid-state laser radar, generating a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle includes: Determining a light emission point corresponding to the hybrid solid-state laser radar according to the reference point position and the position offset; Determining the actual emission angle of each light ray according to the emission angle and the angle offset; Generate a laser beam corresponding to the hybrid solid-state laser radar according to the light emission point, the actual emission angle of each light beam and the detection range; Determine point cloud data generated when the laser beam hits the surface of the target object, including: Calculating the intersection coordinates and the detection distance between the laser beam and the target object, and the reflection intensity corresponding to the laser beam; The point cloud data is determined according to the intersection coordinates, the detection distance and the reflection intensity.

5. The method according to claim 4, characterized in that Calculating the reflection intensity corresponding to the laser beam, including: Respectively determine the total incident energy, reflected energy ratio, material diffuse reflectivity, echo angle energy attenuation coefficient and echo path attenuation coefficient corresponding to the laser beam; The total incident energy, the reflected energy ratio, the material diffuse reflectivity, the echo angle energy attenuation coefficient and the echo path attenuation coefficient are multiplied to obtain the reflection intensity corresponding to the laser beam.

6. The method according to claim 5, characterized in that Determining the total incident energy corresponding to the laser beam includes: The initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the light exit point to the surface of the target object are obtained respectively; Calculating the total incident energy according to the initial energy of the light, the distance traveled when the light intensity remains at a preset intensity, and the distance from the exit point of the light to the surface of the target object; Determining the reflected energy ratio corresponding to the laser beam includes: Obtaining respectively the reflectivity of the material and the cosine value of the angle between the light and the normal line of the plane where the target object is located; Calculating the reflected energy ratio according to the reflectivity of the material and the cosine value of the angle between the light and the normal of the plane where the target object is located; Determining the echo angle energy attenuation coefficient corresponding to the laser beam includes: Obtaining the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, as well as the speed at which the energy decays along the incident angle; Determine the echo angle energy attenuation coefficient according to the cosine value of the angle between the direction of the light returning from the surface of the target object to the sensor and the normal line of the plane where the target object is located, and the speed at which the energy decays along the incident angle; Determining the echo path attenuation coefficient corresponding to the laser beam includes: Acquire the distance that the light travels from the contact point of the target object back to the sensor; The echo path attenuation coefficient corresponding to the laser beam is determined according to the distance of the light beam returning from the contact point of the target object to the sensor.

7. The method according to claim 1, characterized in that The method further comprises: Reorganize and package the point cloud data according to the laser radar protocol to obtain reorganized and packaged point cloud data; Sending the reorganized and packaged point cloud data to a controller via Ethernet; The method further comprises: When there are multiple hybrid solid-state laser radars, different threads are opened to achieve communication between different hybrid solid-state laser radars and the controller.

8. A hybrid solid-state laser radar simulation device, characterized in that: include: An acquisition unit, used to acquire an angle distribution table corresponding to the hybrid solid-state laser radar, wherein the angle distribution table includes angle parameters of each light ray emitted by the hybrid solid-state laser radar when scanning a frame of point cloud; A first determining unit, configured to determine, according to the angle distribution table, an emission angle of each light ray emitted by the hybrid solid-state laser radar; A generating unit, configured to read the attribute information of the hybrid solid-state laser radar in the simulation scene, and generate a laser beam corresponding to the hybrid solid-state laser radar based on the attribute information and the emission angle; A second determining unit, configured to determine point cloud data generated when the laser beam hits a surface of a target object; A rendering unit is used to render the point cloud data into a simulation scene to achieve point cloud simulation of the hybrid solid-state laser radar.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Simulation method and device of solid-state laser radar, computer equipment and medium

    CN120178697A

  • Simulation methods, devices, computer equipment and media for solid-state lidar

    CN120178697B