Laser emitting apparatus, lidar, and lidar control method
By using two laser emitting devices that generate discontinuous spots in lidar, crosstalk is identified and reduced, the problem of inaccurate lidar measurement information is solved and the measurement accuracy of object information is improved.
Patent Information
- Application Number
- PCT/CN2023/094627
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-16
- Publication Date
- 2024-11-21
AI Technical Summary
When existing lidars measure object information, the measured object information is often not accurate, resulting in a large difference between distance measurement and actual distance.
A laser emitting device is adopted, which includes two emission modules. Each module emits a laser beam at different times, generating discontinuous light spots, and receives echoes staggeredly to identify crosstalk, improving the accuracy of object information measured by the lidar sex.
By identifying and reducing crosstalk, the accuracy of object information measured by lidar is improved, errors are reduced, and the reliability of measurement results is enhanced.
Smart Images

Figure CN2023094627_21112024_PF_FP_ABST
Abstract
Description
Laser emitting device, laser radar and laser radar control method Technical Field
[0001] The present application relates to the field of laser technology, and in particular to a laser emitting device, a laser radar, and a control method for the laser radar. Background Art
[0002] LiDAR is used to emit a laser beam, receive the laser beam reflected from the object after the laser beam hits it (i.e., the echo), and measure relevant information about the object based on the echo, such as the distance between the object and the LiDAR.
[0003] However, when using LiDAR to measure object-related information, the measured object information is often inaccurate. For example, the distance between the object and the LiDAR measured by the LiDAR may differ significantly from the actual distance.
[0004] Summary of the Invention
[0005] The present application provides a laser emitting device, a laser radar, and a control method for the laser radar, which are used to solve the problem of low accuracy of object information measured by the laser radar in the prior art.
[0006] In a first aspect, the present application provides a laser emitting device that can be used in a laser radar. The laser emitting device may include a first emitting module and a second emitting module. The first emitting module is configured to generate a first light spot when emitting a laser beam during a first time period, and the second emitting module is configured to generate a second light spot when emitting a laser beam during a second time period, wherein the first time period and the second time period are different time periods; the first light spot is a discontinuous light spot, and the second light spot is a discontinuous light spot; the first light spot and the second light spot constitute a continuous light spot.
[0007] As an example, the light spot generated after the first emission module emits the laser beam may be as shown in (a) of FIG6 .
[0008] As an example, the light spot generated when the second emission module emits a laser beam may be as shown in (b) of FIG6 .
[0009] The first transmitting module and the second transmitting module emit laser beams at different times, so that the laser receiving module in the laser radar can stagger the received echo of the first light spot and the echo of the second light spot, thereby being able to identify at a same time whether the echo of the first light spot is crosstalked by the echo of the second light spot, which is beneficial to improving the accuracy of the object information measured by the laser radar.
[0010] In addition, the light spot generated when each transmitting module emits a laser beam is discontinuous, so that each echo received by the laser receiving module in the laser radar is also discontinuous, so that based on the coverage area of each echo of the first light spot, it is possible to determine whether a certain echo of the first light spot is affected by crosstalk from other echoes in the first light spot, and based on the coverage area of each echo of the second light spot, it is possible to determine whether a certain echo of the second light spot is affected by crosstalk from other echoes in the second light spot, which is beneficial to improving the accuracy of the object information measured by the laser radar.
[0011] In some possible implementations, the first emission module includes one or more laser arrays, and each laser array in the first emission module includes one or more array elements; the second emission module includes one or more laser arrays, and each laser array in the second emission module includes one or more array elements.
[0012] That is, the laser emitting device may include multiple laser arrays, the light spots generated by the laser beams emitted by each laser array are discontinuous, and the laser beams emitted by the multiple laser arrays in the laser emitting device may constitute a continuous light spot.
[0013] In some possible implementations, the first light spot is a plurality of discontinuous point light spots or line light spots, and the second light spot is a plurality of discontinuous point light spots or line light spots.
[0014] In some possible implementations, the multiple point spots or line spots in the first light spot are generated when different array elements in the first emitting module emit laser beams; the multiple point spots or line spots in the second light spot are generated when different laser array elements in the second emitting module emit laser beams.
[0015] In this method, multiple point spots or line spots in the first light spot are generated when different array elements in the first transmitting module emit laser beams, so that after the laser receiving module receives multiple discontinuous echoes of the first light spot, it can determine which point spot or line spot each echo corresponds to based on the echo of the first light spot, which is conducive to identifying whether each echo is affected by crosstalk from other echoes, thereby helping to improve the accuracy of object information measured by the lidar.
[0016] In some possible implementations, the second light spot is located in the interval between the first light spot.
[0017] The second light spot is located in the interval of the first light spot, so that the echo of the first light spot and the echo of the second light spot received by the laser receiving module alternate with each other, which is conducive to identifying whether the echo of the first light spot is crosstalked by the echo of the second light spot, and is conducive to identifying whether the echo of the second light spot is crosstalked by the echo of the first light spot, thereby helping to improve the accuracy of the object information measured by the laser radar.
[0018] In some possible implementations, the first emission module emits a first laser beam and a second laser beam, and the light spot generated by the first laser beam is discontinuous with the light spot generated by the second laser beam; the second emission module emits a third laser beam and a fourth laser beam, and the light spot generated by the third laser beam is discontinuous with the light spot generated by the fourth laser beam; the light spot generated by the third laser beam is located in the interval area between the light spot generated by the first laser beam and the light spot generated by the second laser beam, and the light spot generated by the second laser beam is located in the interval area between the light spot generated by the third laser beam and the light spot generated by the fourth laser beam.
[0019] In some possible implementations, the laser emitting device further includes an optical module, which is used to process the laser beam emitted by the first emitting module into discontinuous light spots, and the optical module is also used to process the laser beam emitted by the second emitting module into discontinuous light spots.
[0020] In this method, the first light spot can be made discontinuous, and the second light spot can be made discontinuous through the optical module, which is helpful for determining whether the echo of the first light spot and the echo of the second light spot are subject to crosstalk, thereby helping to improve the accuracy of the object information measured by the lidar.
[0021] In some possible implementations, there is a first offset between the optical axis of the first emitting module and the optical axis of the second emitting module.
[0022] The optical axis of the first emitting module may be equivalent to the symmetry axis of the first emitting module, and the optical axis is parallel to the direction in which the first emitting module emits the laser beam.
[0023] The optical axis of the second emitting module may be equivalent to the symmetry axis of the second emitting module, and the optical axis is parallel to the direction in which the second emitting module emits the laser beam.
[0024] There is a first offset between the optical axis of the first emitting module and the optical axis of the second emitting module, so that there can be a distance difference between the position of the light spot generated by the first emitting module and the position of the light spot generated by the second emitting module. This can avoid the light spots generated by the first emitting module and the second emitting module from overlapping, which is conducive to the alternation of the light spots generated by the first emitting module and the second emitting module.
[0025] In some possible implementations, there is a first offset between the center of the laser array of the first emission module and the center of the laser array of the second emission module.
[0026] There is a first offset between the center of the laser array of the first emission module and the center of the laser array of the second emission module, so that there can be a distance difference between the position of the light spot generated by the first emission module and the position of the light spot generated by the second emission module. This can avoid the overlap of the light spots generated by the first emission module and the second emission module, and is conducive to the alternation of the light spots generated by the first emission module and the second emission module.
[0027] In a second aspect, the present application provides a laser radar, which may include the laser emitting device and the laser receiving device of the first aspect.
[0028] In which, the laser receiving module is used to receive the echo and determine the echo information based on the received echo, the echo information is used to generate a point cloud data set, the point cloud data set includes multiple point cloud data, each point cloud data in the multiple point cloud data includes distance information and light intensity information, the distance information is used to indicate the distance between the spatial point and the laser radar, and the light intensity information is used to indicate the light intensity of the echo; the laser receiving module is also used to send the echo information.
[0029] In this method, echo information can be used to generate a point cloud dataset. The point cloud dataset contains multiple point cloud data. Each point cloud data can correspond to a spatial point. The point cloud data can include information such as the distance from the spatial point to the lidar, the laser intensity at the spatial point, and the position coordinates of the spatial point. Each point cloud data can correspond to a pixel in the point cloud image.
[0030] For each emission module, the coverage area of the laser beam emitted by the emission module can be called the ideal lighting area of the laser beam, and the area that cannot be covered by the laser beam can be called the ideal non-lighting area.
[0031] Since the coverage area of each laser beam emitted by each transmitting module is known, the position coordinates of each point cloud data can be used to determine whether the point cloud data is located in the ideal illuminated area of the laser beam or the ideal non-illuminated area of the laser beam. Based on the ideal illuminated area and the ideal non-illuminated area, it is helpful to determine whether the point cloud data is crosstalk data, which is beneficial to improve the accuracy of the lidar measurement of object information.
[0032] In a third aspect, the present application provides a method for controlling a laser radar. The laser radar may include the laser radar of the second aspect.
[0033] The control method of the laser radar may include: obtaining point cloud data to be processed, the point cloud data to be processed including a first distance and a first light intensity, the first distance being the distance between a first spatial point and the laser radar, the first distance being determined based on the time when a first transmitting module in a laser transmitting device transmits a second laser beam and the time when a laser receiving module receives a first echo, the first light intensity being the light intensity of the first echo, and the first spatial point being located within the spot of the second laser beam. Obtaining related point cloud data, the related point cloud data including first adjacent point cloud data, the first adjacent point cloud data including a second distance and a second light intensity, the second distance being the distance between a second spatial point and the laser radar, the second distance being determined based on the time when the second laser beam is transmitted and the time when the laser receiving module receives the second echo, the second light intensity being the light intensity of the second echo, and the second spatial point being located within the spot of the third laser beam. The target point cloud data set of the laser radar is determined based on the point cloud data to be processed and the related point cloud data, wherein when the difference between the first light intensity and the estimated crosstalk light intensity is less than or equal to the light intensity threshold, the target point cloud data set does not include the point cloud data to be processed, and the estimated crosstalk light intensity is associated with the first distance, the first light intensity, the light intensity in the related point cloud data, and the distance in the related point cloud data.
[0034] As an example, the point cloud data to be processed may correspond to the eighth square in the first point cloud image shown in Figure 7. The area at the position indicated by the point cloud data to be processed is the first ideal lighting area.
[0035] The area at the position indicated by the first adjacent point cloud data is a first ideal non-lighting area, and the first ideal non-lighting area is adjacent to the first ideal lighting area.
[0036] Taking Figure 7 as an example, when the point cloud data to be processed corresponds to the 8th square in the first point cloud image, the position indicated by the first adjacent point cloud data can be any one of squares 4, 5, 6, 10, 11, and 12 in the first point cloud image. For example, the position indicated by the first adjacent point cloud data can be square 5 in the first point cloud image.
[0037] In this method, the second echo may include a crosstalk echo generated when the first transmitting module emits the second laser beam. Thus, the number of crosstalk photons generated when the first transmitting module emits the second laser beam may include the second light intensity, and an estimated crosstalk light intensity for the point cloud data to be processed may be obtained based on the second light intensity.
[0038] In this method, when the difference between the first light intensity and the estimated crosstalk light intensity is less than or equal to the light intensity threshold, it indicates that the light intensity of the point cloud data to be processed is caused by crosstalk, that is, the point cloud data to be processed does not contain real image information. This way, each point cloud data in the target point cloud dataset contains real image information, which can reduce the impact of crosstalk and thus improve the accuracy of object information measured by the lidar.
[0039] In some possible implementations, the relevant point cloud data may also include second adjacent point cloud data, the second adjacent point cloud data includes a third distance and a third light intensity, the third distance is the distance between the third spatial point and the laser radar, the third distance is determined based on the sending time of the second laser beam and the time when the laser receiving module receives the third echo, the third light intensity is the light intensity of the third echo, and the third spatial point is located within the spot of the fourth laser beam.
[0040] The area at the position indicated by the second adjacent point cloud data is also the first ideal non-illuminated area, and the first ideal non-illuminated area corresponding to the second adjacent point cloud data is different from the first ideal non-illuminated area corresponding to the first adjacent point cloud data.
[0041] Taking FIG7 as an example, when the position indicated by the first adjacent point cloud data is square 5 in the first point cloud image, the position indicated by the second adjacent point cloud data can be any one of square 10, square 11, and square 12. For example, the position indicated by the second adjacent point cloud data can be square 11.
[0042] In this method, the third echo can include a crosstalk echo generated when the first transmitting module emits the second laser beam. Thus, the number of crosstalk photons generated when the first transmitting module emits the second laser beam can also include a third light intensity. Based on the third light intensity, an estimated crosstalk intensity of the point cloud data to be processed can be obtained, which facilitates determining whether the point cloud data to be processed contains a true image.
[0043] In some possible implementations, the related point cloud data may also include crosstalk point cloud data, and the crosstalk point cloud data includes a fourth distance and a fourth light intensity. The fourth distance is the distance between the fourth spatial point and the laser radar. The fourth distance is determined based on the sending time of the third laser beam and the time when the laser receiving module receives the fourth echo. The fourth light intensity is the light intensity of the fourth echo. The fourth spatial point is located within the spot of the second laser beam.
[0044] The area at the position indicated by the second adjacent point cloud data is a second ideal non-lighting area, and the second ideal non-lighting area overlaps with the first ideal non-lighting area.
[0045] Taking Figure 7 as an example, when the point cloud data to be processed corresponds to square 8 in the first point cloud image, the point cloud data corresponding to one or more of squares 7, 8, and 9 in the second point cloud image can be determined as crosstalk point cloud data. For example, the location indicated by the crosstalk point cloud data can be square 8 in the second point cloud image.
[0046] In this method, the fourth echo may include a crosstalk echo generated when the second transmitting module emits the third laser beam. Because the fourth echo is generated based on a fourth spatial point, and the fourth spatial point is located within the spot of the second laser beam, the number of photons obtained when the first transmitting module emits the second laser beam may include a fourth light intensity. Based on this fourth light intensity, an estimated crosstalk light intensity for the point cloud data to be processed can be obtained, which facilitates determining whether the point cloud data to be processed contains a true image.
[0047] In some possible implementations, the estimated crosstalk light intensity is associated with the first distance, the first light intensity, the light intensity in the relevant point cloud data, and the distance in the relevant point cloud data, including: the estimated crosstalk light intensity is the weighted sum of the light intensity in the relevant point cloud data, wherein the weight of the light intensity in the relevant point cloud data is associated with the difference between the distance in the relevant point cloud data and the first distance.
[0048] As an example, for any adjacent point cloud data to be processed, the weight of the light intensity in the adjacent point cloud data can be determined by two distances: one distance is the distance between the spatial point corresponding to the point cloud data to be processed and the lidar, and the other distance is the distance between the spatial point corresponding to the adjacent point cloud data and the lidar. The difference between the first distance and the second distance is less than or equal to the distance threshold.
[0049] For example, the weight of the light intensity in adjacent point cloud data of the point cloud data to be processed may be the ratio of the previous distance to the next distance.
[0050] Optionally, when the difference between the distance between the spatial point corresponding to the point cloud data to be processed and the laser radar and the distance between the spatial point corresponding to the adjacent point cloud data and the laser radar is greater than a preset distance threshold, the weight can be 0.
[0051] As an example, for any crosstalk point cloud data to be processed, the weight of the light intensity in the crosstalk point cloud data can also be determined by two distances: one distance is the distance between the spatial point corresponding to the processed point cloud data and the lidar, and the other distance is the distance between the spatial point corresponding to the crosstalk point cloud data and the lidar. The difference between the first distance and the second distance is less than or equal to the distance threshold.
[0052] For example, the weight of the light intensity in the crosstalk point cloud data of the to-be-processed point cloud data may be the ratio of the previous distance to the next distance.
[0053] Optionally, when the difference between the distance between the spatial point corresponding to the point cloud data to be processed and the laser radar and the distance between the spatial point corresponding to the crosstalk point cloud data of the first point cloud data and the laser radar is greater than a preset distance threshold, the weight can be 0.
[0054] In this method, after the weight of the light intensity in the relevant point cloud data is determined, the estimated crosstalk light intensity of the point cloud data to be processed can be obtained based on the weight of the light intensity in the relevant point cloud data, and then it can be judged whether the point cloud data to be processed contains a real image based on the estimated crosstalk light intensity.
[0055] In some possible implementations, after the weights of the adjacent point cloud data and the weights of the crosstalk point cloud data (which may be referred to as the second light intensity weights) are determined, the weights of the adjacent point cloud data and the weights of the crosstalk point cloud data may be normalized based on the first coordinate distance and the second coordinate distance to obtain the normalized weights.
[0056] Among them, the first coordinate distance can be the distance between the corresponding coordinate position of the adjacent point cloud data in the first point cloud map and the corresponding coordinate position of the point cloud data to be processed in the first point cloud map, and the second coordinate distance can be the distance between the corresponding coordinate position of the crosstalk point cloud data of the point cloud data to be processed in the second point cloud map and the corresponding coordinate position of the adjacent point cloud data of the crosstalk point cloud data in the second point cloud map.
[0057] In some possible implementations, the estimated crosstalk light intensity and the light intensity in the relevant point cloud data satisfy the following formula:
[0058] Among them, λ / represents the estimated crosstalk intensity, represents the weight of the light intensity of the first adjacent point cloud data, λ1 represents the second light intensity, represents the weight of the light intensity of the second adjacent point cloud data, λ2 represents the third light intensity, ω represents the weight of the light intensity of the crosstalk point cloud data, λ ω represents the fourth light intensity.
[0059] In this method, the estimated crosstalk light intensity is the number of photons in the crosstalk echo corresponding to the point cloud data to be processed. Based on the estimated crosstalk light intensity, it can be determined whether the point cloud data to be processed contains real image information, which is beneficial to improve the accuracy of the object information measured by the lidar.
[0060] In some possible implementations, the method may further include: controlling the first module in the laser emitting device to emit the first laser beam and the second laser beam in a first time period; controlling the second module in the laser emitting device to emit the third laser beam and the fourth laser beam in a second time period; and controlling the laser receiving module to receive laser beams.
[0061] Among them, the obtaining of the point cloud data to be processed and the obtaining of related point cloud data may include: receiving echo information, the echo information is determined by the laser receiving module based on the received echo, the echo information is used to generate a point cloud data set, the point cloud data set includes multiple point cloud data; obtaining the point cloud data to be processed and the obtaining of related point cloud data from the multiple point cloud data.
[0062] In this method, the first transmitting module and the second transmitting module transmit laser beams in different time periods, so that after the first transmitting module transmits the laser beam, it can be determined based on the laser beam received by the laser receiving module whether the received laser beam contains the crosstalk echo of the point cloud data to be processed in the first transmitting module, which is conducive to obtaining the estimated crosstalk light intensity of the point cloud data to be processed, and further conducive to determining whether the point cloud data to be processed contains real image information.
[0063] In addition, after the second transmitting module emits a laser beam, it can be determined based on the laser beam received by the laser receiving module whether the received laser beam contains the crosstalk echo of the point cloud data to be processed in the second transmitting module, which is conducive to obtaining the estimated crosstalk light intensity of the point cloud data to be processed, and further conducive to determining whether the point cloud data to be processed contains real image information.
[0064] In a fourth aspect, the present application provides a control device for a laser radar. The beneficial effects can be found in the description of the third aspect and are not further elaborated here. The device has the function of implementing the behaviors described in the method example of the third aspect. The functions can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.
[0065] In one possible design, the device includes: an acquisition module and a determination module.
[0066] In which, the acquisition module can be used to acquire point cloud data to be processed, and the point cloud data to be processed includes a first distance and a first light intensity, the first distance is the distance between the first spatial point and the laser radar, the first distance is determined based on the time when the first transmitting module in the laser transmitting device transmits the second laser beam and the time when the laser receiving module receives the first echo, the first light intensity is the light intensity of the first echo, and the first spatial point is located within the spot of the second laser beam.
[0067] The acquisition module can also be used to acquire relevant point cloud data, the relevant point cloud data includes first adjacent point cloud data, the first adjacent point cloud data includes a second distance and a second light intensity, the second distance is the distance between the second spatial point and the laser radar, the second distance is determined based on the sending time of the second laser beam and the time when the laser receiving module receives the second echo, the second light intensity is the light intensity of the second echo, and the second spatial point is located in the spot of the third laser beam.
[0068] The determination module can be used to determine the target point cloud data set of the lidar based on the cloud data to be processed and the first adjacent point cloud data, wherein when the difference between the first light intensity and the estimated crosstalk light intensity is less than the light intensity threshold, the target point cloud data set does not include the point cloud data to be processed, and the estimated crosstalk light intensity is associated with the first distance, the first light intensity, the light intensity in the related point cloud data, and the distance in the related point cloud data.
[0069] Optionally, the device may further include a control module.
[0070] The control module can be used to control the first emission module in the laser emission device to emit the first laser beam and the second laser beam in a first time period.
[0071] The control module can also be used to control the second emission module in the laser emission device to emit the third laser beam and the fourth laser beam in the second time period.
[0072] The control module can also be used to control the laser receiving module to receive the laser beam.
[0073] Accordingly, when the acquisition module is used to acquire the point cloud data to be processed and the related point cloud data, the acquisition module can be used to: acquire the point cloud data to be processed and the related point cloud data based on the information of the laser received by the laser receiving module.
[0074] In a fifth aspect, the present application provides a control device for a laser radar. The device includes a communication interface and a processor, and optionally, a memory. The memory is used to store computer programs or instructions. The processor is coupled to the memory and the communication interface. When the processor executes the computer program or instructions, the device executes the method performed by the terminal device in the above method embodiment.
[0075] In a sixth aspect, the present application provides a computer-readable storage medium, which stores a program code for controlling the execution of a device, wherein the program code includes instructions for implementing the method in the third aspect.
[0076] In a seventh aspect, the present application provides a computer program product comprising instructions, which, when executed on a control device, enables the control device to implement the method in the third aspect.
[0077] It can be understood that the effects that can be obtained in the fourth to seventh aspects can be referred to the description in the second aspect and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0078] FIG1 is a schematic diagram of a laser radar;
[0079] FIG2 is a schematic diagram of a light spot formed on an object by a laser beam emitted by a transmitting module;
[0080] FIG3 is a schematic structural diagram of a laser radar 300 according to an embodiment of the present application;
[0081] FIG4 is a schematic structural diagram of an optical module 3103 provided in one embodiment of the present application;
[0082] FIG5 is a schematic diagram of a light spot on an object after the first emission module 3101 emits a laser beam according to an embodiment of the present application;
[0083] FIG6 is a schematic diagram of the position of a light spot formed when a laser radar 300 is irradiated onto an object according to an embodiment of the present application;
[0084] FIG7 is a schematic diagram of a first point cloud image and a second point cloud image provided by an embodiment of the present application;
[0085] FIG8 is a schematic diagram of a control method of a laser radar 300 provided in one embodiment of the present application;
[0086] FIG9 is a schematic structural diagram of a control device for a laser radar according to an embodiment of the present application;
[0087] FIG10 is a schematic structural diagram of a control device of a laser radar provided in another embodiment of the present application. DETAILED DESCRIPTION
[0088] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.
[0089] To facilitate a clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. For example, the first information and the second information are merely used to distinguish different information and do not limit their order. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity or execution order, and words such as "first" and "second" do not necessarily limit differences.
[0090] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c; a and b; a and c; b and c; or a, b, and c. Among them, a, b, and c can be single or multiple.
[0091] LiDAR can be used in a variety of scenarios, such as surveying and mapping, remote sensing, autonomous driving, drones, robot navigation, and marine science research.
[0092] There are many types of LiDAR. For example, based on the carrier platform, LiDAR can be divided into handheld LiDAR, ground-mounted LiDAR, vehicle-mounted mobile LiDAR, airborne LiDAR, ship-mounted LiDAR, satellite-mounted LiDAR, etc.
[0093] According to the laser emission waveform, lidar can include pulse lidar, continuous wave lidar and hybrid lidar.
[0094] According to the laser medium, laser radar can include all-solid-state laser radar, gas laser radar, semiconductor laser radar, and diode laser pumped solid-state laser radar.
[0095] According to the laser band classification, lidar can include ultraviolet lidar, visible light lidar and infrared lidar.
[0096] The technical solution of the present application can be applied to any of the aforementioned laser radars, especially to all-solid-state laser radars.
[0097] Figure 1 is a schematic diagram of the system architecture of a laser radar. As shown in Figure 1 , the laser radar 100 includes a transmitting module 110, a receiving module 120, a signal processing unit 130, and a control unit 140. Transmitting module 110 includes an array 1130 and an optical module 1120. Array 1130 may include at least one array element 1110.
[0098] The array element 1110 is a component that emits a laser beam. For example, the array element 1110 may be a laser driver.
[0099] Optical module 1120 is used to collimate the light beam incident upon it, adjusting the divergence angle of the received light beam and outputting the resulting light beam after the adjustment. Optical module 1120 may include one or more optical lenses. For ease of description, the light obtained by the optical module through collimation is referred to as collimated light in the following text.
[0100] In the transmitting module 110 of this embodiment, the positions of the array element 1110 and the optical module 1120 should meet the following conditions: the laser beam emitted by the array element 1110 can irradiate the optical module 1120, and the divergence angle of the collimated light output by the optical module 1120 is smaller than the divergence angle of the laser beam irradiating the optical module.
[0101] After the laser beam emitted by the emission module 110 is irradiated on an object, a light spot is formed on the object. Figure 2 is a schematic diagram of a light spot formed when the laser beam emitted by the emission module is irradiated on an object.
[0102] As shown in Figure 2, the laser beam emitted by array element 1110 forms collimated light with a small divergence angle after passing through optical module 1120. After the laser beams emitted by multiple array elements 1110 pass through optical module 1120 and illuminate an object, they produce a continuous plurality of light spots. The term "continuous plurality of light spots" here can be understood as meaning that the two light spots generated by the laser beams emitted by at least two adjacent array elements 1110, upon irradiating the object through optical module 1120, at least partially overlap.
[0103] When the collimated light output by the optical module 1120 is irradiated on an object, an echo is generated.
[0104] The receiving module 120 is used to receive the laser beam and process the received laser beam, such as performing optical filtering and / or photoelectric conversion, etc. The laser beam received by the receiving module 120 includes an echo generated when the collimated light output by the optical module 1120 is irradiated on an object.
[0105] The receiving module 120 may determine echo information based on the received laser beam, for example, determine the receiving time of the laser beam, the intensity of the received laser beam, etc.
[0106] After determining the echo information, the receiving module 120 may also send the echo information to the signal processing unit 130 .
[0107] For the sake of simplicity, in the following content, the time it takes for the receiving module 120 to receive the laser beam is referred to as the echo time, and the intensity of the laser beam received by the receiving module 120 is referred to as the echo intensity.
[0108] Optionally, receiving module 120 may also determine the distance between the location on the object where the laser beam emitted by transmitting module 110 illuminates the object and the lidar based on the time when transmitting module 110 emits the laser beam and the time when receiving module 120 receives the laser beam. For simplicity, the distance between the location on the object where the laser beam emitted by transmitting module 110 illuminates the object and the lidar is referred to as the echo distance in the following text.
[0109] After determining the echo distance, the receiving module 120 may also send the echo distance to the signal processing unit 130 .
[0110] Optionally, the laser radar 100 may include a sensor system 150. The sensor system 150 may include several sensors that sense environmental information about the laser radar 100 and position information of the laser radar 100. For example, the sensor system may include an inertial measurement unit (IMU) 151, an odometer (DMI) 152, and a positioning system 153.
[0111] The IMU can be used to sense changes in the position and orientation of the laser radar 100 based on inertial acceleration. In some examples, the IMU can be a combination of an accelerometer and a gyroscope. The DMI can be used to estimate the position and orientation of the laser radar 100. The positioning system 153 can be used to estimate the geographic location of the laser radar 100. In some embodiments, the positioning system can be a global positioning system (GPS), a Beidou system, or other positioning systems.
[0112] After the sensor system obtains the environmental information and position information of the laser radar 100, it can send the environmental information and position information to the signal processing unit 130.
[0113] The signal processing unit 130 is used to generate a point cloud data set based on the echo information output by the receiving module 120 and the environmental information and position information output by the sensor system 150. The point cloud data set contains multiple point cloud data. Each point cloud data may include the intensity information of the echo generated by a laser beam sent by the transmitting module 110 and irradiated on an object, the time information from the laser beam being emitted from the transmitting module 110 to being received by the receiving module 120, the echo distance and coordinate information, etc.
[0114] Optionally, the echo distance may also be determined by the signal processing unit 130 based on the time when the transmitting module 110 transmits the laser beam and the time when the receiving module 120 receives the laser beam.
[0115] The method for the signal processing unit 130 to generate a point cloud data set based on the echo information, the environmental information and the position information can be referred to in the prior art and will not be described in detail here.
[0116] The control unit 140 is used to control the transmitting module 110 , the receiving module 120 , the signal processing unit 130 and the sensor system to perform related operations.
[0117] During the use of the LiDAR 100, it was found that the point cloud images generated by the LiDAR 100 often have problems such as crosstalk, which leads to inaccurate LiDAR measurement results and a series of related problems. For example, vehicle-mounted LiDAR may cause vehicle driving safety issues.
[0118] After research by the inventors, it was found that the reasons for the inaccurate measurement problem of the laser radar 100 are as follows: in the process of the receiving module 130 receiving the echo generated by a laser beam in the laser radar 100, it may also receive light waves emitted by other laser radars and / or receive echoes generated by light waves emitted by other laser radars, or receive echoes generated by other laser beams in the laser radar.
[0119] In response to the technical problem of low accuracy of the above-mentioned laser radar, this application provides a new technical solution to improve the measurement accuracy of the laser radar.
[0120] The present application provides a laser emitting device that can be used in a laser radar. The laser emitting device can include M emitting modules, wherein the mth emitting module of the M emitting modules includes array elements with Tm rows and Sm columns, where M is an integer greater than 1, Tm and Sm are positive integers, and m is an integer ranging from 1 to M.
[0121] In the present application, array elements or arrays that emit laser beams at the same time are components of one emission module, and array elements or arrays that emit laser beams at different times are components of different emission modules.
[0122] For example, assume that a laser emitting device includes two emitting modules, one of which includes a first array element and a second array element, and the other includes a third array element and a fourth array element. The first array element and the second array element emit laser beams at the same time, the third array element and the fourth array element emit laser beams at the same time, and the first array element and the third array element emit laser beams at different times.
[0123] When an emitting module includes multiple array elements, the laser beams emitted by the multiple array elements in the emitting module can generate multiple light spots, and these multiple light spots do not overlap with each other, or in other words, two adjacent light spots in the multiple light spots are discontinuous, or in other words, there is a gap between two adjacent light spots in the multiple light spots.
[0124] In the laser emitting device of the present application, the multiple light spots formed by the multiple laser beams emitted by any emitting module are located in the intervals between the multiple light spots formed by the multiple laser beams emitted by other emitting modules. Optionally, the light spots corresponding to different emitting modules may partially overlap.
[0125] In the laser emitting device of the present application, the light spots formed by the laser beams emitted by the M emitting modules can constitute continuous light spots.
[0126] The following describes a laser radar system with two transmitting modules as an example. For ease of description, one of the two transmitting modules will be referred to as the first transmitting module, and the other as the second transmitting module.
[0127] Figure 3 is a schematic diagram of a laser radar 300 according to one embodiment of the present application. As shown in Figure 3 , the laser radar 300 may include a laser emitting device 310, a laser receiving module 320, a signal processing unit 330, a sensor system 340, and a control unit 350. Specifically, the laser emitting device 310 includes a first emitting module 3101 and a second emitting module 3102.
[0128] In this embodiment, the first emission module 3101 may include one or more laser arrays, and each laser array in the first emission module 3101 may include one or more array elements.
[0129] In this embodiment, the second emission module 3102 may include one or more laser arrays, and each laser array in the second emission module 3102 may include one or more array elements.
[0130] The array element is a component that emits a laser beam. For example, the array element can be a laser actuator.
[0131] In the following, this application will be described by taking the example that the first emission module 3101 includes a laser array and the second emission module 3102 includes a laser array.
[0132] In this embodiment, the first emission module can generate a first light spot when emitting a laser beam in a first time period, and the second emission module can generate a second light spot when emitting a laser beam in a second time period. The first time period and the second time period are different time periods.
[0133] The first light spot is a discontinuous light spot. In some embodiments, the first light spot can be a plurality of discontinuous point light spots or line light spots. The plurality of point light spots or line light spots in the first light spot can be generated when different array elements in the first emission module 3101 emit laser beams.
[0134] The second light spot is a discontinuous light spot. In some embodiments, the second light spot can be a plurality of discontinuous point light spots or line light spots. The plurality of point light spots or line light spots in the second light spot can be generated when different array elements in the second emission module 3102 emit laser beams.
[0135] The first light spot and the second light spot may constitute a continuous light spot. In one example, the second light spot is located in the interval of the first light spot.
[0136] As an example, assume that the first emission module 3101 emits the first laser beam and the second laser beam, and the light spot generated by the first laser beam is discontinuous with the light spot generated by the second laser beam. The second emission module 3102 emits the third laser beam and the fourth laser beam, and the light spot generated by the third laser beam is discontinuous with the light spot generated by the fourth laser beam. In this example, the first light spot includes the light spot generated by the first laser beam and the light spot generated by the second laser beam, and the second light spot includes the light spot generated by the third laser beam and the light spot generated by the fourth laser beam. Optionally, the second light spot is located in the interval of the first light spot, which can be understood as: the light spot generated by the third laser beam can be located in the interval area between the light spot generated by the first laser beam and the light spot generated by the second laser beam, and the light spot generated by the second laser beam can be located in the interval area between the light spot generated by the third laser beam and the light spot generated by the fourth laser beam.
[0137] Optionally, the laser emitting device 310 may further include an optical module 3103, which may be used to process the laser beam emitted by the first emitting module 3101 into discontinuous light spots. The optical module 3103 may also be used to process the laser beam emitted by the second emitting module 3102 into discontinuous light spots.
[0138] Optionally, there may be one or more optical modules 3103. When there is only one optical module 3103, it can simultaneously process the laser beams emitted by the first emission module 3101 and the second emission module 3012. When there are multiple optical modules 3103, some of them can process the laser beam emitted by the first emission module 3101, while other optical modules can process the laser beam emitted by the second emission module 3012.
[0139] The optical module is used to collimate the light beam incident thereon, that is, to adjust the divergence angle of the received light beam and output the light beam obtained after the divergence angle is adjusted.
[0140] In the present application, when the laser array includes multiple array elements, the optical module is used to collimate the multiple light beams irradiated thereon and output the multiple light beams obtained after adjusting the divergence angle, so that after these multiple light beams are irradiated onto the object, multiple light spots can be formed, and these multiple light spots do not overlap with each other.
[0141] In the first emitting module 3101 of this embodiment, the positions of the array elements and the optical module should meet the following conditions: the laser beam emitted by at least one array element can irradiate the optical module, the divergence angle of the collimated light output by the optical module is smaller than the divergence angle of the laser beam irradiating the optical module, and the at least one light spot formed after the at least one array element irradiates the object does not overlap with each other.
[0142] 4 is a schematic diagram of the structure of an optical module 3103 provided in one embodiment of the present application. In this embodiment, the optical module 3103 may include an optical lens 1, a first cylindrical lens 2, and a second cylindrical lens 3.
[0143] The optical lens 1 can be used to collimate the laser beam irradiated thereon to obtain a first collimated light, wherein the divergence angle of the first collimated light is smaller than the divergence angle of the laser beam irradiated on the optical lens 1 .
[0144] The first cylindrical lens 2 can be used to collimate the first collimated light incident on it again to obtain a second collimated light. The divergence angle of the second collimated light in the first dimension is smaller than the divergence angle of the first collimated light in the first dimension, and the divergence angle of the second collimated light in the second dimension is equal to the divergence angle of the first collimated light in the second dimension.
[0145] The second cylindrical lens 3 can be used to collimate the second collimated light incident thereon again to obtain a third collimated light. The divergence angle of the third collimated light in the first dimension is equal to the divergence angle of the second collimated light in the first dimension, and the divergence angle of the third collimated light in the second dimension is greater than the divergence angle of the second collimated light in the second dimension.
[0146] Taking the coordinate system OXYZ shown in Figure 4 as an example, the first dimension can be a longitudinal dimension, which can be parallel to the direction of the Z axis, the second dimension can be a transverse dimension, which can be parallel to the direction of the X axis, and the Y axis represents the direction in which the first emitting module 3101 emits the laser beam.
[0147] Optionally, after the first emitting module 3101 emits the laser beam, the light spot irradiated on the object may be as shown in Figure 5. In Figure 5, the oval filled with oblique lines represents a light spot.
[0148] It is understandable that the elliptical shape of the light spot is only an example, and the present application does not limit the size and shape of the light spot, as long as the light spots do not overlap with each other.
[0149] In this embodiment, the first emission module 3101 includes a plurality of array elements. After the laser beams emitted by the plurality of array elements pass through the optical module 3103 , a plurality of light spots can be formed on the object, and the plurality of light spots do not overlap with each other.
[0150] Optionally, the angle of each of the multiple light spots in the non-scanning direction can be between Fov / (m*n) and Fov / m. Fov represents the field of view of the first transmitting module 3101, m represents the number of light spots that can be formed by the first transmitting module 3101, which can be equivalent to the number of array elements in the first transmitting module 3101, and n represents the number of transmitting modules in the lidar. In this embodiment, n can be 2.
[0151] The non-scanning direction may represent the arrangement direction of the array elements in the first emitting module 3101. Accordingly, the angle of the light spot in the non-scanning direction may be represented as the angle between the lines connecting the two boundary points of the light spot in the non-scanning direction and the first emitting module 3101.
[0152] In this embodiment, the structure and functions of each component in the second transmitting module 3102 can refer to the first transmitting module 3101 and will not be repeated here.
[0153] In this embodiment, the viewing angle ranges of the first transmitting module 3101 and the second transmitting module 3102 may partially or completely overlap, and the light spots generated by the laser beams emitted by the first transmitting module 3101 and the second transmitting module 3102 may alternate with each other.
[0154] Here, the light spots generated by the laser beams emitted by the first emission module 3101 and the second emission module 3102 alternate with each other, which can be understood as follows: the light spots generated by the laser beam emitted by the second emission module 3102 can be located in the interval area between the light spots generated by the laser beam emitted by the first emission module 3101, and the light spots generated by the laser beam emitted by the first emission module 3101 can be located in the interval area between the light spots generated by the laser beam emitted by the second emission module 3102.
[0155] When the light spots generated by the laser beams emitted by the first emitting module 3101 and the second emitting module 3102 alternate with each other, the deflection angle between the first emitting module 3101 and the second emitting module 3102 may be k*Fov / (m*n), where k is a positive integer.
[0156] The deflection angle between the first transmitting module 3101 and the second transmitting module 3102 can be understood as the angle difference between the first angle and the second angle, where the first angle can be the angle between the direction of the laser beam emitted by the i-th array element in the first transmitting module 3101 and the optical axis of the first transmitting module 3101, and the second angle can be the angle between the direction of the laser beam emitted by the i-th array element in the second transmitting module 3102 and the optical axis of the second transmitting module 3102.
[0157] The optical axis of the first emitting module 3101 may be equivalent to the symmetry axis of the first emitting module 3101 , and the optical axis is parallel to the direction in which the first emitting module 3101 emits the laser beam.
[0158] The optical axis of the second emitting module 3102 may be equivalent to the symmetry axis of the second emitting module 3102 , and the optical axis is parallel to the direction in which the second emitting module 3102 emits the laser beam.
[0159] In this embodiment, there may be a first offset between the optical axis of the first emitting module 3101 and the optical axis of the second emitting module 3102 , so as to avoid the light spots generated by the first emitting module 3101 and the second emitting module 3102 from overlapping.
[0160] In one implementation, the first transmitting module 3101 may be offset by a certain distance along the arrangement direction of its array elements, so that there is a first offset between the optical axis of the first transmitting module 3101 and the optical axis of the second transmitting module 3102 .
[0161] In another implementation, the second transmitting module 3102 may be offset by a certain distance along the arrangement direction of its array elements, so that a first offset exists between the optical axis of the first transmitting module 3101 and the optical axis of the second transmitting module 3102 .
[0162] Optionally, there may be a first offset between the center of the array of the first emission module 3101 and the center of the array of the second emission module 3102. This can prevent the light spots generated by the first emission module 3101 and the second emission module 3102 from overlapping.
[0163] In one implementation, the array of the first transmitting module 3101 may be offset by a certain distance relative to the optical axis of the first transmitting module 3101 , so that a first offset exists between the center of the array of the first transmitting module 3101 and the center of the array of the second transmitting module 3012 .
[0164] In another implementation, the array of the second transmitting module 3102 can be offset by a certain distance relative to the optical axis of the second transmitting module 3102 , so that there is a first offset between the center of the array of the first transmitting module 3101 and the center of the array of the second transmitting module 3012 .
[0165] FIG6 is a schematic diagram of the position of a light spot formed when the laser radar 300 provided in one embodiment of the present application illuminates an object.
[0166] Among them, (a) in Figure 6 can represent the position of the light spot formed on the object when the laser beam emitted by the first emission module 3101 is irradiated, (b) in Figure 6 can represent the position of the light spot formed on the object when the laser beam emitted by the second emission module 3102 is irradiated, and (c) in Figure 6 can represent the position of the light spot formed on the object when the laser beam emitted by the first emission module 3101 and the second emission module 3102 are irradiated.
[0167] In the present application, the first transmitting module 3101 and the second transmitting module 3102 transmit in a time-sharing manner, for example, they can transmit alternately. Here, alternate transmission can be understood as the first transmitting module 3101 transmitting a laser beam, and after a period of time, the second transmitting module 3102 transmits a laser beam again, and after another period of time, the first transmitting module 3101 transmits a laser beam again, and so on.
[0168] The laser receiving module 320 can be used to receive a laser beam and process the received laser beam, such as performing optical filtering and / or photoelectric conversion.
[0169] Optionally, the first transmitting module 3101 transmits a laser beam, and the laser receiving module 320 receives the laser beam; the second transmitting module 3102 transmits a laser beam, and the laser receiving module 320 receives the laser beam.
[0170] After the first transmitting module 3101 transmits a laser beam, the echo received by the laser receiving module 320 may include an echo generated by the laser beam emitted by the first transmitting module 3101 after it irradiates an object, may also include other crosstalk echoes, or may include both an echo generated by the laser beam emitted by the first transmitting module 3101 after it irradiates an object and other crosstalk echoes. It is understandable that after the first transmitting module 3101 transmits a laser beam, the laser receiving module 320 may not receive any echo.
[0171] Similarly, after the second transmitting module 3102 transmits a laser beam, the echo received by the laser receiving module 320 may include an echo generated by the laser beam emitted by the second transmitting module 3102 after it irradiates an object, may also include other crosstalk echoes, or may include both an echo generated by the laser beam emitted by the second transmitting module 3102 after it irradiates an object and other crosstalk echoes. It is understandable that after the second transmitting module 3102 transmits a laser beam, the laser receiving module 320 may not receive any echo.
[0172] In this embodiment, after the first transmitting module 3101 or the second transmitting module 3102 transmits a laser beam, if the laser receiving module 320 receives the laser beam, the laser receiving module 320 can determine echo information based on the received echo and send the echo information. The echo information may include the time the laser beam was received, the intensity of the received laser beam, etc.
[0173] In some embodiments, the laser receiving module 320 may send the echo information to the signal processing unit 330. In other embodiments, the laser receiving module 320 may send the echo information to a controller, which may be disposed outside the laser radar 300.
[0174] Signal processing unit 330 receives the echo information and generates a point cloud dataset based on the echo information, the environment information, and the location information of LiDAR 300. The point cloud dataset contains multiple point cloud data, each of which corresponds to a spatial point. The point cloud data may include information such as the distance from the spatial point to the LiDAR, the laser intensity at the spatial point, and the location coordinates of the spatial point.
[0175] In one implementation of the embodiment of the present application, the laser radar can generate three point cloud data for one echo received by the laser receiving module 320.
[0176] The signal processing unit 340 may also generate a point cloud image based on the point cloud data set. Each point cloud data corresponds to a pixel point in the point cloud image, or in other words, a pixel point may be generated based on one point cloud data.
[0177] Optionally, the laser radar generates three point cloud data for one echo received by the receiving module, which can be understood as: for each laser beam emitted by each transmitting module, the laser radar can generate three pixel points for the echo received by the laser receiving module.
[0178] In the embodiment of the present application, the coverage area of the laser beam emitted by each emission module can be called the ideal lighting area of the laser beam, and the area that cannot be covered by the laser beam can be called the ideal non-lighting area.
[0179] In the embodiment of the present application, the coverage area of each laser beam emitted by each emitting module is known, so based on the position of each pixel point, it can be determined whether the pixel point is located in the ideal illuminated area of the laser beam or the ideal non-illuminated area of the laser beam.
[0180] After first transmitting module 3101 emits a laser beam, signal processing unit 330 in the lidar can generate a point cloud dataset based on the echo received by laser receiving module 320. Furthermore, signal processing unit 330 can generate a point cloud image based on this point cloud dataset. For ease of description, this point cloud dataset is referred to as the first point cloud dataset, and this point cloud image is referred to as the first point cloud image.
[0181] After second transmitting module 3102 emits a laser beam, signal processing unit 330 can generate a point cloud dataset based on the echo received by laser receiving module 320. Furthermore, signal processing unit 330 can generate a point cloud image based on this point cloud dataset. For ease of description, this point cloud dataset is referred to as the second point cloud dataset, and this point cloud image is referred to as the second point cloud image.
[0182] An example of the first point cloud is shown in Figure 7(a), and an example of the second point cloud is shown in Figure 7(b). In the point cloud shown in Figure 7, each small square represents a pixel. A small square filled with a diagonal line indicates that the pixel is located in the ideal illuminated area of the laser beam emitted by the transmitting module, and a blank small square indicates that the pixel is located in the ideal non-illuminated area of the laser beam emitted by the transmitting module.
[0183] After acquiring the first and second point cloud datasets, the signal processing unit 330 can obtain a target point cloud dataset based on the first and second point cloud datasets. The target point cloud dataset includes point cloud data from the first and second point cloud datasets that meets specified conditions. For ease of description, the point cloud data from the first point cloud dataset that meets the specified conditions is referred to as first point cloud data, and the point cloud data from the second point cloud dataset that meets the specified conditions is referred to as second point cloud data.
[0184] For the convenience of description, in the embodiment of the present application, the adjacent ideal non-illuminated area of the ideal illuminated area where the position indicated by the first point cloud data is located is referred to as the adjacent ideal non-illuminated area of the first point cloud data, the point cloud data located in the adjacent ideal non-illuminated area of the first point cloud data is referred to as the adjacent point cloud data of the first point cloud data, and the point cloud data in the second point cloud data that falls into the ideal illuminated area corresponding to the first point cloud data is referred to as the crosstalk point cloud data of the first point cloud data.
[0185] The adjacent ideal non-illuminated area of the first point cloud data may include all or part of the adjacent ideal non-illuminated area of the ideal illuminated area at the position indicated by the first point cloud data. For example, when the position indicated by the first point cloud data is the second light spot area in (a) of Figure 6, the adjacent ideal non-illuminated area of the first point cloud data includes the area between the first light spot area and the second light spot area, and the area between the second light spot area and the third light spot area.
[0186] The first point cloud data meeting the specified conditions can be understood as: the position indicated by the first point cloud data is located in the ideal lighting area of the laser beam of the first transmitting module, the difference between the light intensity indicated by the first point cloud data and the estimated crosstalk light intensity at the position indicated by the first point cloud data is greater than or equal to the light intensity threshold, and the estimated crosstalk light intensity at the position indicated by the first point cloud data can be determined based on the light intensity in the adjacent point cloud data of the first point cloud data and / or the light intensity in the crosstalk point cloud data of the first point cloud data.
[0187] For example, a weighted summation may be performed on the light intensities in the adjacent point cloud data of the first point cloud data and / or the light intensities in the crosstalk point cloud data of the first point cloud data, thereby obtaining the estimated crosstalk light intensity at the position indicated by the first point cloud data.
[0188] As an example, for any first point cloud data, the estimated crosstalk light intensity at the position indicated by the first point cloud data can be determined based on formula (1):
[0189] Wherein, λ represents the estimated crosstalk intensity of the first point cloud data, represents the weight of the light intensity of the i-th adjacent point cloud data of the first point cloud data, λ i represents the light intensity in the i-th adjacent point cloud data, ω represents the weight of the light intensity of the crosstalk point cloud data of the first point cloud data, and λ ω Represents the light intensity in the crosstalk point cloud data.
[0190] In one possible implementation, for any adjacent point cloud data of a first point cloud data, the weight of the light intensity in the adjacent point cloud data of the first point cloud data can be determined by two distances: one distance is the distance between the spatial point corresponding to the first point cloud data and the lidar, and the other distance is the distance between the spatial point corresponding to the adjacent point cloud data and the lidar. The difference between the first distance and the second distance is less than or equal to the distance threshold.
[0191] As an example, the weight of the light intensity in the adjacent point cloud data of the first point cloud data can be the ratio of the previous distance to the next distance. The weight of the light intensity in the adjacent point cloud data of the first point cloud data can be called the first light intensity weight.
[0192] Optionally, when the difference between the distance between the spatial point corresponding to the first point cloud data and the laser radar and the distance between the spatial point corresponding to the adjacent point cloud data and the laser radar is greater than a preset distance threshold, the first light intensity weight can be 0.
[0193] The weight of the light intensity in the crosstalk point cloud data of the first point cloud data can also be determined by two distances: one distance is the distance between the spatial point corresponding to the first point cloud data and the laser radar, and the other distance is the distance between the spatial point corresponding to the crosstalk point cloud data and the laser radar. The difference between the first distance and the second distance is less than or equal to the distance threshold.
[0194] As an example, the light intensity weight in the crosstalk point cloud data of the first point cloud data may be a ratio of a previous distance to a next distance. The light intensity weight in the crosstalk point cloud data of the first point cloud data may be referred to as a second light intensity weight.
[0195] Optionally, when the difference between the distance between the spatial point corresponding to the first point cloud data and the laser radar and the distance between the spatial point corresponding to the crosstalk point cloud data of the first point cloud data and the laser radar is greater than a preset distance threshold, the second light intensity weight can be 0.
[0196] In this case, the first light intensity weight can be used as the weight of the light intensity of the adjacent point cloud data, and the second light intensity weight can be used as the weight of the light intensity of the crosstalk point cloud data. The estimated crosstalk light intensity is determined based on the first light intensity weight and the second light intensity weight.
[0197] In another possible implementation, after the first light intensity weight is determined, the first light intensity weight may be normalized based on the first coordinate distance and the second coordinate distance to obtain a third light intensity weight.
[0198] Among them, the first coordinate distance can be the distance between the coordinate position corresponding to the adjacent point cloud data in the first point cloud map and the coordinate position corresponding to the first point cloud data in the first point cloud map, and the second coordinate distance can be the distance between the coordinate position corresponding to the crosstalk point cloud data of the first point cloud data in the second point cloud map and the coordinate position corresponding to the adjacent point cloud data of the crosstalk point cloud data in the second point cloud map.
[0199] Optionally, after the second light intensity weight is determined, the second light intensity weight may be normalized based on the first coordinate distance and the second coordinate distance to obtain a fourth light intensity weight.
[0200] In this case, the third light intensity weight can be used as the weight of the light intensity of the adjacent point cloud data, and the fourth light intensity weight can be used as the weight of the light intensity of the crosstalk point cloud data. The estimated crosstalk light intensity is determined based on the third light intensity weight and the fourth light intensity weight.
[0201] Optionally, the estimated crosstalk light intensity at the position indicated by the first point cloud data can be determined based on the light intensity in the adjacent point cloud data of the first point cloud data and / or the light intensity in the crosstalk point cloud data of the first point cloud data, and may include: the estimated crosstalk light intensity at the position indicated by the first point cloud data may be the sum of the light intensity in the adjacent point cloud data of the first point cloud data and / or the light intensity in the crosstalk point cloud data of the first point cloud data.
[0202] The specified conditions satisfied by the second point cloud data are similar to the specified conditions satisfied by the first point cloud data, except that the first of the specified conditions satisfied by the first point cloud data is replaced by the second, and the second is replaced by the first.
[0203] Next, this application will introduce a method for obtaining first point cloud data from a first point cloud dataset in conjunction with FIG. 8 .
[0204] FIG8 is a schematic diagram of a control method for a laser radar 300 according to an embodiment of the present application. As shown in FIG8 , the method may include S801 to S807.
[0205] Optionally, the method may be executed by the signal processing unit 330 in FIG. 3 .
[0206] Optionally, the method may also be performed by a controller. The controller may be deployed outside the laser radar 300. In some embodiments, the controller may also be a processor, a chip used in a controller, or a chip used in a processor.
[0207] S801, obtaining point cloud data to be processed from a first point cloud data set, where a position indicated by the point cloud data to be processed is located in a first ideal lighting area of a first transmitting module.
[0208] In this embodiment, the first transmitting module may be the first transmitting module 3101 in the embodiment shown in FIG. 3 .
[0209] In this embodiment, the ideal lighting area of the first transmitting module 3101 includes a first ideal lighting area, which is an area in the ideal lighting area of the first transmitting module 3101 that includes the position indicated by the point cloud data to be processed.
[0210] Taking FIG. 7 as an example, it is assumed that the point cloud data to be processed corresponds to the 8th square in the first point cloud image.
[0211] In this embodiment, before obtaining the point cloud data to be processed from the first point cloud data set, the first transmitting module 3101 is controlled to emit the first laser beam and the second laser beam in the first time period, the second transmitting module 3102 is controlled to emit the third laser beam and the fourth laser beam in the second time period, the first time period and the second time period are different time periods, and the laser receiving module 320 is controlled to receive the echo.
[0212] The light spot generated by the first laser beam is discontinuous with the light spot generated by the second laser beam, and the light spot generated by the third laser beam is discontinuous with the light spot generated by the fourth laser beam.
[0213] The light spot generated by the third laser beam may be located in the interval between the light spots generated by the first laser beam and the second laser beam, and the light spot generated by the second laser beam may be located in the interval between the light spots generated by the third laser beam and the fourth laser beam.
[0214] In this embodiment, obtaining the point cloud data to be processed may include: receiving echo information, where the echo information is determined by the laser receiving module 320 based on the received echo, and the echo information is used to generate a first point cloud data set; and obtaining the point cloud data to be processed from the first point cloud data set.
[0215] In this embodiment, the point cloud data to be processed may include a first distance and a first light intensity, wherein the first distance may be the distance between the first spatial point and the laser radar 300, and the first spatial point may be located within the light spot generated by the second laser beam.
[0216] The laser receiving module 320 can form the point cloud data to be processed based on the first echo. The first distance can be determined based on the time when the first transmitting module 3101 emits the second laser beam and the time when the laser receiving module 320 receives the first echo. The first light intensity can be the light intensity of the first echo. Here, the light intensity of the first echo can be understood as the light intensity in the first echo that forms the point cloud data to be processed, that is, it is used to indicate the number of photons corresponding to the point cloud data to be processed.
[0217] S802, obtaining adjacent point cloud data of the point cloud data to be processed from the first point cloud data set, where the position indicated by the adjacent point cloud data is located in the first ideal non-illuminated area of the first transmitting module, and the first ideal non-illuminated area is adjacent to the first ideal illuminated area.
[0218] Optionally, the number of the first ideal non-lighting area may be one or two.
[0219] Optionally, one adjacent point cloud data set, two adjacent point cloud data sets, a plurality of adjacent point cloud data sets, or zero adjacent point cloud data sets may be obtained for the point cloud data to be processed from the first point cloud data set.
[0220] Optionally, the difference between the distance indicated by the adjacent point cloud data and the distance indicated by the to-be-processed point cloud data is less than or equal to the distance threshold. The distance indicated by the adjacent point cloud data refers to the distance between the spatial point corresponding to the adjacent point cloud data and the laser radar 300, and the distance indicated by the to-be-processed point cloud data refers to the distance between the spatial point corresponding to the to-be-processed point cloud data and the laser radar 300.
[0221] Taking Figure 7 as an example, when the point cloud data to be processed corresponds to square 8 in the first point cloud image, one or more corresponding point cloud data in squares 4, 5, 6, 10, 11 and 12 in the first point cloud image can be determined as adjacent point cloud data.
[0222] In a possible implementation, the adjacent point cloud data may include first adjacent point cloud data.
[0223] Taking Figure 7 as an example, the position indicated by the first adjacent point cloud data may be any one of squares 4, 5, 6, 10, 11, and 12 in the first point cloud image. For example, the position indicated by the first adjacent point cloud data may be square 5 in the first point cloud image.
[0224] In this embodiment, the first adjacent point cloud data may include a second distance and a second light intensity, wherein the second distance may be the distance between the second spatial point and the laser radar 300, and the second spatial point may be located within the light spot generated by the third laser beam.
[0225] The laser receiving module 320 can form the first adjacent point cloud data based on the second echo. The second distance can be determined based on the time when the first transmitting module 3101 emits the second laser beam and the time when the laser receiving module 320 receives the second echo. The second light intensity can be the light intensity of the second echo. Here, the light intensity of the second echo can be understood as the light intensity in the second echo that forms the first adjacent point cloud data, that is, it is used to indicate the number of photons corresponding to the first adjacent point cloud data.
[0226] It can be understood that the second echo may include a crosstalk echo generated when the first transmitting module 3101 transmits the second laser beam.
[0227] In another possible implementation, the adjacent point cloud data may further include second adjacent point cloud data.
[0228] The position indicated by the second adjacent point cloud data and the position indicated by the first adjacent point cloud data may be different first ideal non-lighting areas.
[0229] Taking FIG7 as an example, when the position indicated by the first adjacent point cloud data is square 5 in the first point cloud image, the position indicated by the second adjacent point cloud data can be any one of square 10, square 11, and square 12. For example, the position indicated by the second adjacent point cloud data can be square 11.
[0230] In this embodiment, the second adjacent point cloud data may include a third distance and a third light intensity, wherein the third distance may be the distance between the third spatial point and the laser radar 300, and the third spatial point may be located within the light spot generated by the fourth laser beam.
[0231] The laser receiving module 320 can form the second adjacent point cloud data based on the third echo. The third distance can be determined based on the time when the first transmitting module 3101 emits the second laser beam and the time when the laser receiving module 320 receives the third echo. The third light intensity can be the light intensity of the third echo. Here, the light intensity of the third echo can be understood as the light intensity in the third echo that forms the second adjacent point cloud data, that is, it is used to indicate the number of photons corresponding to the second adjacent point cloud data.
[0232] It can be understood that the third echo may include a crosstalk echo generated when the first transmitting module 3101 transmits the second laser beam.
[0233] S803, obtaining crosstalk point cloud data of the point cloud data to be processed from the second point cloud data set, where the position indicated by the crosstalk point cloud data is located within the second ideal non-illuminated area of the second transmitting module, and the second ideal non-illuminated area overlaps with the first ideal illuminated area.
[0234] In this embodiment, the second transmitting module may be the second transmitting module 3102 in the embodiment shown in FIG. 3 .
[0235] Optionally, one crosstalk point cloud data, two crosstalk point cloud data, a plurality of crosstalk point cloud data or zero crosstalk point cloud data may be obtained from the second point cloud data set for the point cloud data to be processed.
[0236] Optionally, the difference between the distance indicated by the crosstalk point cloud data and the distance indicated by the to-be-processed point cloud data is less than or equal to a distance threshold. The distance indicated by the crosstalk point cloud data refers to the distance between the spatial point corresponding to the crosstalk point cloud data and the laser radar.
[0237] Taking Figure 7 as an example, when the point cloud data to be processed corresponds to square 8 in the first point cloud image, the point cloud data corresponding to one or more of squares 7, 8, and 9 in the second point cloud image can be determined as crosstalk point cloud data. For example, the location indicated by the crosstalk point cloud data can be square 8 in the second point cloud image.
[0238] In this embodiment, the crosstalk point cloud data may include a fourth distance and a fourth light intensity, wherein the fourth distance may be the distance between the fourth spatial point and the laser radar 300 , and the fourth spatial point may be located within the light spot generated by the second laser beam.
[0239] The laser receiving module 320 can generate the crosstalk point cloud data based on the fourth echo. The fourth distance can be determined based on the time when the second transmitting module 3102 emits the third laser beam and the time when the laser receiving module 320 receives the fourth echo. The fourth light intensity can be the light intensity of the fourth echo. Here, the light intensity of the fourth echo can be understood as the light intensity in the fourth echo that generates the crosstalk point cloud data, that is, it is used to indicate the number of photons corresponding to the crosstalk point cloud data.
[0240] It can be understood that the fourth echo may include a crosstalk echo generated when the second transmitting module 3102 transmits the third laser beam.
[0241] S804 : Determine a first light intensity weight according to the distance indicated by the point cloud data to be processed and the distance indicated by the adjacent point cloud data, where the first light intensity weight is the weight of the light intensity indicated by the adjacent point cloud data.
[0242] In this embodiment, the first light intensity weight may be used to determine an estimated crosstalk light intensity at a position indicated by the point cloud data to be processed based on the light intensity indicated by the adjacent point cloud data.
[0243] Optionally, the first light intensity weight may include one, two, multiple or zero. The number of the first light intensity weights is the same as the number of adjacent point cloud data, and one adjacent point cloud data may correspond to one first light intensity weight.
[0244] As an example, the first light intensity weight corresponding to a piece of adjacent point cloud data may be the ratio of the distance indicated by the point cloud data to be processed to the distance indicated by the adjacent point cloud data.
[0245] In a possible implementation, when the adjacent point cloud data includes first adjacent point cloud data, the first light intensity weight corresponding to the first adjacent point cloud data can be taken as the ratio of the distance indicated by the point cloud data to be processed to the distance indicated by the first adjacent point cloud data.
[0246] In another possible implementation, when the adjacent point cloud data includes second adjacent point cloud data, the first light intensity weight corresponding to the second adjacent point cloud data can be taken as the ratio of the distance indicated by the point cloud data to be processed to the distance indicated by the second adjacent point cloud data.
[0247] S805 , determining a second light intensity weight according to the distance indicated by the to-be-processed point cloud data and the distance indicated by the crosstalk point cloud data, where the second light intensity weight is the weight of the light intensity indicated by the crosstalk point cloud data.
[0248] In this embodiment, the second light intensity weight may be used to determine an estimated crosstalk light intensity at a position indicated by the to-be-processed point cloud data based on the light intensity indicated by the crosstalk point cloud data.
[0249] Optionally, the second light intensity weight may include one, two, multiple or zero. The number of the second light intensity weights is the same as the number of crosstalk point cloud data, and one crosstalk point cloud data may correspond to one second light intensity weight.
[0250] As an example, the second light intensity weight corresponding to a piece of crosstalk point cloud data may be a ratio of the distance indicated by the to-be-processed point cloud data to the distance indicated by the crosstalk point cloud data.
[0251] S806 , determining an estimated crosstalk light intensity at a position indicated by the point cloud data to be processed based on the first light intensity weight, the second light intensity weight, the light intensity indicated by the adjacent point cloud data, and the light intensity indicated by the crosstalk point cloud data.
[0252] In one possible implementation, the light intensity indicated by the adjacent point cloud data and the light intensity indicated by the crosstalk point cloud data can be weighted and summed based on the first light intensity weight and the second light intensity weight, respectively, to obtain the estimated crosstalk light intensity at the position indicated by the point cloud data to be processed.
[0253] As an example, assuming that the relevant point cloud data of the point cloud data to be processed includes the first point cloud data, the second point cloud data, and the crosstalk point cloud data, the estimated crosstalk light intensity at the position indicated by the point cloud data to be processed can be determined based on formula (2):
[0254] Among them, λ / represents the estimated crosstalk light intensity at the location indicated by the point cloud data to be processed, represents the weight of the light intensity of the first adjacent point cloud data, λ1 represents the light intensity indicated by the first adjacent point cloud data, represents the weight of the light intensity of the second adjacent point cloud data, λ2 represents the light intensity indicated by the second adjacent point cloud data, ω represents the weight of the light intensity of the crosstalk point cloud data, λ ω Indicates the light intensity indicated by the crosstalk point cloud data.
[0255] In this example, the weight of the light intensity of the first adjacent point cloud data is the first light intensity weight of the first adjacent point cloud data described above, and the light intensity indicated by the first adjacent point cloud data is the second light intensity described above; the weight of the light intensity of the second adjacent point cloud data is the first light intensity weight of the second adjacent point cloud data described above, and the light intensity indicated by the second adjacent point cloud data is the third light intensity described above; the weight of the light intensity of the crosstalk point cloud data is the second light intensity weight described above, and the light intensity indicated by the crosstalk point cloud data is the fourth light intensity described above.
[0256] In another possible implementation, after the first light intensity weight is determined, the first light intensity weight can be normalized to obtain a third light intensity weight; after the second light intensity weight is determined, the second light intensity weight can be normalized to obtain a fourth light intensity weight; then, based on the third light intensity weight and the fourth light intensity weight, the light intensities indicated by the adjacent point cloud data and the light intensities indicated by the crosstalk point cloud data are weighted and summed, thereby obtaining the estimated crosstalk light intensity at the position indicated by the point cloud data to be processed.
[0257] For example, the first light intensity weight and the second light intensity weight may be normalized based on the first coordinate distance and the second coordinate distance, respectively, to obtain the third light intensity weight and the fourth light intensity weight.
[0258] Among them, the first coordinate distance can be the distance between the coordinate position corresponding to the adjacent point cloud data in the first point cloud map and the coordinate position corresponding to the first point cloud data in the first point cloud map, and the second coordinate distance can be the distance between the coordinate position corresponding to the crosstalk point cloud data of the first point cloud data in the second point cloud map and the coordinate position corresponding to the adjacent point cloud data of the crosstalk point cloud data in the second point cloud map.
[0259] As an example, when the adjacent point cloud data includes first adjacent point cloud data and second adjacent point cloud data, the first coordinate distance can be the sum of the two coordinate distances, where the first coordinate distance is the distance between the coordinate position corresponding to the first adjacent point cloud data in the first point cloud map and the coordinate position corresponding to the first point cloud data in the first point cloud map, and the second coordinate distance is the distance between the coordinate position corresponding to the second adjacent point cloud data in the first point cloud map and the coordinate position corresponding to the first point cloud data in the first point cloud map.
[0260] At this time, when determining the third light intensity weight, you can first determine the sum of the third light intensity weights of the first adjacent point cloud data and the second adjacent point cloud data based on the first coordinate distance and the second coordinate distance, and then determine the third light intensity weights of the first adjacent point cloud data and the second adjacent point cloud data based on the two coordinate distances in the first coordinate distance.
[0261] As an example, the sum of the third light intensity weights may be determined based on formula (3):
[0262] in, represents the sum of the third light intensity weights of the first and second adjacent point cloud data, α1 represents the sum of the first light intensity weights of the first and second adjacent point cloud data, s1 represents the first ratio, α2 represents the second light intensity weight, and s2 represents the second ratio. The first ratio is equal to the ratio of the second coordinate distance to the sum of the first and second coordinate distances, and the second ratio is equal to the ratio of the first coordinate distance to the sum of the first and second coordinate distances.
[0263] Furthermore, the third light intensity weight of the first adjacent point cloud data can be determined based on formula (4):
[0264] in, represents the third light intensity weight of the first adjacent point cloud data, and s3 represents the ratio of the second coordinate distance in the first coordinate distance to the first coordinate distance.
[0265] The third light intensity weight of the second adjacent point cloud data can be determined based on formula (5):
[0266] in, represents the third light intensity weight of the second adjacent point cloud data, and s4 represents the ratio of the first coordinate distance in the first coordinate distance to the first coordinate distance.
[0267] As an example, the fourth light intensity weight may be determined based on formula (6):
[0268] Wherein, ω represents the fourth light intensity weight.
[0269] In this example, the weight of the light intensity of the first adjacent point cloud data is the third light intensity weight of the first adjacent point cloud data described above; the weight of the light intensity of the second adjacent point cloud data is the third light intensity weight of the second adjacent point cloud data described above; and the weight of the light intensity of the crosstalk point cloud data is the fourth light intensity weight described above.
[0270] Optionally, in some embodiments, the related point cloud data of the point cloud data to be processed may include any one or more of first adjacent point cloud data, second adjacent point cloud data, and crosstalk point cloud data.
[0271] S807 : Determine whether the point cloud data to be processed is first point cloud data based on the estimated crosstalk light intensity and the light intensity indicated by the point cloud data to be processed.
[0272] In this embodiment, the method for determining whether the target point cloud data set contains the point cloud data to be processed based on the estimated crosstalk light intensity and the light intensity indicated by the point cloud data to be processed may include: comparing the estimated crosstalk light intensity with the light intensity indicated by the point cloud data to be processed; if the difference between the estimated crosstalk light intensity and the light intensity indicated by the point cloud data to be processed is less than or equal to the light intensity threshold, it indicates that the point cloud data to be processed does not contain real image information, and the point cloud data to be processed is not the first point cloud data, that is, the target point cloud data set does not contain the point cloud data to be processed; if the estimated crosstalk light intensity and the light intensity indicated by the point cloud data to be processed are greater than the light intensity threshold, it indicates that the point cloud data to be processed contains real image information, and the point cloud data to be processed is the first point cloud data, that is, the point cloud data to be processed is contained in the target point cloud data set. Optionally, in the technical solution of the present application, it is also necessary to obtain second point cloud data from the second point cloud data set. The method for obtaining the second point cloud data from the second point cloud data set is the same as the method for obtaining the first point cloud data from the first point cloud data set, and will not be repeated here.
[0273] In the present application, after acquiring the first point cloud data and the second point cloud data, the laser radar can obtain a target point cloud dataset based on the first point cloud data and the second point cloud data, and then generate a target point cloud image based on the target point cloud dataset. Since the first point cloud data is the point cloud data containing real image information in the first point cloud dataset, and the second point cloud data is the point cloud data containing real image information in the second point cloud dataset, each point cloud data in the target point cloud dataset obtained based on the first point cloud data and the second point cloud data contains real image information, which can improve the accuracy of the laser radar measurement.
[0274] FIG9 is a schematic diagram of the structure of a control device for a laser radar provided by an embodiment of the present application. As shown in FIG9 , the control device 900 for the laser radar includes an acquisition module 901 and a determination module 902 .
[0275] As an example, the control device 900 may be used to implement the processing method of the embodiment shown in Figure 8. The acquisition module 901 may be used to execute S801 to S803, and the determination module 902 may be used to execute S804 to S807.
[0276] FIG10 is a schematic diagram of the structure of a control device for a laser radar provided in another embodiment of the present application. As shown in FIG10 , the control device 1000 for the laser radar may include a processor 1001 and an interface circuit 1002. The processor 1001 and the interface circuit 1002 are coupled to each other. It is understood that the interface circuit 1002 may be a transceiver or an input / output interface. Optionally, the control device 1000 may also include a memory 1003 for storing instructions executed by the processor 1001, or storing input data required by the processor 1001 to execute instructions, or storing data generated after the processor 1001 executes instructions.
[0277] As an example, the processor 1001 may be configured to implement the functions of the determination module 902. The interface circuit 1002 may be configured to implement the functions of the acquisition module 901.
[0278] The control device 1000 may be a controller, or a chip used in a controller.
[0279] In the present application, the first transmitting module 3101 and the second transmitting module 3102 of the laser radar 300 can also send laser beams in the same time period.
[0280] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.
[0281] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium can be located in an ASIC. In addition, the ASIC can be located in an access network device or a terminal device. Of course, the processor and storage medium can also exist as discrete components in the access network device or the terminal device.
[0282] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the embodiment of the present application is executed in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program or instruction may be stored in a computer-readable storage medium or transmitted via the computer-readable storage medium. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a tape; it may also be an optical medium, such as a DVD; it may also be a semiconductor medium, such as a solid state disk (SSD).
[0283] In the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.
[0284] It is understood that the various numbers used in the embodiments of this application are merely for ease of description and are not intended to limit the scope of the embodiments of this application. The order of the sequence numbers of the above-mentioned processes does not necessarily imply a specific order of execution; the order of execution of the processes should be determined by their functions and inherent logic.
Claims
1. A laser emitting device, characterized in that: The laser emitting device is applied to a laser radar, and the laser emitting device comprises a first emitting module and a second emitting module; The first emission module is used to generate a first light spot when emitting a laser beam in a first time period, and the second emission module is used to generate a second light spot when emitting a laser beam in a second time period, and the first time period and the second time period are different time periods; The first light spot is a discontinuous light spot, and the second light spot is a discontinuous light spot; The first light spot and the second light spot form a continuous light spot.
2. The device according to claim 1, characterized in that The first emission module includes one or more laser arrays, and each laser array in the first emission module includes one or more array elements; The second emission module includes one or more laser arrays, and each laser array in the second emission module includes one or more array elements.
3. The device according to claim 1 or 2, characterized in that: The first light spot is a plurality of discontinuous point light spots or line light spots, and the second light spot is a plurality of discontinuous point light spots or line light spots.
4. The device according to claim 3, characterized in that The plurality of point light spots or line light spots in the first light spot are generated when different array elements in the first emission module emit laser beams; The multiple point light spots or line light spots in the second light spot are generated when different laser array elements in the second emission module emit laser beams.
5. The device according to any one of claims 1 to 4, characterized in that The second light spot is located in the interval of the first light spot.
6. The device according to any one of claims 1 to 5, characterized in that The first emission module emits a first laser beam and a second laser beam, and the light spot generated by the first laser beam is discontinuous with the light spot generated by the second laser beam; The second emission module emits a third laser beam and a fourth laser beam, and the light spot generated by the third laser beam is discontinuous with the light spot generated by the fourth laser beam; The light spot generated by the third laser beam is located in the interval area between the light spot generated by the first laser beam and the light spot generated by the second laser beam, and the light spot generated by the second laser beam is located in the interval area between the light spot generated by the third laser beam and the light spot generated by the fourth laser beam.
7. The device according to any one of claims 1 to 6, characterized in that The laser emitting device further comprises an optical module, wherein the optical module is used to process the laser beam emitted by the first emitting module into a discontinuous light spot, and the optical module is also used to process the laser beam emitted by the second emitting module into a discontinuous light spot.
8. The device according to any one of claims 1 to 7, characterized in that There is a first offset between the optical axis of the first emitting module and the optical axis of the second emitting module.
9. The device according to any one of claims 1 to 7, characterized in that There is a first offset between the center of the laser array of the first emission module and the center of the laser array of the second emission module.
10. A laser radar, characterized in that: It comprises a laser emitting device and a laser receiving module as claimed in any one of claims 1 to 9; The laser receiving module is used to receive the echo and determine the echo information based on the received echo, the echo information is used to generate a point cloud data set, the point cloud data set includes a plurality of point cloud data, each point cloud data in the plurality of point cloud data includes distance information and light intensity information, the distance information is used to indicate the distance between the spatial point and the laser radar, and the light intensity information is used to indicate the light intensity of the echo; The laser receiving module is also used to send the echo information.
11. A laser radar control method, characterized in that: The laser radar comprises the laser radar as claimed in claim 10, and the method comprises: Acquire point cloud data to be processed, wherein the point cloud data to be processed includes a first distance and a first light intensity, wherein the first distance is the distance between the first spatial point and the laser radar, the first distance is determined based on the time when the first transmitting module in the laser transmitting device transmits the second laser beam and the time when the laser receiving module receives the first echo, the first light intensity is the light intensity of the first echo, and the first spatial point is located within the spot of the second laser beam; Acquire relevant point cloud data, wherein the relevant point cloud data includes first adjacent point cloud data, wherein the first adjacent point cloud data includes a second distance and a second light intensity, wherein the second distance is a distance between a second spatial point and the laser radar, wherein the second distance is determined based on a sending time of the second laser beam and a time when the laser receiving module receives a second echo, wherein the second light intensity is a light intensity of the second echo, and the second spatial point is located within a light spot of a third laser beam; The target point cloud data set of the laser radar is determined based on the point cloud data to be processed and the related point cloud data, wherein when the difference between the first light intensity and the estimated crosstalk light intensity is less than the light intensity threshold, the target point cloud data set does not include the point cloud data to be processed, and the estimated crosstalk light intensity is associated with the first distance, the first light intensity, the light intensity in the related point cloud data and the distance in the related point cloud data.
12. The method according to claim 11, characterized in that The related point cloud data also includes second adjacent point cloud data, and the second adjacent point cloud data includes a third distance and a third light intensity. The third distance is the distance between the third spatial point and the laser radar, and the third distance is determined based on the sending time of the second laser beam and the time when the laser receiving module receives the third echo. The third light intensity is the light intensity of the third echo, and the third spatial point is located in the spot of the fourth laser beam.
13. The method according to claim 11 or 12, characterized in that: The related point cloud data also includes crosstalk point cloud data, which includes a fourth distance and a fourth light intensity. The fourth distance is the distance between the fourth spatial point and the laser radar. The fourth distance is determined based on the sending time of the third laser beam and the time when the laser receiving module receives the fourth echo. The fourth light intensity is the light intensity of the fourth echo. The fourth spatial point is located in the spot of the second laser beam.
14. The method according to claim 13, characterized in that The estimated crosstalk light intensity is associated with the first distance, the first light intensity, the light intensity in the relevant point cloud data, and the distance in the relevant point cloud data, including: The estimated crosstalk light intensity is a weighted sum of the light intensities in the relevant point cloud data, wherein the weight of the light intensities in the relevant point cloud data is associated with a difference between a distance in the relevant point cloud data and the first distance.
15. The method according to claim 14, characterized in that The estimated crosstalk light intensity and the light intensity in the relevant point cloud data satisfy the following formula: Among them, λ / represents the estimated crosstalk intensity, represents the weight of the light intensity of the first adjacent point cloud data, λ1 represents the second light intensity, represents the weight of the light intensity of the second adjacent point cloud data, λ2 represents the third light intensity, ω represents the weight of the light intensity of the crosstalk point cloud data, λ ω represents the fourth light intensity.
16. The method according to any one of claims 11 to 15, characterized in that The method further comprises: Controlling a first emission module in the laser emission device to emit the first laser beam and the second laser beam in a first time period; Controlling the second emission module in the laser emission device to emit the third laser beam and the fourth laser beam in the second time period; Controlling the laser receiving module to receive echo; Wherein, the obtaining of the point cloud data to be processed and the obtaining of the related point cloud data include: Receive echo information, the echo information is determined by the laser receiving module based on the received echo, the echo The information is used to generate a point cloud data set, wherein the point cloud data set includes a plurality of point cloud data; The point cloud data to be processed and related point cloud data are obtained from the plurality of point cloud data.
17. A laser radar control device, characterized in that: The apparatus comprises modules for implementing the method according to any one of claims 11 to 16.
18. A laser radar control device, characterized in that: The device includes a memory and a processor; The memory is used to store program instructions; The processor is configured to call the program instructions in the memory to execute the method according to any one of claims 11 to 16.
19. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program code for computer execution, wherein the program code includes instructions for implementing the method according to any one of claims 11 to 16.
20. A computer program product, characterized in that The computer program product comprises instructions which, when executed, cause a computer to perform the method of any one of claims 11 to 16.
Citation Information
Patent Citations
Laser radar and laser radar control method
CN107153182A
Transmitting unit of laser radar, laser radar and ranging method
CN113176555A
Synchronized image capturing for electronic scanning lidar systems
CN114096883A
Distance information acquisition system
CN114624722A
Signal processing method and apparatus, and signal transmission method and apparatus
WO2023044688A1
