Signal processing method, optical receiver, optical receiving array and laser radar system

By receiving and processing optical signals of different acquisition sub-cycles in the lidar system, generating and splicing point clouds, the problem of insufficient recognition accuracy of target objects in the ROI is solved, and high-resolution recognition of target objects is achieved and Accurate reflection of detailed information.

CN119024354APending Publication Date: 2024-11-26ZVISION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310594254.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

When using lidar to locate objects, how to dynamically improve the pixel resolution in the area of ​​interest (ROI) to improve the accuracy of identification of target objects in the ROI has become an urgent problem.

Method used

By receiving the optical signals of each acquisition sub-cycle and processing the optical signals based on multiple acquisition units in each acquisition sub-cycle, a point cloud corresponding to each acquisition sub-cycle is generated, and the acquisition is started in at least one acquisition sub-cycle. The central position of the acquisition unit is different from the preset position. Then, point clouds of multiple acquisition sub-cycles are spliced ​​to generate target point clouds to improve the recognition accuracy of target objects.

Benefits of technology

By dynamically adjusting the position and data transmission period of the acquisition unit, high-resolution recognition of the target object is achieved, and the accuracy of recognition of the target object in the ROI is improved and the detailed information is reflected.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024354A_ABST
    Figure CN119024354A_ABST
Patent Text Reader

Abstract

The invention discloses a signal processing method, an optical receiver, an optical receiving array and a laser radar system, and relates to the technical field of laser radars. The method comprises the steps that optical signals corresponding to all collection sub-periods are received, and the optical signals received in different collection sub-periods are different; in each acquisition sub-period, the optical signals corresponding to each acquisition sub-period are processed based on a plurality of acquisition units, point clouds corresponding to each acquisition sub-period are generated, and in at least one acquisition sub-period, the central position of the acquisition unit for initial acquisition is different from a preset position; and splicing the point clouds corresponding to the plurality of acquisition sub-cycles to generate a target point cloud. The attribute of the target object can be reflected more accurately based on the target point cloud, and the recognition accuracy of the target object is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of laser radar technology, and in particular to a signal processing method, an optical receiver, a light receiving array, a laser radar system, an electronic device and a storage medium. Background Art

[0002] Generally, when a laser radar is used to locate an object, a laser beam is emitted to the target object, and the beam reflected from the target object is received to measure the position information of the target object, the speed information of the target object, etc.

[0003] However, how to dynamically improve the pixel resolution in a region of interest (ROI) to enhance the recognition accuracy of the target object in the ROI has become an urgent problem to be solved. Summary of the invention

[0004] To this end, the present application provides a signal processing method, an optical receiver, a light receiving array, a lidar system, an electronic device and a storage medium to solve the problem of how to dynamically improve the pixel resolution in the ROI to improve the recognition accuracy of the target object in the ROI.

[0005] In a first aspect, the present application provides a signal processing method, comprising: receiving optical signals corresponding to each acquisition sub-cycle, wherein the optical signals received in different acquisition sub-cycles are different; within each acquisition sub-cycle, processing the optical signals corresponding to each acquisition sub-cycle based on multiple acquisition units to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit that starts acquisition is different from a preset position; and splicing the point clouds corresponding to multiple acquisition sub-cycles to generate a target point cloud.

[0006] In a second aspect, the present application provides an optical receiver, comprising: a receiving module, used to receive optical signals corresponding to each acquisition sub-cycle, wherein the optical signals received in different acquisition sub-cycles are different; a processing module, used to process the optical signals corresponding to each acquisition sub-cycle based on multiple acquisition units within each acquisition sub-cycle, and generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit that starts acquisition is different from a preset position; a splicing module, used to splice the point clouds corresponding to multiple acquisition sub-cycles to generate a target point cloud.

[0007] In a third aspect, the present application provides a light receiving array, comprising: a receiving module, for receiving, based on an acquisition sub-cycle, an optical signal carried in a light beam transmitted by a scanner and reflected by a target object, wherein the scanner is a device comprising a plurality of preset mirrors and rotating at a preset rotation speed based on a preset rotation axis; a resolution determination module, for determining the lateral angular resolution based on the number of preset mirrors included in the scanner, the rotation speed of the scanner and the transmission cycle of each frame of data, and for determining the longitudinal angular resolution based on the longitudinal field of view angle of the radar and the number of single-photon detection modules included in the acquisition unit corresponding to the pixel point in the point cloud, wherein the number of acquisition units used in each acquisition sub-cycle corresponds to the longitudinal angular resolution; a signal processing module, for processing, within each acquisition sub-cycle, the optical signal corresponding to each acquisition sub-cycle based on a plurality of acquisition units to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit for starting acquisition is different from the preset position; a splicing module, for splicing the point clouds corresponding to a plurality of acquisition sub-cycles with the lateral angular resolution as the horizontal coordinate and the longitudinal angular resolution as the vertical coordinate to generate a target point cloud.

[0008] In a fourth aspect, the present application provides a laser radar system, comprising: a light transmitter for emitting a light beam, the light beam comprising a light signal; a scanner for receiving the light beam emitted by the light transmitter, and changing the transmission path of the light beam emitted by the light transmitter so that the light beam is irradiated onto the target object; and receiving the light beam reflected by the target object, and transmitting the light beam reflected by the target object to a light receiver, the scanner comprising a plurality of preset mirrors, and the scanner rotates at a preset rotation speed based on a preset rotation axis; a light receiver for receiving the light signal carried in the light beam reflected by the target object and transmitted through the scanner, and executing any one of the signal processing methods in the embodiments of the present application.

[0009] In a fifth aspect, the present application provides an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any one of the signal processing methods in the embodiments of the present application.

[0010] In a sixth aspect, the present application provides a readable storage medium, in which a plurality of instructions are stored; the plurality of instructions are used by a processor to load and execute any one of the signal processing methods in the embodiments of the present application.

[0011] The signal processing method, optical receiver, optical receiving array, lidar system, electronic device and storage medium in the present application receive optical signals corresponding to each acquisition sub-cycle, wherein the optical signals received in different acquisition sub-cycles are different; in each acquisition sub-cycle, the optical signal corresponding to each acquisition sub-cycle is processed based on multiple acquisition units to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit for starting acquisition is different from the preset position, so that the point cloud corresponding to each acquisition sub-cycle can reflect the pixel position information corresponding to the optical signal, thereby improving the resolution of the target object; the point clouds corresponding to multiple acquisition sub-cycles are spliced ​​to generate a target point cloud, and the target point cloud can more accurately reflect the detailed information of the target object, thereby improving the recognition accuracy of the target object. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. By describing the detailed exemplary embodiments with reference to the accompanying drawings, the above and other features and advantages will become more apparent to those skilled in the art.

[0013] Figure 1 A schematic diagram of the structure of a laser radar system provided in an embodiment of the present application is shown.

[0014] Figure 2 A flow chart showing a signal processing method in an embodiment of the present application is shown.

[0015] Figure 3 A schematic structural diagram of a laser radar system in an embodiment of the present application is shown.

[0016] Figure 4 A schematic diagram showing a point cloud in an initial acquisition sub-cycle in an embodiment of the present application.

[0017] Figure 5 A schematic diagram showing a point cloud in an initial acquisition sub-cycle determined based on an updated lateral angular resolution in an embodiment of the present application is shown.

[0018] Figure 6 A schematic diagram showing a target point cloud in an embodiment of the present application.

[0019] Figure 7 A schematic diagram showing a target point cloud in an embodiment of the present application.

[0020] Figure 8 A schematic diagram showing a target point cloud in an embodiment of the present application.

[0021] Fig. 9 A schematic diagram showing a target point cloud determined based on a collection unit in an embodiment of the present application is shown.

[0022] Fig.10 A schematic diagram of a target point cloud in an embodiment of the present application is shown.

[0023] Fig.11 A block diagram showing the composition of an optical receiver in an embodiment of the present application is shown.

[0024] Fig.12 A schematic structural diagram of a photoelectric sensor device in an optical receiver in an embodiment of the present application is shown.

[0025] Fig.13 A block diagram showing the composition of the light receiving array in an embodiment of the present application is shown.

[0026] Fig.14 A schematic structural diagram of a laser radar system in an embodiment of the present application is shown.

[0027] Fig.15 A structural diagram showing an exemplary hardware architecture of an electronic device according to a signal processing method and apparatus according to an embodiment of the present application. DETAILED DESCRIPTION

[0028] The specific embodiments of the present application are described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present application and are not intended to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of the specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0029] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0030] The terms used in this application are only used to describe specific embodiments and are not intended to limit the present application.As used in this application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0031] When the terms “comprising” and / or “made of…” are used in this application, it specifies the existence of the stated features, integers, steps, operations, elements and / or components, but does not exclude the existence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0032] Unless otherwise defined, all terms (including technical and scientific terms) used in this application have the same meaning as those commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this application, and will not be interpreted as having an idealized or overly formal meaning unless explicitly defined in this application.

[0033] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0034] Figure 1 A schematic diagram of the structure of a laser radar system provided in an embodiment of the present application is shown.

[0035] Reference below Figure 1 The laser radar system 100 according to an embodiment of the present application is described. Figure 1 The XYZ coordinate system is marked in . Figure 1 FIG. 1 is a schematic diagram showing the components of a laser radar system 100 according to an embodiment of the present application. The laser radar system 100 can be used to detect the distance and speed of a target object.

[0036] In an embodiment of the present application, the laser radar system 100 may include a transmitting device 110 , a scanning device 120 and a receiving device 130 .

[0037] In various embodiments, the transmitting device 110 can be configured to transmit an emission light beam having a uniform energy distribution. Here, uniform energy distribution can also be interpreted as uniform illumination or light intensity. In some embodiments, such an emission light beam having a uniform energy distribution can be obtained by shaping (homogenizing) using an emission optical system 112, which will be discussed in detail later.

[0038] In various embodiments, the emission light beam is divergent in a first direction perpendicular to the optical axis of the emission device 110, with a corresponding first divergence angle.

[0039] Furthermore, in various embodiments, the emission light beam is either parallel in a second direction perpendicular to the optical axis of the emission device and perpendicular to the first direction, or divergent and the corresponding second divergence angle is smaller than a preset threshold.

[0040] In practical applications, the first direction ( Figure 1 The Y-axis direction shown in the figure) can usually refer to the vertical direction (V direction), while the second direction ( Figure 1The Z-axis direction shown in the figure may generally refer to the horizontal direction (H direction). For ease of understanding, the following description is made by taking the case where the first direction corresponds to the vertical direction and the second direction corresponds to the horizontal direction as an example. However, it is easy for those skilled in the art to understand that the present application is not limited thereto. For example, the first direction may also refer to the horizontal direction, and the second direction may refer to the vertical direction.

[0041] On the one hand, the emitted light beam diverges in the vertical direction, and the corresponding first divergence angle is defined as Δθ V That is, the emitted light beam is at an angle Δθ in the vertical direction. V Fan-shaped beam emission.

[0042] On the other hand, the emission light beam may be parallel in the horizontal direction. Alternatively, the emission light beam may also be divergent in the horizontal direction, but the corresponding second divergence angle is less than the preset threshold. That is, the emission light beam is emitted in the horizontal direction as parallel light or at a very small angle. The selection of the preset threshold will be discussed in detail later.

[0043] That is, the emission light beam is a uniform linear or narrow rectangular light beam. As a result, the light spot projected in the field of view can appear as a narrow rectangle or even a line. The long side of the rectangle corresponds to the vertical direction, and the short side corresponds to the horizontal direction. Here, "narrow" may mean that the aspect ratio of the rectangle is greater than a preset aspect ratio threshold. Advantageously, by using an emission light beam that is linear or narrow rectangular, the laser radar system 100 of the present application can achieve a more concentrated field of view angle energy, a longer distance detection, and a higher resolution.

[0044] The inventors of the present application have recognized that an emission light beam having the above-mentioned specific illumination distribution can be obtained by shaping a laser beam emitted from a common light source.

[0045] Therefore, in some embodiments, the emission device 110 includes a light source 111 and an emission optical system 112. The emission optical system 112 is configured to shape the laser beam emitted from the light source 111 to convert it into the emission light beam.

[0046] In some embodiments, the light source 111 may be a laser, such as a solid-state laser (such as a vertical-cavity surface-emitting laser (VCSEL), an edge-emitting laser (EEL), an external-cavity diode laser (ECDL)), a laser diode, or a fiber laser. In some embodiments, the light source 111 may also include a light emitting diode (LED). However, it is easy for those skilled in the art to understand that the present application does not impose any specific restrictions on the type of device of the light source 111, as long as the output power of the light source 111 is large enough.

[0047] In some embodiments, the light source 111 may be an array light source. For example, the light source 111 may be a VCSEL array including a plurality of VCSELs. In a non-limiting example, the plurality of VCSELs may be configured to light up all at the same time during measurement, rather than lighting up in partitions and / or time divisions.

[0048] Alternatively, in some embodiments, the light source 111 may also be a single point light source. It is easy for those skilled in the art to understand that the present application does not impose any specific limitation on the arrangement of the light source 111.

[0049] In some embodiments, the light source 111 can emit light beams in different forms, including pulsed light, continuous wave (CW) and quasi-continuous light. The operating wavelength of the light source can be 650 nanometers (nm) to 1150nm, 800nm ​​to 1000nm, 850nm to 950nm or 1300nm to 1600nm. In some embodiments, the light source 111 can also include an optical component optically coupled to the light source 111 for collimating or focusing the light beam emitted by the light source 111. Each emitted light beam emitted by the light source 111 can be continuous light lasting a certain period of time, or it can be one or more light pulses.

[0050] In some embodiments, the emission optical system 112 may include a diffusion unit configured to diffuse and shape the input laser beam. For example, the diffusion unit may diffuse and shape the beam based on diffraction and / or refraction, etc., to emit the above-mentioned uniform linear or narrow rectangular beam. However, it is easy for those skilled in the art to understand that the present application may also obtain the above-mentioned emission beam through other shaping processes.

[0051] In some embodiments, the diffusion unit may include at least one of the following optical devices: an optical diffuser, a diffractive optical element (DOE), and an aspherical cylindrical mirror. However, those skilled in the art will readily appreciate that the above devices are merely examples of the diffusion unit, and the present application is not limited thereto.

[0052] In the case of using an optical diffuser or DOE to perform diffusion shaping, the emission optical system 112 may further include a collimating unit, wherein the collimating unit may be configured to collimate the laser beam emitted from the light source to obtain a collimated laser beam to be input into the diffuser or DOE.

[0053] In some embodiments, the collimating unit may include at least one of the following optical devices: a microlens or a collimating mirror. For example, the collimating unit may be an array of microlenses. However, it is easy for those skilled in the art to understand that the above devices are only examples of collimating units, and the present application is not limited thereto.

[0054] In some embodiments, the laser radar system 100 further includes a transmitting and receiving separation device. The transmitting and receiving separation device may be a plane mirror 140 or a beam splitter having a hole 141. Specifically, taking a plane mirror with a hole as an example, the plane mirror 140 uses the hole 141 to transmit the emission light beam to guide the emission light beam to the scanning device 120, and uses a mirror to reflect the receiving light beam to guide the receiving light beam to the receiving device 130. That is, the emission light beam emitted from the transmitting device 110 can be directly transmitted through the plane mirror 140 via the hole 141, and the reflected receiving light beam can be reflected by the mirror in the plane mirror 140. That is, the reverse receiving path can be separated from the forward transmitting path at the plane mirror 140. Thus, with the help of the plane mirror 140 with a hole, the laser radar system 100 can realize the coaxial transmission and reception. Advantageously, the coaxial transmission and reception can avoid the imaging position deviation problem of the return light spot of the close-range and long-range detection caused by the separation of the optical axes of the two, thereby avoiding the additional calibration caused by this problem, which is conducive to mass production of products. However, it is easy for those skilled in the art to understand that the present application may also be a non-coaxial lidar system.

[0055] The inventor of the present application realizes that the plane reflector with a hole has relatively loose requirements on the precision of the manufacturing and adjustment of the hole, as long as the emitted light beam can pass through. On this basis, by reducing the size of the hole, the loss of reflected light can be reduced.

[0056] Therefore, in some embodiments, the emission light beam is in a focused state when passing through the hole. For example, by designing the light beam characteristics of the emission light beam and / or adjusting the position of the plane reflector relative to the emission device, it can be ensured that the emission light beam is in a focused state when passing through the hole. Advantageously, by focusing the emission light beam at the hole, the hole can be minimized while ensuring that the emission light beam passes through the hole, thereby minimizing the loss of reflected light and further reducing the precision requirements for the manufacture and adjustment of the hole. However, it is easy to understand for those skilled in the art that the present application is not limited to this.

[0057] The hole is usually located at the center of the plane reflector, but the present application is not limited thereto. In addition, to reduce the loss of reflected light, the shape of the hole can correspond to the cross-sectional shape of the emitted light beam when passing through the hole, and therefore is not necessarily circular.

[0058] It is easy for those skilled in the art to understand that the present application can also use other methods to achieve coaxial transmission and reception. However, compared with other methods such as a beam splitter, the plane reflector with holes proposed in the present application can reduce light loss and improve efficiency.

[0059] In various embodiments, the scanning device 120, such as a rotating mirror, can be configured to rotate around a rotation axis oriented in a vertical direction (a first direction, the Y-axis direction in the figure) to guide the emission light beam to scan the target object in the field of view. The target object can be any object that can reflect the scanning laser within the scanning field of view of the laser radar system, such as vehicles, pedestrians, animals, road signs, obstacles, trees, shelves, furniture, etc.

[0060] After irradiating the target object, the transmitted light beam is scattered back, and a portion of it returns to the laser radar system 100 as a received light beam and is received by the receiving device 130.

[0061] In various embodiments, the receiving device 130 may be configured to receive and detect a receiving light beam returned from the target object. For example, the receiving light beam scattered and returned by the target object may return to the scanning device 120 along the original path, and then be guided by the scanning device 120 to the plane reflector 140, and then reflected to the receiving device 130 by the plane reflector 140.

[0062] In some embodiments, the receiving device 130 may include a photodetector 131. The photodetector 131 may measure the power, phase, or time characteristics of the received light and generate a corresponding current output.

[0063] In some embodiments, Figure 1As shown, the photodetector 131 may include a plurality of photodetection units 1310 arranged along a direction. Among them, different photodetection units 1310 are configured to receive and detect light signals returned from target objects at different relative angles in the vertical direction of the field of view. The photodetector 131 may also include a receiving circuit (not shown) associated with each photodetection unit 1310. Each receiving circuit may be used to process the output electrical signal of the corresponding photodetection unit 1310.

[0064] The photodetection unit 1310 may include various forms of photodetection devices or one-dimensional or two-dimensional arrays of photodetection devices, and accordingly, the receiving circuit may be an array of one circuit or multiple circuits. In various embodiments, the photodetection device may be an avalanche diode (APD), a single photon avalanche diode (SPAD), a PN photodiode, or a PIN photodiode.

[0065] For example, the photodetection unit 1310 can be a photodetection device SPAD or a one-dimensional or two-dimensional array thereof, so the photodetector 131 is an array of SPADs. Advantageously, since the spacing between SPADs is very small and they are closely arranged, the spatial resolution can be greatly improved. Moreover, different SPADs can simultaneously and individually perform direct Time-of-Flight (dToF) measurements without the need to light up the light source in different zones and at different times, which can greatly improve the temporal resolution.

[0066] In some embodiments, the receiving device 130 may further include a receiving optical system 132. The receiving optical system 132 may be configured to image the received light onto the photodetector 131. For example, in some embodiments, the receiving optical system 132 may include a receiving lens and an aperture. The receiving lens and the aperture are located upstream of the photodetector 131 on the receiving path. For example, the receiving lens may include an imaging system lens so that the focus of the received light beam is in front of or behind the receiving surface of the photodetector or just above the receiving surface. In some cases, instead of existing as a separate component, the receiving lens may also be integrated into the photodetector 131. The aperture is used to limit the angle of incident light incident on the photodetector 131, block stray light, etc.

[0067] As described above, the light spot projected into the field of view by the laser radar system 100 can be a uniform line or a narrow rectangle extending in the vertical direction, so the received light beam returned from the target object will form a similar pattern on the receiving surface of the photodetector 131. By arranging a plurality of photodetection units 1310 correspondingly along the direction of the long side of the line or rectangle, and imaging the light returned from the target object at different relative angles in the vertical direction of the field of view to different photodetection units 1310 using the receiving optical system 132, these photodetection units 1310 can be made to correspond to the target objects at different relative angles in the vertical direction of the field of view, respectively. That is, different photodetection units 1310 are configured to receive and detect light signals returned from target objects at different relative angles in the vertical direction of the field of view. Therefore, based on the arrangement information of the photodetection unit 1310 and the parameter information of the optical system, etc., the relative angle of the corresponding target object can be accurately calculated.

[0068] Since a uniform linear (or narrow rectangular) transmitting light beam is adopted, it is only necessary to perform a simple adjustment on the laser radar system 100 so that the receiving light spot imaged by the receiving optical system 132 on the photodetector 131 can cover the receiving surface of the photodetection unit 1310 (i.e., the photosensitive surface of all photodetection units 1310), and there is no need to perform separate alignment of the transmitting module and the receiving module. Here, the receiving light spot "covering" the receiving surface can be understood as the receiving light spot at least partially overlapping with the receiving surface, so that each photodetection unit can receive the light signal returned from the target object. For example, in some embodiments, the size of the receiving light spot can be made relatively small, and can only cover a portion of the receiving surface, so that the returned light signal can be received by the photodetection unit as much as possible to reduce waste. Therefore, advantageously, the solution proposed in the present application can greatly simplify the difficulty of adjustment and is conducive to realizing automated production.

[0069] The angular resolution δθ of the laser radar system 100 in the vertical direction according to the embodiment of the present application is V =Δθ V / Q, where Q is the number of photodetection units 1310 included in the photodetector 131. By reducing the emission angle Δθ V And / or increasing the number Q of the photodetection units 1310 in the photodetector 131 can reduce the angular resolution δθ in the vertical direction. V value, thereby improving the angular resolution in the vertical direction.

[0070] It is worth noting that, in some embodiments, each photodetection unit 1310 may include a plurality of photodetection devices (such as SPADs) arranged along one direction, wherein the arrangement direction of the plurality of photodetection devices is perpendicular to the arrangement direction of the plurality of photodetection units 1310. With this arrangement, the number of photodetection devices in each photodetection unit 1310 can be increased without affecting the spacing of the photodetection units 1310, thereby improving the accuracy of detection without affecting the spatial resolution.

[0071] exist Figure 1 In the laser radar system shown, during the rotation of multiple mirrors of the scanning device 120, a ROI can be formed, which is used to represent the area in the image that needs to be processed and is outlined with different graphics (such as square, circle, etc.).

[0072] Figure 2 FIG. 2 is a flow chart showing a signal processing method in an embodiment of the present application. The signal processing method can be applied to an optical receiver. Figure 2 As shown, including:

[0073] Step S201, receiving the optical signal corresponding to each acquisition sub-period.

[0074] The optical signals received in different acquisition sub-cycles are different.

[0075] For example, the optical signals corresponding to different acquisition sub-cycles may be obtained in the following manner: based on the acquisition sub-cycle, the optical signal carried in the light beam reflected by the preset mirror during the rotation of the scanner is acquired.

[0076] The scanner includes a plurality of preset mirrors, and the preset mirrors are used to change the transmission path of the light beam emitted by the light emitter.

[0077] For example, a scanner may be implemented using a rotating mirror having multiple preset mirror structures facing different angles, so that during the rotation of the rotating mirror, different light signals can be obtained through reflections from preset mirrors facing different angles, so that the information carried by the obtained light signals is more comprehensive.

[0078] Step S202: In each acquisition sub-cycle, the optical signal corresponding to each acquisition sub-cycle is processed based on multiple acquisition units to generate a point cloud corresponding to each acquisition sub-cycle.

[0079] In at least one acquisition sub-cycle, the center position of the acquisition unit for starting acquisition is different from the preset position. The acquisition unit for starting acquisition may be the first acquisition unit in a certain acquisition sub-cycle; and the center position of the acquisition unit corresponds to the pixel point when the point cloud data is displayed, that is, the center position of each acquisition unit is the position of a pixel point.

[0080] Step S203, stitching the point clouds corresponding to the multiple acquisition sub-cycles to generate a target point cloud.

[0081] The target point cloud obtained by the above method includes more pixels. In other words, the pixel density of the target point cloud is higher, so that the detailed information of the target object can be more accurately reflected based on the target point cloud, such as the relative position of the target object, thereby improving the recognition accuracy of the target object.

[0082] In this embodiment, by receiving the light signal corresponding to each acquisition sub-cycle, wherein the light signals received in different acquisition sub-cycles are different; in each acquisition sub-cycle, the light signal corresponding to each acquisition sub-cycle is processed based on multiple acquisition units to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit that starts acquisition is different from the preset position, so that the point cloud corresponding to each acquisition sub-cycle can reflect the pixel position information corresponding to the light signal, thereby improving the resolution of the target object; the point clouds corresponding to multiple acquisition sub-cycles are spliced ​​to generate a target point cloud, and the target point cloud can more accurately reflect the detailed information of the target object, thereby improving the recognition accuracy of the target object.

[0083] In some optional embodiments, the acquisition sub-period corresponds to the lateral angular resolution.

[0084] The lateral angular resolution is determined based on the number of preset mirrors included in the scanner, the rotation speed of the scanner, and the transmission period of each frame of data; the number of acquisition units used in each acquisition sub-period corresponds to the longitudinal angular resolution, which is determined based on the longitudinal field of view angle of the radar and the number of single-photon detection modules included in the acquisition unit corresponding to the pixel point in the point cloud. In addition, each frame of data is the data formed by the reflection of the light beam emitted by the light transmitter through a preset mirror in the scanner.

[0085] For example, Figure 3 FIG. 2 is a schematic diagram showing the structure of the laser radar system in the embodiment of the present application. Figure 3 As shown, the light beam emitted by the transmitting chip 301 in the optical transmitter is transmitted to the transceiver light beam unit 303 through the transmitting lens 302; when the light beam transmitted by the transceiver light beam unit 303 reaches the scanner 304 (e.g., using N mirrors to construct a terminal rotating mirror, etc.), the scanner 304 guides the light beam to various positions within the field of view to achieve scanning of the target object in the field of view.

[0086] In some specific implementations, the optical receiver can be implemented using a single photon receiving array, for example, the single photon receiving array includes but is not limited to at least one of a SPAD linear array, a SPAD planar array, a SiPM linear array, and a SiPM planar array. The transmitting lens 302 is but is not limited to a light homogenizer or a DOE element.

[0087] If the scanner 304 is implemented by a coaxial rotating mirror, the transmitting lens 302 can collimate or homogenize the light beam to generate a light source matrix or a homogenized light source; then, the central light hole ( Figure 3 The central circular area in the light beam transmitting and receiving unit 303 shown in the figure) and the rotating mirror enable the light source dot matrix or the homogenized light source to be projected onto the target object within the field of view.

[0088] After the light beam is reflected from the target object, it is received by the receiving lens 305 in the optical receiver and forwarded by the receiving lens 305 to the receiving chip 306, thereby obtaining optical signals corresponding to multiple acquisition sub-cycles. Furthermore, the receiving chip 306 processes the optical signals corresponding to each acquisition sub-cycle based on multiple acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit that starts acquisition is different from the preset position; the point clouds corresponding to multiple acquisition sub-cycles are spliced ​​to generate a target point cloud.

[0089] For example, the lateral angular resolution is calculated using formula (1):

[0090] Δθ=720×FPS / N×Δt (1)

[0091] Wherein, N represents the number of preset mirrors included in the scanner;

[0092] FPS stands for frame rate, that is, the number of frames transmitted per second (Frames Per Second, FPS);

[0093] FPS / N represents the rotation speed of the scanner. For example, if FPS=10 and N=4, then FPS / N=2.5 revolutions per second (RPS), which means the scanner rotates 2.5 times per second.

[0094] Δt represents the transmission period of each frame of data, that is, the duration of a single ranging.

[0095] For another example, the longitudinal angular resolution is calculated using formula (2):

[0096]

[0097] Among them, FOV_V represents the longitudinal field of view angle of the radar; M represents the number of single-photon detection modules included in the acquisition unit corresponding to the pixel point in the point cloud.

[0098] Based on the lateral angular resolution and longitudinal angular resolution obtained by the above calculation, a coordinate system is constructed to obtain a point cloud.

[0099] For example, Figure 4 A schematic diagram showing a point cloud in an embodiment of the present application.

[0100] like Figure 4 As shown, in the coordinate system constructed with the lateral angular resolution as the horizontal coordinate and the longitudinal angular resolution as the vertical coordinate, each sampling moment corresponds to the lateral angular resolution one by one. For example, the lateral angular resolution θ0 corresponds to the sampling moment t0, the lateral angular resolution θ0+Δθ corresponds to the sampling moment t0+Δt, the lateral angular resolution θ0+2Δθ corresponds to the sampling moment t0+2Δt, and the lateral angular resolution θ0+3Δθ corresponds to the sampling moment t0+3Δt.

[0101] Among them, the point cloud in each acquisition sub-cycle includes multiple pixel points (such as Figure 4 Solid black dots are shown), each pixel corresponds to a collection unit, and one collection unit includes 3×3 single-photon detection modules (for example, a SPAD, an APD, etc.).

[0102] Horizontally, with Δt as the interval, a column of acquisition points corresponding to each acquisition moment is obtained, such as the first column of point clouds corresponding to time t0, the second column of point clouds corresponding to time t0+Δt, the third column of point clouds corresponding to time t0+2Δt, and the fourth column of point clouds corresponding to time t0+3Δt.

[0103] Vertically, For intervals, at each acquisition time (such as time t0, etc.), each column of pixels includes 5 pixels. For example, the first column of point cloud includes the following 5 pixels: The corresponding first pixel point, The corresponding second pixel point, The corresponding third pixel point, The corresponding fourth pixel point, The corresponding fifth pixel)

[0104] Through the above point cloud, relevant information (such as position information, attribute information, etc.) of the target object in the field of view can be preliminarily described to facilitate preliminary judgment of the target object.

[0105] In some optional embodiments, the target point cloud includes m rows of pixel points, where m is an integer greater than or equal to 1; when it is determined that the number of preset mirrors included in the scanner and the rotation speed of the scanner remain unchanged, based on a second preset ratio, the transmission period of each frame of data is shortened to obtain an updated lateral angular resolution; based on the updated lateral angular resolution, the row point cloud in the initial acquisition sub-period is updated.

[0106] The second preset ratio is used to characterize the ratio of the updated transmission period to the original transmission period. For example, the second preset ratio is 30%, 50%, 66%, and other different ratio values. The above second preset ratio is only an example, which can be specifically set according to actual needs. Other unspecified second preset ratios are also within the scope of protection of this application and will not be described in detail here.

[0107] For example, when the second preset ratio is 50%, based on the original transmission period Δt of each frame of data, by shortening Δt to obtain 0.5Δt, multiple updated sampling moments can be obtained (for example, (t0+0.5Δt) moment, (t0+1.5Δt) moment, (t0+2.5Δt) moment, etc.).

[0108] Furthermore, based on the above-mentioned multiple updated sampling moments, formula (1) can be used to respectively calculate and obtain multiple updated lateral angular resolutions (for example, the updated lateral angular resolution (θ0+0.5Δθ) corresponding to the moment (t0+0.5Δt), the updated lateral angular resolution (θ0+1.5Δθ) corresponding to the moment (t0+1.5Δt), and the updated lateral angular resolution (θ0+2.5Δθ) corresponding to the moment (t0+2.5Δt); and the column point clouds corresponding to each updated lateral angular resolution (for example, the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ), the column point cloud corresponding to the lateral angular resolution (θ0+1.5Δθ), the column point cloud corresponding to the lateral angular resolution (θ0+2.5Δθ), etc.).

[0109] While keeping the longitudinal angular resolution unchanged, update the column point cloud corresponding to the updated sampling time to Figure 4 From the point cloud in the initial acquisition sub-cycle shown in FIG. , the point cloud in the updated initial acquisition sub-cycle can be obtained. For example, Figure 5 A schematic diagram of a point cloud in an initial acquisition sub-cycle determined based on an updated lateral angular resolution in an embodiment of the present application is shown. Figure 5 The updated point cloud in the initial acquisition sub-cycle is shown.

[0110] It can be seen from the above update process that by controlling the transmission period of each frame of data, for example, by using the second preset ratio to update the transmission period of each frame of data, the horizontal angular resolution can be dynamically updated, thereby obtaining a column point cloud corresponding to the updated horizontal angular resolution to highlight the pixel resolution of the point cloud data in the horizontal dimension. Figure 5 The updated point cloud in the initial acquisition sub-cycle is shown compared to Figure 4 For the point cloud in the initial acquisition sub-cycle shown in FIG, the number of pixels of the point cloud is doubled, that is, Figure 5 The number of pixels in the point cloud in the updated initial acquisition sub-cycle shown is Figure 4 The number of pixels in the point cloud in the initial acquisition sub-cycle shown is twice as large.

[0111] In some optional embodiments, the plurality of acquisition units correspond one-to-one to the plurality of pixel points, and the acquisition sub-cycles include: an even-numbered acquisition sub-cycle and an odd-numbered acquisition sub-cycle.

[0112] For example, one acquisition sub-cycle includes P acquisition units, and the center position of each acquisition unit corresponds to a pixel point (eg, Figure 4 or Figure 5 The solid black dots shown in the figure), and each acquisition unit includes K×K single-photon detection modules; within any acquisition sub-cycle, the starting position of the sampling can be adjusted according to the dynamically set first preset starting position and the second preset starting position, wherein the first preset starting position (or the second preset starting position can be the position corresponding to the 0th to P×Kth single-photon detection modules), thereby adjusting the density of the point cloud in the acquisition sub-cycle to obtain the ROI (i.e., the target point cloud) desired by the user.

[0113] Wherein, P and K are both integers greater than or equal to 1.

[0114] For example, the center position of the acquisition unit corresponding to one of the odd acquisition sub-cycle and the even acquisition sub-cycle is a preset position; the center position of the acquisition unit corresponding to the other of the odd acquisition sub-cycle and the even acquisition sub-cycle is a position other than the preset position that is determined based on the number of single-photon detection modules included in each acquisition unit.

[0115] Based on the positions in different single-photon detection modules of the same acquisition unit, different first preset starting positions and second preset starting positions are obtained. For example, the first preset starting position is set to correspond to the 0th single-photon detection module in the first acquisition unit; the second preset starting position corresponds to the 3rd single-photon detection module in the first acquisition unit.

[0116] For another example, the first preset starting position and the second preset starting position may also be determined based on the number of single-photon detection modules in different acquisition units. For example, the first preset starting position is set to correspond to the 0th single-photon detection module in the first acquisition unit; and the second preset starting position corresponds to the 3rd single-photon detection module in the second acquisition unit.

[0117] In some optional embodiments, the acquisition unit includes K×K single-photon detection modules, and the center position of the acquisition unit corresponding to one of the odd-numbered acquisition sub-periods and the even-numbered acquisition sub-periods is a position determined based on the first row of single-photon detection modules;

[0118] The center position of the acquisition unit of the other of the odd-numbered acquisition sub-cycle and the even-numbered acquisition sub-cycle is determined based on the position of any row of single-photon detection modules in K rows except the first row of single-photon detection modules, where K is an integer greater than or equal to 2.

[0119] For example, when K is equal to 3, the acquisition unit includes 3×3 single-photon detection modules, wherein the position corresponding to the first row of single-photon detection modules is the position of the 0th single-photon detection module, the position corresponding to the second row of single-photon detection modules is the position of the 4th single-photon detection module, and the position corresponding to the third row of single-photon detection modules is the position of the 7th single-photon detection module.

[0120] Correspondingly, the first preset starting position can be set as the position of the 0th single-photon detection module; the second preset starting position can be the position corresponding to the second row of single-photon detection modules (i.e., the position of the 4th single-photon detection module), or it can be the position corresponding to the third row of single-photon detection modules (i.e., the position of the 7th single-photon detection module).

[0121] Furthermore, in each odd-numbered acquisition sub-cycle, the optical signal corresponding to each odd-numbered acquisition sub-cycle is processed based on multiple acquisition units to generate a point cloud corresponding to each odd-numbered acquisition sub-cycle; then, in each even-numbered acquisition sub-cycle, the optical signal corresponding to each even-numbered acquisition sub-cycle is processed based on multiple acquisition units to generate a point cloud corresponding to each even-numbered acquisition sub-cycle; and then, the point clouds corresponding to multiple odd-numbered acquisition sub-cycles and the point clouds corresponding to multiple even-numbered acquisition sub-cycles are spliced ​​to obtain the target point cloud.

[0122] For example, Figure 6 A schematic diagram showing a target point cloud in an embodiment of the present application.

[0123] When the first preset starting position is set to the 0th single-photon detection module, in the odd-numbered acquisition sub-cycle, the optical signal can be processed based on the first preset starting position to obtain a plurality of first-type point clouds corresponding to the odd-numbered acquisition sub-cycles, wherein the first-type point clouds include: Figure 6Shown are the column point cloud corresponding to the lateral angular resolution θ0, the column point cloud corresponding to the lateral angular resolution (θ0+Δθ), the column point cloud corresponding to the lateral angular resolution (θ0+2Δθ), and the column point cloud corresponding to the lateral angular resolution (θ0+3Δθ).

[0124] At the same time, the second preset starting position is set as the third single-photon detection module; in the even-numbered acquisition sub-cycle, the optical signal is processed based on the second preset starting position to obtain a plurality of second-type point clouds corresponding to the even-numbered acquisition sub-cycles, wherein the second-type point clouds include: Figure 6 Shown are the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ), the column point cloud corresponding to the lateral angular resolution (θ0+1.5Δθ), and the column point cloud corresponding to the lateral angular resolution (θ0+2.5Δθ).

[0125] The pixel points in the second type of point cloud are offset longitudinally relative to the pixel points in the first type of point cloud (for example, the pixel points in the i+1th column are offset longitudinally relative to the pixel points in the ith column (the offset is )).like Figure 6 As shown, the position of the pixel point in the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ) is offset by the position of the pixel point in the column point cloud corresponding to the lateral angular resolution θ0. The longitudinal resolution of the point cloud can be offset to improve the resolution of the point cloud in the longitudinal dimension.

[0126] In some optional embodiments, the number of pixels included in a first type of point cloud is the same as the number of acquisition units determined based on the first preset starting position. For example, when the first preset starting position is set to the 0th single-photon detection module, the number of pixels included in the obtained first type of point cloud (e.g., Figure 6 The 5 solid black dots shown) are the same as the number of acquisition units.

[0127] In some optional embodiments, the number of pixels included in a second type of point cloud is the same as the number of acquisition units determined based on the second preset starting position. For example, when the second preset starting position is set to the fourth single-photon detection module, Figure 6 The lateral angular resolution (θ0+0.5Δθ) shown in FIG. 1 corresponds to four acquisition units in the column point cloud, that is, the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ) includes four pixel points.

[0128] With the above updates, compared to Figure 4 For the point cloud shown, the obtained Figure 6 The target point cloud shown not only realizes the offset in the lateral dimension, but also realizes the offset in the longitudinal dimension, so that the resolution of the point cloud data is higher.

[0129] In some optional embodiments, in order to more accurately obtain information about a target object at the center of the field of view, the point cloud data at the center may be processed by adjusting the second preset starting position to obtain a target point cloud with higher resolution.

[0130] In some optional embodiments, before executing step S203 to stitch point clouds corresponding to multiple acquisition sub-cycles to generate a target point cloud, the method further includes: when it is determined that pixel information of a central area corresponding to the light signal needs to be obtained and the central position of the acquisition unit corresponding to the odd-numbered acquisition sub-cycle is a preset position, deleting at least one edge pixel point in an even-numbered acquisition sub-cycle to obtain at least one updated point cloud corresponding to the even-numbered acquisition sub-cycle;

[0131] Step S203 of stitching point clouds corresponding to a plurality of acquisition sub-cycles to generate a target point cloud includes: generating a target point cloud based on at least one updated point cloud corresponding to an even-numbered acquisition sub-cycle and a point cloud corresponding to an odd-numbered acquisition sub-cycle.

[0132] Among them, the distance between the edge pixel and the middle pixel in the point cloud corresponding to the even-numbered acquisition sub-period is greater than the preset distance threshold. The preset distance threshold can be the width of an acquisition unit (for example, an acquisition unit includes K×K single-photon detection modules, and its width is K); it can also be an integer multiple of the width of an acquisition unit, such as the preset distance threshold is 2K, 3K, etc. This application does not limit it and can be set according to actual needs.

[0133] For example, Figure 7 Schematic diagram of the target point cloud in the embodiment of the present application is shown. Figure 7 As shown in FIG. 1 , the first pixel point in the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ) is obtained by using the fourth single-photon detection module of the second acquisition unit as the second preset starting position; and after completing the above update, Figure 6 The 4th pixel point in the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ), the 4th pixel point in the column point cloud corresponding to the lateral angular resolution (θ0+1.5Δθ), and the 4th pixel point in the column point cloud corresponding to the lateral angular resolution (θ0+2.5Δθ); thereby obtaining Figure 7 The target point cloud is shown to highlight the resolution of the pixels at the center.

[0134] In some optional embodiments, before executing step S203 to stitch the point clouds corresponding to the multiple acquisition sub-cycles to generate the target point cloud, the method further includes: when it is determined that the pixel information of the edge area corresponding to the light signal needs to be obtained and the center position of the acquisition unit corresponding to the odd acquisition sub-cycle is the preset position, deleting the center pixel point in at least one even acquisition sub-cycle to obtain at least one updated point corresponding to the even acquisition sub-cycle.

[0135] Step S203 of stitching point clouds corresponding to a plurality of acquisition sub-cycles to generate a target point cloud includes: generating a target point cloud based on at least one updated point cloud corresponding to an even-numbered acquisition sub-cycle and a point cloud corresponding to an odd-numbered acquisition sub-cycle.

[0136] Among them, the distance between the central pixel point and the middle pixel point in the point cloud corresponding to the even-numbered acquisition sub-period is less than or equal to a preset distance threshold.

[0137] For example, during the process of autonomous driving, if you are turning left or right, you need to pay more attention to the edge point cloud data. Figure 6 Based on the target point cloud shown, the pixels in the central area of ​​the target point cloud are deleted to reduce the data volume of the updated target point cloud, so that the user can focus more resolution on the processing of the edge point cloud.

[0138] Figure 8 Schematic diagram of the target point cloud in the embodiment of the present application is shown. Figure 8 As shown, in Figure 6 Based on the target point cloud shown in FIG. 1 , by deleting the 2nd to 3rd pixel points in the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ), the 2nd to 3rd pixel points in the column point cloud corresponding to the lateral angular resolution (θ0+1.5Δθ), and the 2nd to 3rd pixel points in the column point cloud corresponding to the lateral angular resolution (θ0+2.5Δθ), we obtain Figure 8 The updated target point cloud is shown.

[0139] It should be noted that in the above-mentioned different adjustment schemes, the optical transmitter needs to be dynamically updated corresponding to the optical receiver, or the optical transmitter adopts a redundant homogenized light source to ensure the accuracy of the point cloud data received by the optical receiver.

[0140] An embodiment of the present application provides another possible implementation method, wherein the preset position is the center position of the reference acquisition unit, and the number of single-photon detection modules included in the reference acquisition unit is greater than the number of single-photon detection modules included in the acquisition unit.

[0141] For example, while keeping the total number of single-photon detection modules in the scanner unchanged, the number of single-photon detection modules included in the acquisition unit corresponding to each pixel point is reduced, and an updated acquisition unit can be obtained;

[0142] For example, one acquisition sub-cycle includes P acquisition units, and the center position of each acquisition unit corresponds to a pixel point (eg, Figure 4 The solid black dots shown in the figure), an acquisition unit includes K×K single-photon detection modules; within any acquisition sub-cycle, a first preset ratio can be determined as needed, and the number of single-photon detection modules included in the acquisition unit corresponding to each pixel point is determined based on the first preset ratio (for example, the number can be 0 to K×K), thereby increasing the point cloud density.

[0143] For example, the reference acquisition unit includes K×K reference single-photon detection modules; the acquisition unit includes M×K reference single-photon detection modules, M<K.

[0144] If K is set to 3 and M is set to 2, the reference acquisition unit includes 3×3 reference single-photon detection modules, and the acquisition unit includes 2×3 reference single-photon detection modules.

[0145] Fig. 9 FIG. 2 is a schematic diagram showing a target point cloud determined based on a collection unit in an embodiment of the present application. Fig. 9 As shown, the first preset ratio is 33%, then the number of single-photon detection modules included in the acquisition unit corresponding to each pixel is Figure 4 The number of single-photon detection modules included in the reference acquisition unit shown is 9, which is updated to Fig. 9 The collection unit shown includes six single-photon detection modules.

[0146] Among them, it is necessary to maintain the total number of single-photon detection modules in each acquisition sub-cycle in the scanner (e.g., Fig. 9 The total number of single-photon detection modules corresponding to the time t0 shown in FIG. 1 is 48) remains unchanged; further, based on Fig. 9 The acquisition unit shown processes the optical signal corresponding to each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, and then splices the point clouds corresponding to multiple acquisition sub-cycles to generate a target point cloud, thereby increasing the density of pixel points in the target point cloud.

[0147] in, Fig. 9 The vertical position of each pixel in the target point cloud shown is relative to Figure 4 The longitudinal position of each pixel in the point cloud shown is shifted; and, Fig. 9 The number of pixels in the target point cloud shown is significantly larger than Figure 4The number of pixels in the point cloud shown is increased, thereby improving the resolution of the target point cloud in the longitudinal dimension.

[0148] In some specific implementations, the transmission period of each frame of data can be shortened based on the third preset ratio to obtain an updated lateral angular resolution; and based on the updated lateral angular resolution, the row point cloud in the target point cloud is updated.

[0149] The third preset ratio is used to characterize the ratio of the updated transmission period to the original transmission period. For example, the third preset ratio is 30%, 50%, 66% and other different ratio values. The above third preset ratio is only an example, which can be specifically set according to actual needs. Other unspecified third preset ratios are also within the scope of protection of this application and will not be repeated here.

[0150] For example, when the third preset ratio is 50%, based on the original transmission period Δt of each frame of data, by shortening Δt to obtain 0.5Δt, multiple updated sampling moments can be obtained (for example, (t0+0.5Δt) moment, (t0+1.5Δt) moment, (t0+2.5Δt) moment, etc.).

[0151] Furthermore, based on the above-mentioned multiple updated sampling moments, formula (1) can be used to respectively calculate and obtain multiple updated lateral angular resolutions (for example, the updated lateral angular resolution (θ0+0.5Δθ) corresponding to the moment (t0+0.5Δt), the updated lateral angular resolution (θ0+1.5Δθ) corresponding to the moment (t0+1.5Δt), and the updated lateral angular resolution (θ0+2.5Δθ) corresponding to the moment (t0+2.5Δt); and the column point clouds corresponding to each updated lateral angular resolution (for example, the column point cloud corresponding to the lateral angular resolution (θ0+0.5Δθ), the column point cloud corresponding to the lateral angular resolution (θ0+1.5Δθ), the column point cloud corresponding to the lateral angular resolution (θ0+2.5Δθ), etc.).

[0152] While keeping the longitudinal angular resolution unchanged, the point cloud corresponding to the above updated sampling time and Fig. 9 The target point cloud shown in the figure can be stitched together to obtain a new target point cloud. Fig.10 A schematic diagram of a target point cloud in an embodiment of the present application is shown.

[0153] By controlling the transmission period for updating each frame of data through the third preset ratio, the lateral angular resolution can be dynamically updated, thereby obtaining a column point cloud corresponding to the updated lateral angular resolution to highlight the pixel resolution of the point cloud data in the lateral dimension.

[0154] Fig.11FIG. 2 shows a block diagram of the optical receiver in an embodiment of the present application. Fig.11 As shown, the optical receiver 1100 includes but is not limited to the following modules:

[0155] The receiving module 1101 is used to receive the optical signal corresponding to each acquisition sub-cycle, wherein the optical signals received in different acquisition sub-cycles are different.

[0156] The processing module 1102 is used to process the optical signal corresponding to each acquisition sub-cycle based on multiple acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit that starts acquisition is different from the preset position.

[0157] The stitching module 1103 is used to stitch the point clouds corresponding to multiple acquisition sub-cycles to generate a target point cloud.

[0158] It should be noted that the optical receiver 1100 in this embodiment can implement any signal processing method in this application, which will not be described in detail here.

[0159] In this embodiment, an optical signal corresponding to each acquisition sub-cycle is received by an acquisition module, wherein the optical signals received in different acquisition sub-cycles are different; a processing module is used to process the optical signal corresponding to each acquisition sub-cycle based on multiple acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit for starting acquisition is different from the preset position, so that the point cloud corresponding to each acquisition sub-cycle can reflect the pixel position information corresponding to the optical signal, thereby improving the resolution of the target object; a splicing module is used to splice the point clouds corresponding to multiple acquisition sub-cycles to generate a target point cloud, and the target point cloud can more accurately reflect the detailed information of the target object, thereby improving the recognition accuracy of the target object.

[0160] Fig.12 FIG. 2 is a schematic diagram showing the structure of the photoelectric sensor device in the optical receiver in the embodiment of the present application. Fig.12 As shown, the photoelectric sensing device includes a two-dimensional detector array 1202, a two-dimensional readout circuit array 1204, and a plurality of electrical connections 1206 for coupling the detector array and the readout circuit array.

[0161] The detector array 1202 includes: a plurality of photodetectors 1212 (eg, APDs, etc.) arranged in rows and columns. Correspondingly, the readout circuit array 1204 includes: a plurality of readout circuit units 1214 arranged in rows and columns.

[0162] The electrical connector 1206 couples the photodetector 1212 and the corresponding readout circuit unit 1214 in a bump-bonding or bridge-bonding manner. The substrate material of the detector array 1202 can be any one or more of silicon, germanium, indium gallium arsenic / indium phosphide, mercury cadmium telluride, etc. The readout circuit array 1204 is an array manufactured based on a complementary metal oxide semiconductor (CMOS) process.

[0163] It should be noted that each readout circuit unit 1214 is coupled to a corresponding photodetector 1212 and is used to process (including conversion, amplification, filtering, sampling, comparison and storage, etc.) the current signal output by the photodetector 1212. Each readout circuit unit 1214 includes a separate selection switch (not shown in the figure).

[0164] Fig.13 FIG. 1 is a block diagram showing the composition of the light receiving array in the embodiment of the present application. Fig.13 As shown, the light receiving array 1300 includes but is not limited to the following modules.

[0165] The receiving module 1301 is used to receive, based on the acquisition sub-period, an optical signal carried in the light beam transmitted by the scanner and reflected by the target object.

[0166] The scanner is a device including a plurality of preset mirrors and rotating at a preset rotation speed based on a preset rotation axis.

[0167] For example, the scanner is implemented using a coaxial rotating mirror (e.g., Figure 3 The scanner 304 shown in FIG. Figure 3 The transmitting lens 302 shown can collimate or homogenize the light beam to generate a light source matrix or a homogenized light source; then, the light beam is transmitted through the central light hole ( Figure 3 The central circular area in the light beam transmitting and receiving unit 303 shown in the figure) and the rotating mirror enable the light source dot matrix or the homogenized light source to be projected onto the target object within the field of view.

[0168] After the light beam is reflected from the target object, the light beam is received by the receiving module 1301, thereby obtaining light signals corresponding to multiple acquisition sub-periods.

[0169] The resolution determination module 1302 is used to determine the lateral angular resolution based on the number of preset mirrors included in the scanner, the rotation speed of the scanner and the transmission period of each frame of data, and to determine the longitudinal angular resolution based on the longitudinal field of view angle of the radar and the number of single-photon detection modules included in the acquisition unit corresponding to the pixel points in the point cloud, wherein the number of acquisition units used in each acquisition sub-period corresponds to the longitudinal angular resolution.

[0170] The signal processing module 1303 is used to process the optical signal corresponding to each acquisition sub-cycle based on multiple acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit that starts acquisition is different from the preset position.

[0171] The stitching module 1304 is used to stitch point clouds corresponding to multiple acquisition sub-periods using the horizontal angular resolution as the horizontal coordinate and the vertical angular resolution as the vertical coordinate to generate a target point cloud.

[0172] In this embodiment, the receiving module in the light receiving array receives the light signal carried in the light beam transmitted by the scanner and reflected by the target object based on the acquisition sub-cycle, so as to obtain light beams in more directions; then, the resolution determination module in the light receiving array determines the lateral angular resolution based on the number of preset mirrors included in the scanner, the rotation speed of the scanner and the transmission cycle of each frame of data, and determines the longitudinal angular resolution based on the longitudinal field of view angle of the radar and the number of single-photon detection modules included in the acquisition unit corresponding to the pixel point in the point cloud, wherein the number of acquisition units used in each acquisition sub-cycle corresponds to the longitudinal angular resolution, so that the splicing module can determine the longitudinal angular resolution in the horizontal direction. A point cloud is constructed by taking the lateral angular resolution as the horizontal coordinate and the longitudinal angular resolution as the vertical coordinate; a signal processing module is used to process the optical signal corresponding to each acquisition sub-cycle based on multiple acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit starting acquisition is different from the preset position; further, a stitching module is used to stitch the point clouds corresponding to multiple acquisition sub-cycles with the lateral angular resolution as the horizontal coordinate and the longitudinal angular resolution as the vertical coordinate to generate a target point cloud, based on which the detailed information of the target object can be more accurately reflected, thereby improving the recognition accuracy of the target object.

[0173] It is worth mentioning that all modules involved in this embodiment are logic modules. In practical applications, a logic unit can be a physical unit, a part of a physical unit, or a combination of multiple physical units. In addition, in order to highlight the innovative part of this application, this embodiment does not introduce units that are not closely related to solving the technical problems proposed by this application, but this does not mean that there are no other units in this embodiment.

[0174] Fig.14 FIG. 2 is a schematic diagram showing the structure of the laser radar system in the embodiment of the present application. Fig.14 As shown, the laser radar system 1400 includes but is not limited to the following devices.

[0175] The optical transmitter 1401 is used to transmit an optical beam, where the optical beam includes an optical signal;

[0176] The scanner 1402 is used to receive the light beam emitted by the light transmitter 1401, and change the transmission path of the light beam emitted by the light transmitter 1401 so that the light beam is irradiated onto a target object (not shown in the figure); and receive the light beam reflected by the target object, and transmit the light beam reflected by the target object to the light receiver 1403. The scanner 1402 includes a plurality of preset mirrors, and the scanner 1402 rotates at a preset rotation speed based on a preset rotation axis;

[0177] The optical receiver 1403 is used to receive the optical signal carried in the light beam transmitted by the scanner 1402 and reflected by the target object, and execute any one of the signal processing methods in the embodiments of the present application.

[0178] In some optional embodiments, the optical receiver 1403 includes a plurality of acquisition units, each of which includes a plurality of single-photon detection modules, and the single-photon detection modules are single-photon avalanche diodes (SPADs).

[0179] In this embodiment, a light beam to be processed reflected by a preset mirror during the rotation of the scanner is acquired by an optical receiver, and the scanner includes multiple preset mirrors, and the preset mirrors are used to change the transmission path of the light beam emitted by the optical transmitter, so as to acquire light beams in more directions; then, the optical receiver receives the light signal carried in the light beam reflected by the target object and transmitted through the scanner, and receives the light signal corresponding to each acquisition sub-cycle, wherein the light signals received in different acquisition sub-cycles are different; within each acquisition sub-cycle, the light signal corresponding to each acquisition sub-cycle is processed based on multiple acquisition units to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit for starting acquisition is different from the preset position; the point clouds corresponding to multiple acquisition sub-cycles are spliced ​​to generate a target point cloud, and the target point cloud can more accurately reflect the detailed information of the target object, thereby improving the recognition accuracy of the target object.

[0180] Fig.15 A structural diagram showing an exemplary hardware architecture of an electronic device according to a signal processing method and apparatus according to an embodiment of the present application.

[0181] like Fig.15As shown, the electronic device 1500 includes an input device 1501, an input interface 1502, a central processing unit 1503, a memory 1504, an output interface 1505, and an output device 1506. The input interface 1502, the central processing unit 1503, the memory 1504, and the output interface 15015 are connected to each other via a bus 1510, and the input device 1501 and the output device 1506 are connected to the bus 1510 via the input interface 1502 and the output interface 1505, respectively, and then connected to other components of the electronic device 1500.

[0182] Specifically, the input device 1501 receives input information from the outside (for example, a preset mirror in a scanner), and transmits the input information to the central processing unit 1503 through the input interface 1502; the central processing unit 1503 processes the input information based on the computer executable instructions stored in the memory 1504 to generate output information, temporarily or permanently stores the output information in the memory 1504, and then transmits the output information to the output device 1506 through the output interface 1505; the output device 1506 outputs the output information to the outside of the computing device 1500 for user use.

[0183] In one embodiment, Fig.15 The electronic device 1500 shown may be implemented as a network device, which may include: a memory configured to store a program; and a processor configured to run the program stored in the memory to execute any one of the signal processing methods described in the above embodiments.

[0184] According to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program tangibly contained on a machine-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network, and / or installed from a removable storage medium.

[0185] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0186] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present application, but the present application is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and substance of the present application, and these modifications and improvements are also considered to be within the scope of protection of the present application.

Claims

1. A signal processing method, characterized in that: include: receiving optical signals corresponding to each acquisition sub-cycle, wherein the optical signals received in different acquisition sub-cycles are different; In each of the acquisition sub-cycles, the optical signal corresponding to each of the acquisition sub-cycles is processed based on the multiple acquisition units to generate a point cloud corresponding to each of the acquisition sub-cycles, wherein in at least one of the acquisition sub-cycles, the center position of the acquisition unit starting acquisition is different from the preset position; The point clouds corresponding to the multiple acquisition sub-cycles are spliced ​​to generate a target point cloud.

2. The method according to claim 1, characterized in that The plurality of acquisition units correspond to the plurality of pixel points one by one, and the acquisition sub-cycles include: an even-numbered acquisition sub-cycle and an odd-numbered acquisition sub-cycle; Among them, the center position of the collection unit corresponding to one of the odd collection sub-cycle and the even collection sub-cycle is the preset position; the center position of the collection unit corresponding to the other of the odd collection sub-cycle and the even collection sub-cycle is a position other than the preset position, which is determined based on the number of single-photon detection modules included in each of the collection units.

3. The method according to claim 2, characterized in that The acquisition unit includes K×K single-photon detection modules, and the center position of the acquisition unit corresponding to one of the odd-numbered acquisition sub-period and the even-numbered acquisition sub-period is determined based on the position of the first row of single-photon detection modules; The center position of the acquisition unit corresponding to the other of the odd acquisition sub-cycle and the even acquisition sub-cycle is determined based on the position of any row of single-photon detection modules in K rows except the first row of single-photon detection modules, where K is an integer greater than or equal to 2.

4. The method according to claim 1, characterized in that The preset position is the center position of the reference acquisition unit, and the number of single-photon detection modules included in the reference acquisition unit is greater than the number of single-photon detection modules included in the acquisition unit.

5. The method according to claim 4, characterized in that The reference acquisition unit includes K×K reference single-photon detection modules; The acquisition unit includes M×K reference single-photon detection modules, where M<K.

6. The method according to any one of claims 1 to 5, characterized in that The receiving of optical signals corresponding to each acquisition sub-period includes: Based on the acquisition sub-period, acquiring a light signal carried in a light beam reflected by a preset mirror during the rotation of the scanner; Wherein, the scanner comprises a plurality of the preset mirrors, and the preset mirrors are used to change the transmission path of the light beam emitted by the light emitter.

7. The method according to claim 1, characterized in that The acquisition sub-period corresponds to the lateral angular resolution.

8. The method according to claim 2, characterized in that: Before splicing the point clouds corresponding to the plurality of acquisition sub-periods to generate the target point cloud, the signal processing method further includes: When it is determined that pixel information of the central area corresponding to the optical signal needs to be obtained and the central position of the acquisition unit corresponding to the odd-numbered acquisition sub-cycle is the preset position, at least one edge pixel point in the even-numbered acquisition sub-cycle is deleted to obtain at least one updated point cloud corresponding to the even-numbered acquisition sub-cycle, wherein the distance between the edge pixel point and the middle pixel point in the point cloud corresponding to the even-numbered acquisition sub-cycle is greater than a preset distance threshold; The step of stitching point clouds corresponding to the plurality of acquisition sub-periods to generate a target point cloud includes: The target point cloud is generated based on the at least one updated point cloud corresponding to the even-numbered acquisition sub-cycle and the point cloud corresponding to the odd-numbered acquisition sub-cycle.

9. The method according to claim 2, characterized in that: Before splicing the point clouds corresponding to the plurality of acquisition sub-periods to generate the target point cloud, the signal processing method further includes: When it is determined that pixel information of the edge area corresponding to the optical signal needs to be obtained and the center position of the acquisition unit corresponding to the odd-numbered acquisition sub-cycle is the preset position, the center pixel point in the at least one even-numbered acquisition sub-cycle is deleted to obtain at least one updated point cloud corresponding to the even-numbered acquisition sub-cycle, wherein the distance between the center pixel point and the middle pixel point in the point cloud corresponding to the even-numbered acquisition sub-cycle is less than or equal to the preset distance threshold; The step of stitching point clouds corresponding to the plurality of acquisition sub-periods to generate a target point cloud includes: The target point cloud is generated based on the at least one updated point cloud corresponding to the even-numbered acquisition sub-cycle and the point cloud corresponding to the odd-numbered acquisition sub-cycle.

10. An optical receiver, characterized in that: include: A receiving module, used for receiving optical signals corresponding to each acquisition sub-cycle, wherein the optical signals received in different acquisition sub-cycles are different; A processing module, configured to process the optical signal corresponding to each acquisition sub-cycle based on a plurality of acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one of the acquisition sub-cycles, the center position of the acquisition unit for starting acquisition is different from a preset position; The splicing module is used to splice the point clouds corresponding to the multiple acquisition sub-cycles to generate a target point cloud.

11. A light receiving array, characterized in that: include: A receiving module, configured to receive, based on a collection sub-period, an optical signal carried in a light beam transmitted by a scanner and reflected by a target object, wherein the scanner is a device including a plurality of preset mirrors and rotating at a preset rotation speed based on a preset rotation axis; A resolution determination module, configured to determine the lateral angular resolution based on the number of preset mirrors included in the scanner, the rotation speed of the scanner and the transmission period of each frame of data, and determine the longitudinal angular resolution based on the longitudinal field of view angle of the radar and the number of single-photon detection modules included in the acquisition unit corresponding to the pixel point in the point cloud, wherein the number of acquisition units used in each acquisition sub-period corresponds to the longitudinal angular resolution; A signal processing module, configured to process the optical signal corresponding to each acquisition sub-cycle based on a plurality of acquisition units in each acquisition sub-cycle to generate a point cloud corresponding to each acquisition sub-cycle, wherein in at least one acquisition sub-cycle, the center position of the acquisition unit starting acquisition is different from a preset position; The splicing module is used to splice the point clouds corresponding to the multiple acquisition sub-periods with the transverse angular resolution as the horizontal coordinate and the longitudinal angular resolution as the vertical coordinate to generate a target point cloud.

12. A laser radar system, characterized in that: include: A light transmitter, configured to transmit a light beam, wherein the light beam includes a light signal; A scanner, configured to receive the light beam emitted by the light emitter, and change the transmission path of the light beam emitted by the light emitter so that the light beam is irradiated onto a target object; and receive the light beam reflected by the target object, and transmit the light beam reflected by the target object to a light receiver, wherein the scanner comprises a plurality of preset mirrors, and the scanner rotates at a preset rotation speed based on a preset rotation axis; An optical receiver is used to receive an optical signal carried in a light beam transmitted by the scanner and reflected by the target object, and to perform a signal processing method as claimed in any one of claims 1 to 9.

13. The laser radar system according to claim 12, characterized in that: The optical receiver includes a plurality of collection units, each of which includes a plurality of single-photon detection modules, and the single-photon detection modules are single-photon avalanche diodes (SPADs).

14. An electronic device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the signal processing method according to any one of claims 1 to 9.

15. A readable storage medium, wherein a plurality of instructions are stored in the readable storage medium; the plurality of instructions are used for a processor to load and execute the signal processing method as claimed in any one of claims 1 to 9.