LIDAR OCCLUSION DETECTION METHOD AND SYSTEM
The method and system for detecting occlusions and optical defects within the LIDAR's field of view improve scanning accuracy by analyzing reflected light intensity and characteristics from external structures, addressing the challenge of obstructions in LIDAR systems.
Patent Information
- Application Number
- JP2022536577
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-12-22
- Filing Date
- 2020-12-23
- Publication Date
- 2024-11-11
- Estimated Expiration
- 2040-12-23
AI Technical Summary
LIDAR systems face challenges in detecting occlusions such as dust, dirt, or optical defects on the optical window, which obstruct the scanning field of view and affect the accuracy of distance measurements.
A method and system for detecting occlusions by scanning external structures within the LIDAR's field of view, using reflective mounting brackets or external surfaces to reflect light pulses, and analyzing the intensity and characteristics of the reflected light to identify any obstructions or optical defects.
Enhances the detection of occlusions and optical defects, improving the accuracy and reliability of LIDAR systems by ensuring clear scanning paths and maintaining precise distance measurements.
Smart Images

Figure 0007580464000001 
Figure 0007580464000002 
Figure 0007580464000003
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Patent Application No. 17 / 131,594, filed December 22, 2020, and U.S. Provisional Patent Application No. 62 / 954,338, filed December 27, 2019. [Background technology]
[0002] Some Light Detection and Ranging (lidar) systems utilize a light emitting transmitter (e.g., a laser diode) to emit a light pulse into an environment. The emitted light pulse that interacts with (e.g., reflects off) an object in the environment can then be received by a receiver (e.g., a photodetector) of the lidar system. Distance information about objects in the environment can then be determined based on the time difference between the emission of the light pulse and the reception of the return reflection of the emitted light pulse. Summary of the Invention
[0003] In one example, a method is provided. The method includes scanning, by a light detection and ranging (LIDAR) device physically coupled to the external structure, at least a portion of an external structure within a field-of-view (FOV) of the LIDAR device. The scanning includes transmitting light pulses in various directions toward the external structure through an optical window. The scanning also includes receiving reflected light pulses through the optical window including reflections of the transmitted light pulses from the external structure back to the LIDAR device. The method also includes detecting a presence of an occlusion at least partially occluding the LIDAR device from scanning the FOV based on at least the scanning of the at least a portion of the external structure.
[0004] In another example, a system is provided. The system includes a mounting structure, a light detection and ranging (LIDAR) device mounted to the mounting structure, an optical window, one or more processors, and data storage. The data storage stores instructions that, when executed by the one or more processors, cause the system to perform operations. The operations include scanning at least a portion of the mounting structure that is within a field of view (FOV) of the LIDAR device. The scanning includes transmitting light pulses in various directions from the LIDAR device toward the mounting structure through the optical window. The scanning also includes receiving reflected light pulses including reflections of the transmitted light pulses from the mounting structure back to the LIDAR device through the optical window. The operations also include detecting the presence of an occlusion at least partially occluding the LIDAR device from the scanning FOV based on at least the scanning of at least a portion of the mounting structure.
[0005] In yet another example, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium stores instructions that, when executed by one or more processors, cause a system to perform operations. The operations include scanning at least a portion of an external structure within a field of view (FOV) of the LIDAR device using a light detection and ranging (LIDAR) device physically coupled to the external structure. The scanning includes transmitting light pulses in various directions toward the external structure through an optical window of the LIDAR device. The scanning also includes receiving reflected light pulses through the optical window including a reflection of the transmitted light pulses from the external structure back to the LIDAR device. The operations also include detecting the presence of an occlusion at least partially occluding the LIDAR device from scanning the FOV based on at least the scanning of at least a portion of the external structure.
[0006] In yet another example, a system is provided. The system includes means for scanning, by a light detection and ranging (LIDAR) device physically coupled to the external structure, at least a portion of the external structure within a field of view (FOV) of the LIDAR device. The scanning includes transmitting light pulses in various directions toward the external structure through an optical window. The scanning also includes receiving reflected light pulses through the optical window including reflections of the transmitted light pulses from the external structure back to the LIDAR device. The system also includes means for detecting the presence of an occlusion at least partially occluding the LIDAR device from scanning the FOV based on at least the scanning of at least a portion of the mounting structure.
[0007] Other aspects, embodiments, and implementations will become apparent to those of ordinary skill in the art upon reading the following detailed description, with appropriate reference to the accompanying drawings. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 illustrates a simplified block diagram of a system in accordance with an exemplary embodiment. [Diagram 2] 1 illustrates a LIDAR device mounted on a mounting structure in accordance with an exemplary embodiment. [Figure 3A] 1 illustrates a first view of a vehicle in accordance with an exemplary embodiment. [Figure 3B] 1 illustrates a second view of the vehicle in accordance with an exemplary embodiment. [Figure 3C] 13 illustrates a third view of a vehicle in accordance with an exemplary embodiment. [Figure 3D] 11 illustrates a fourth view of a vehicle in accordance with an exemplary embodiment. [Figure 3E] 11 illustrates a fifth view of a vehicle in accordance with an exemplary embodiment. [Figure 4] 1 illustrates a method according to an example embodiment. [Diagram 5] 4 illustrates another method according to an example embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Exemplary methods, devices, and systems are described herein. It should be understood that the words "example" and "exemplary" are used herein to mean "serving as an example, instance, or illustration." Any embodiment or feature described herein as "example" or "exemplary" should not necessarily be construed as preferred or advantageous over other embodiments or features. Other embodiments can be utilized, and other changes can be made, without departing from the scope of the subject matter presented herein. Thus, the exemplary embodiments described herein are not meant to be limiting. The aspects of the disclosure as generally described herein and illustrated in the figures can be arranged, substituted, combined, separated, and designed in a wide variety of different configurations, all of which are contemplated herein. Moreover, unless the context suggests otherwise, features illustrated in each figure can be used in combination with one another. Thus, the figures should generally be viewed as partial aspects of one or more overall embodiments, with the understanding that not all illustrated features are necessarily required for each embodiment.
[0010] I. Overview An example LIDAR system herein includes a transmitter and a receiver. The transmitter may include one or more light emitting devices (e.g., one or more laser bars each having 1-8 laser diodes) configured to transmit light into an environment of the LIDAR system via one or more optical elements in a transmission path (e.g., a transmitting lens, a rotatable mirror, and an optical window). The rotatable mirror may be configured to rotate about a mirror axis of rotation. The rotatable mirror may be configured to interact with light pulses emitted by the one or more light emitting devices to direct the light pulses in various directions toward a field of view (FOV) of the LIDAR system. Additionally, the rotatable mirror may be configured to direct the light pulses to the receiver after such light pulses interact with the environment to form return light pulses.
[0011] Among other examples, systems and methods for occlusion detection are provided. For example, an exemplary occlusion detection system may provide a method for determining the presence of dust, dirt, and / or cracks on the optical window and / or other types of occlusions that at least partially obstruct the LIDAR system from scanning the FOV through the optical window.
[0012] Continuing with the above example, the LIDAR system may include a reflective mounting bracket disposed at least partially outside the optical cavity including the transmitter and receiver. In some implementations, the reflective mounting bracket may physically couple the LIDAR system to a mounting surface. The mounting surface may include, for example, the body of a vehicle.
[0013] In one implementation, the reflective mounting bracket may include a reflective surface configured to reflect at least a portion of the emitted light (transmitted from the transmitter through the optical window) back to the LIDAR system for reception by the receiver (through the optical window). For example, the reflective surface may correspond to a portion of the reflective mounting bracket that is within the FOV scanned by the LIDAR system. In some embodiments, the mounting bracket (or the scanned portion) is within a given distance (e.g., 50 millimeters, etc.) to the optical window.
[0014] In another implementation, the exterior surface of any other external structure physically coupled to the LIDAR device may reflect at least a portion of the emitted light instead of or in addition to being reflected by the mounting bracket. In one example, the mounting bracket may be configured to mount the LIDAR device on the body of a vehicle. In this example, the exterior surface may correspond to any exterior surface of the vehicle within the FOV of the LIDAR device (e.g., body panels, side mirror structures, bumpers, fenders, etc.). Thus, in this example, the exterior surface may remain in a fixed position relative to the LIDAR device even as the vehicle moves through the environment. In another example, the LIDAR device may be mounted on a building. In this example, the exterior structure / surface may instead include walls, doors, window frames, or other exterior features of the building within the FOV of the LIDAR device. Other examples are possible.
[0015] In some examples, scanning of the reflective mounting bracket (or other external structure) can be used to detect the presence of an occlusion on or near the optical window. For example, if the light reflected from the reflective mounting bracket (or external structure) and received by the LIDAR device has a lower intensity than expected, the exemplary system may determine that an occlusion (e.g., dirt, dust, mud, water, etc.) is reducing the amount of energy transmitted to and / or received from the reflective surface of the mounting bracket (or external structure). Thus, by scanning across the reflective surface of the mounting bracket, the exemplary system may be configured to determine whether an occlusion is present on the optical window or elsewhere along the optical path between the LIDAR device and the mounting bracket (or external structure).
[0016] Additionally or alternatively, in some examples, scanning can be used to detect optical defects of the LIDAR device. For example, if light reflected from an external structure (e.g., a mounting bracket) and received by the LIDAR device has a lower intensity than expected, an example system may determine that there is an optical defect associated with a decrease in light intensity (e.g., laser dimming). For example, the optical defect may be related to a change in the relative position of one or more optical components in the LIDAR device (e.g., optical misalignment), aging of one or more light emitters (e.g., laser diodes) in the LIDAR device, and / or any other type of optical defect that may cause a dimming (e.g., a decrease in light intensity) of light transmitted and / or received by the LIDAR device.
[0017] II. System Example FIG. 1 illustrates a system 100 according to an exemplary embodiment. In some embodiments, the system 100 may be a laser-based distance and ranging (lidar) system, or a portion thereof. In such a scenario, the system 100 may be configured to emit light pulses into an environment 10 to provide information indicative of objects 12 within a field of view (FOV) 17. As shown, the system 100 may include or be physically coupled to an external structure 190. For example, the system 100 may be mounted at a given position relative to the external structure 190 such that the system 100 and the external structure 190 remain in a predetermined physical arrangement relative to one another.
[0018] In some examples, system 100 may be coupled to a vehicle (or other system) to provide information regarding the vehicle's external environment. In one example, external structure 190 may include a mounting structure (e.g., a mounting bracket) that physically couples system 100 to the vehicle. Thus, in this example, system 100 may remain in a given position relative to the mounting structure (e.g., even as the vehicle moves through the environment). In other examples, external structure 190 may include any structure (e.g., a vehicle side mirror structure, a vehicle body panel, a vehicle bumper, etc.) that is physically coupled to system 100 such that an exterior surface of the external structure remains in a fixed position relative to a given position of system 100 (e.g., even as the vehicle moves through the environment).
[0019] As shown, the external structure 190 may optionally include one or more calibration targets 192. The calibration targets 192 may include, for example, one or more surfaces with a particular texture, surfaces of varying reflectivity and / or emissivity, patterned targets, among other possibilities. By way of example, a particular calibration target may be configured to redirect or absorb all but a given portion of the incident beam energy away from the receiver 121 (e.g., a black dot-like surface disposed on a tilted mirror, etc.). Various other exemplary calibration target configurations are also possible. In some examples, the calibration target 192 may be disposed on at least a portion of the external structure 190 that is within the FOV 17. Thus, the system 100 may be configured to scan at least a portion of the external structure 190 (where the calibration targets 192 are located) while scanning the FOV 17.
[0020] As shown, the system 100 includes a rotatable base 110 configured to rotate about a first axis 102. In some embodiments, the base actuator 112 may be operable to rotate the rotatable base 110 about the first axis 102 at an azimuth rotational speed between 3 Hertz and 60 Hertz (e.g., between 180 revolutions per minute (RPM) and 3600 RPM). However, other azimuth rotational speeds are possible and contemplated. In some embodiments, the base actuator 112 may be controlled by the controller 150 to rotate at a desired rotational speed. In such a scenario, the controller 150 may control the base actuator 112 to rotate at a single target rotational speed and / or the controller 150 may dynamically adjust the desired rotational speed of the base actuator 112 within a range of possible rotational speeds.
[0021] In some embodiments, the base actuator 112 may include an electric motor. For example, the electric motor may include a stator 116 and a rotor 114 that may be operable to rotate a shaft 118 of the rotatable base 110. In various embodiments, the base actuator 112 may be a direct current (DC) motor, a brushless motor, or another type of rotary actuator. In some embodiments, the shaft 118 may be coupled to the rotatable base 110 via one or more bearings 119. The bearings 119 may include rotary bearings or another type of low-friction bearings.
[0022] In some embodiments, system 100 need not include a rotatable base 110. In such scenarios, one or more elements of system 100 within housing 160 may be configured to rotate about first axis 102. In other cases, however, some elements of system 100 need not rotate about first axis 102. Thus, in such embodiments, system 100 may be utilized in line scanning applications, single point scanning applications, among other possibilities.
[0023] The system 100 also includes a mirror assembly 130 with a shaft 134 and a mirror body 133 configured to rotate about a mirror axis of rotation 131. In some embodiments, the mirror axis of rotation 131 can be substantially perpendicular (e.g., within 0-10 degrees of perpendicular) to the first axis 102. In an exemplary embodiment, the mirror actuator 136 can be configured to rotate the mirror body 133 about the mirror axis of rotation 131 at a mirror rotation speed of 100 Hz to 1000 Hz (e.g., 6,000 RPM to 60,000 RPM). In some contexts, the mirror body 133 can be configured to rotate about the mirror axis of rotation 131 within a rotation period (e.g., 3.3 ms to 1 ms).
[0024] The mirror actuator 136 may be a DC motor, a brushless DC motor, an AC motor, a stepper motor, a servo motor, or another type of rotational actuator. It will be understood that the mirror actuator 136 may be operated at various rotational speeds or at a desired rotational speed, and that the mirror actuator 136 may be controlled by the controller 150.
[0025] In some embodiments, the mirror assembly 130 includes a plurality of reflective surfaces 132. For example, the plurality of reflective surfaces 132 may include four reflective surfaces. In various embodiments, the reflective surfaces 132 may be formed from at least one of gold, silicon oxide, titanium oxide, titanium, platinum, or aluminum. In such a scenario, the four reflective surfaces may be symmetrically arranged with respect to the mirror rotation axis 131 such that the mirror body 133 of the mirror assembly 130 has a rectangular prism shape. It will be understood that the mirror assembly 130 may include more or less than four reflective surfaces. Thus, the mirror assembly 130 may be shaped as a multi-sided prism shape having more or less than four sides. For example, the mirror assembly 130 may have three reflective surfaces. In such a scenario, the mirror body 133 may have a triangular cross section.
[0026] In some embodiments, the mirror body 133 may be configured to couple multiple reflective surfaces 132 to the shaft 134. In such a scenario, the mirror body 133 may be substantially hollow. In various embodiments, at least a portion of the mirror body 133 may have an octagonal cross-section and / or four-fold symmetry. In one example, the mirror body 133 may include a polycarbonate material. In this example, the octagonal and / or four-fold symmetric configuration of the mirror body 133 may facilitate reducing potential slippage of the polycarbonate material of the mirror body 133 on the shaft 134 during rotation of the mirror body. Other examples are possible as well.
[0027] In some embodiments, the mirror body 133 may include multiple flexible support members 138. In such a scenario, at least one of the flexible support members 138 may be straight. Additionally or alternatively, at least one of the flexible support members 138 may be curved. In some embodiments, based on the geometry of the system of flexible support members, the mirror body 133 may be rigid in some directions (e.g., to transfer loads) and elastic in some directions to accommodate thermal expansion. For example, the flexible support members 138 may be configured to be substantially rigid when twisted and substantially elastic in response to forces perpendicular to the axis of rotation. In various embodiments, the mirror body 133 may be formed from an injection molded material. Additionally, the shaft 134 may be formed from steel or another structural material.
[0028] In some embodiments, the mirror assembly 130 may include an encoder magnet 139 that may be coupled to the shaft 134. In such a scenario, the encoder magnet 139 is configured to provide information indicative of the rotational position of the rotatable mirror assembly 130 relative to the transmitter 127 and receiver 121.
[0029] In some embodiments, the encoder magnet 139 may also be configured as a mirror motor magnet (e.g., included in the mirror actuator 136). In these embodiments, the system 100 may use the magnet 139 to facilitate both measuring and adjusting the rotational position of the rotatable mirror assembly 130. In one exemplary embodiment, the magnet 139 may be one of a plurality of magnets (e.g., a magnet ring, etc.) arranged in a circular arrangement and configured to interact with a magnetic field (e.g., generated by the actuator 136) to cause rotation of the mirror assembly. Other embodiments are possible.
[0030] In various examples, the mirror assembly 130 may additionally or alternatively include a coupling bracket 135 configured to couple at least a portion of the mirror assembly 130 to other elements of the system 100, such as a housing 160. The coupling bracket 135 may be configured to attach the mirror assembly 130 to the housing 160 through one or more connectors 137. In such a scenario, the coupling bracket 135 and connectors 137 may be configured to be easily removable from other elements of the system 100. Such ease of removal may provide better recalibration, service, and / or repair options.
[0031] The system 100 further includes an optical resonator 120 coupled to the rotatable base 110. The optical resonator includes a transmitter 127 having at least one light emitting device 126 and a light emitting lens 128. In an exemplary embodiment, the at least one light emitting device 126 may include one or more laser diodes. Other types of light sources are possible and contemplated. The at least one light emitting device 126 and the light emitting lens 128 are positioned to define a light emitting axis 18.
[0032] In various embodiments, the rotatable mirror assembly 130 can be configured to controllably rotate about the mirror rotation axis 131 to transmit emitted light towards and receive return light from a location within the environment 10.
[0033] The optical cavity 120 also includes a receiver 121 configured to detect return light 16 from the environment 10. The receiver 121 includes a plurality of photodetectors 122. By way of example, the plurality of photodetectors 122 may include at least one solid-state single-photon sensitive device. For example, in some embodiments, the plurality of photodetectors 122 may include one or more silicon photomultipliers (SiPMs). In such a scenario, the SiPMs may each include a plurality (e.g., a two-dimensional array) of single-photon avalanche diodes (SPADs). Additionally or alternatively, the plurality of photodetectors 122 may include avalanche photodiodes (APDs), infrared photodiodes, photoconductors, or another type of photodetector. It will be appreciated that systems incorporating a plurality of photodetectors, such as focal plane arrays or another type of image sensor, are also possible and contemplated.
[0034] The plurality of photodetectors 122 includes a respective set of two or more photodetectors for each light-emitting device of the at least one light-emitting device 126. In various embodiments, the at least one light-emitting device 126 may be configured to emit a light pulse that interacts with the mirror assembly 130 such that the light pulse is redirected toward the environment 10 of the system 100 as transmitted light 14. In such a scenario, at least a portion of the light pulse may be reflected back toward the system 100 as returned light 16 and received by the plurality of photodetectors 122 to determine at least one of a time of flight, a distance to the object 12, and / or a point cloud.
[0035] In an exemplary embodiment, light detector 122 may provide an output signal to controller 150. For example, the output signal may include information indicative of a time of flight of a given light pulse directed to a given portion of field of view 17 of environment 10. Additionally or alternatively, the output signal may include information indicative of at least a portion of a range map or point cloud of environment 10.
[0036] In some embodiments, each set of two or more photodetectors may include a primary photodetector 123 and a secondary photodetector 125. The primary photodetector 123 is configured to receive a first portion of the return light 16 corresponding to the light pulse emitted from a given light emitting device. In such a scenario, the secondary photodetector 125 is configured to receive a second portion of the return light emitted from the given light emitting device.
[0037] In various embodiments, the first portion of the return light 16 and the second portion of the return light 16 can have significantly different intensities. For example, the first portion of the return light 16 can be at least an order of magnitude greater in photon flux than the second portion of the return light 16.
[0038] In one exemplary embodiment, the at least one light emitting device 126 may include a four-element laser diode bar (e.g., four individual light sources disposed on a laser bar). In such a scenario, the plurality of photodetectors 122 may include four primary photodetectors. Each primary photodetector may correspond to a respective light emitter on the laser diode bar. Additionally, the plurality of photodetectors 122 may include four secondary photodetectors. Each secondary photodetector may correspond to a respective light emitter on the laser diode bar.
[0039] In alternative embodiments, the at least one light emitting device 126 may include two or more laser diode bars, and a laser bar may include more or less than four light emitting devices.
[0040] In some embodiments, the light emitting device 126 can be coupled to a laser pulser circuit operable to cause the light emitting device 126 to emit one or more pulses of laser light. In such a scenario, the laser pulser circuit can be coupled to a trigger source, which can include the controller 150. The light emitting device 126 can be configured to emit infrared light (e.g., having a wavelength between 800 and 1600 nanometers (nm), e.g., 905 nm). However, other wavelengths of light are possible and contemplated.
[0041] The receiver 121 also includes a photodetector lens 124. The multiple photodetectors 122 and the photodetector lens 124 are arranged to define a light receiving axis 19. At least one of the light receiving axis 19 or the light emitting axis 18 forms an oblique angle with respect to the first axis 102. By way of example, the oblique angle may be between 5 and 30 degrees, although other oblique angles are possible and contemplated.
[0042] Receiver 121 additionally includes a plurality of apertures 178, which may be openings in an aperture plate 176. In various embodiments, aperture plate 176 may have a thickness between 50 microns and 200 microns. Additionally or alternatively, at least one aperture of the plurality of apertures 178 may have a diameter between 150 microns and 300 microns. However, other aperture sizes larger and smaller than this range are possible and contemplated. Further, in one exemplary embodiment, each aperture of the plurality of apertures 178 may be spaced apart by between 200 microns and 800 microns. Other aperture spacings are possible and contemplated.
[0043] The receiver 121 may also include one or more light redirectors 129. In such a scenario, each light redirector 129 may be configured to optically couple a respective portion of the return light 16 from a respective aperture to at least one photodetector of the plurality of photodetectors 122. For example, each light redirector may be configured to optically couple a respective portion of the return light from a respective aperture to at least one photodetector of the plurality of photodetectors by total internal reflection.
[0044] In some embodiments, the light redirector 129 may be formed from an injection moldable optical material. In such a scenario, the light redirector 129 is coupled together to element pairs such that the first element pair and the second element pair are formed to slidably couple to one another. In an exemplary embodiment, the light redirector 129 is configured to split the return light 16 into unequal portions such that the first photodetector is illuminated with a first photon flux of the first portion of the return light 16 and the second photodetector is illuminated with a second photon flux of the second portion of the return light 16.
[0045] In some examples, the light redirector 129 may also be configured to expand the beam width of the first portion of the return light 16 projected onto the first photodetector (and / or the second portion of the return light 16 projected onto the second photodetector). In this way, for example, the detection area at each photodetector onto which each portion of the return light 16 is projected may be larger than the cross-sectional area of their associated apertures.
[0046] In various exemplary embodiments, the rotatable base 110, the mirror assembly 130, and the optical cavity 120 may be arranged to provide a field of view 17. In some embodiments, the field of view 17 may include an azimuth range of 360 degrees about the first axis 102 and an elevation range of 60 degrees to 120 degrees (e.g., at least 100 degrees) about the mirror rotation axis 131. In one embodiment, the elevation range may be configured to enable the system 100 to direct one or more radiation beams along (and / or substantially parallel to) the direction of the first axis 102. It will be understood that other azimuth and elevation ranges are possible and contemplated.
[0047] In some embodiments, the field of view 17 may have two or more consecutive angular ranges (e.g., a "split" or discontinuous field of view). In one embodiment, the two or more consecutive angular ranges may extend off the same side of the first axis 102. Alternatively, in another embodiment, the two or more consecutive angular ranges may extend off opposite sides of the first axis 102. For example, a first side of the first axis 102 may be associated with an elevation angle between 0 degrees and 180 degrees, and a second side of the first axis may be associated with an elevation angle between 180 degrees and 360 degrees.
[0048] In some embodiments, the system 100 includes a rotatable housing 160 having an optical window 162. The optical window 162 may include a flat window. Additionally or alternatively, the optical window 162 may include a curved window and / or a window having optical power. As an example, a curved window may provide an extended field of view (compared to a flat optical window) at the expense of some loss or degradation of the quality of the light beam. In such a scenario, light pulses may be emitted through the optical window 162 towards, transmitted through, and received from the environment 10. Additionally, while various embodiments herein have described one optical window, it will be understood that examples having two or more optical windows are possible and contemplated.
[0049] The optical window 162 may be substantially transparent to light having wavelengths such as the wavelengths of the emitted light pulses (e.g., infrared wavelengths). For example, the optical window 162 may include an optically transparent material configured to transmit the emitted light pulses with a transmission efficiency of greater than 80% in the infrared wavelength range. In one embodiment, the transmission efficiency of the optical window 162 may be 98% or greater. In another embodiment, the transmission efficiency of the optical window 162 may vary as a function of the angle of incidence of the transmitted and / or received light incident on the optical window 162. For example, the transmission efficiency may be lower when the light is incident on the optical window from a relatively higher angle of incidence than when the light is incident from a relatively lower angle of incidence.
[0050] In some examples, the optical window 162 may be formed from a polymeric material (e.g., polycarbonate, acrylic, etc.), glass, quartz, or sapphire. It will be understood that other optical materials that are substantially transparent to infrared light are possible and contemplated.
[0051] In some embodiments, other portions of the rotatable housing 160 may be coated or formed with a light absorbing material, such as black tape, absorptive paint, carbon black, black anodized and / or micro-arc oxidized surfaces or materials, and / or another type of optically absorbing, anti-reflective surface or material.
[0052] The various elements of the system 100 may be arranged in different configurations. For example, in one exemplary embodiment, at least one of the light receiving axis 19 or the light emitting axis 18 does not intersect with the mirror rotation axis 131.
[0053] The system 100 includes a controller 150. In some embodiments, the controller 150 includes at least one of a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). Additionally or alternatively, the controller 150 may include one or more processors 152 and a memory 154. The one or more processors 152 may include general purpose processors or special purpose processors (e.g., digital signal processors, graphics processor units, etc.). The one or more processors 152 may be configured to execute computer readable program instructions stored in the memory 154. Thus, the one or more processors 152 may execute the program instructions to provide at least some of the functions and operations described herein.
[0054] The memory 154 may include or take the form of one or more computer-readable storage media that are readable or accessible by the one or more processors 152. The one or more computer-readable storage media may include volatile and / or non-volatile storage components, such as optical, magnetic, organic, or other memory, or disk storage, that may be integrated in whole or in part with at least one of the one or more processors 152. In some embodiments, the memory 154 may be implemented using a single physical device (e.g., one optical, magnetic, organic, or other memory, or disk storage unit), while in other embodiments, the memory 154 may be implemented using two or more physical devices. Thus, in one embodiment, the memory 154 may include a non-transitory computer-readable medium that stores instructions that, when executed by the one or more processors 152, cause the system 100 to perform at least some of the operations described herein.
[0055] As noted above, memory 154 may include computer readable program instructions related to the operation of system 100. Thus, memory 154 may include program instructions for performing or facilitating some or all of the operations or functions described herein.
[0056] For example, the operation may include causing the light-emitting device 126 to emit a light pulse. In such a scenario, the controller 150 may cause a pulser circuit associated with the light-emitting device 126 to provide one or more current / voltage pulses to the light-emitting device 126, thereby causing the light-emitting device 126 to provide the light pulse.
[0057] The operations may also include receiving at least a first portion of a reflected light pulse (e.g., return light 16) from the field of view 17 as a detected light signal. For example, at least a portion of the light pulse emitted from the light emitting device 126 through the optical window 162 (e.g., transmitted light 14) may interact with an object 12 in the environment 10 within the field of view 17 to provide a reflected light pulse or return light 16. At least a portion of the reflected light pulse may be received by at least one photodetector of the plurality of photodetectors 122. A given photodetector may then provide a detected light signal, which may include a photocurrent signal or a photovoltage signal.
[0058] Additionally, the operations may include determining a point cloud indicative of object 12 within field of view 17 based on the detected optical signals. In an exemplary embodiment, determining the point cloud may be performed by controller 150. For example, controller 150 may determine and accumulate a plurality of spatial points based on the respective time of flight of each emitted and received optical pulse. Determining the point cloud may be further based on an elevation angle of mirror assembly 130 and an azimuth angle of rotatable base 110.
[0059] It will be understood that some or all of the operations described herein may be performed by a computing device located remotely from the controller 150 and / or other elements of the system 100.
[0060] In various embodiments, the system 100 may include at least one baffle. For example, the system 100 may include at least one rotatable baffle 170 and / or at least one static baffle 172. In such a scenario, the at least one rotatable baffle 170 and / or at least one static baffle 172 may be configured to reduce stray light in the optical cavity 120 (e.g., light traveling internally from the light emitting device 126 to the plurality of photodetectors 122 without first interacting with the environment around the system 100). In an exemplary embodiment, the static baffle 172 may include an optically opaque material disposed between the light receiving axis 19 and the light emitting axis 18. In some embodiments, the rotatable baffle 170 may be coupled to the mirror body 133 and may include an optically opaque material configured to reduce or eliminate stray light between the transmitter portion and the receiver portion of the system 100. In other words, the first portion of the mirror body 133 and the second portion of the mirror body 133 may be separated by the rotatable baffle 170. In such a scenario, the rotatable baffle 170 may be shaped like a flat disk, although other shapes are contemplated and possible. The rotatable baffle 170 may be centered on and perpendicular to the mirror rotation axis 131.
[0061] In some embodiments, system 100 may include an optical feedback system. As part of the optical feedback system, transmitter 127 may be configured to transmit a plurality of optical pulses toward reflective surface 132 of mirror assembly 130 during rotation of mirror body 133. In such a scenario, mirror assembly 130 may be configured to (i) reflect at least a first optical pulse of the plurality of optical pulses into environment 10 of system 100, and (ii) reflect at least a second optical pulse of the plurality of optical pulses into internal optical path 168. In some embodiments, internal optical path 168 may include baffle openings 174 in rotatable baffle 170, static baffle 172, and / or in a gap between rotatable baffle 170 and static baffle 172.
[0062] In such a scenario, the multiple optical detectors 122 of the receiver 121 may be configured to (i) detect a reflected light pulse including a reflection of the first light pulse caused by an object 12 in the environment 10, and (ii) detect a second light pulse received via the internal light path 168. In various embodiments, the internal light path 168 may be defined at least in part by one or more internal reflecting mirrors 180 that reflect the second light pulse toward the reflective surface 132 of the mirror assembly 130 such that the reflective surface 132 reflects the second light pulse toward the receiver 121.
[0063] Further, in such a scenario, controller 150 may be configured to determine a distance to an object 12 in environment 10 based on the time a first light pulse is transmitted by transmitter 127, the time a reflected light pulse is detected by photodetector 122, and the time a second light pulse is detected by photodetector 122. In such a scenario, the first light pulse (and its corresponding reflected light pulse) may provide information indicative of the distance to the object, and the second light pulse (and its corresponding reflected light pulse) may provide information indicative of a feedback distance or a zero-length reference.
[0064] 2 illustrates a LIDAR device 200 mounted on a mounting structure 290, according to an exemplary embodiment. For convenience of illustration, xyz axes are shown in FIG.
[0065] The mounting structure 290 may be similar to the external structure 190. For example, the mounting structure 290 may be formed from any solid material suitable for physically supporting the LIDAR 200 while the housing 160 and / or one or more components therein rotate about the axis 102.
[0066] 2, the LIDAR 200 may be physically coupled to the mounting structure 290 via a receiving structure 291. In one example, the receiving structure 291 may include a curved wall of the mounting structure 290 that extends out from the page to define a recess into which a portion of the LIDAR 200 may be inserted to physically couple the LIDAR 200 to the mounting structure 290. For example, a first portion of the LIDAR 200 may be physically connected to the mounting structure 290 at the receiving structure 291, and a bottom portion of the LIDAR 200 including the optical window 162 may remain outside the receiving structure 291. Other examples are also possible for physically attaching the LIDAR 200 to the mounting structure 290 at a given location.
[0067] As shown in FIG. 2, the calibration target 292 is disposed on a surface of the mounting structure 290. The calibration target 292 may be similar to the calibration target 191 described in connection with the system 100, for example. By way of example, the calibration target 292 is shown extending horizontally (e.g., along the y-axis) along the surface of the mounting structure 290 such that at least a portion (not shown) of the calibration target 292 overlaps with the LIDAR 200 (e.g., a portion behind the LIDAR 200). However, in other examples, the target 292 may alternatively be positioned at a different location along any surface of the mounting structure 290 that is within the FOV scanned by the LIDAR 200 as the LIDAR (or a portion thereof) rotates about the axis 102. Additionally, the target 292 may alternatively have a size and / or shape different from that shown in FIG. 2. It should therefore be understood that various shapes, sizes, and positions of the calibration target 292 are possible, and that the target 292 is illustrated as shown in FIG. 2 for convenience of explanation only.
[0068] In some embodiments, the LIDAR 200 may include an occlusion detection system that may be configured to provide information indicative of the presence of an occlusion object 222 associated with (e.g., coupled to, or near) the optical window 162.
[0069] 2 shows the obstructing object 222 disposed on an outer surface of the optical window 162, it will be understood that other obstructing objects may be located elsewhere. In one example, the obstructing object 222 may alternatively include an external object coupled near the optical window 162. For example, a plastic bag or other object (not shown) may be coupled to a mounting structure or a LIDAR or other external structure and may extend such that at least a portion of such external object is at or near the LIDAR. In another example, the obstructing object 222 may alternatively include an obstruction integrated into the optical window 162 itself, such as a crack in the optical window 162, or a cloudy or opaque area. Other examples are possible.
[0070] 2, the LIDAR 200 may scan at least a portion of a mounting structure 290 disposed within the FOV scanned by the LIDAR 200 (e.g., a portion where a calibration target 292 is located). For example, as the LIDAR 200 (or a portion thereof) rotates about the axis 102, one or more of the light pulses emitted through the optical window 162 (e.g., when the optical window 162 faces the mounting structure) may propagate toward the mounting structure 290. The LIDAR 200 (or another computing system receiving data from the LIDAR 200) may then detect the presence of an occlusion 222, for example, by comparing a reflectance characteristic of the scanned portion of the mounting structure 290 to a predetermined and / or otherwise expected reflectance characteristic.
[0071] In some examples, the mounting structure 290 may reflect the "first light pulse" and the "second light pulse." In some embodiments, the corresponding reflected light pulses returning from the mounting structure 290 to the LIDAR 200 may be used as a basis for determining a reference time (e.g., "zero time"), for example, instead of or in addition to a given reference time determined based on scanning an external calibration target and / or other known features in the environment. In some scenarios, using the mounting structure to determine the reference time may increase the accuracy of the determined reference time (e.g., compared to a given reference time calculated using an external calibration target that is not necessarily physically coupled to the LIDAR 200) due to a given physical placement of the LIDAR 200 relative to the mounting structure 290.
[0072] III. Exemplary Vehicles 3A, 3B, 3C, 3D, and 3E illustrate a vehicle 300 according to an exemplary embodiment. The vehicle 300 may be a semi-autonomous or fully autonomous vehicle. Although FIGS. 3A-3E illustrate the vehicle 300 as being an automobile (e.g., a passenger van), it will be understood that the vehicle 300 may include another type of autonomous vehicle, a robot, or a drone that may use sensors and other information about its environment to navigate within its environment.
[0073] The vehicle 300 can include one or more sensor systems 302, 304, 306, 308, and 310. In some embodiments, the sensor systems 302, 304, 306, 308, and 310 can include LIDAR sensors having multiple light emitting devices positioned over a range of angles relative to a given plane (e.g., the xy plane).
[0074] One or more of the sensor systems 302, 304, 306, 308, and 310 may be configured to rotate about an axis perpendicular to a given plane (e.g., the z-axis) to illuminate the environment around the vehicle 300 with light pulses. Based on detecting various factors of the reflected light pulses (e.g., elapsed time of flight, polarization, intensity, etc.), information about the environment may be determined.
[0075] In an exemplary embodiment, sensor systems 302, 304, 306, 308, and 310 may be configured to provide respective point cloud information that may relate to physical objects in an environment of vehicle 300. Although vehicle 300 and sensor systems 302, 304, 306, 308, and 310 are shown as including particular features, it will be understood that other types of sensor systems are contemplated within the scope of the present disclosure.
[0076] Exemplary embodiments may include a system having multiple light emitter devices. The system may include a transmission block of a lidar device. For example, the system may correspond to (or be included in) a lidar device of a vehicle (e.g., an automobile, a truck, a motorcycle, a golf cart, an aircraft, a boat, etc.). Each light emitter device of the multiple light emitter devices is configured to emit light pulses along a respective beam elevation angle. The respective beam elevation angles may be based on a reference angle or a reference plane. In some embodiments, the reference plane may be based on a motion axis of the vehicle 300.
[0077] Although a lidar system having a single light emitting device is described and illustrated herein, a lidar system having multiple light emitting devices (e.g., a light emitting device having multiple laser bars on a single laser die) is also contemplated. For example, light pulses emitted by one or more laser diodes can be controllably directed around the environment of the system. The angle of emission of the light pulses can be adjusted by a scanning device, such as, for example, a mechanical scanning mirror and / or a rotating motor. For example, the scanning device can rotate in a reciprocating motion around a given axis and / or rotate around a vertical axis. In another embodiment, the light emitting device can emit light pulses toward a rotating prism mirror that can cause the light pulses to be emitted into the environment based on the angle of the prism mirror angle when interacting with each light pulse. Additionally or alternatively, scanning optics and / or other types of electro-optical mechanical devices can scan the light pulses around the environment. Embodiments utilizing multiple fixed beams are also contemplated within the context of the present disclosure.
[0078] In some embodiments, as described herein, a single light emitting device can emit light pulses according to a variable shot schedule and / or with variable power per shot. That is, the emission power and / or timing of each laser pulse or shot can be based on the respective elevation angle of the shot. Furthermore, the variable shot schedule can be based on providing a desired vertical spacing at a given distance from the lidar system or from a given vehicle surface (e.g., the front bumper) supporting the lidar system. As an example, when light pulses from a light emitting device are directed downward, the power per shot may be reduced due to a shorter expected maximum distance to the target. Conversely, light pulses emitted by a light emitting device at an elevation angle above a reference plane may have a relatively higher power per shot to provide sufficient signal-to-noise to adequately detect pulses traveling longer distances.
[0079] In some embodiments, the power / energy per shot can be dynamically controlled on a shot-by-shot basis. In other embodiments, the power / energy per shot can be controlled for a consecutive set of several pulses (e.g., 10 light pulses). That is, the characteristics of the light pulse train can be changed on a per pulse and / or per few pulses basis.
[0080] Although Figures 3A-3E show various lidar sensors mounted on the vehicle 300, it will be understood that the vehicle 300 may incorporate other types of sensors, such as multiple optical systems (e.g., cameras), radar, or ultrasonic sensors.
[0081] In an exemplary embodiment, the vehicle 300 may include a lidar system (e.g., system 100) configured to emit light pulses into an environment of the vehicle 300 to provide information indicative of objects within a default field of view. For example, the vehicle 300 may include an optical system (e.g., system 100) having a rotatable base (e.g., rotatable base 110) configured to rotate about a first axis (e.g., first axis 102). The optical system may also include a mirror assembly (e.g., mirror assembly 130). The mirror assembly may be configured to rotate about a mirror rotation axis. In some embodiments, the mirror rotation axis is substantially perpendicular to the first axis.
[0082] The optical system also includes an optical resonator (e.g., optical resonator 120) coupled to the rotatable base. In such a scenario, the optical resonator includes at least one light emitting device (e.g., light emitting device 126) and a light emitting lens (e.g., light emitting lens 128). The at least one light emitting device and the light emitting lens are arranged to define a light emitting axis (e.g., light emitting axis 18).
[0083] The optical system further includes a plurality of photodetectors (e.g., photodetector 122). In an exemplary embodiment, the plurality of photodetectors includes a respective set of two or more photodetectors for each light emitting device of the at least one light emitting device. The optical system also includes a photodetector lens (e.g., photodetector lens 124). In such a scenario, the plurality of photodetectors and the photodetector lens are arranged to define a light receiving axis (e.g., light receiving axis 19). In some embodiments, at least one of the light receiving axis or the light emitting axis may form an oblique angle with respect to the first axis.
[0084] In some embodiments, each set of two or more photodetectors may include a primary photodetector (e.g., primary photodetector 123) and a secondary photodetector (e.g., secondary photodetector 125). In such a scenario, the primary photodetector is configured to receive a first portion of the return light emitted from a given light-emitting device. Additionally, the secondary photodetector is configured to receive a second portion of the return light emitted from a given light-emitting device.
[0085] In some embodiments, the first portion of the returning light is at least an order of magnitude greater in photon flux than the second portion of the returning light.
[0086] IV. Exemplary Methods FIG. 4 illustrates a method 400, according to an exemplary embodiment. It will be understood that the method 400 may include fewer or more steps or blocks than those explicitly illustrated or otherwise disclosed herein. Additionally, each step or block of the method 400 may be performed in any order, and each step or block may be performed one or more times. In some embodiments, some or all of the blocks or steps of the method 400 may be performed by the controller 150 and / or other elements of the system 100, the LIDAR 200, and / or the vehicle 300, as shown and described in connection with FIG. 1, FIG. 2, and / or FIG. 3A-FIG. 3E, respectively.
[0087] Block 402 involves emitting a light pulse from a light emitting device coupled to a rotatable base, which first interacts with a mirror assembly and then is emitted as emitted light towards the environment.
[0088] Block 404 involves receiving returning light from the environment, which first interacts with the mirror assembly and is then detected by at least a primary photodetector and a secondary photodetector.
[0089] Block 406 involves determining a distance to an object in the environment based on the time of flight between the time of emission and the time of reception.
[0090] In some embodiments, the method 400 may further include rotating the rotatable base about a first axis, rotating the mirror assembly about a mirror rotation axis, and repeating the emitting, receiving, and determining steps while the mirror assembly is rotating to form a point cloud. The point cloud includes a plurality of ranges or range data within a three-dimensional representation of the environment.
[0091] FIG. 5 illustrates a method 500 according to an exemplary embodiment. It will be understood that the method 500 may include fewer or more steps or blocks than those explicitly illustrated or otherwise disclosed herein. Additionally, each step or block of the method 500 may be performed in any order, and each step or block may be performed one or more times. In some embodiments, some or all of the blocks or steps of the method 500 may be performed by the controller 150 and / or other elements of the system 100, the LIDAR 200, and / or the vehicle 300, as shown and described in connection with FIGS. 1, 2, and 3A-3E, respectively.
[0092] At block 502, the method 500 includes scanning at least a portion of an external structure within a field of view of the LIDAR device.
[0093] In a first example, the external structure may correspond to a mounting structure, and the LIDAR device may be attached to the mounting structure. For example, returning to FIG. 2, the LIDAR 200 may be attached to a mounting structure 290, which may then optionally mount the LIDAR 200 to another system (not shown), such as a vehicle 300. Thus, in this example, the LIDAR device may be physically coupled to the external structure (e.g., the mounting structure 290) such that the LIDAR device remains in an offset position relative to the external structure. For example, as shown in FIG. 2, the LIDAR 200 and the mounting structure 290 may be physically connected in a particular relative arrangement while the LIDAR 200 (or a portion thereof) rotates about the axis 102.
[0094] In a second example, the external structure may correspond to any other structure that is physically coupled (directly or indirectly) to the LIDAR device such that the external structure remains at a predetermined offset position relative to the LIDAR 200. For example, returning to FIG. 3A, the external structure may correspond to a component (or a portion thereof) of the vehicle 300 that is within the FOV scanned by the LIDAR 310 (e.g., a vehicle body panel, a vehicle bumper, a vehicle fender, a vehicle rearview mirror, etc.). Thus, in this example, the LIDAR device may be physically coupled (e.g., indirectly) to the external structure (e.g., any component of the vehicle that has an outer surface within the FOV of the LIDAR device) such that the LIDAR device remains at an offset position relative to the external structure. For example, returning to FIG. 3A, the external structure may be a body panel of the vehicle and the LIDAR device may be the LIDAR 310 mounted on the vehicle at a particular mounting location. In this case, the body panel and the LIDAR 310 may remain in a particular relative arrangement defined by a particular mounting location of the LIDAR 310 relative to a given location of the body panel on the vehicle. Further, in this case, as the vehicle 300 moves through the environment, the body panels (i.e., the exterior structure) and the LIDAR 310 (i.e., the LIDAR device) may remain in the same particular relative orientation.
[0095] It should be noted that for ease of explanation, the terms "mounting structure" and "external structure" may be used interchangeably in the description of the various blocks of method 500. However, it should be understood that some examples herein in which an external structure is a mounting structure may alternatively be implemented using any other external structure physically coupled (directly or indirectly) to the LIDAR device (and vice versa) without departing from the scope of the present disclosure.
[0096] Scanning at block 502 may include transmitting light pulses (e.g., light 14) in various directions through an optical window (e.g., optical window 162) toward at least a portion of the external structure. For example, a series of emitted light pulses may be directed in various directions by the LIDAR 200, such that one or more of the emitted light pulses may be transmitted (through the optical window 162) toward at least a portion of the external structure that is within the FOV of the LIDAR 200 (e.g., the mounting structure 290 shown in FIG. 2).
[0097] Scanning at block 502 may also include receiving reflected light pulses (e.g., light 16) through the optical window, including reflections of the transmitted light pulses from the external structure back to the LIDAR device, in accordance with the discussion above.
[0098] At block 504, the method 500 includes detecting the presence of an occlusion at least partially obstructing the LIDAR device from scanning the FOV based at least on the scanning of block 502.
[0099] For example, returning to Figure 2, the system of method 500 may determine that an occlusion 222 is present based on a scan indicating that one or more reflected light pulses returning from the mounting structure 290 have a lower intensity than expected. As another example, the system may determine that an occlusion is present in response to a scan indicating that the appearance, location, and / or other characteristics of the external structure indicated by the scan are different from expected. Other examples are possible.
[0100] In some examples, method 500 includes comparing a reflectance characteristic of the external structure indicated by the scan to a predetermined reflectance characteristic. In these embodiments, detecting the presence of an occlusion in block 504 may be based on the comparison. For example, the scanned portion of the external structure may be associated with a predetermined characteristic that is measured prior to the scan and compared to the measurements indicated by the scan to determine if an occlusion is present.
[0101] In one example, the predetermined reflectance characteristic is based on a previous scan of an external structure by the LIDAR device. For example, the LIDAR 200 may be configured to repeatedly scan its FOV, such that if the reflectance characteristic indicated by the scan at block 502 differs from the predetermined reflectance characteristic indicated by the previous scan, the LIDAR 200 or another system of method 500 may detect an occlusion.
[0102] In another example, the predetermined reflectance characteristics may be associated with one or more calibration targets disposed on at least a portion of the external structure. For example, returning to Figure 2, the predetermined characteristics (e.g., texture, pattern, etc.) of the calibration target 292 may be compared to the measured characteristics indicated by the scan in block 502 to determine whether an occlusion is present.
[0103] In some examples, method 500 includes determining whether an occlusion is disposed on the optical window based on one or more scans of the FOV with the LIDAR device. For example, one or more previous scans of the FOV may indicate changes in characteristics and / or appearance of the external structure and / or other portions of the FOV as compared to corresponding characteristics and / or appearances indicated by the scan of block 502.
[0104] In some examples, the method 500 includes rotating the LIDAR device about an axis (e.g., axis 102) during a rotation period, and the scanning at block 502 may occur during a first portion of the rotation period. For example, returning to FIG. 2, the first portion of the rotation period may correspond to a period during which the LIDAR 200 is within a range of angles about axis 102 during which light pulses emitted from the optical window 162 are directed toward the mounting structure 290 (or any other external structure physically coupled to the LIDAR 200 at a predetermined offset from the LIDAR 200). In some examples, the method 500 includes scanning at least one object during a second portion of the rotation period.
[0105] In some examples, the method 500 includes determining a reference time based on one or more time differences between one or more transmission times of the light pulses transmitted toward the external structure and one or more reception times of one or more reflected light pulses returning from the external structure to the LIDAR device. For example, the reference time (e.g., "zero time") may be calibrated based on predetermined and / or known positions of one or more calibration targets (e.g., calibration targets 192, 292, etc.) and / or the external structure itself instead of or in addition to calibrating the reference time using features in the environment of the LIDAR device.
[0106] In these examples, the method 500 may also include determining a distance to the at least one object based on a transmission time of the light pulse transmitted toward the at least one object, a reception time of the reflected light pulse returning to the LIDAR device from the at least one object, and a reference time. For example, in accordance with the above discussion, a measured time difference associated with the at least one object may be calibrated using the determined reference time.
[0107] In some examples, the method 500 may include detecting an optical misalignment (or other defect) of the LIDAR device. For example, one or more components of the LIDAR 200, such as the mirror assembly 130, the mirror surface 132, the optical resonator 120, the receiver 121, the optical window 162, or any of the other components of the LIDAR, may be offset from its expected position and / or orientation. As one example of an optical misalignment, a misaligned rotatable base 110 may rotate about an offset axis different from the axis 102. Other exemplary optical misalignments are possible as well. In examples where such optical misalignment exists, the actual direction of the light pulses emitted from the LIDAR 200 may differ from the expected direction associated with a properly aligned LIDAR configuration. Thus, in some examples, method 500 may include detecting optical misalignment (or other defects) of the LIDAR device based on measurements of the angle (e.g., about axis 102) at which an external structure and / or one or more features thereon (e.g., such as calibration structure 292) are detected.
[0108] The arrangements shown in the figures should not be considered as limiting. It should be understood that other embodiments may include more or less of each element shown in a given figure. Additionally, some of the illustrated elements may be combined or omitted. Still further, example embodiments may include elements not shown in the figures.
[0109] A step or block representing the processing of information may correspond to a circuit that can be configured to perform a particular logical function of a method or technique described herein. Alternatively or additionally, a step or block representing the processing of information may correspond to a module, segment, or portion of program code (including associated data). The program code may include one or more instructions executable by a processor to implement a particular logical function or operation in a method or technique. The program code and / or associated data may be stored in any type of computer-readable medium, such as a storage device, including a disk, hard drive, or other storage medium.
[0110] The computer readable medium may also include non-transitory computer readable media, such as register memory, processor cache, and computer readable media that store data for a short period of time, such as random access memory (RAM). The computer readable medium may also include non-transitory computer readable media that store program code and / or data for a long period of time. Thus, the computer readable medium may include, for example, secondary or long-term permanent storage devices, such as read only memory (ROM), optical or magnetic disks, compact disk read only memory (CD-ROM). The computer readable medium may also be any other volatile or non-volatile storage system. The computer readable medium may be, for example, a computer readable storage medium, or a tangible storage device.
[0111] While various examples and embodiments have been disclosed, other examples and embodiments will be apparent to those of ordinary skill in the art. The various disclosed examples and embodiments are for purposes of illustration and are not intended to be limiting, the true scope of which is indicated by the following claims.
Claims
1. 1. A method comprising: scanning, with a light detection and ranging (LIDAR) device physically coupled to an external structure, at least a portion of the external structure that is within a field of view (FOV) of the LIDAR device, wherein the scanning includes: transmitting optical pulses in various directions through an optical window towards the external structure; receiving a reflected light pulse through the optical window, the reflected light pulse including a reflection of the transmitted light pulse from the external structure back to the LIDAR device; and detecting the presence of an occlusion at least partially occluding the LIDAR device from scanning the FOV based at least on an appearance of the external structure indicated by the scan of the at least a portion of the external structure being different from a predetermined appearance indicated by a previous scan.
2. The method of claim 1 , further comprising: comparing a reflectance characteristic of the external structure indicated by the scan to a predetermined reflectance characteristic, and wherein detecting the presence of the occlusion is based on the comparison.
3. The method of claim 2 , wherein the predetermined reflectance characteristic is based on a previous scan of the at least a portion of the exterior structure by the LIDAR device.
4. 3. The method of claim 2 , wherein the at least a portion of the external structure scanned by the LIDAR device includes one or more calibration targets disposed on the external structure, and the predetermined reflectance characteristics are associated with the one or more calibration targets.
5. 10. The method of claim 1, further comprising determining whether the occlusion is disposed on the optical window based on one or more scans of the FOV by the LIDAR device.
6. 10. The method of claim 1, further comprising rotating the LIDAR device about an axis during a rotation period, wherein the scanning of the at least a portion of the external structure occurs during a first portion of the rotation period.
7. 7. The method of claim 6, further comprising scanning at least one object separated from the external structure with the LIDAR device during a second portion of the rotation period.
8. determining a reference time based on one or more time differences between one or more transmission times of one or more of the light pulses transmitted towards the external structure and one or more reception times of one or more of the reflected light pulses returning from the external structure to the LIDAR device; 8. The method of claim 7, further comprising: determining a distance to the at least one object based on a transmission time of a light pulse transmitted towards the at least one object, a reception time of a reflected light pulse returning from the at least one object to the LIDAR device, and the reference time.
9. 10. The method of claim 1 , wherein the external structure comprises a mounting structure coupled to a vehicle, the LIDAR device being mounted to the mounting structure.
10. 1. A system comprising: The mounting structure, a light detection and ranging (LIDAR) device mounted to the mounting structure; and An optical window; one or more processors; When executed by the one or more processors, the system comprises: scanning at least a portion of the mounting structure within a field of view (FOV) of the LIDAR device, the scanning including: transmitting light pulses from the LIDAR device towards the mounting structure in various directions through the optical window; receiving through the optical window a reflected light pulse comprising a reflection of the transmitted light pulse from the mounting structure back to the LIDAR device; detecting the presence of an occlusion at least partially obstructing the LIDAR device from scanning the FOV based at least on an appearance of the mounting structure indicated by the scan of the at least a portion of the mounting structure being different from a predetermined appearance indicated by a previous scan; and data storage storing instructions for performing operations including:
11. The operation, The system of claim 10 , further comprising: comparing a reflectance characteristic of the mounting structure indicated by the scan to a predetermined reflectance characteristic, and wherein detecting the presence of the occlusion is based on the comparison.
12. The system of claim 11 , wherein the predetermined reflectance characteristic is based on a previous scan of the at least a portion of the mounting structure.
13. The system of claim 11 , further comprising one or more calibration targets disposed on at least the scanned portion of the mounting structure, the predetermined reflectance characteristics being associated with the one or more calibration targets.
14. The system of claim 10 , wherein the mounting structure is coupled to a vehicle.
15. A non-transitory computer-readable medium that, when executed by one or more processors, provides a system with: scanning at least a portion of the external structure that is within a field of view (FOV) of the LIDAR device using a light detection and ranging (LIDAR) device physically coupled to the external structure, the scanning including: Transmitting light pulses in various directions toward the external structure through an optical window of the LIDAR device; receiving a reflected light pulse through the optical window, the reflected light pulse including a reflection of the transmitted light pulse from the external structure back to the LIDAR device; detecting the presence of an occlusion at least partially obstructing the LIDAR device from scanning the FOV based at least on an appearance of the external structure indicated by the scan of the at least a portion of the external structure being different from a predetermined appearance indicated by a previous scan; A non-transitory computer-readable medium storing instructions for performing operations including:
16. The operation, 16. The non-transitory computer readable medium of claim 15, further comprising: comparing a reflectance characteristic of the exterior structure indicated by the scan to a predetermined reflectance characteristic, and wherein detecting the presence of the occlusion is based on the comparison.
17. The operation, 16. The non-transitory computer readable medium of claim 15, further comprising determining whether the occlusion is disposed on the optical window based on one or more scans of the FOV.
18. The operation, 16. The non-transitory computer readable medium of claim 15, further comprising rotating the LIDAR device about an axis during a rotation period, wherein the scanning of the at least a portion of the external structure occurs during a first portion of the rotation period.
19. The operation, 20. The non-transitory computer readable medium of claim 18, further comprising: scanning at least one object separated from the external structure during a second portion of the rotation period using the LIDAR device.
20. The operation, determining a reference time based on one or more time differences between one or more transmission times of one or more of the light pulses transmitted towards the external structure and one or more reception times of one or more of the reflected light pulses returning from the external structure to the LIDAR device; 20. The non-transitory computer readable medium of claim 19, further comprising: determining a distance to the at least one object based on a transmission time of a light pulse transmitted towards the at least one object, a reception time of a reflected light pulse returning to the LIDAR device from the at least one object, and the reference time.
Citation Information
Patent Citations
Obstacle detecting device for vehicle
JP1984145982A
On-vehicle radar device
JP2007108028A
Laser scan sensor
JP2011022080A
Range finding device and calibration method
JP2016095136A
LIDAR systems and methods
JP2019535014A
