Lidar system and method with beam steering and wide angle signal detection
Through the beam steering system combined with the MEMS structure and a multi-lens array, the efficient point density and range detection of the LiDAR system is achieved, solving the problem of insufficient detection range and noise distinction capabilities in the prior art, and improving the detection accuracy.
Patent Information
- Application Number
- CN202411227212.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2019-01-10
- Filing Date
- 2020-01-08
- Publication Date
- 2024-11-29
AI Technical Summary
While the existing LiDAR system increases the point density, the detection range is limited and it is impossible to effectively distinguish between noise in the return signal and scattered light from the object, affecting the detection accuracy.
The beam steering system that combines a microelectromechanical system (MEMS) structure and a multi-lens array can be used to selectively activate the detector segment and adjust the moving speed of the mirror and the repetition rate of the light pulses in the field of view to achieve efficient steering and signal detection of light pulses in the field of view. , and capture the return pulse through a combination of multiple lenses and detectors to filter out the noise signal.
The point density and detection range of the LiDAR system are improved, while the signal-to-noise ratio is enhanced, which effectively distinguishes the scattered light and noise of the object, and improves the detection accuracy.
Smart Images

Figure CN119044932A_ABST
Abstract
Description
[0001] This application is a divisional application of the Chinese patent application with the invention name “LIDAR system and method with beam steering and wide-angle signal detection”, the application date of January 8, 2020, and the application number of “2020800070597”.
[0002] CROSS-REFERENCE TO RELATED APPLICATIONS
[0003] This application claims the benefit of U.S. Provisional Application No. 62 / 790,842, filed on January 10, 2019, the disclosure of which is incorporated herein in its entirety. Technical Field
[0004] The present disclosure relates generally to light detection and ranging (LiDAR) systems and methods, and more particularly to systems and methods for steering continuous light pulses to illuminate objects in a field of view using a microelectromechanical system (MEMS). Background Art
[0005] LiDAR systems can be used to measure the distance between an object and the system. Specifically, the system can transmit a signal (e.g., using a light source), record the returned signal (e.g., using a light detector), and determine the distance by calculating the delay between the returned signal and the transmitted signal. Summary of the invention
[0006] A simplified overview of one or more examples is presented below to provide a basic understanding of the present disclosure. This overview is not an extensive overview of all contemplated examples, and is not intended to identify key or important elements of all examples or to describe the scope of any or all examples. Its purpose is to present some concepts of one or more examples in a simplified form as a prelude to the more detailed description presented below.
[0007] Embodiments discussed herein relate to the use of a LiDAR system that uses a microelectromechanical system (MEMS) or other beam steering system to steer continuous light pulses to illuminate objects in the field of view. Different receiver systems may be used to detect the returning light pulses. One such receiver system may use relatively large optics in combination with an array of detectors. Another receiver system may use multiple optics in combination with multiple detectors.
[0008] In one embodiment, a LiDAR system may include a beam steering system; a laser system operable to emit light pulses that are steered by the beam steering system such that each emitted light pulse is steered along an optical path within a field of view (FOV); and a receiver system operable to receive return pulses from the FOV. The beam steering system may include a microelectromechanical system (MEMS) structure and a mirror. The receiver system may include an optical lens and a detector array including a plurality of detector segments. The LiDAR system may include control circuitry operable to activate a subset of the detector segments based on the optical path; deactivate the detector segments not included in the subset; and process return pulses detected by the subset of activated detector segments.
[0009] In one embodiment, the MEMS structure is a MEMS polyhedron.
[0010] In one embodiment, the MEMS structure is a liquid crystal.
[0011] In one embodiment, the MEMS structure includes at least one micromirror.
[0012] In one embodiment, the optical lens is a wide angle lens.
[0013] In one embodiment, the detector array is positioned at or near the focal plane of the optical lens.
[0014] In one embodiment, the control circuit is operable to align the optical path with the selective activation of a subset of the detector segments such that only the subset of the detector segments are active to receive the return pulses.
[0015] In one embodiment, deactivated detector segments are powered off, and wherein activated detector segments are powered on.
[0016] In one embodiment, the beam steering system does not direct the return pulses to the detector array.
[0017] In one embodiment, the controller is operable to control the repetition rate of the light pulses based on the optical path.
[0018] In one embodiment, the controller is operable to adjust the speed of movement of the mirror based on the optical path.
[0019] In one embodiment, the controller is operable to coordinate at least one of a speed of movement of the mirror and a repetition rate of the light pulses based on the optical path.
[0020] In one embodiment, a method for using a LiDAR scanning system is provided, the method comprising controlling transmission of light pulses along an optical path within a field of view (FOV) via a beam steering system, the beam steering system comprising a microelectromechanical system (MEMS) structure; activating a subset of detector segments of a detector array comprising a plurality of detector segments based on the optical path; deactivating detector segments not included in the activated subset; monitoring return pulses in the subset of activated detector segments; and processing the monitored return pulses.
[0021] In one embodiment, the beam steering system comprises a mirror.
[0022] In one embodiment, the method further comprises receiving return pulses from the FOV, wherein the return pulses are collected by an optical lens that directs the return pulses to the subset of activated detector segments.
[0023] In one embodiment, the optical lens is a wide angle lens.
[0024] In one embodiment, the detector array is positioned at or near the focal plane of the optical lens.
[0025] In one embodiment, the MEMS structure is a MEMS polyhedron.
[0026] In one embodiment, the MEMS structure is a liquid crystal.
[0027] In one embodiment, the MEMS structure includes at least one micromirror.
[0028] In one embodiment, the method further comprises aligning the optical path with selective activation of a subset of the detector segments such that only the subset of the detector segments are active to receive the return pulses.
[0029] In one embodiment, deactivated detector segments are powered off, and wherein activated detector segments are powered on.
[0030] In one embodiment, the beam steering system does not direct the return pulses to the detector array.
[0031] In one embodiment, the method further comprises controlling a repetition rate of the light pulses based on the optical path.
[0032] In one embodiment, the method further comprises adjusting a movement speed of a mirror included in the beam steering system based on the optical path.
[0033] In one embodiment, the method further comprises coordinating at least one of a movement speed of a mirror included in the beam steering system and a repetition rate of the light pulses based on the optical path.
[0034] In one embodiment, a LiDAR system is provided, the system comprising a beam steering system; a laser system operable to emit light pulses, the light pulses being steered by the beam steering system such that each emitted light pulse is steered along an optical path within a field of view (FOV); a receiver system operable to receive return pulses from the FOV; and a control circuit. The beam steering system may include a microelectromechanical system (MEMS) structure and a mirror. The receiver system may include a multi-lens array including a plurality of lenses, each lens being associated with a window within the FOV, wherein at least two windows overlap each other, such that lenses associated with the overlapping windows receive the same return pulses; and a plurality of detectors, each of the plurality of detectors corresponding to one of the plurality of lenses. The control circuit is operable to process signals received from each of the plurality of detectors and to distinguish between processed signals by filtering out received return pulses that are not captured by the at least two overlapping windows to produce filtered signals.
[0035] In one embodiment, the MEMS structure is a MEMS polyhedron.
[0036] In one embodiment, the MEMS structure is a liquid crystal.
[0037] In one embodiment, the MEMS structure includes at least one micromirror.
[0038] In one embodiment, at least two windows overlap each other at a minimum distance within the FOV.
[0039] In one embodiment, a LiDAR system is provided, the system comprising a beam steering system; a laser system operable to emit light pulses, the light pulses being steered by the beam steering system such that each emitted light pulse is steered along an optical path within a field of view (FOV); a receiver system operable to receive return pulses from the FOV. The receiver system may include a multi-lens array including a plurality of lenses, each lens being associated with a window within the FOV, wherein at least two windows overlap each other, such that lenses associated with the overlapping windows receive the same return pulses; and a plurality of detectors, each of the plurality of detectors corresponding to one of the plurality of lenses. The LiDAR system may include a control circuit operable to process signals received from each of the plurality of detectors; and to distinguish between processed signals by filtering out received return pulses that were not captured by the at least two overlapping windows to produce filtered signals.
[0040] In one embodiment, a method for a LiDAR system is provided, the method comprising controlling transmission of light pulses along an optical path within a field of view (FOV) via a beam steering system; receiving returned light pulses from the FOV via a multi-lens array comprising a plurality of lenses, each lens being associated with a window within the FOV, wherein at least two windows overlap with each other such that lenses associated with the overlapping windows receive the same returned light pulses, and wherein each lens of the plurality of lenses directs any returned light pulses to a detector corresponding to that particular lens of the plurality of lenses; processing signals received from each detector corresponding to the plurality of lenses; and distinguishing between processed signals by filtering out received return pulses that were not captured by the at least two overlapping windows to produce filtered signals.
[0041] In one embodiment, a LiDAR system is provided that includes a laser transmission and steering system operable to transmit light pulses along a transmission path within a field of view (FOV); and a receiver system operable to receive return pulses from the FOV, wherein at least one of the return pulses is received along a receive path that is different from any of the transmission paths. The receiver system includes a plurality of optical lenses and detector combinations (ODCs), each ODC being associated with a receive path, and wherein at least two ODCs process return pulses from the same object within the FOV. The LiDAR system may include a control circuit operable to filter out received return pulses that are processed by the at least two ODCs and do not correspond to the same object.
[0042] In one embodiment, all return pulses are received along a receive path that is different from any of the transmit paths.
[0043] In one embodiment, each ODC includes an optical lens and a detector.
[0044] In one embodiment, the LiDAR system further includes a vehicle, wherein the light pulses are transmitted from a first location on the vehicle, wherein each of the plurality of ODCs is located at a respective different location on the vehicle other than the first location.
[0045] A further understanding of the nature and advantages of the embodiments discussed herein may be realized by reference to the remainder of the specification and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1-3 An exemplary LiDAR system that uses pulse signals to measure distances to points in the external environment is illustrated.
[0047] Figure 4 A logical block diagram of an exemplary LiDAR system is depicted.
[0048] Figure 5 A light source for an exemplary LiDAR system is depicted.
[0049] Figure 6 A photodetector of an exemplary LiDAR system is depicted.
[0050] Figure 7 An illustrative MEMS-based LiDAR system is shown in accordance with an embodiment.
[0051] Figure 8 , Fig. 8A and Figure 8B An exemplary multi-segment detector is illustrated in accordance with various embodiments.
[0052] Fig. 9A , Fig. 9B and Fig. 9C An illustrative example of selectively activating and deactivating detector segments based on the position of a beam steering system is shown.
[0053] Fig.10 An illustrative process according to an embodiment is shown.
[0054] Fig.11A and Fig. 11B Illustrated are simplified diagrams of different LiDAR systems according to various embodiments.
[0055] Fig. 12A and Fig. 12B An illustrative field of view of a LiDAR system is shown in accordance with an embodiment.
[0056] Fig. 12C An illustrative field of view of a LiDAR system is shown in accordance with an embodiment.
[0057] Fig.13 An illustrative block diagram of a LiDAR system according to an embodiment is shown.
[0058] Fig.14 An exemplary fiber tip arrangement according to an embodiment is shown.
[0059] Fig.15A and Fig. 15B Several mirror alignment arrangements are shown that may be used with various embodiments.
[0060] Fig. 15C Illustrative multiple collimator arrangements are shown that may be used in various embodiments.
[0061] Fig.15D An illustrative collimator and lens arrangement according to an embodiment is shown.
[0062] Fig.16Exemplary scanning resolutions using multiple fiber tips, multiple mirror alignment arrangements, or multiple collimator arrangements are shown, according to embodiments.
[0063] Fig.17A Another illustrative diagram showing vertical resolution using a multiple fiber tip or multiple mirror alignment arrangement according to an embodiment.
[0064] Fig. 17B It shows various embodiments Fig.17A An illustrative close-up view of a sparse region within and Fig. 17C It shows various embodiments Fig.17A An illustrative close-up view of a dense area within.
[0065] Fig.18 An illustrative FOV with laser pulses of variable size is shown in accordance with an embodiment.
[0066] Fig.19 An illustrative multi-lens array based LiDAR system according to an embodiment is shown.
[0067] Fig. 20 An exemplary diagram of a multi-lens array according to an embodiment is shown.
[0068] Fig.21A , Fig.21B , Fig. 21C , Fig.21D , Fig.21E and Fig.21F Different window arrangements resulting from corresponding multi-lens arrays according to various embodiments are shown.
[0069] Fig. 22 An illustrative process according to an embodiment is shown.
[0070] Fig.23 An illustrative LiDAR system is shown in accordance with an embodiment.
[0071] Fig.24 An illustrative schematic diagram of two optics / detector combinations with overlapping windows capturing returned light pulses from the same object within the FOV of a LiDAR system is shown.
[0072] Fig.25 An illustrative vehicle 2501 with an integrated LiDAR system is shown in accordance with an embodiment. DETAILED DESCRIPTION
[0073] Illustrative embodiments are now described more fully hereinafter with reference to the accompanying drawings, in which representative examples are shown. In fact, the disclosed LiDAR systems and methods may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Like reference numerals refer to like elements throughout the text.
[0074] In the following detailed description, for the purpose of illustration, many specific details are set forth to provide a thorough understanding of various embodiments. Those skilled in the art will recognize that these various embodiments are merely illustrative and are not intended to be limited in any way. For those skilled in the art who benefit from this disclosure, other embodiments will be easily conceived.
[0075] In addition, for the sake of clarity, all conventional features of the embodiments described herein are not shown or described. It will be readily appreciated by those skilled in the art that in the development of any such actual embodiment, many embodiment-specific decisions may be required to achieve specific design goals. These design goals may vary from one embodiment to another and from one developer to another. In addition, it will be appreciated that such development work may be complex and time-consuming, but this may be a routine engineering task for those skilled in the art who benefit from the present disclosure.
[0076] Some light detection and ranging (LiDAR) systems use a single light source to generate one or more light signals of a single wavelength that scan the surrounding environment. The signals are scanned using a steering system that directs the pulses in one or two dimensions to cover an area of the surrounding environment (the scanning area). Many different types of steering systems can be used to direct the light pulses within the FOV. For example, the steering system can include MEMS, mechanical phase arrays, optical phase arrays, or other suitable systems.
[0077] For example, some embodiments of the present technology use one or more light sources that generate light signals of different wavelengths and / or along different optical paths. These light sources provide signals to the signal steering system at different angles so that the scanning areas for the light signals are different (for example, if two light sources are used to create two light signals, then the scanning areas associated with each light source are different). This allows the signal to be tuned to the appropriate transmission power and has the possibility of overlapping scanning areas covering scans of different distances. (For example, when using pulsed light signals) A longer range can be scanned with a signal having a higher power and / or a lower repetition rate. (For example, when using pulsed light signals) A shorter range can be scanned with a signal having a lower power and / or a higher repetition rate to increase the point density.
[0078] As another example, some embodiments of the present technology use a signal steering system with one or more dispersion elements (e.g., gratings, optical combs, prisms, etc.) to direct pulsed signals based on the wavelength of the pulses. The dispersion elements can make fine adjustments to the optical path of the pulses, which may be difficult or impossible with a mechanical system. In addition, the use of one or more dispersion elements allows the signal steering system to use fewer mechanical components to achieve the desired scanning capabilities. This results in a simpler, more efficient (e.g., lower power) design that may be more reliable (due to fewer moving components).
[0079] Some LiDAR systems use the time of flight of a light signal (e.g., a light pulse) to determine the distance to an object in the light path. Figure 1 , an exemplary LiDAR system 100 includes a laser light source (e.g., a fiber laser), a steering system (e.g., a system of one or more moving mirrors), and a light detector (e.g., a photon detector having one or more optical devices). The LiDAR system 100 transmits light pulses 102 along a path 104 determined by the steering system of the LiDAR system 100. In the depicted example, the light pulses 102 generated by the laser light source are short pulses of laser light. In addition, the signal steering system of the LiDAR system 100 is a pulsed signal steering system. However, it should be recognized that the LiDAR system can operate by generating, transmitting, and detecting non-pulsed light signals, and can be used to derive the range to objects in the surrounding environment using techniques other than time of flight. For example, some LiDAR systems use frequency modulated continuous waves (i.e., "FMCW"). It should also be recognized that any of the techniques described herein regarding time-of-flight-based systems using pulses can also be applied to LiDAR systems that do not use one or both of these techniques.
[0080] Reference again Figure 1 (a time-of-flight LiDAR system using light pulses), when the light pulse 102 reaches the object 106, the light pulse 102 is scattered and the returning light pulse 108 will be reflected back to the system 100 along a path 110. The time from when the transmitted light pulse 102 leaves the LiDAR system 100 to when the returning light pulse 108 arrives at the LiDAR system 100 can be measured (e.g., by a processor or other electronic device within the LiDAR system). This time of flight combined with knowledge of the speed of light can be used to determine the range / distance from the LiDAR system 100 to the point on the object 106 where the light pulse 102 was scattered.
[0081] like Figure 2As depicted in , by directing many light pulses, the LiDAR system 100 scans the external environment (e.g., by directing light pulses 102, 202, 206, 210 along paths 104, 204, 208, 212, respectively). Figure 3 As depicted in FIG, the LiDAR system 100 receives returning light pulses 108, 302, 306 (corresponding to transmitted light pulses 102, 202, 210, respectively) after objects 106 and 214 scatter the transmitted light pulses and reflect the pulses back along paths 110, 304, 308, respectively. Based on the direction of the transmitted light pulse (determined by the LiDAR system 100) and the calculated range from the LiDAR system 100 to the point on the object where the scattered light pulse occurred (e.g., a point on objects 106 and 214), the surrounding environment within the detection range (e.g., including the field of view between paths 104 and 212) can be accurately mapped (e.g., a point cloud or image can be created).
[0082] If a corresponding light pulse is not received for a particular transmitted light pulse, then it may be determined that there are no objects within a particular range of the LiDAR system 100 (e.g., the maximum scanning distance of the LiDAR system 100) that may scatter a sufficient amount of signal for the LiDAR light pulse. Figure 2 In the embodiment, since the light pulse 206 does not generate any scattering event along its transmission path 208 within the predetermined detection range, (e.g. Figure 3 208 ) it will not have a corresponding returned light pulse. The LiDAR system 100 (or an external system in communication with the LiDAR system 100 ) may interpret this as no objects along the path 208 being within the detection range of the LiDAR system 100 .
[0083] exist Figure 2 In the embodiment, the transmitted light pulses 102, 202, 206, 210 may be transmitted in any order, serially, in parallel, or based on other timing relative to each other. Figure 2 A one-dimensional array of transmitted light pulses is depicted, but the LiDAR system 100 may also optionally direct similar arrays of transmitted light pulses along other planes, so that a two-dimensional array of light pulses is transmitted. This two-dimensional array may be transmitted point by point, line by line, all at once, or in some other manner. A point cloud or image from a one-dimensional array (e.g., a single horizontal line) will produce two-dimensional information (e.g., (1) horizontal transmission direction and (2) range to an object). A point cloud or image from a two-dimensional array will have three-dimensional information (e.g., (1) horizontal transmission direction, (2) vertical transmission direction, and (3) range to an object).
[0084] The density of points in the point cloud or image from the LiDAR system 100 is equal to the number of pulses divided by the field of view. Assuming the field of view is fixed, in order to increase the density of points generated by a set of transmit-receive optical devices, the LiDAR system should excite pulses more frequently, in other words, a light source with a higher repetition rate is required. However, by sending pulses more frequently, the maximum distance that the LiDAR system can detect may be more limited. For example, if a returned signal from a distant object is received after the system transmits the next pulse, then if the system cannot correctly associate the returned signal with the transmitted signal, the returned signal may be detected in an order different from the order of the signal corresponding to the transmission and mixed together. For illustration, consider an exemplary LiDAR system that can transmit laser pulses at a repetition rate between 500kHz and 1MHz. Based on the time it takes for the pulse to return to the LiDAR system, and to avoid the returned pulses from mixing with the continuous pulses in conventional LiDAR designs, the maximum distance that the LiDAR system can detect can be 300 meters and 150 meters for 500kHz and 1Mhz, respectively. The point density of a LiDAR system with a 500kHz repetition rate is half that of a system with 1MHz. Therefore, this example demonstrates that increasing the repetition rate from 500kHz to 1Mhz (and therefore increasing the point density of the system) will significantly reduce the detection range of the system if the system cannot properly correlate returned signals that arrive out of order.
[0085] Figure 4 A logical block diagram of a LiDAR system 100 is depicted, which includes a light source 402, a signal steering system 404, a pulse detector 406, and a controller 408. These components are coupled together using communication paths 410, 412, 414, 416, and 418. These communication paths represent communications (bidirectional or unidirectional) between various LiDAR system components, but not necessarily the physical components themselves. Although the communication paths can be implemented through one or more wires, buses, or optical fibers, the communication paths can also be wireless channels or open-air optical paths such that no physical communication medium is present. For example, in one exemplary LiDAR system, communication path 410 is one or more optical fibers, communication path 412 represents an optical path, and communication paths 414, 416, 418, and 420 are all one or more wires that carry electrical signals. Communication paths can also include more than one type of communication medium (e.g., they can include optical fibers and optical paths, or one or more optical fibers and one or more electrical wires).
[0086] The LiDAR system 100 may also include Figure 4Other components not depicted in the diagram may include a power bus, power supplies, LED indicators, switches, etc. In addition, there may be other connections between components, such as a direct connection between the light source 402 and the light detector 406 so that the light detector 406 can accurately measure the time from when the light source 402 transmits a light pulse to when the light detector 406 detects a returning light pulse.
[0087] Figure 5 A logical block diagram of one example of a fiber laser based light source 402 is depicted, but any number of light sources with varying architectures may be used as part of a LiDAR system. The light source 402 uses a seed 502 to generate initial light pulses of one or more wavelengths (e.g., 1550 nm), which are provided to a wavelength division multiplexer (WDM) 504 via an optical fiber 503. A pump 506 also provides laser power (of a different wavelength, such as 980 nm) to the WDM 504 via an optical fiber 505. The output of the WDM 504 is provided to a preamplifier 508 (which includes one or more amplifiers), which provides its output to a combiner 510 via an optical fiber 509. The combiner 510 also obtains laser power from a pump 512 via an optical fiber 511 and provides the pulses to a boost amplifier 514 via an optical fiber 513, which produces output light pulses on the optical fiber 410. The output light pulses are then fed to the steering system 404. In some variations, the light source 402 can generate pulses of different amplitudes based on the fiber gain profile of the optical fiber used in the source. The communication path 416 couples the light source 402 to the controller 408 ( Figure 4 ), so that the components of the light source 402 can be controlled by the controller 408 or communicate with the controller 408. Alternatively, the light source 402 can include its own controller. Instead of the controller 408 communicating directly with the components of the light source 402, a dedicated light source controller communicates with the controller 408 and controls the components of the light source 402 and / or communicates with the components of the light source 402. The light source 402 also includes other components not shown, such as one or more power connectors, a power supply, and / or a power cord.
[0088] Some other light sources include one or more laser diodes, short cavity fiber lasers, solid state lasers, and / or tunable external cavity diode lasers configured to generate one or more optical signals of different wavelengths. In some examples, the light source uses an amplifier (e.g., a preamplifier or a boost amplifier) including a doped fiber amplifier, a solid state bulk amplifier, and / or a semiconductor optical amplifier configured to receive and amplify the optical signal.
[0089] return Figure 4, the signal steering system 404 includes any number of components for steering the light signal generated by the light source 402. In some examples, the signal steering system 404 may include one or more optical redirection elements (e.g., mirrors or lenses) that steer the light pulses along the transmission path to scan the external environment (e.g., by rotation, vibration, or guidance). For example, these optical redirection elements may include MEMS mirrors, rotating polygon mirrors, or fixed mirrors to steer the transmitted pulse signals to different directions. The signal steering system 404 optionally also includes other optical components such as dispersive optical devices (e.g., diffuse lenses, prisms, or gratings) to further extend the coverage of the transmitted signal so as to increase the transmission area (i.e., field of view) of the LiDAR system 100. An example signal steering system is described in U.S. Patent Application Publication No. 2018 / 0188355 entitled “2DScanning High Precision LiDAR Using Combination of Rotating Concave Mirror and Beam Steering Devices”, the contents of which are incorporated herein by reference in their entirety for all purposes. In some examples, the signal steering system 404 does not include any active optical components (e.g., does not include any amplifiers). In some other examples, one or more components from the light source 402 (such as a boost amplifier) can be included in the signal steering system 404. In some cases, the signal steering system 404 can be considered a LiDAR front end or a LiDAR scanner.
[0090] Some embodiments of the signal steering system include one or more optical redirection elements (e.g., mirrors or lenses) that redirect the returned light signal along the receive path (e.g., by rotation, vibration, or steering) to direct the returned light signal to the light detector. The optical redirection elements that direct the light signal along the transmit and receive paths can be the same component (e.g., shared), separate components (e.g., dedicated), and / or a combination of shared and separate components. This means that in some cases, the transmit and receive paths are different, but they can partially overlap (or in some cases, substantially overlap).
[0091] Figure 6 The light detector 404 ( Figure 4) is a logical block diagram of one possible arrangement of components in the optical detector 404. The optical detector 404 includes an optical device 602 (e.g., a system of one or more optical lenses) and a detector array 604 (e.g., one or more charge coupled devices (CCDs), photodiodes, avalanche photodiodes, photomultiplier vacuum tubes, image sensors, etc.), which is connected to the controller 408 ( Figure 4 ). Optics 602 may include one or more optoelectronic lenses to receive, focus, and direct the return signal. Photodetector 404 may include filters to selectively pass light of specific wavelengths. Photodetector 404 may also include a timing circuit that measures the time from the transmission of a pulse to the detection of a corresponding return pulse. This data may then be transmitted to controller 408 via communications line 418 ( Figure 4 ) or other device. Light detector 404 may also receive information about when light source 402 transmits light pulses via communication line 418 or other communication line not shown (e.g., an optical fiber from light source 402 that samples the transmitted light pulses). Alternatively, light detector 404 may provide a signal via communication line 418 indicating when a returning light pulse is detected. Other pulse data such as power, pulse shape, and / or wavelength may also be transmitted.
[0092] Back to Figure 4 , controller 408 includes components for controlling LiDAR system 100 and communicating with external devices using the system. For example, controller 408 optionally includes one or more processors, memories, communication interfaces, sensors, storage devices, clocks, ASICs, FPGAs, and / or other devices that control light source 402, signal steering system 404, and / or light detector 406. In some examples, controller 408 controls the power, rate, timing, and / or other properties of the light signal generated by light source 402; controls the speed, transmission direction, and / or other parameters of light steering system 404; and / or controls the sensitivity and / or other parameters of light detector 406.
[0093] The controller 408 is optionally also configured to process data received from these components. In some examples, the controller determines the time taken from transmitting a light pulse to receiving a corresponding returned light pulse; determines when a returned light pulse is not received for a transmitted light pulse; determines the transmission direction (e.g., horizontal and / or vertical information) of the transmitted / returned light pulse; determines an estimated range in a particular direction; and / or determines any other type of data related to the LiDAR system 100.
[0094] Figure 7An illustrative MEMS-based LiDAR system 700 according to an embodiment is shown. The system 700 may include a laser source 710, a beam steering system 720 that may include a galvanometer system 722 and a MEMS steering unit 724, a receiver system 730 including a receiving optical device 732 and a detector array 734, and a control circuit 750. In operation, light pulses from the laser source 710 are directed to the MEMS 724, which redirects the light pulses to the galvanometer system 722, which then redirects the light pulses to the FOV. If desired, one or more beams originate from the laser source 710. For example, the original laser beam can be split to provide two or more beams (shown here as solid and dashed lines). The returning pulses (not shown) are collected by the optical device 732 and directed to the detector array 734. The detector array 734 senses the returning light pulses and provides a signal corresponding to the returned signal to the control circuit 750. The laser source 710 can be similar to the laser 402 discussed above. The beam steering system 720 can direct the light pulses provided by the laser source 710 to a location within the field of view (FOV) of the system 700. The MEM steering unit 742 can be responsible for a first axis scan (e.g., a vertical axis) within the FOV, the galvanometer 723 can be responsible for controlling a second axis scan (e.g., a horizontal axis) within the FOV, and the galvanometer 722 can be a mirror. In some embodiments, the galvanometer 722 can be a device such as a Fig.11A A single plane mirror such as that shown in Fig. 11B The double plane mirror shown in .
[0095] The MEMS steering system 724 can be a liquid crystal, a miniaturized rotating polyhedron, or any other suitable MEMS-based component that can control the direction of a light beam. In some embodiments, the MEMS steering system 724 can include a MEMS device using a micromirror. The MEMS mirror can steer the laser light generated by the laser source in two or three dimensions to illuminate an object in the field of view. It should be appreciated that the MEMS beam steering system 724 can also include other MEMS components, such as optical switches, optical cross-connects, lenses, etc. The use of a MEMS steering system is desirable because such a solution reduces the size of the LiDAR system, which can translate into lower power consumption, smaller packaging, and less cost. In some embodiments, the MEMS steering system can have an optical aperture cross-section of about a few millimeters or less (e.g., less than 5 mm). A relatively small optical cross-section is suitable for propagating a light beam to the FOV, but is not suitable for redirecting the returning pulses to the receiver system 730. That is, compared to a system with a relatively large optical aperture cross-section, the MEMS steering system may not be large enough to "collect" and redirect the returning pulses to the receiver system. To compensate for the relatively small size of the MEMS steering system 724, the size of the optical device 732 can be relatively large to collect the returning pulses and focus them onto the detector array 734. For example, in one embodiment, the optical device 732 can be a fisheye lens or other optical device with a relatively wide acceptance angle. The fisheye lens can be a wide-angle lens that produces visual distortion, intended to produce a wide panoramic or hemispherical image. Thus, the fisheye lens can collect scattered light within a wide angle, thereby enhancing or increasing the visibility of the LiDAR system. The fisheye lens can be, for example, a circular fisheye lens or a full-frame fisheye lens. In some embodiments, the field of view of the fisheye lens can be selected or configured to match the field of view of the MEMS beam steering range. The fisheye wide-angle receiving lens can be coupled to the MEMS beam steering system 724, for example, side by side.
[0096] The detector array 734 may include a 1xN array of detector segments or an NxM array of detector segments, where N and M are integers. The detector segments may be implemented using InGaAs-based detectors or SiGe-based detectors. In contrast to a single detector arrangement, the detector array 734 includes several detector segments because the optical cross-section of the MEMS steering system 724 requires the use of multiple detector segments in conjunction with the optical device 732 in order to detect the returned light signal. However, (as opposed to a single discrete detector) the use of the detector array 734 will increase the detection of noise (e.g., background light), thereby potentially hindering the detection of the returned light pulses. More particularly, because relatively large light collection optics are used in conjunction with the detector array 734, the overall size of the detector array 734 may be relatively large compared to the size of the returned light pulses. For example, the returned light pulses may be in the micrometer range, while the cross-sectional area of the detector array 734 may be in the millimeter range. Thus, the returned light beam size is significantly smaller than the area of the entire detector array 734. Because any portion of the unprocessed return beam of the detector array 734 will generate noise by picking up background light and radiation, this may significantly increase the detector noise and reduce the signal-to-noise ratio. Moreover, the detector array 734 uses a multi-segment array of detectors, as opposed to a single large detector. The use of relatively large area detectors (e.g., large non-segmented detectors, such as detector 734) may also introduce large junction capacitances that are proportional to the area of the detector. Large junction capacitances are undesirable because they may slow down the operation of components (e.g., amplifiers) and cause excessive noise gain.
[0097] Figure 8 An exemplary multi-segment detector 800 is illustrated in accordance with an embodiment. The multi-segment detector 800 shows a plurality of small segments 802 arranged in a 2x4 array. A returned optical signal is also shown (e.g., shown as dots) to illustrate the relatively small size of the returned optical signal compared to the overall size of the multi-segment detector 800. By segmenting the detector 800 into multiple segments, the smaller junction capacitance can be made smaller compared to a single detector of equivalent size.
[0098] Fig. 8A Another exemplary multi-segment detector 820 according to an embodiment is illustrated. The detector 820 is arranged in a 9x9 grid consisting of 9 3x3 sub-grids. As shown, each sub-grid includes nine (9) segments 1-9. The shape of each segment is rectangular, and the multi-segment detector 820 as a whole can be rectangular. Segments with similar numbers can all be interconnected to each other. For example, all segments marked as one (1) are connected, all segments marked as two (2) are connected, and so on. The multi-segment detector array can be a silicon-based detector, or an InGaAs-based detector, or a SiGe-based detector.
[0099] Figure 8B Yet another exemplary multi-segment detector 840 according to an embodiment is illustrated. The detector 840 is composed of several hexagonal polygonal segments arranged in a honeycomb pattern. Like numbered segments are interconnected with each other.
[0100] Now return to Figure 7 , the detector array 734 is shown as being segmented into segments 734a-734i. The number of segments and their arrangement are merely illustrative. During operation of the LiDAR system 700, when a returned light signal is received, a subset of the segments 734a-734i (e.g., only one of the segments) can detect this returned signal. Each returned light signal corresponds to its beam steering angle or position as indicated by the MEMS beam steering system 724. Since the beam steering angle is known, the return angle of the returned light pulse is also known. Using this knowledge, the system knows which subset of the segments 734a-734i should receive the returned light signal. The control circuit 750 can selectively activate a subset of the segments 734a-734i based on the alignment with the MEMS steering system 724 and / or the galvanometer 722. In this way, only the required segments are active for monitoring the returned signal, while the other segments are deactivated (to save power and reduce noise). The control circuit 750 knows the galvanometer 722 position and the MEMS steering system 724 position and is therefore able to selectively activate and deactivate segments 734a-734i based on the positioning of the galvanometer 722 and the MEMS steering system 724. By selectively activating a subset of detectors and deactivating other detectors, the junction capacitance of the detectors can be significantly reduced, which in turn can improve the signal-to-noise ratio. In addition, the selective activation and deactivation of the segments saves power and improves thermal management of the system. Moreover, since only a subset of the segments that are needed are active, noise is reduced, thereby reducing the computational burden otherwise required to process the returned signals.
[0101] Figure 9A-9C An illustrative example of selectively activating and deactivating detector segments based on the position of a beam steering system is shown. Figure 9A-9C Each of the diagrams shows a beam steering system 910 and a detector array 920 having detector segments 920a-920k. Fig. 9A , the beam steering system 910 directs the light pulse to the FOV1 position. Based on this particular FOV1 position, detector segments 920c and 920d are turned on, while all other detector segments are turned off. Fig. 9B In FIG. 1 , the beam steering system 910 directs the light pulse to the FOVN position. Based on this particular FOVN position, detector segments 920i and 920j are turned on, while all other detector segments are turned off. Fig. 9C, the beam steering system 910 directs two light pulses to the FOV1 (A) and FOV2 (B) locations. Based on these light pulse FOV angles, detector segment 920c is turned on to detect the return angle corresponding to FOV1 (A), and detector segment 920e is turned on to detect the return angle corresponding to FOV2 (B). All other detector segments are turned off.
[0102] In some embodiments, the exemplary LiDAR system may also include a second detector array configured to provide automatic balancing. For example, the second detector array may be of the same type or configuration as the detector array 734. However, the second detector array may be configured to receive only background light or noise and provide a noise signal to the controller. Thus, the controller may correlate the signals provided by the first detector array and the second detector array by, for example, subtracting the background noise signal provided by the second detector array from the signal provided by the first detector array (the signal including the scattered light generated by the object and the background noise). Automatic balancing can enhance the performance of the LiDAR system under certain conditions where the background noise may not be easily distinguished from the scattered light of the object. For example, at night, a lot of ambient light is illuminated, so the background noise may include light of the laser wavelength used by the LiDAR system. As a result, in the absence of automatic balancing, the scattered light from the object may be difficult to distinguish from the ambient light.
[0103] Fig.10 An illustrative process 1000 according to an embodiment is shown. Process 1000 can be implemented in a LiDAR system such as LiDAR system 700. Process 1000 can begin at step 1010, where the transmission of light pulses is controlled via a beam steering system to be directed along an optical path within a field of view (FOV), wherein each transmitted light pulse corresponds to a unique optical path. For example, the beam steering system 720 can control where each light pulse is directed within the FOV of the LiDAR system, and the control circuit 750 knows the optical path. At step 1020, a subset of detector segments of a detector array including a plurality of detector segments is activated based on the optical path. For example, the control circuit 750 can turn on one or more detector segments 734a-734i of the detector array 734 based on the optical path of the light transmitted by the beam steering system. At step 1030, the detector segments not included in the activated subset are deactivated. At step 1040, the returned pulses are monitored in the subset of activated detector segments. If (at step 1050) a returned pulse is detected in the subset of activated detector segments, then (at step 1060) the detected returned pulse is processed. That is, the detected returned pulse is used to fill the frame of the FOV. If the determination at step 1050 is "no", then the process 1000 can return to step 1010.
[0104] It should be recognized that Fig.10 The steps shown in are merely illustrative and additional steps may be added.
[0105] Fig.11A and Fig. 11B Simplified diagrams of LiDAR systems 1100 and 1150 are shown, respectively. LiDAR systems 1100 and 1150 may include many of the same components as LiDAR system 700, and may include laser sources 1110 and 1160, galvanometer controllers 1120 and 1170, galvanometers 1125 and 1175, repetition rate controllers 1130 and 1180, and MEMS steering systems 1140 and 1190. Galvanometers 1120 and 1170 may differ between systems 1100 and 1150. Galvanometer 1120 may be a single plane mirror, while galvanometer 1170 may be a dual plane mirror. Galvanometers 1120 and 1170 oscillate to redirect laser pulses to their respective MEMS steering systems and control a first axis of the FOV of the LiDAR system. (Assuming all things are equal, such as a constant repetition rate) the operation of galvanometers 1100 and 1150 may produce different scanning patterns. If desired, the positions of galvanometers 1125 and 1175 can be switched using MEMS steering systems 1140 and 1175, respectively, so that during the oscillation of galvanometer 1120, galvanometer 1120 will slow down at the transition points (e.g., the points where a single plane reverses direction). As a result, the scan density at the transition points may be higher than at other points in the oscillation cycle. For example, Fig. 12A An exemplary scan density produced by galvanometer 1120 (when the repetition rate is held constant) is shown. Fig. 12A As shown in , the density near the transition point is higher than other points. The higher density near the transition point may not be desired because the light transmission at these areas within the FOV may not be as useful as other angles within the FOV. One way to control the density of light transitions throughout the oscillation cycle of the galvanometer 1120 is to control the repetition rate of the light pulses emitted by the laser source 1110. The repetition rate controller 1130 can control the repetition rate. For example, at and / or near the transition point of the galvanometer 1120, the time interval between consecutive light pulses can be increased (e.g., to reduce the frequency). In this way, when the galvanometer 1120 is at or near its transition point, the repetition rate can be reduced to reduce the density of light pulses transmitted at or near the transition point. If desired, the repetition rate can be increased for one or more areas of interest within the FOV. For example, when the galvanometer 1120 is positioned to transmit light pulses at an angle between -2 degrees and 3 degrees of the FOV of the LiDAR system, the repetition rate can be increased. Fig. 12B An exemplary scan density produced by the galvanometer 1120 when the repetition rate is controlled is shown. As shown, the density is greater in the middle portion of the FOV and less at the transition points.
[0106] The dual mirrors of galvanometer 1170 may be driven using either a direct drive or a resonant drive. Direct drives are typically used for relatively slow scan rates (e.g., up to about 3 Hz), while resonant drives are typically used for relatively fast scan rates (e.g., greater than 5 Hz). Because the power required to support the scan rate is the cube of the frequency, direct drives may be limited in their ability to operate at faster scan rates. This may be because a strong reverse current is required to reverse the direction. Therefore, while faster scan rates may be desirable, they may not be practical in an implementation. For example, if a system such as system 1100 uses a direct drive, then an increased scan rate may be achieved at the expense of significant power losses. This may be because a large amount of energy must be expended to reverse the direction of movement of a single mirror. In addition, because a single mirror is used in direct drive mode, such as Fig. 12A As shown in , at the top and bottom ends of the vertical field of view, the scanning density is relatively high, while the central area of the field of view has a relatively low scanning density.
[0107] In systems such as system 1150 that use dual mirrors, a resonant drive mode can be used to achieve increased scan rates. The resonant drive mode can exploit a "spring" or potential energy to operate at relatively high frequencies without exponential (e.g., frequency cubed) power penalties. Using dual mirrors in resonant mode can result in relatively higher scan densities in the middle portion of the field of view compared to the top and bottom. See, e.g., Fig. 12B , shows the scan density of a system using dual plane mirrors in resonant mode. Note that although Fig. 12B Also used with system 1100 , but the same scanning pattern can be reproduced by both systems 1100 and 1150 .
[0108] Fig. 12CAn exemplary field of view (FOV) 1200 of a LiDAR system according to an embodiment is shown. As shown, FOV 1200 is a two-dimensional space defined by an X dimension and a Y dimension. Although the LiDAR system can collect data points from the entire FOV 1200, certain regions of interest (ROIs) may have a higher priority than other regions within FOV 1200 (e.g., such as undesirable regions that occupy all of the space within FOV 1200 that is not an ROI). FIG. 12 shows five different exemplary ROIs 1210-1214 to illustrate different regions within FOV 1200 that require additional data points compared to other regions within FOV 1200. For example, ROI 1210 occupies an entire band of a fixed y-axis height across the x-axis of FOV 1200. ROIs 1211 and 1212 show local ROIs below ROI 1210, and ROIs 1213 and 1214 show local ROIs above ROI 1210. It should be understood that there may be any number of ROIs, and that the ROIs may occupy any portion of the FOV 1200. The embodiments discussed herein enable the collection of additional data points in the ROI in a manner that does not interrupt the operation of the LiDAR system.
[0109] Fig.13 An illustrative block diagram of a LiDAR system 1300 according to an embodiment is shown. The LiDAR system 1300 may include a laser subsystem 1310, a receiver system 1320, a laser controller 1330, a region of interest controller 1340, a MEMS structure 1350, a MEMS controller 1355, a mirror 1360, and a mirror controller 1365. The LiDAR system 1300 may be contained within one or more housings. In multiple housing embodiments, at least one of the housings may be a temperature controlled environment in which selected portions of the LiDAR system 1300 (e.g., laser controller 1330, laser source 1312, controller 1340) are contained. The MEMS structure 1350, the MEMS controller 1355, the mirror 1360, and the mirror controller 1365 may be collectively represented by a beam steering system 1369.
[0110] The laser subsystem 1310 may be operable to direct light energy toward a mirror 1360, which redirects the light energy to the MEMS structure 1350. The mirror 1360 may be movable under the control of a mirror controller 1365, which may control the speed and direction of the mirror movement. As the mirror 1360 moves, it causes light transmitted by the laser subsystem 1310 to engage with the MEMS structure 1350. The MEMS structure 1350 may be a MEMS mirror or a liquid crystal. The MEMS structure 1350 is controlled by a MEMS controller 1355 and is operable to direct light energy received from the mirror 1360 according to the field of view parameters of the LiDAR system 1300. That is, if the LiDAR system 1300 has a field of view of range z, lateral angle x, and vertical angle y, then the range z may be controlled by the power of the laser source 1312, the vertical angle y may be controlled by the MEMS structure 1350, and the lateral angle x may be controlled by the movement of the mirror 1360. The light energy reflects off objects in the field of view and returns to the polyhedral structure 1350 , where it is directed back to the mirror 1360 , which redirects the light energy back to the receiver system 1320 .
[0111] The receiver system 1320 may include receiving optics 1322, a detector array 1324, and a detector array controller 1326. The receiving optics 1322 may be operable to collect the returning light pulses and direct the returning pulses to the detector array 1324. The detector array 1324 may include a number of detector segments that are selectively turned on and off under the direction of the detector array controller 1326. The detector array controller 1326 may selectively turn the detector segments on and off based on alignment signals provided by the mirror controller 1365 and / or the MEMS controller 1355. In this way, two different degrees of angular control may be used to align the selective activation and deactivation of the detector segments.
[0112] As defined herein, frame rate may refer to the time taken by the scanning system 1302 to complete a complete scan of the FOV. For each frame, the scanning system 1302 may obtain data points from each of the multiple rows (or columns) defined by the FOV. Each row may correspond to a vertical angle within the vertical range of the FOV. The vertical angle is controlled by the mirror 1360. As the mirror 1360 moves, the vertical angle changes, thereby enabling the scanning system 1302 to obtain data points from multiple rows within the FOV. Vertical angular resolution refers to the spacing between data points of adjacent rows. An increase in vertical angular resolution corresponds to a denser spacing between adjacent rows, and this increase may be achieved by reducing the increment of the vertical angle between adjacent vertical angles. The increment between adjacent vertical angles may be reduced by slowing down the movement of the mirror 1360. That is, as the mirror moves slower, the change in the vertical angle increment decreases. The reduction in vertical angular resolution corresponds to a sparser spacing between adjacent rows, and this reduction may be achieved by increasing the vertical angle increment. The increment between adjacent vertical angles may be increased by speeding up the movement of the mirror 1360. That is, as the mirror movement speed increases, the change in the vertical angle increment increases.
[0113] The number of data points obtained in any row can depend on the horizontal angle within the horizontal range of the FOV. The horizontal range can be controlled by the polyhedron 1350, and the horizontal angle resolution can be controlled by the time interval between consecutive laser pulses. The time interval is sometimes related to the repetition rate. A smaller time interval can result in increased horizontal angle resolution, and a larger time interval can result in reduced horizontal angle resolution.
[0114] The vertical angle and horizontal angle and the vertical angle resolution and horizontal angle resolution mentioned above are made with reference to the system where the mirror 1360 controls the horizontal angle. It should be understood that the mirror 1360 can be reused to control the vertical angle and in different Fig.13 used in the system shown.
[0115] The laser subsystem 1310 may include a laser source 1312 and fiber tips 1314-1316. As indicated by the "n" label of the fiber tip 1316, any number of fiber tips may be used. As shown, each of the fiber tips 1314-1316 may be associated with a laser source 1312. The laser source 1312 may be a fiber laser or a diode laser. The fiber tips 1314-1316 may be aligned in a fixed orientation so that the light leaving each tip illuminates the mirror 1360 at a specific location. The actual orientation may depend on several factors, including, for example, frame rate, mirror movement and speed, polyhedron speed, ROI, repetition rate, etc. Additional discussion of the fiber tips and their characteristics for obtaining additional data points in the ROI is discussed in more detail below.
[0116] The laser controller 1330 may be operable to control the laser source 1312. In particular, the laser controller 1330 may control the power of the laser source 1312, may control the repetition rate or time interval of the light pulses emitted by the laser source 1312 (via the time interval adjustment module 1332), and may control the pulse duration of the laser source 1312. The time interval adjustment module 1332 may be operable to control and / or adjust the repetition rate / time interval of the emitter pulses of the laser 1310. The time interval adjustment circuit 1332 may change the repetition rate / time interval for different regions within the FOV. For example, the repetition rate may be increased for the ROI, but the repetition rate may be decreased for regions of the FOV that are not of interest. As another example, the time interval may be decreased for the ROI, and the time interval may be increased for regions of the FOV that are not of interest.
[0117] The region of interest controller 1340 may be operable to control the LiDAR system 1300 to obtain additional data points for the ROI. That is, when the LiDAR system 1300 is scanning the ROI, the ROI controller 1340 may cause the system 1300 to operate differently than when the system 1300 is not scanning the ROI. The ROI controller 1340 may control the operation of the laser controller 1330, the polyhedron controller 1355, and the mirror controller 1365 to change the amount of data to be obtained by the system 1300. The ROI controller 1340 may receive several inputs indicating how it should control the scanning subsystem 1302. The inputs may include, for example, a frame rate 1342, a sparse area 1343, a dense area 1344, a distance range, or any other suitable input. The frame rate 1342 may specify how often the scanning subsystem 1302 completes a FOV scan. The sparse area 1343 and the dense area 1344 may provide a specific location of the ROI. For example, dense region 1344 may correspond to a ROI, and sparse region 1343 may correspond to a region within the FOV that is not a ROI. Fiber tip angle 1345 may be used as a design constraint within which scanning subsystem 1302 operates in order to optimally perform scanning.
[0118] Mirror 1360 can be a single plane mirror or a multi-plane mirror that oscillates back and forth to redirect the light energy emitted by laser source 1312 to MEMS structure 1350. A single plane mirror can provide a higher resolution at the top and bottom of the vertical field of view than in the middle, while a multi-plane mirror can provide a higher resolution at the middle part of the vertical field of view than at the top and bottom. Mirror 1360 can be a galvanometer. Changing the oscillation speed within the oscillation period can enable the scanning subsystem 1302 to acquire sparse or dense data points within the FOV. For example, if dense data points are required (for a particular ROI), the movement speed can be reduced, and if sparse data points are required (for non-ROI), the movement speed can be increased.
[0119] Fig.14 An exemplary fiber tip arrangement according to an embodiment is shown. Four fiber tips 1401-1404 are shown as being oriented relative to each other so that there is the same angle α between adjacent fiber tips. Multiple fiber tips can be used (as opposed to only one fiber tip) to achieve high data collection. When the ROI is scanned, the mirror movement speed is adjusted to the ROI speed (e.g., a speed slower than the sparse or non-ROI speed), and the combination of the additional fiber tip and the reduced relative mirror movement speed produces denser data capture. Moreover, when the non-ROI is scanned, the mirror movement speed is operated at the non-ROI speed (e.g., a speed faster than the ROI speed), and the presence of multiple fiber tips ensures that sufficient data collection is achieved. Angle α can be selected based on the properties (e.g., size) of the light energy emitted by each fiber tip, the speed and movement characteristics of the mirror (e.g., mirror 1360) for both the ROI and the non-ROI, and the speed of the polyhedron (e.g., the polyhedron structure 1350). The angles between each tip can be the same, or they can be different.
[0120] In some embodiments, all four fiber tips can be associated with the same laser source. Thus, if the laser source is turned off, no fiber tip will emit light energy. In another embodiment, each fiber tip can be associated with its own corresponding laser source. This embodiment provides a high degree of on / off control for each fiber tip. In yet another embodiment, a subset of fiber tips can be associated with the same laser source. For example, fiber tips FT1 and FT3 can share a first common laser source, and fiber tips FT2 and FT4 can share a second common laser source. This embodiment provides a balance between full on / off control or no on / off control and a single on / off control.
[0121] Fig.15A A multiple mirror alignment arrangement (MMAA) 1500 is shown that can be used in both ROI and non-ROI embodiments. MMAA 1500 is a method of using a plurality of mirror alignment arrangements such as Fig.1415. An alternative to the multiple fiber tips shown in . As shown, MMAA 1500 shows a collimator 1510, partial reflectors 1521-1523, and a reflector 1524. Light energy originating from a laser source (not shown) is routed to collimator 1510, which directs the light energy to partial reflector 1521. Partial reflector 1521 allows a portion of the light energy to pass (shown as exit path 1531), and the remaining light energy is redirected to partial reflector 1522. Partial reflector 1522 allows a portion of the light energy to pass to reach partial reflector 1523. Partial reflector 1522 redirects the light energy along exit path 1532. Partial reflector allows a portion of the light energy to pass to reach partial reflector 1524. Partial reflector 1523 redirects the light energy along exit path 1533. Reflector 1524 can redirect all or at least a portion of all the remaining light energy along exit path 1534.
[0122] The angle between adjacent exit paths can be selected to achieve the desired resolution of the ROI and non-ROI. For example, the angle between adjacent exit paths can be Fig.14 In some embodiments, the angle between adjacent exit paths may be fixed. In other embodiments, the angle between adjacent exit paths may be variable. Variable angle adjustment may be used to provide different resolutions as required. For example, if a LiDAR system is used in a vehicle, the angle may be set to a first configuration when the vehicle is operating in a first mode (e.g., traveling at highway speeds or being driven by a first driver), and the angle may be set to a second configuration when the vehicle is operating in a second mode (e.g., traveling at city speeds or being driven by a second driver).
[0123] Fig. 15B Another multiple mirror alignment arrangement (MMAA) 1501 that can be used for ROI and non-ROI embodiments is shown. MMAA 1501 is an alternative to MMAA 1500. As shown, MMAA 1501 shows a collimator 1512, partial reflectors 1525-1527, a reflector 1528, and an exit path 1535-1538. MMAA 1501 is similar to MMAA 1500 except for the positioning of collimator 1512. As shown, collimator 1512 is positioned above mirror 1525. If desired, collimator 1512 can be positioned below mirror 1528. As a further alternative, collimator 1512 can be aimed at a different mirror (such as mirror 1526 or mirror 1527), and such a mirror can redirect light energy as needed to achieve the desired result.
[0124] Fig. 15CAn exemplary multiple collimator arrangement 1550 that can be used for ROI and non-ROI embodiments is shown. Arrangement 1550 may include collimators 1561-1563. Each of collimators 1561-1563 may be associated with its own laser source. Associating each collimator with its own laser source enables selectively turning on and off the light energy emitted from each collimator. For sparse areas, one or more laser sources may be turned off (to save power), and for dense areas, all laser sources may be turned on to maximize resolution. Each of collimators 1561-1563 may be fixed in a specific orientation to achieve a desired α angle between each collimator. If desired, each of collimators 1561-1563 may be movable to dynamically adjust the α angle between each collimator.
[0125] Fig.15D An exemplary collimator and lens arrangement 1570 is shown that can be used to control the divergence of an existing collimator 1571 of a light beam according to an embodiment. Lens 1572 can be moved toward and away from collimator 1571 to adjust the divergence of the light beam. When the light beam is projected by a scanning system, arrangement 1570 can be used to adjust the size of the light beam. For the ROI area, it may be desirable to have a relatively narrow light beam. In order to produce a relatively narrow light beam, lens 1572 can be positioned at a narrow beam distance from collimator 1571. For non-ROI areas, it may be desirable to have a relatively wide light beam. In order to produce a relatively wide light beam, lens 1572 can be positioned at a wide beam distance from collimator 1571.
[0126] Fig.16 Illustrative scanning resolutions using multiple fiber tips, multiple mirror alignment arrangements, or multiple collimator arrangements are shown according to embodiments. Illustrative vertical resolution lines from the fiber tips (FT1-FT4) are shown. As shown, the resolution lines are grouped according to sparse resolution and dense resolution. In sparse areas, the scanning system moves the mirror at a relatively faster speed than in dense areas, and in dense areas, the scanning system moves the mirror at a relatively slower speed than in sparse areas. (As FT 1 -FT 4The spacing between adjacent scan lines is substantially equidistant (as shown in a repeating pattern of ). Such equidistant spacing can be made possible by coordinating the alignment of the fiber tips with the frame rate, mirror speed, polyhedron speed, and any other suitable factors. In contrast, if the alignment of the fiber tips is not properly coordinated, then equidistant spacing may not be possible, resulting in an undesirable scan pattern. In dense areas, each fiber tip can provide multiple resolution lines. For example, as shown, FT1 provides four resolution lines before FT2 provides its four resolution lines. Thus, each fiber tip provides four resolution lines before transitioning to the next fiber tip. It should be understood that the number of resolution lines provided by each fiber tip depends on a number of factors, including, for example, the mirror speed, the polyhedron speed, and the angle between the fiber tips. The resolution lines among the fiber tips can be staggered at the transition between sparse areas and dense areas. For example, (as shown in ). Fig.17A ) at least one resolution line from one or more of the fiber tips FT2-FT4 may be interleaved among the four resolution lines associated with FT1.
[0127] The angle (e.g., α) between the fiber tips can be selected to be substantially equidistant from each other based on the mirror speed, the polygon speed, the desired angular resolution of the ROI, and the requirement for spacing between resolution lines in (one or more) sparse regions. At least two different mirror speeds are used to provide dense resolution and sparse resolution, and if the angle between the fiber tips is not properly aligned, then the difference in mirror speed may cause the resolution lines to be unequally spaced. For example, assume the angle for the dense region is θ. θ can represent the total degrees within the FOV that is part of the ROI and for which dense resolution is required. If the mirror speed is constant throughout the frame, then the angle α between the fiber tips can be approximated as θ / n, where n is the number of fiber tips. This α is referred to as the angle with constant speed. cs The target angle of the fiber tips can be expressed, but additional calculations are required to take into account that the mirrors operate at different speeds, and therefore α cannot be set exactly to θ / n. Sparse regions must be taken into account. In sparse regions, the desired angle between adjacent resolution lines is assumed to be φ. For example, φ may exist between FT1 and FT2, between FT2 and FT3, between FT3 and FT4, and between FT4 and FT1 in the sparse regions. To achieve φ between different fiber tips, the angle between the fiber tips can be calculated by the following equation:
[0128] α=α vs =φ*n*2–φ
[0129] where α vsis the angle of the variable speed mirror, φ is the angle between adjacent resolution lines in the sparse region, n is the number of fiber tips, and the number 2 is the scaling factor to account for overlapping resolution lines. The variables φ, n, mirror speed, and polyhedron speed are chosen so that α vs With α cs These variables are chosen so that α vs With α cs Being identical or nearly identical enables the scanning system to achieve a desired scanning density for both ROI and non-ROI areas within each frame of the FOV.
[0130] Fig.17A Another illustrative diagram of vertical resolution using multiple fiber tips or multiple mirror alignment arrangements according to an embodiment is shown. Sparse areas and dense areas are shown. Four fiber tips FT1-4 are used. In the sparse areas, the resolution lines of each fiber tip are evenly spaced. In the dense areas, the vertical resolution lines are substantially denser than the vertical resolution lines in the sparse areas. In the dense areas, the vertical resolution lines are primarily grouped for each fiber tip, however, staggered resolution lines from other fiber tips may be present within a particular group.
[0131] Fig. 17B It shows various embodiments Fig.17A illustrative close-up view of a sparse region within, and Fig. 17C It shows various embodiments Fig.17A An illustrative close-up view of a dense region within. Note that Fig. 17B The ratio of the scale factor Fig. 17C The scaling factor in is small. Therefore, Fig. 17B The resolution lines for multiple fiber tips are shown, and Fig. 17C Multiple resolution lines are shown for only one fiber tip.
[0132] The dynamic resolution discussed above is in the context of dynamic vertical resolution. If desired, the laser subsystem (e.g., fiber tip, multiple mirror alignment arrangement, or multiple collimator arrangement) can be oriented in the horizontal direction (opposite to the vertical direction described above) to provide dynamic horizontal resolution.
[0133] Assuming that changes in the speed of the mirror movement are used to control the vertical resolution, the repetition rate or time interval can be changed to dynamically control the horizontal resolution. This provides a dual-axis dynamic resolution control that can be synchronized by a controller (e.g., ROI controller 1340) to provide increased resolution for the ROI and reduced resolution for the non-ROI for both vertical and horizontal orientations. For example, when the scanning cycle encounters the ROI, the mirror movement speed is reduced and the time interval between consecutive light pulses is reduced (thereby increasing the repetition rate). When the scanning cycle encounters the non-ROI, the mirror movement speed is increased and the time interval between consecutive light pulses is increased (thereby reducing the repetition rate).
[0134] In some embodiments, (assuming the laser subsystem is so oriented) the laser source(s) may be selectively turned on and off to provide a vertical dynamic range. This may eliminate the need to adjust the mirror speed to achieve dynamic vertical resolution. However, if desired, the laser source(s) may be selectively turned on and off in conjunction with changes in the mirror movement speed.
[0135] Fig.18 An illustrative FOV 1800 of laser pulses with variable sizes according to an embodiment is shown. As shown, FOV 1800 includes two sparse areas and one dense area. Both the sparse area and the dense area show illustrative light pulses in the form of circles of different sizes. The sparse size of the circle is larger than the dense size of the circle. When the scanning system projects light into the sparse area, the mirror speed can move at the sparse speed, and the repetition rate can be set to the sparse area repetition rate. In contrast, when the scanning system projects light into the dense area, the mirror speed can move at the dense speed and the repetition rate can be set to the dense area repetition rate. The sparse speed is faster than the dense speed and the sparse area repetition rate is slower than the dense area repetition rate. Therefore, fewer light pulses are sent to the sparse area than in the dense area. If the circle size of the light pulse projected into the sparse area is the same as the circle size in the dense area, there may be insufficient filling (underfilling). When there is too much space between adjacent light pulse circles, insufficient filling may occur. Therefore, in order to minimize insufficient filling, it is desirable to project light pulses of appropriate size for the sparse area and the dense area.
[0136] Although the LiDAR system 1300 and the Figure 14-18 , but similar principles can be applied to receiver systems using multiple optics and multiple detectors, such as described below.
[0137] Multiple optics / multiple detector systems according to the embodiments discussed herein can be used in LiDAR systems where the light transmission path does not need to be the same as the light reception path. Decoupling the transmission and reception paths provides design flexibility for the placement of each optics / detector combination. Each optics / detector combination may include an optic designed to capture returned light pulses in a window present within the FOV, and these returned light pulses are processed by the detector corresponding to this optic. Each window can capture a subset of the FOV or the entire FOV. The optics / detectors can be independently positioned outside the transmission path of the light, as long as any object in the FOV is captured by at least two overlapping windows. Capturing the returned pulses from the object via at least two overlapping windows can enable the receiver system to filter out erroneous light or background noise.
[0138] Fig.23 An exemplary LiDAR system 2300 is shown in accordance with an embodiment. The LiDAR system 2300 may include a laser transmission and steering system 2310 and an optical receiver system 2320. Other components may be included but are omitted to avoid overcrowding the drawing. Light pulses are transmitted along exemplary paths 2311-2313 toward an object 2330 in the FOV. Return light pulses from the object 2330 are shown returning along exemplary paths 2321-2323. The return path 2321 may be the same as the transmission path 2313 and would require the transmission system 2310 to redirect the returning light pulses to the receiver system 2320 (e.g., similar to the transmission path 2313). Figure 1 The light returned on paths 2322 and 2323 does not coincide with any transmission path and is returned directly to the optical receiver system 2320. In some embodiments, a first optics / detector combination 2325 can detect light returned along path 2322 and a second optics / detector combination 2326 can detect light returned along path 2323. Both optics / detector combinations 2325 and 2326 can have overlapping windows that capture returned light from the same object.
[0139] Fig.24 An illustrative schematic diagram of two optics / detector combinations with overlapping windows that capture returned light pulses from the same object within the FOV of the LiDAR system is shown. Detector / lens combination 2410 has an associated window W1, and detector / lens combination 2420 has an associated window W2. Windows W1 and W2 overlap as shown.
[0140] Fig.19An illustrative multi-lens array based LiDAR system 1900 is shown according to an embodiment. System 1900 may include (one or more) laser sources 1910, a beam steering system 1920, a receiver system 1930 that may include a receiving lens array 1940 and a detector circuit 1950, and a control circuit 1960. In some embodiments, LiDAR system 1900 is similar to LiDAR system 700, but the components of receiver system 1930 are different. The general operating principles are similar. If desired, one or more light beams originate from laser source 1910. Return pulses (not shown) are collected by receiving lens array 1940 and directed to detector circuit 1950. Detector circuit 1950 processes the returned light pulses and provides signals corresponding to the returned signals to control circuit 1960.
[0141] The receiving lens array 1940 may include several lenses, shown as lenses 1-N. The combination of all lenses 1-N can detect returned light pulses within the FOV of the LiDAR system 1900. The lenses can be arranged to detect all returned light pulses anywhere within the FOV, or the lenses can be arranged to emphasize the detection of returned light pulses within an area of interest of the FOV (e.g., -10 degrees to +10 degrees in the vertical FOV) and de-emphasize the detection of returned light pulses outside the area. Each lens can be designed to detect light returned by objects within a window of the FOV. The window represents an area within the FOV. Lenses 1-N can be arranged so that the window corresponding to any given lens overlaps with at least one other window corresponding to at least one other lens. This window overlap can enable two or more lenses corresponding to the overlapping windows to receive the same returned light pulses. For example, Fig.19 It is shown that lens 1 and lens 2 have overlapping windows as shown by WOL1-2, and the windows of lenses 2 and 3 overlap as shown by WOL2-3. In combination with the discrete detectors 1-N of detector circuit 1950, the overlapping windows are effective in filtering out noise present in the FOV.
[0142] The detector circuit 1950 may include a plurality of discrete detectors 1-N. The detectors 1-N may be discrete, rather than Figure 7 734. An array of detectors is shown. Each of detectors 1-N is associated with one of lenses 1-N. Thus, for example, any returned light pulse received by lens 1 is detected only by detector 1, and any returned light pulse received by lens 2 is detected only by detector 2, and so on. This provides a one-to-one correspondence between lenses and detectors. This can be advantageous because discrete detectors are cheaper and easier to implement than array-based detectors such as detector array 734.
[0143] Fig. 20It shows that according to the embodiment Fig.19 1930. As shown, the receiver system 1930 may include a receiver processing circuit 1960, which may be the same as or separate from the control circuit 1960. The system 1930 may include detectors 1951-1954 (only four of the N possible detectors are shown), and may include lenses 1941-1944 (only four of the N possible lenses are shown). The receiver processing circuit 1960 is connected to each of the detectors 1951-1954, and each of the detectors 1951-1954 is associated with a lens 1941-1944, respectively. As shown, each of the lenses 1941-1944 has an associated window 1941a-1944a. As also shown, two or more of the windows 1941a-1944a overlap each other.
[0144] The use of a multi-lens array and several discrete detectors may provide enhanced flexibility in the design and shape (e.g., industrial design) of the LiDAR system. For example, the LiDAR system may be used on a vehicle such as a car or a drone, and it may be desirable to integrate the LiDAR system into or attach it to the vehicle in a manner that is visually pleasing and unobtrusive but does not compromise its performance.
[0145] Thus, the multi-lens array can be arranged to have any desired number and configuration of windows that capture returned light from objects in the FOV. Figure 21A-Figure 21F Different window arrangements resulting from corresponding multi-lens arrays according to various embodiments are shown. Fig.21A An MxN array of windows 2102a-2102f arranged with horizontal deviations is shown. Windows 2102a-f can each have approximately the same size as each other. Each window can overlap with three other windows. For example, window 2102a can overlap with windows 2102b, 2102d, and 2102e. Fig.21A The window overlap shown in is illustrative only. If desired, Fig.21A The windows may be arranged so that only two windows overlap each other. Fig.21B An NxM array of windows 2112a-2112f arranged with a vertical offset is shown. In some embodiments, Fig.21B The array and Fig.21A The array is the same, but rotated 90 degrees.
[0146] Fig. 21CShown is a single row or column of window 2122a-2122e.The size of window 2122a and 2122e can be identical, and the size of window 2122b and 2122d can be identical, and the size of window 2122c can be different from other windows.As shown, window 2122a can only overlap with window 2122b, and window 2122b can overlap with both window 2122a and 2122c, window 2122c can overlap with window 2122b and 2122d, window 2122d can overlap with window 2122c and 2122e, and window 2122e can only overlap with window 2122d.
[0147] Fig.21D Combinations of windows 2132a and 2132b of different sizes are shown as shown. Fig.21E A combination of similarly sized windows 2142a are shown overlapping each other in a serpentine configuration. Fig.21F A combination of similarly sized windows overlapping each other to form a triangular shape is shown.
[0148] Fig. 22 An exemplary process 2200 is shown in accordance with an embodiment. Beginning at step 2210, transmission of light pulses is controlled via a beam steering system to be transmitted along an optical path within a field of view (FOV). At step 2220, returned light pulses from the FOV may be received via a multi-lens array comprising a plurality of lenses, each lens being associated with a window within the FOV, wherein at least two windows overlap one another such that lenses associated with the overlapping windows receive the same returned light pulses, and wherein each lens of the plurality of lenses directs any returned light pulses to a detector corresponding to that particular lens of the plurality of lenses. The multi-lens array may be, for example, Figure 18-Figure 20 and Figure 21A-Figure 21F At step 2230, the signals received from each detector corresponding to the plurality of lenses may be processed. At step 2240, the processed signals may be differentiated by filtering out the received returned pulses that are not captured by the at least two overlapping windows to produce filtered signals. That is, if the detector associated with the overlapping windows does not detect the returned light pulse, the returned light pulse is rejected.
[0149] It should be recognized that Fig. 22 The steps shown in are merely illustrative and additional steps may be added.
[0150] Fig.25An illustrative vehicle 2501 with an integrated LiDAR system according to an embodiment is shown. A laser transmission and steering system 2510 can be integrated into a rearview mirror assembly 2502. If desired, the system 2510 can be placed at other locations on the vehicle 2501. Moreover, multiple instances of the system 2510 can be placed on the vehicle 2501. Multiple instances of an optical device / detector combination (ODC) can be placed at various locations on the vehicle. For example, ODCs 2520 and 2521 can be located near or in front of the vehicle (e.g., near a grille assembly or a bumper assembly). ODCs 2522 and 2523 can be located together near a headlight assembly. As shown, ODC 2524 can be located at the same location as a side mirror assembly. ODCs 2525 and 2526 can be located near the roofline adjacent to the windshield. If desired, the ODC can be integrated with the steering system 2510. It should be appreciated that by decoupling the ODC from the optical transmission path, design flexibility of placing the ODC in any location in the vehicle 2501 can be achieved.
[0151] It is believed that the disclosure set forth herein includes multiple different inventions with independent utility. Although each of these inventions has been disclosed in its preferred form, because many variations are possible, its specific embodiments as disclosed and illustrated herein should not be considered as limiting. Each example is limited to the embodiments disclosed in the aforementioned disclosure, but any one example does not necessarily include all features or combinations that may ultimately be claimed. Wherein the description states "one" or "first" element or its equivalent, such a description includes one or more such elements, and neither requires nor excludes two or more such elements. In addition, the order indicators such as the first, second or third for identifying elements are used to distinguish between elements, and do not indicate the required number or limited number of these elements, and do not indicate the specific position or order of these elements, unless otherwise specifically stated.
[0152] Moreover, relative to Figure 1-Figure 25Any of the processes described and any other aspects of the present invention may each be implemented by software, but may also be implemented in hardware, firmware, or any combination of software, hardware, and firmware. Each of them may also be embodied as a machine or computer readable code recorded on a machine or computer readable medium. A computer readable medium may be any data storage device that can store data or instructions that can then be read by a computer system. Examples of computer readable media may include, but are not limited to, read-only memory, random access memory, flash memory, CD-ROM, DVD, magnetic tape, and optical data storage devices. Computer readable media may also be distributed on a network-coupled computer system so that computer readable codes are stored and executed in a distributed manner. For example, a computer readable medium may be transmitted from one electronic subsystem or device to another electronic subsystem or device using any suitable communication protocol. A computer readable medium may embody computer readable code, instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery medium. A modulated data signal may be a signal that sets or changes one or more of its characteristics in a manner that encodes information in the signal.
[0153] It should be understood that any or each module or state machine discussed herein can be set as a software construct, a firmware construct, one or more hardware components, or a combination thereof. For example, any one or more of a state machine or module can be described in the general context of a computer executable instruction (such as a program module) that can be executed by one or more computers or other devices. Typically, a program module can include one or more routines, programs, objects, components, and / or data structures that can perform one or more specific tasks or can implement one or more specific abstract data types. It should also be understood that the number, configuration, function, and interconnection of modules or state machines are merely illustrative, and the number, configuration, function, and interconnection of existing modules can be modified or omitted, additional modules can be added, and the interconnection of certain modules can be changed.
[0154] Although many changes and modifications of the present invention will undoubtedly become clear to those of ordinary skill in the art after reading the foregoing description, it should be understood that the specific embodiments shown and described by way of example are by no means intended to be considered limiting. Therefore, reference to details of the preferred embodiments is not intended to limit the scope thereof.
Claims
1. A light detection and ranging (LiDAR) system, include: Beam steering system; a laser system configured to emit light pulses that are steered by a beam steering system such that each emitted light pulse is steered along an optical path within a field of view (FOV); a receiver system configured to receive return pulses from the FOV, the receiver system comprising: a detector array comprising a plurality of detector segments; and a first controller configured as: selectively activating a subset of the detector segments based on the optical path, and Return pulses detected by the subset of activated detector segments are processed.
2. The LiDAR system of claim 1 , wherein the beam steering system comprises one or more moving mirrors.
3. The LiDAR system of claim 2, wherein the one or more moving mirrors comprise at least one of a single plane mirror, a double plane mirror, or a polygonal mirror.
4. The LiDAR system of claim 2, further comprising a second controller configured to adjust a moving speed of at least one of the one or more mirrors based on the optical path.
5. The LiDAR system of claim 1, wherein the receiver system further comprises an optical lens configured to direct return pulses to the detector array.
6. The LiDAR system of claim 5, wherein the detector array is positioned at or near a focal plane of the optical lens.
7. The LiDAR system of claim 1 , wherein the first controller is configured to selectively activate a subset of the detector segments based on alignment signals provided by one or more controllers of the beam steering system, the alignment signals corresponding to angles associated with the optical path within the FOV. 8 . The LiDAR system of claim 1 , further comprising a third controller configured to control a pulse repetition rate of the light pulses based on the optical path.
9. The LiDAR system of claim 1, further comprising a fourth controller configured to coordinate at least one of: a movement speed associated with the beam steering system, and a repetition rate of the light pulses based on the optical path.
10. A method performed by a light detection and ranging (LiDAR) scanning system, include: directing multiple light pulses from a laser system to a beam steering system; steering, by the beam steering system, a light pulse from among the plurality of light pulses along an optical path within a field of view (FOV); selectively activating a subset of detector segments of a detector array comprising a plurality of detector segments based on the optical path; detecting the return pulse by a subset of the activated detector segments; as well as Return pulses detected by the subset of activated detector segments are processed.
11. The method of claim 10, wherein the beam steering system comprises one or more moving mirrors.
12. The method according to claim 10, further comprising: include: A movement speed of at least one of the one or more mirrors is adjusted based on the optical path.
13. The method of claim 10, wherein a subset of the detector segments are selectively activated include: A subset of the detector segments is selectively activated based on alignment signals provided by one or more controllers of the beam steering system, the alignment signals corresponding to angles associated with the optical paths within the FOV.
14. The method of claim 10, further comprising controlling a repetition rate of the light pulses based on the optical path.
15. The method of claim 10, further comprising coordinating at least one of: a movement speed associated with the beam steering system, and a repetition rate of the light pulses based on the optical path.
16. A light detection and ranging (LiDAR) system, include: Beam steering system; a laser system configured to emit light pulses that are steered by a beam steering system such that each emitted light pulse is steered along an optical path within a field of view (FOV); a receiver system configured to receive return pulses from the FOV, the receiver system comprising: a multi-lens array associated with a plurality of windows within the FOV, wherein at least two windows of the plurality of windows overlap each other, and a plurality of detectors configured to receive return pulses directed by the multi-lens array; as well as Controller, configured as: Received return pulses not captured by the at least two overlapping windows are filtered out to produce a filtered signal.
17. The LiDAR system of claim 16, wherein the multi-lens array comprises a plurality of optical lenses arranged such that each lens is associated with one of the plurality of windows within the FOV.
18. The LiDAR system of claim 17, wherein each window of the plurality of windows corresponds to one of the plurality of optical lenses, and each window overlaps with at least one other window corresponding to at least one other optical lens.
19. The LiDAR system of claim 17, wherein the plurality of optical lenses are arranged to emphasize detection of return pulses within a region of interest (ROI) and de-emphasize detection of return pulses outside the ROI.
20. The LiDAR system of claim 17, wherein each of the plurality of detectors corresponds to one of the plurality of optical lenses.
21. The LiDAR system of claim 16, wherein the at least two windows overlap each other at a minimum distance within the FOV.
22. The LiDAR system of claim 16, wherein the plurality of windows are arranged in a one-dimensional or two-dimensional array.
23. The LiDAR system of claim 16, wherein at least one window of the plurality of windows has a different size than the other windows.
24. A method performed by a light detection and ranging (LiDAR) system, include: directing a plurality of light pulses via a laser system to a beam steering system; steering, by the beam steering system, a light pulse from among the plurality of light pulses along an optical path within a field of view (FOV); receiving return pulses from the FOV by a multi-lens array associated with a plurality of windows within the FOV, wherein at least two windows of the plurality of windows overlap each other; receiving, through the plurality of detectors, return pulses directed by the multi-lens array; as well as Received return pulses not captured by the at least two overlapping windows are filtered out to produce a filtered signal.
25. The method of claim 24, wherein each window of the plurality of windows corresponds to an optical lens of the multi-lens array having a plurality of optical lenses, and each window overlaps with at least one other window corresponding to at least one other optical lens.
26. The method of claim 24, wherein the multi-lens array comprises a plurality of optical lenses arranged to emphasize detection of return pulses within a region of interest (ROI) and de-emphasize detection of return pulses outside the ROI.
27. The method of claim 24, wherein the at least two windows overlap each other at a minimum distance within the FOV.
28. A light detection and ranging (LiDAR) system, include: a laser transmission and steering system configured to transmit light pulses along a transmission path within a field of view (FOV); a receiver system configured to receive return pulses from the FOV, the receiver system comprising: a plurality of optical lens and detector combinations (ODCs), wherein at least two different ODCs are associated with overlapping windows and process return pulses from the same object within the FOV; A controller capable of operating: Received return pulses processed by the at least two ODCs that do not correspond to the same object are filtered out.
29. The LiDAR system of claim 28, wherein at least one of the return pulses is received along a receive path different from any of the transmit paths.
30. The LiDAR system of claim 28, wherein each ODC comprises an optical lens and a detector.
31. The LiDAR system of claim 28, wherein the light pulse is transmitted from a first location on a vehicle, wherein each of the plurality of ODCs is located at a corresponding different location on the vehicle.
Citation Information
Patent Citations
2D SCANNING HIGH PRECISION LiDAR USING COMBINATION OF ROTATING CONCAVE MIRROR AND BEAM STEERING DEVICES
US20180188355A1
