Combining multiple functions of lidar system for assisting in vehicle operation
Patent Information
- Application Number
- JP2024201724
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2020-06-29
- Filing Date
- 2024-11-19
- Publication Date
- 2025-03-05
- Estimated Expiration
- 2041-06-03
AI Technical Summary
【0058】 FM LIDARシステム他の利点は、各データポイントに対して瞬間的に正確な速度を提供するということである。一部の具現において、速度の測定は半径方向の速度(例えば、探知されたオブジェクトとセンサとの間の方向ベクトル)またはレーザ信号の周波数のうち少なくとも一つに基づいて、オブジェクトから受信された光の周波数をシフトするドップラー効果を使用して達成される。例えば、速度が100m/s未満のオンロード(on-road)状況にある速度の場合、1550ナノメートル(nm)の波長においてこのようなシフトは130MHz未満の周波数シフトに当たる。このような周波数シフトは光ドメインで直接探知することが難しいくらい小さい。しかし、FMCW、PMCW、またはFMQW LIDARシステムにおいてコヒーレント探知を使用することで、信号はその周波数シフトが多様な信号処理技法を使用して計算されるようにRFドメインに変換される。これは自律走行車両制御システムが入力されるデータをより速く処理できるようにする。
Smart Images

Figure 2025028908000001_ABST
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATION(S) This application claims priority to patent application Ser. No. 16 / 915,404, filed Jun. 29, 2020, now assigned as U.S. Patent No. 10,948,600, the disclosures of which are incorporated herein by reference. [Background technology]
[0002] Optical ranging using lasers, commonly referred to as LIDAR, a mnemonic for light detection and ranging, and sometimes called RADAR, is used in a variety of applications from altimetry to photography to collision avoidance. LIDAR offers finer-scale ranging resolution with smaller beam sizes than traditional microwave ranging systems such as RADAR (radio-wave detection and ranging). Optical ranging is achieved by different techniques, including direct ranging, which is based on the round trip travel time of a light pulse to an object, chirp detection, which is based on the difference in frequency between a transmitted chirped light signal and the return signal scattered from the object, and phase-coded detection, which is based on a single-frequency phase-change sequence that can be distinguished from a delayed signal. Summary of the Invention [Means for solving the problem]
[0003] Aspects of the present disclosure relate generally to the optical field of light detection and ranging (LIDAR), and more particularly to a system and method for combining multiple functions of a LIDAR system to aid in vehicle operation.
[0004] Implementations disclosed herein relate to LIDAR systems. The LIDAR system includes one or more optical components configured to receive an optical beam generated by a laser light source, the optical beam associated with a local oscillator (LO) signal. In some implementations, the one or more optical components are configured to split the optical beam into a first split optical beam and a second split optical beam. In some implementations, the one or more optical components are configured to transmit the first split optical beam and the second split optical beam to an optical device. In some implementations, the one or more optical components are configured to receive from the optical device a first reflected beam associated with the first split optical beam and a second reflected beam associated with the second split optical beam. In some implementations, the one or more optical components are configured to pair the first reflected beam with the LO signal and pair the second reflected beam with the LO signal.
[0005] In another aspect, the present disclosure relates to a method of combining multiple functions of a LIDAR system. In some implementations, the method includes receiving a light beam generated by a laser light source, the light beam associated with an LO signal. In some implementations, the method includes splitting the light beam into a first split light beam and a second split light beam. In some implementations, the method includes transmitting the first split light beam and the second split light beam to an optical device. In some implementations, the method includes receiving from the optical device a first reflected beam associated with the first split light beam and a second reflected beam associated with the second split light beam. In some implementations, the method includes pairing the first reflected beam with an LO signal and pairing the second reflected beam with the LO signal.
[0006] In another aspect, the present disclosure relates to a LIDAR system including a semiconductor substrate and one or more optical components disposed on the semiconductor substrate. The one or more optical components are configured to receive an optical beam generated by a laser light source, where the optical beam is associated with an LO signal. The one or more optical components are configured to split the optical beam into a first split optical beam and a second split optical beam. The one or more optical components are configured to transmit the first split optical beam and the second split optical beam to an optical device. The one or more optical components are configured to receive from the optical device a first reflected beam associated with the first split optical beam and a second reflected beam associated with the second split optical beam. The one or more optical components are configured to pair the first reflected beam with the LO signal and pair the second reflected beam with the LO signal.
[0007] In some implementations, the one or more optical components are configured to receive a second optical beam generated by the laser light source or the second laser light source, where the second optical beam is associated with the LO signal. The one or more optical components are configured to split the third split optical beam into a second split optical beam and a fourth split optical beam. The one or more optical components are configured to transmit the third split optical beam and the fourth split optical beam to the optical device. The one or more optical components are configured to receive from the optical device a third reflected beam associated with the third split optical beam and a fourth reflected beam associated with the fourth split optical beam. The one or more optical components are configured to pair the third reflected beam with a second LO signal and pair the fourth reflected beam with the second LO signal.
[0008] In some implementations, the one or more optical components are configured to receive the LO signal and split the LO signal into a first split LO signal and a second split LO signal. The one or more optical components are configured to receive the LO signal from an LO input, where the LO signal at the LO input is less than 5 milliwatts.
[0009] In some implementations, the LIDAR system includes a first photodetector and a second photodetector. The one or more optical components provide a first split LO signal and a first reflected beam to the first photodetector, causing the first photodetector to generate a first electrical signal from the first split LO signal and the first reflected beam. The one or more optical components provide a second split LO signal and a second reflected beam to the second photodetector, causing the second photodetector to generate a second electrical signal from the second split LO signal and the second reflected beam. Signal crosstalk associated with the first electrical signal and the second electrical signal is less than -55 dB within 1 MHz and 200 MHz.
[0010] In some embodiments, the first photodetector includes a pair of photodiodes, the pair of photodiodes having a common mode rejection ratio (CMRR) of 30 dB or greater. The first photodetector has a bandwidth of 3 dB between 80 kHz and 650 MHz. The first photodetector has a responsivity of 0.9 A / W or greater. The light beam has an operating wavelength that is the same as or substantially the same as 1550 nanometers.
[0011] In some implementations, the LIDAR system is 5×10 -12 The LIDAR system includes a transimpedance amplifier (TIA) having a peak noise-equivalent power (NEP) of less than Watts per square root Hertz. The first photodetector is configured to provide a first electrical signal to the TIA. In some implementations, the LIDAR system includes a TIA having a gain between 4 kilo-ohms and 25 kilo-ohms. The first photodetector is configured to provide the first electrical signal to the TIA.
[0012] In some embodiments, the LIDAR system includes a semiconductor substrate. The semiconductor substrate includes one or more optical components. The semiconductor substrate includes a plurality of outputs, each of the plurality of outputs associated with a pitch between 31.75 micrometers and 381 micrometers. In some embodiments, the optical beam has an operating wavelength between 1400 nanometers and 1600 nanometers.
[0013] In some embodiments, the LIDAR system includes a modulator configured to modulate the optical beam before the one or more optical components receive the optical beam. The modulator has a modulation bandwidth between 600 MHz and 1000 MHz. In some embodiments, a signal crosstalk associated with the first reflected beam and the first split optical beam is 55 dB or less within 1 MHz and 200 MHz. In some embodiments, an internal scattering of the first split optical beam into the first reflected beam is -66 dB or less compared to a Tx transmit power. The scattering is associated with a maintained polarization. In some embodiments, an internal scattering of the first split optical beam into the first reflected beam is -84 dB or less compared to a Tx transmit power. In some embodiments, the scattering is associated with a flipped polarization. In some embodiments, the first split optical beam has a duty cycle of 33% or less.
[0014] In another aspect, the disclosure relates to a method of combining multiple functions of a LIDAR system. The method includes one or more optical components disposed on a semiconductor substrate receiving a light beam generated by a laser light source, where the light beam is associated with an LO signal. The method includes the one or more optical components splitting the light beam into a first split light beam and a second split light beam. The method includes the one or more optical components transmitting the first split light beam and the second split light beam to an optical device. The method includes the one or more optical components receiving from the optical device a first reflected beam associated with the first split light beam and a second reflected beam associated with the second split light beam. The method includes the one or more optical components pairing the first reflected beam with an LO signal and pairing the second reflected beam with the LO signal.
[0015] In another aspect, the present disclosure relates to an autonomous vehicle control system. The autonomous vehicle control system includes a semiconductor substrate, one or more LIDAR circuits disposed on the semiconductor substrate, and one or more processors. The one or more LIDAR circuits are configured to receive a light beam generated by a laser light source. The light beam is associated with an LO signal. The one or more LIDAR circuits are configured to split the light beam into a first split light beam and a second split light beam. The one or more LIDAR circuits are configured to transmit the first split light beam and the second split light beam to an optical device. The one or more LIDAR circuits are configured to receive from the optical device a first reflected beam associated with the first split light beam and a second reflected beam associated with the second split light beam. The one or more LIDAR circuits are configured to pair the first reflected beam with the LO signal to generate a first pairing signal and pair the second reflected beam with the LO signal to generate a second pairing signal. The one or more processors are configured to control operation of the autonomous vehicle using the first pairing signal and the second pairing signal.
[0016] In another aspect, the present disclosure relates to a LIDAR system. The LIDAR system includes a laser light source configured to output optical signals and a transceiver. The transceiver includes a plurality of transmit (TX) outputs and a plurality of receive (RX) inputs, through which optical signals are output to an environment and through which light beams are received from objects in the environment. The transceiver is configured to receive one or more LO signals, transmit one or more optical signals received from the laser light source to the environment through the plurality of TX outputs, receive first light reflected and returned from one or more objects in the environment through the plurality of RX inputs, and output a first LO signal and a first reflected light of the one or more LO signals. The plurality of TX outputs and the plurality of RX inputs are located on a first side of the transceiver.
[0017] In some embodiments, the multiple TX outputs and multiple RX inputs are interleaved on a first side of the transceiver. In some embodiments, the LIDAR system includes a detector from which the first return light and the first LO signal are output. In some embodiments, the transceiver includes a first semiconductor substrate including the multiple TX outputs and a second semiconductor substrate including the multiple RX inputs. In some embodiments, the first semiconductor substrate and the second semiconductor substrate are disposed at an interval that corresponds to the pitch of the multiple TX outputs or the pitch of the multiple RX inputs.
[0018] In some implementations, the transceiver includes one or more LO inputs, one or more TX inputs, and a first plurality of outputs, where one or more LO signals are provided to the transceiver via the one or more LO inputs, one or more optical signals are output to the transceiver via the one or more TX inputs, and a first return light and a first LO signal are provided to the first plurality of outputs. The one or more LO outputs, the one or more TX inputs, and the first plurality of outputs are located on a second side of the transceiver. The transceiver further includes a second plurality of RX outputs. The transceiver is configured to receive second return light reflected from one or more objects in the environment via the multiple RX inputs, and provide a second LO signal of the second return light and the one or more LO signals to the multiple second RX outputs. The one or more LO inputs, the one or more TX inputs, the multiple first outputs, and the multiple second RX outputs are located on a second side of the transceiver. The one or more LO inputs and the one or more TX inputs are located between (1) the multiple first RX outputs and (2) the multiple second RX outputs. In some implementations, the LIDAR system further includes a scanner configured to receive one or more optical signals transmitted from the multiple TX outputs via free space.
[0019] In another aspect, the disclosure relates to an autonomous vehicle control system including a LIDAR system and one or more processors. The LIDAR system includes a laser light source configured to output optical signals and a transceiver. The transceiver includes a plurality of transmit (TX) outputs and a plurality of receive (RX) inputs, where the optical signals are output to an environment via the plurality of transmit outputs and the optical beams are received from objects in the environment via the plurality of receive inputs. The transceiver is configured to receive one or more LO signals, transmit one or more optical signals received from the laser light source to the environment via the plurality of TX outputs, receive first light reflected and returned from one or more objects in the environment via the plurality of RX inputs, and output a first LO signal and a first reflected light of the one or more LO signals. The plurality of TX outputs and the plurality of RX inputs are located on a first side of the transceiver. The one or more processors are configured to control operation of the autonomous vehicle using the first returned light and the first LO signal.
[0020] In some implementations, the multiple TX outputs and multiple RX inputs are interleaved on a first side of the transceiver. In some implementations, the transceiver includes a first semiconductor substrate including the multiple TX outputs and a second semiconductor substrate including the multiple RX inputs. In some implementations, the first semiconductor substrate and the second semiconductor substrate are spaced apart at a pitch that corresponds to the pitch of the multiple TX outputs or the pitch of the multiple RX inputs.
[0021] In some implementations, the transceiver includes one or more LO inputs, one or more TX inputs, and a first plurality of outputs, where one or more LO signals are provided to the transceiver via the one or more LO inputs, one or more optical signals are output to the transceiver via the one or more TX inputs, and the first return light and the first LO signal are provided to the first plurality of outputs. The one or more LO outputs, the one or more TX inputs, and the first plurality of outputs are located on a second side of the transceiver. The transceiver further includes a second plurality of RX outputs. The transceiver is configured to receive second return light reflected from one or more objects in the environment via the multiple RX inputs, and provide a second LO signal of the second return light and the one or more LO signals to the multiple second RX outputs. The one or more LO inputs, the one or more TX inputs, the multiple first outputs, and the multiple second RX outputs are located on a second side of the transceiver.
[0022] In another aspect, the disclosure relates to an autonomous vehicle. The autonomous vehicle includes at least one of a steering system or a braking system, a LIDAR system, and at least one processor. The LIDAR system includes a laser light source configured to output an optical signal and a transceiver. The transceiver includes a plurality of transmit (TX) outputs and a plurality of receive (RX) inputs, where the optical signals are output to an environment via the plurality of transmit outputs and the optical beams are received from objects in the environment via the plurality of receive inputs. The transceiver is configured to receive one or more LO signals, transmit one or more optical signals received from the laser light source to the environment via the plurality of TX outputs, receive first light reflected and returned from one or more objects in the environment via the plurality of RX inputs, and output a first LO signal and a first reflected light of the one or more LO signals. The plurality of TX outputs and the plurality of RX inputs are located on a first side of the transceiver. The one or more processors are configured to control operation of at least one of the steering system or the braking system using the first returned light and the first LO signal.
[0023] Other aspects, features, and advantages will become readily apparent from the following detailed description, which sets forth a number of specific embodiments, including the best mode contemplated prior to carrying out the present invention. However, other embodiments may also have different features and advantages than others, and many details may be modified in various and obvious aspects without departing from the spirit and scope of the present invention. Accordingly, the drawings and description are illustrative in nature and should not be regarded as limiting. [Brief description of the drawings]
[0024] The embodiments are illustrated by way of example, and not by way of limitation, in the accompanying drawings, in which like reference numerals refer to like elements and in which: [Figure 1a] FIG. 1 is a block diagram illustrating an example system environment for an autonomous vehicle according to some implementations. [Figure 1b] FIG. 1 is a block diagram illustrating an example system environment for a commercial autonomous truck according to some embodiments. [Figure 1c] FIG. 1 is a block diagram illustrating an example system environment for a commercial autonomous truck according to some embodiments. [Figure 1d] FIG. 1 is a block diagram illustrating an example system environment for a commercial autonomous truck according to some embodiments. [Diagram 2] FIG. 1 is a block diagram illustrating an example environment of a LIDAR system for an autonomous vehicle according to some implementations. [Diagram 3] FIG. 1 is a block diagram illustrating an example coherent LIDAR transceiver for operation in a vehicle according to some implementations. [Figure 4] FIG. 1 is a block diagram illustrating an example two semiconductor substrate coherent LIDAR transceiver according to some implementations. [Diagram 5] 1 is a flow chart illustrating an exemplary method for combining multiple functions of a LIDAR system according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0025] A LIDAR system includes a transmit (Tx) path and a receive (Rx) path. The transmit (Tx) path includes a laser source that provides an optical signal (sometimes referred to as a "beam") derived from (or related to) the LO signal, one or more modulators that modulate the phase and / or frequency of the optical signal using continuous wave (CW) or quasi-CW modulation, and an amplifier that amplifies the modulated signal before transmitting the signal to an optic (e.g., an oscillating scanner, a unidirectional scanner, a Risley prism, a circulator optic, and / or a beam collimator, etc.).
[0026] The optical instrument is configured to steer the amplified light received from the Tx path toward an object in an environment within a given field of view, receive a return signal reflected from the object, and provide the return signal to a receive (Rx) path.
[0027] The receive (Rx) path includes a mixer (e.g., 50 / 50) that mixes the LO signal with the return signal to produce a down-converted signal, and a TIA amplifier that amplifies the down-converted signal. The Rx path provides the down-converted (now amplified) signal to an autonomous vehicle control system to determine the distance to an object and / or measure the object's velocity.
[0028] In conventional LIDAR systems, a fiber coupling (sometimes called a "fiber calbe") connects the Tx path, the Rx path, and the optics together. The fiber coupling provides flexibility while testing and developing the LIDAR system by allowing different channels to be used with different Tx / Rx apertures and optical circulation methods.
[0029] However, the bulkiness of fiber couplings limits the ability of LIDAR designers to add additional channels – each of which requires more fiber couplings – and / or reduce the scale of the LIDAR system to the size required for efficient automotive applications.
[0030] Thus, the present disclosure relates to systems and methods that combine multiple functions of a LIDAR system (e.g., splitting, collecting, combining, redirecting, pairing, etc.) to assist in vehicle operation.
[0031] As described below, the Tx path of the multi-channel coherent LIDAR transceiver generally receives a light beam from a laser source (via the Tx input). The laser source generates a light beam based on a LO signal. The Tx path of the coherent LIDAR transceiver splits (e.g., multiplies, replicates, regenerates, etc.) the light beam into multiple light paths and emits the light beam into free space (via the Tx output) toward one or more objects. The Rx path of the multi-channel coherent LIDAR transceiver receives (via the Rx input) return light that is reflected from one or more objects into Rx waveguides. Each Rx waveguide is paired with a respective Tx output of the Tx path. The Rx path splits the LO signal into multiple LO signals, which are then combined with the return light from the Rx waveguides using splitters (e.g., 50 / 50). The Rx path provides the combined signal to one or more detectors (via the Rx output).
[0032] Various example implementations described herein include one or more of the following features: (1) each of the Tx and LO inputs of the coherent LIDAR transceiver are split into two inputs to improve matching with the LIDAR engine architecture; (2) the Tx / Rx outputs to free space occur along one edge of the coherent LIDAR transceiver where the waveguides are interleaved with the Tx / Rx outputs (e.g., Tx-Rx-Tx-Rx, etc.), where the pitch is determined by the free space circulation requirements and / or beam collimation optics. (3) the LO and Tx inputs are paired (e.g., LO_A, LO_B; Tx_A, Tx_B, etc.) to function as independent subsystems; (4) the input power levels to the Tx inputs are high (e.g., >1 Watt each); (5) the fiber coupling to the coherent LIDAR transceiver input receives high power; (6) scattering of the Tx path (sometimes referred to as "directional") into the Rx path (e.g., towards the detector) is very small while being interleaved; (7) reflections from the output facet are minimized (e.g., the angled glare of the coherent LIDAR transceiver). (8) when the output beam quality is defined as the output of the waveguide, the output of the coherent LIDAR transceiver should also have high quality (e.g., low distortion from the transverse electromagnetic (TEMOO) beam); (9) the functions of the LIDAR system (e.g., splitting, collecting, combining, redirecting, pairing, etc.) are combined into one integrated photonic device; (10) the coherent LIDAR transceiver is implemented using a programmable logic controller (PLC).
[0033] In the foregoing description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the present disclosure may be practiced without such specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present disclosure.
[0034] 1. System environment for autonomous vehicles FIG. 1a is a block diagram illustrating an example system environment for an autonomous vehicle according to some implementations.
[0035] 1a, an exemplary autonomous vehicle 100 may embody various techniques disclosed herein. For example, the vehicle 100 may include a prime mover 104 powered by an energy source 106, a powertrain 102 powering a drivetrain 108, a controller system 110 including a direction control 112, a powertrain controller 114, and a brake controller 116. While the vehicle 100 may be embodied in a variety of forms, including vehicles that transport people and / or cargo and operate in a variety of environments, it should be understood that the components 102-116 described above may vary widely based on the type of vehicle in which the components are used.
[0036] For simplicity, the implementations discussed below focus on wheeled land vehicles, such as, for example, cars, vans, trucks, buses, etc. In such implementations, prime mover 104 includes (among others) one or more electric motors and / or an internal combustion engine. Energy sources include, for example, a fuel system (e.g., providing fuel oil, gasoline, diesel, hydrogen, etc.), a battery system, solar panels, or other renewable energy sources, and / or a fuel cell system. Drivetrain 108 includes wheels and / or tires that work in conjunction with a transmission and / or any other mechanical drive components to convert the power output of prime mover 104 into vehicle motion, as well as one or more brakes configured to controllably stop vehicle 100 or slow the vehicle down, and appropriate directional or steering components to control the trajectory of vehicle 100 (e.g., a rack and pinion steering linkage that causes one or more wheels of vehicle 100 to rotate about a generally vertical axis such that the rotational plane angle of the wheels changes relative to the vehicle's longitudinal axis). In some implementations, a combination powertrain and energy source is used (e.g., in the case of electric / gas hybrid vehicles), and in some instances multiple electric motors (e.g., dedicated to individual wheels or axles) are used as prime movers.
[0037] The direction controller 112 includes one or more actuators and / or sensors that control and receive feedback from the direction or steering components to steer the vehicle 100 along a desired trajectory. The power controller 114 is configured to control the output of the powertrain 102, such as by controlling the output power of the prime mover 104 to control the gears of the transmission in the drive train 108, thereby controlling the speed and / or direction of the vehicle 100. The brake controller 116 is configured to control one or more brakes, such as disc or drum brakes coupled to the wheels of the vehicle, to slow or stop the vehicle.
[0038] Other vehicle types, including but not limited to off-road vehicles, all-terrain or tracked vehicles, construction equipment, and the like, inevitably use different powertrains, drivetrains, energy sources, directional controllers, powertrain controllers, and brake controllers. Also, in some implementations some of the components are combined, for example where rearward control of a vehicle is primarily handled by varying the output of one or more prime movers. Thus, the implementations described herein are not limited to the specific application of the techniques described herein in autonomous wheeled land vehicles.
[0039] Various levels of autonomous driving control for vehicle 100 are embodied in vehicle controller system 120, which includes one or more processors 122 and one or more memories 124, each configured to execute program code instructions 126 stored in memory 124. The processor(s) may include, for example, graphic processing unit(s) (“GPU(s)”) and / or central processing unit(s) (“CPU(s)”).
[0040] The sensors 130 include a variety of sensors adapted to gather information from the vehicle's environment that is used to control the operation of the vehicle. For example, the sensors 130 include a radar sensor 134, a LIDAR 136 sensor, and a 3D positioning sensor 138, which may be, for example, an accelerometer, a gyroscope, a magnetometer, or any one of the satellite navigation systems such as GPS, GLONASS (Globalnaya Navigazionnaya Sputnikovaya Sistema, or Global Navigation Satellite System), BDS (BeiDou Navigation Satellite System), Galileo, Compass, etc. The 3D positioning sensor 138 is used to determine the position of the vehicle on the Earth using satellite signals. The sensors 130 include a camera 140 and / or an inertial measurement unit (IMU) 142. The camera 140 may be a monographic or stereographic camera and may record still and / or video images. The IMU 142 includes multiple gyroscopes and accelerometers that detect linear and rotational motion of the vehicle 100 in three directions. One or more encoders (not shown), such as wheel encoders, are used to monitor the rotation of one or more wheels of the vehicle 100. Each sensor 130 outputs sensor data at a variable data rate that differs from the data rates of the other sensors 130.
[0041] The output of the sensors 130 is provided to a set of control subsystems 150, including a localization subsystem 152, a planning subsystem 156, a perception subsystem 154, and a control subsystem 158. The localization subsystem 152 functions to accurately determine the position and orientation (sometimes also referred to as "pose") of the vehicle 100 within the surrounding environment and approximately within some reference frame. The autonomous vehicle's position is part of a labeled autonomous vehicle data generation and is compared to the positions of additional vehicles within the same environment. The perception subsystem 154 functions to detect, track, determine, and / or identify objects within the surrounding environment of the vehicle 100. Machine learning models in some implementations are used to track the objects. The planning subsystem 156 functions to plan a trajectory for the vehicle 100 for some time frame given a desired destination, as well as stationary or moving objects within the environment. Machine learning models in some implementations are used to plan the tracking of the objects. The controller subsystem 158 functions to generate appropriate controller signals to control various controllers in the controller system 120 to implement the planned trajectory of the vehicle 100. The machine learning model may be used to generate one or more signals to control the autonomous vehicle to implement the planned trajectory.
[0042] It should be understood that the collection of components depicted in FIG. 1a for vehicle control system 120 is merely exemplary in nature. Individual sensors are omitted in some implementations. Additionally or alternatively, in some implementations, the various types of sensors depicted in FIG. 1 are duplicated and / or used to cover different areas around the vehicle, although other types of sensors may be used. Similarly, different types and / or combinations of control subsystems may be used in other implementations. Also, while subsystems 152-158 are shown as being separate from processor 122 and memory 124, it should be understood that in some implementations, some or all of the functionality of subsystems 152-158 are embodied in program code instructions 126 resident in one or more memories 124 and executed by one or more processors 122, and in some examples, subsystems 152-158 are embodied using the same processor(s) and / or memory. The subsystems may be implemented, at least in part, using various dedicated circuit logic, various processors, various field programmable gate arrays ("FPGAs"), various application-specific integrated circuits ("ASICs"), various real-time controllers, etc., and as discussed above, many of the subsystems may use circuits, processors, sensors, and / or other components, and the various components within vehicle control system 120 may be networked in various manners.
[0043] In some embodiments, vehicle 100 also includes a secondary vehicle control system (not shown) that is used as a redundant or backup control system for vehicle 100. In some embodiments, the secondary vehicle control system operates the entire autonomous vehicle 100 in the event of an adverse event in vehicle controller system 120, while in other embodiments, the secondary vehicle control system may only have limited functionality, such as performing a controlled stop of vehicle 100 in response to an adverse event detected in primary vehicle control system 120. In other embodiments, the secondary vehicle control system is omitted.
[0044] A myriad of different architectures may be used to implement the various components shown in FIG. 1a, including various combinations of software, hardware, circuit logic, sensors, networks, etc. Each processor may be implemented, for example, by a microprocessor, and each memory may be implemented, for example, by a random access memory (RAM) device, including main storage as well as supplementary level memory such as cache memory, non-volatile or backup memory (e.g., programmable or flash memory), read only memory (ROM), etc. Also, each memory may be considered to be virtual memory, including memory storage physically located anywhere within the vehicle 100, for example, any cache memory within the processor, as well as storage capacity used to store, for example, mass storage devices or other computers or controllers. One or more of the processors shown in FIG. 1a, or entirely separate processors, may be used to implement additional functions within the vehicle 100 beyond the purpose of autonomous control, such as the operation of entertainment systems, doors, lights, convenience features, etc.
[0045] For additional storage, vehicle 100 may also include one or more mass storage devices, such as, among others, removable disk drives, hard disk drives, direct access storage devices ("DASD"), optical drives (e.g., CD drives, DVD drives, etc.), solid state storage drives ("SSD"), network attached storage, a storage area network, and / or tape drives.
[0046] Vehicle 100 also includes a user interface 164 that allows vehicle 100 to receive multiple inputs from a user or operator and generate outputs for the user or operator, such as one or more displays, a touch screen, a voice and / or gesture interface, buttons and other tactile controls, etc. Alternatively, user inputs may be received via an app on another computer or electronic device, such as a portable device, or via a web interface.
[0047] Vehicle 100 also includes one or more network interfaces, such as network interface 162, adapted to communicate with one or more networks 170 (e.g., a local area network ("LAN"), a wide area network ("WAN"), a wireless network, and / or the Internet, among others) to allow communication of information with other computers and electronic devices, including, for example, a central service such as a cloud service from which vehicle 100 receives environmental and other data for use in autonomous control. Data collected by one or more sensors 130 is uploaded via network 170 to a computing system 172 for further processing. In some implementations, a timestamp is added to each instance of vehicle data before uploading.
[0048] 1a, as well as various additional controllers and subsystems described herein, operate approximately under an operating system as described in more detail below and execute or rely on various computer software applications, components, programs, objects, modules, data structures, etc. It is noted that the various applications, components, programs, objects, modules may also execute on one or more processors in other computers coupled to vehicle 100 via network 170, e.g., in a distributed, cloud-based, or client-server computing environment, whereby the processing required to implement the functionality of a computer program is allocated across multiple computers and / or services via the network.
[0049] In general, the routines executed to implement the various embodiments described herein are referred to herein as "program code" whether embodied in an operating system or a particular application, component, program, object, module, or instruction sequence, or a subset thereof. Program code resides at various times in various memory and storage devices of a computer, and when read or executed by one or more processors, includes one or more instructions that perform the steps necessary to execute the steps or elements that implement various aspects of the disclosure. Additionally, embodiments are described in the context of fully functional computers and systems, as described below, and it should be understood that the various embodiments described herein may be distributed in various forms as a program product, and that an embodiment may be embodied regardless of the particular type of computer readable medium used to actually achieve this distribution.
[0050] Examples of computer-readable media include, among others, tangible and non-transitory media such as volatile and non-volatile memory devices, floppy disks and other removable disks, solid state drives (SSDs), hard disk drives, magnetic tape, and optical disks (e.g., CD-ROMs, DVDs, etc.).
[0051] Additionally, various program code described below will be identified based on the application for which it is implemented in a particular embodiment. However, any specific program names described below are merely for convenience, and the disclosure should not be limited to any specific application identified and / or suggested by such names. Furthermore, it should be understood that the disclosure is not limited to the specific organization and allocation of program functions described herein, given the myriad ways in which computer programs may be organized into routines, procedures, methods, modules, objects, etc., as well as the various ways in which program functions may be allocated to the various software layers (e.g., operating systems, libraries, APIs, applications, applets, etc.) present in a typical computer.
[0052] The environment illustrated in Figure 1a is not intended to limit the implementations disclosed herein, and indeed other alternative hardware and / or software environments may be used without departing from the scope of the implementations disclosed herein.
[0053] 2. FM LIDAR for autonomous driving applications The truck includes a LIDAR system (e.g., vehicle control system 120 of FIG. 1a, LIDAR system 201 of FIG. 2, etc.). In some implementations, the LIDAR system encodes an optical signal using frequency modulation and scatters the encoded optical signal into free space using optics. By detecting the difference in frequency between the encoded optical signal and the return signal reflected by an object, a frequency modulated (FM) LIDAR system determines the object's location and / or precisely measures the object's velocity using the Doppler effect. In some implementations, the FM LIDAR system uses continuous wave (referred to as FMCW LIDAR) or quasi-continuous wave (referred to as FMQW LIDAR). In some implementations, the LIDAR system encodes an optical signal using phase modulation (PM) and scatters the encoded optical signal into free space using optics.
[0054] FM or phase-modulated (PM) LIDAR systems offer substantial advantages over conventional LIDAR systems for autonomous and / or commercial truck applications. In some examples, an object (e.g., a pedestrian wearing dark clothing) has a low reflectivity because a small amount (e.g., 10% or less) of the light striking the object is reflected back to the sensor (e.g., sensor 130 of FIG. 1a) of the FM or PM LIDAR system. In other examples, an object (e.g., a road sign) has a high reflectivity (e.g., greater than 10%) because a large amount of the light striking the object is reflected back to the sensor of the FM or PM LIDAR system.
[0055] Regardless of the object's reflectivity, FM LIDAR systems can detect (e.g., classify, recognize, find, etc.) objects at greater distances (e.g., 2x) than traditional LIDAR systems. For example, an FM LIDAR system can detect a low reflectivity object 300 meters away and a high reflectivity object 400 meters away.
[0056] To achieve such improvements in detection capabilities, FM LIDAR systems use sensors (e.g., sensor 130 of FIG. 1a). In some implementations, such sensors are sensitive to single photons, meaning that they are capable of detecting the smallest amount of light. FM LIDAR systems use infrared wavelengths (e.g., 950 nm, 1550 nm, etc.) in some applications, but are not limited to infrared wavelength ranges (e.g., near infrared: 800 nm-1500 nm; mid infrared: 1500 nm-5600 nm; and far infrared: 5600 nm-1,000,000 nm). By operating an FM or PM LIDAR system at infrared wavelengths, the FM or PM LIDAR system can broadcast stronger light pulses or beams while still meeting eye safety standards. Conventional LIDAR systems are sometimes not sensitive to single photons and / or only operate at near infrared wavelengths, requiring limited light output (and distance detection capabilities) for eye safety reasons.
[0057] Thus, by detecting objects at a greater distance, FM LIDAR systems have more time to react to unexpected obstacles. Indeed, even a few extra milliseconds can improve safety and stability, especially for large vehicles (e.g., commercial trucks) operating at highway speeds.
[0058] Another advantage of FM LIDAR systems is that they provide instantaneous and accurate velocity for each data point. In some implementations, velocity measurement is accomplished using the Doppler effect, which shifts the frequency of light received from an object based on at least one of the radial velocity (e.g., the direction vector between the detected object and the sensor) or the frequency of the laser signal. For example, for on-road speeds of less than 100 m / s, such a shift translates to a frequency shift of less than 130 MHz at a wavelength of 1550 nanometers (nm). Such a frequency shift is so small that it is difficult to detect directly in the optical domain. However, by using coherent detection in FMCW, PMCW, or FMQW LIDAR systems, the signal is converted to the RF domain so that the frequency shift can be calculated using various signal processing techniques. This allows autonomous vehicle control systems to process incoming data faster.
[0059] Calculating instantaneous velocity also makes it easier for the FM LIDAR system to determine rare data points as distances or objects and / or track how the points move over time. For example, if an FM LIDAR sensor (e.g., sensor 130 of FIG. 1a) receives only a few returns (e.g., hits) from an object 300 m away, but the returns provide velocity values of interest (e.g., moving toward the vehicle at a speed >70 mph), the FM LIDAR system and / or the autonomous vehicle control system can determine a weight for each of them relative to their probability of being associated with the object.
[0060] Faster identification and / or tracking of an FM LIDAR system provides an autonomous vehicle control system with more time to activate the vehicle. Knowing better how fast an object is moving also allows the autonomous vehicle control system to better plan a response.
[0061] Another advantage of FM LIDAR systems is that they are less static than traditional LIDAR systems; that is, traditional LIDAR systems, which are designed to be more sensitive to light, typically perform poorly in bright sunlight. Such systems also tend to be susceptible to crosstalk (e.g., when sensors are confused by each other's light pulses or light beams) and self-interference (e.g., when a sensor is confused by its own previous light pulse or light beam). To overcome these shortcomings, vehicles using traditional LIDAR systems typically require extra hardware, complex software, and / or more computational power to manage such "noise." In contrast, FM LIDAR systems do not experience these issues because each sensor is designed to respond only to its own light characteristics (e.g., light beams, light waves, light pulses). If the returning light does not match the timing, frequency and / or wavelength originally transmitted, the FM sensor filters (e.g., removes, ignores, etc.) that data point. Such FM LIDAR systems produce (e.g., generate, derive) more accurate data with less hardware or software, enabling safer, smoother driving.
[0062] Finally, FM LIDAR systems are easier to size than traditional LIDAR systems. As more autonomous moving vehicles (e.g., automobiles, commercial trucks, etc.) appear on the roads, vehicles equipped with FM LIDAR systems do not have to contend with interference issues due to sensor crosstalk. Also, FM LIDAR systems use less optical peak power than traditional LIDAR sensors. Some or all of the optical components for such FM LIDARs may be fabricated on a single chip, creating inherent advantages as discussed herein.
[0063] 2.1 Commercial Trucks 1b is a block diagram illustrating an example system environment for a commercial autonomous truck, according to some implementations. The environment 100B includes a commercial truck 102B for transporting cargo 106B. In some implementations, the commercial truck 102B includes vehicles configured for long-haul freight transport, local freight transport, intermodal freight transport (i.e., transportation in which a road-based vehicle is used as one of multiple modes of transportation to move cargo), and / or some other road-based freight transport application. In some embodiments, the commercial truck 102B is a flatbed truck, a refrigerated truck (e.g., a reefer truck, a ventilated van (e.g., a dry van), a moving truck, etc. In some embodiments, the cargo 106B is goods and / or products. In some embodiments, the commercial truck 102B includes a trailer for transporting the cargo 106B, such as a platbed trailer, a lowboy trailer, a step deck trailer, an expandable platbed trailer, a sidekit trailer, etc.
[0064] The environment 100B includes an object 110B (illustrated as another vehicle in FIG. 1b) that is within a distance range of 30 meters or less from the truck.
[0065] The commercial truck 102B includes a LIDAR system 104B (e.g., the FM LIDAR system of FIG. 1a, the vehicle control system 120, the LIDAR system 201 of FIG. 2, etc.) for determining a distance to the object 110B and / or measuring a speed of the object 110B. Although FIG. 1b shows one LIDAR system 104B mounted on the front of the commercial truck 102B, the number of LIDAR systems on the commercial truck and the mounting areas of the LIDAR systems are not limited to a particular number or area. The commercial truck 102B may include any number of LIDAR systems 104B (or components such as sensors, modulators, coherent signal generators, etc.) mounted on any area of the commercial truck 102B (e.g., the front, rear, sides, top, bottom, underside, and / or bottom) to facilitate detection of objects in any free space relative to the commercial truck 102B.
[0066] As shown, LIDAR system 104B in environment 100B is configured to detect objects (e.g., other vehicles, bicycles, trees, city signs, potholes, etc.) within a short distance (e.g., 30 meters or less) from commercial truck 102B.
[0067] 1c is a block diagram illustrating an example system environment for a commercial autonomous truck according to some implementations. Environment 100C includes the same components included in environment 100B (e.g., commercial truck 102B, cargo 106B, LIDAR system 104B, etc.).
[0068] Environment 100C includes objects 110C (illustrated as other vehicles in FIG. 1c) at distances of (i) greater than 30 meters and (ii) less than or equal to 150 meters from the commercial truck. As shown, in environment 100C, LIDAR system 104B is configured to detect objects (e.g., other vehicles, bicycles, trees, city signs, depressions, etc.) at a distance (e.g., 100 meters) from commercial truck 102B.
[0069] 1d is a block diagram illustrating an example system environment for a commercial autonomous truck according to some implementations. Environment 100D includes the same components included in environment 100B (e.g., commercial truck 102B, cargo 106B, LIDAR system 104B, etc.).
[0070] The environment 100D includes objects 100D (illustrated as other vehicles in FIG. 1d) that are at a distance greater than 150 meters from the commercial truck 102B. As shown, in the environment 100D, the LIDAR system 104B is configured to detect objects (e.g., other vehicles, bicycles, trees, city signs, depressions, etc.) at a distance (e.g., 300 meters) from the commercial truck 102B.
[0071] In commercial truck applications, it is important to effectively detect objects at all ranges due to the increased weight and therefore longer stopping distances required for such vehicles. FM LIDAR systems (e.g., FMCW and / or FMQW systems) or PM LIDAR systems are highly suitable for commercial truck applications due to the advantages described above. As a result, commercial trucks equipped with such systems have improved capabilities for safely moving people and goods over short or long distances, thereby improving the safety of the commercial truck as well as surrounding vehicles. In various implementations, such FM or PM LIDAR systems are used in semi-autonomous driving applications where the commercial truck has a driver and some functions of the commercial truck operate autonomously using the FM or PM LIDAR system, or in fully autonomous driving applications where the commercial truck operates entirely using the FM or PM LIDAR system alone or in combination with other vehicle systems.
[0072] 3. Continuous wave modulation and quasi-continuous wave modulation In a LIDAR system that uses CW modulation, the modulator modulates the laser light continuously. For example, if the modulation cycle is 10 seconds, the input signal is modulated for the entire 10 seconds. Alternatively, in a LIDAR system that uses quasi-continuous wave modulation, the modulator modulates the laser light to have active and inactive portions. For example, for 10 cycles, the modulator only modulates the laser light for 8 seconds (sometimes referred to as the "active portion"), but does not modulate the laser light for 2 seconds (sometimes referred to as the "inactive portion"). In this way, the LIDAR system can reduce power consumption for the 2 seconds because the modulator does not need to provide a continuous signal.
[0073] In FMCW LIDAR for autonomous driving applications, it is advantageous to operate the LIDAR system using quasi-CW modulation where FMCW measurement and signal processing methods are used, but the optical signal is not always on (e.g., enabled, powered on, transmitting, etc.). In some implementations, the quasi-CW modulation has a duty cycle of 1% or more and up to 50%. If energy is required during the actual measurement time in the off (disabled, powered down, etc.) state, there may be a boost to the signal-to-noise ratio (SNR) and / or a reduction in the signal processing requirements to coherently integrate all the energy over a longer time domain.
[0074] 4. Coherent LIDAR Transceiver with Many Channels 2 is a block diagram illustrating an example environment of a LIDAR system for an autonomous vehicle according to some implementations. The environment 200 includes a LIDAR system 201 that includes a transmit (Tx) path and a receive (Rx) path. The Tx path includes one or more Tx input / output ports (not shown) and one or more Rx input / output ports (not shown).
[0075] In some embodiments, the semiconductor substrate and / or semiconductor package include a Tx path and an Rx path. In some embodiments, a first semiconductor substrate and / or first semiconductor package includes a Tx path and a second semiconductor substrate and / or second semiconductor package includes an Rx path. In some arrangements, the Rx input / output ports and / or the Tx input / output ports occur along one or more edges of one or more of the semiconductor substrates and / or semiconductor packages.
[0076] The environment 200 includes one or more optical instruments 210 (e.g., an oscillating scanner, a unidirectional scanner, a Risley prism, a circulator optic, and / or a beam collimator, etc.) coupled to the LIDAR system 201. In some implementations, the one or more optical instruments 210 are coupled to a Tx path via one or more Tx input / output ports. In some implementations, the one or more optical instruments 210 are coupled to an Rx path via one or more Rx input / output ports.
[0077] The environment 200 includes a vehicle control system (e.g., vehicle control system 120 of FIG. 1) coupled to a LIDAR system. In some implementations, the vehicle control system 120 is coupled to an Rx path via one or more Rx input / output ports.
[0078] The Tx path includes laser source 202, modulator 204A, modulator 204B, and amplifier 206. The Rx path includes mixer 208, detector 212, and TIA 212. Although Figure 2 shows a selected number of components and only one input / output channel, environment 200 may include any number of components and / or input / output channels coupled together in any arrangement (in any combination) to facilitate the combination of multiple functions of the LIDAR system to support vehicle operation.
[0079] The laser source 202 is configured to generate an optical signal derived from (or related to) the LO signal. In some implementations, the optical beam has an operating wavelength equal to or substantially equal to 1550 nanometers. In some implementations, the optical beam has an operating wavelength between 1400 nanometers and 1600 nanometers.
[0080] The laser source 202 is configured to provide an optical signal to a modulator 204A, which is configured to modulate the phase and / or frequency of the optical signal based on a first radio frequency (RF) signal (illustrated as “RF1” in FIG. 2 ) using CW or quasi-CW modulation to generate a modulated optical signal. The modulator 204A is configured to transmit the modulated optical signal to an amplifier 206. The amplifier 206 is configured to amplify the modulated optical signal to generate an amplified optical signal to the optical device 210.
[0081] The optics are configured to steer the amplified light received from the Tx path toward an object 218 in a given field of view, receive a return signal reflected from the object, and provide the return signal to a mixer 208 in the receive (Rx) path.
[0082] The laser source 202 is configured to provide the LO signal to the modulator 204B, which modulates the phase and / or frequency of the LO signal based on a second RF signal (shown as “RF2” in FIG. 2) using CW or quasi-CW modulation to generate a modulated LO signal, and transmits the modulated LO signal to the mixer 208 in the Rx path.
[0083] The mixer 208 mixes (e.g., combines, multiplies, etc.) the modulated LO signal with the return signal to generate a down-converted signal and transmits the down-converted signal to the detector 212. In some arrangements, the mixer 208 is configured to transmit the modulated LO signal to the detector 212.
[0084] The detector 212 generates an electrical signal based on the downconverted signal and transmits the electrical signal to the TIA 214. In some arrangements, the detector 212 is configured to generate an electrical signal based on the downconverted signal and the modulated signal.
[0085] The TIA 214 is configured to amplify the electrical signal and transmit the amplified electrical signal to the vehicle control system 120 .
[0086] In some implementations, the TIA 214 is rated at 5 picowatts per square root hertz (i.e., 5 x 10 per square root hertz). -12 In some implementations, the TIA 214 has a gain between 4 kilo-ohms and 25 kilo-ohms.
[0087] In some implementations, the detector 212 and / or the TIA 214 has a 3 dB bandwidth between 80 kHz and 650 MHz.
[0088] Vehicle control system 210 is configured to determine a distance to object 218 and / or measure a velocity of object 218 based on the one or more electrical signals received from the TIA.
[0089] In some implementations, modulator 204A and / or modulator 204B have a bandwidth between 600 MHz and 1000 MHz.
[0090] 3 is a block diagram illustrating an example coherent LIDAR transceiver for operation in a vehicle according to some implementations. The environment 300 includes a coherent LIDAR transceiver 301 and detectors 303, 304, 305, 306, 307, 308, 309, 310 (collectively referred to as "detectors 303-310"). A laser source (e.g., laser source 202 in FIG. 2) generates an LO signal via a Tx path (e.g., Tx path in FIG. 2) and provides the LO signal (modulated or unmodulated) to an LO input 360 (illustrated as "LOA-A" in FIG. 3). In some implementations, the LO signal at the LO input 360 is less than 5 milliwatts.
[0091] The coherent LIDAR transceiver 301 splits the LO signal received from the LO input 306 into LO signal 360-1 and LO signal 306-2. The coherent LIDAR transceiver 301 splits the LO signal 360-1 into LO signal 360-1a and LO signal 306-1b. The coherent LIDAR transceiver 301 splits the LO signal 360-2 into LO signal 360-2a and LO signal 306-2b.
[0092] The laser source provides an LO signal (modulated or unmodulated) to an LO input 366 (illustrated as "LOA-B" in FIG. 3). The coherent LIDAR transceiver 301 splits the LO signal received from the LO input 366 into LO signal 366-1 and LO signal 366-2. The coherent LIDAR transceiver 301 splits LO signal 366-1 into LO signal 366-1a and LO signal 366-1b. The coherent LIDAR transceiver 301 splits LO signal 266-2 into LO signal 366-2a and LO signal 366-2b.
[0093] The laser source generates an LO signal via a Tx path (e.g., the Tx path in FIG. 2) and provides an optical signal (modulated or unmodulated) to a Tx input 362 (illustrated as “Tx-A” in FIG. 3). The coherent LIDAR transceiver 301 splits the optical signal received from the Tx input 362 into optical signals 362-1 and 362-2. The coherent LIDAR transceiver 301 splits the optical signal 362-1 into optical signals 362-1a and 362-1b. The coherent LIDAR transceiver 301 splits the optical signal 362-2 into optical signals 362-2a and 362-2b.
[0094] The laser source provides an optical signal (modulated or unmodulated) to a Tx input 364 (illustrated as "Tx-B" in FIG. 3). The coherent LIDAR transceiver 301 splits the optical signal received from the Tx input 364 into optical signals 364-1 and 364-2. The coherent LIDAR transceiver 301 splits optical signal 364-1 into optical signals 364-1a and 364-1b. The coherent LIDAR transceiver 301 splits optical signal 364-2 into optical signals 364-2a and 364-2b.
[0095] The coherent LIDAR transceiver 301 emits an optical signal 362-1a into free space via the Tx output 320 towards one or more objects, receives return light reflected from the objects via the Rx input 322, and provides the return light and an LO signal 360-2b to a detector 303 (illustrated as "RX-1" in FIG. 3 ). The detector 303 generates an electrical signal based on the return light and / or the LO signal 360-2b.
[0096] The coherent LIDAR transceiver 301 emits an optical signal 362-1b into free space towards one or more objects via the Tx output 324, receives return light reflected from the objects via the Rx input 326, and provides the return light and an LO signal 360-2a to a detector 304 (illustrated as "Rx-2" in FIG. 3). The detector 304 generates an electrical signal based on the return light and / or the LO signal 360-2a.
[0097] The coherent LIDAR transceiver 301 emits an optical signal 362-2a into free space via the Tx output 328 towards one or more objects, receives return light reflected from the objects via the Rx input 330, and provides the return light and an LO signal 360-1b to a detector 305 (illustrated as "Rx-1" in FIG. 3). The detector 305 generates an electrical signal based on the return light and / or the LO signal 360-1b.
[0098] The coherent LIDAR transceiver 301 emits an optical signal 362-2b into free space via the Tx output 332 towards one or more objects, receives return light reflected from the objects via the Rx input 334, and provides the return light and LO signal 360-1a to a detector 306 (illustrated as "Rx-2" in FIG. 3 ). The detector 306 generates an electrical signal based on the return light and / or the LO signal 360-1a.
[0099] The coherent LIDAR transceiver 301 emits an optical signal 364-1a into free space via a Tx output 336 towards one or more objects, receives return light reflected from the objects via an Rx input 338, and provides the return light and an LO signal 366-2b to a detector 307 (illustrated as "Rx-1" in FIG. 3 ). The detector 307 generates an electrical signal based on the return light and / or the LO signal 366-2b.
[0100] The coherent LIDAR transceiver 301 emits an optical signal 364-1b into free space via a Tx output 340 towards one or more objects, receives return light reflected from the objects via an Rx input 342, and provides the return light and an LO signal 366-2a to a detector 308 (illustrated as "Rx-2" in FIG. 3). The detector 308 generates an electrical signal based on the return light and / or the LO signal 366-2a.
[0101] The coherent LIDAR transceiver 301 emits an optical signal 364-2a into free space towards one or more objects via the Tx output 344, receives return light reflected from the objects via the Rx input 346, and provides the return light and an LO signal 366-1b to a detector 309 (illustrated as "Rx-1" in FIG. 3). The detector 309 generates an electrical signal based on the return light and / or the LO signal 366-1b.
[0102] The coherent LIDAR transceiver 301 emits an optical signal 364-2b into free space via the Tx output 348 towards one or more objects, receives return light reflected from the objects via the Rx input 350, and provides the return light and LO signal 366-1a to a detector 310 (illustrated as "Rx-2" in FIG. 3). The detector 310 generates an electrical signal based on the return light and / or the LO signal 366-1a.
[0103] In some implementations, signal crosstalk associated with return light (sometimes referred to as the "return beam") returned from an internal surface to the LIDAR sensor and emissions of the corresponding optical signals (e.g., optical signals 362-1a, 362-1b, 362-2a, 362-2b, 364-1a, 364-1b, 364-2a, 364-2b, etc.) is less than -55 dB within 1 MHz and 200 MHz in all other channels relative to the channel in which the reflected beam is obtained.
[0104] In some implementations, the scattering of the optical signal from the interior surfaces to the corresponding return light reflected back to the LIDAR sensor is less than -66 dB relative to the transmitted Tx power, but the scattering is related to the polarization being maintained.
[0105] In some implementations, the scattering of optical signals reflected from interior surfaces to the corresponding return light to the LIDAR sensor is less than -84 dB relative to the transmitted Tx power, but the scattering is associated with a polarization rotated by 90 degrees.
[0106] In some implementations, the signal crosstalk between any electrical signals generated by detectors 303-310 is less than -55 dB relative to electrical signals generated on other detectors within the frequency range of 1 MHz and 200 MHz.
[0107] In some implementations, one or more of the detectors 303-301 includes a pair of photodiodes. In some implementations, the pair of photodiodes in a detector has a CMRR of 30 dB or greater.
[0108] In some implementations, any of detectors 303-310 has a 3 dB bandwidth between 80 kHz and 650 MHz.
[0109] In some implementations, one or more of the detectors 303-310 have a responsivity of 0.9 A / W or greater.
[0110] In some implementations, any of the optical signals (e.g., optical signals 362-1a, 362-1b, 362-2a, 362-2b, 364-1a, 364-1b, 364-2a, 364-2b, etc.) have a duty cycle of 33% or less.
[0111] 4 is a block diagram illustrating an exemplary coherent LIDAR transceiver on two semiconductor substrates according to some implementations. The environment 400 includes a semiconductor substrate 402 that includes an Rx / LO path and a semiconductor substrate 404 that includes a Tx path. The semiconductor substrates 402 and 404 are arranged back-to-back with a spacing "A" that is close to the pitch (e.g., the distance between the centers of two inputs / outputs) in a single chip concept. In some implementations, each of the inputs / outputs of the semiconductor substrates has a pitch that is between 31.75 micrometers and 381 micrometers.
[0112] 5 is a flow chart illustrating an exemplary method for combining multiple functions of a LIDAR system, according to an embodiment. Although the steps are shown in FIG. 5 as integral steps in a particular order for purposes of illustration, in other embodiments, one or more steps, or portions thereof, may be performed in a different order or overlapping in time, directly or in parallel, omitted, one or more additional steps may be added, or the method may be combined or modified in some manner. In some embodiments, some or all of the operations of method 500 are performed by coherent LIDAR transceiver 301 of FIG.
[0113] The method 500 includes receiving 502 a light beam generated by a laser light source. In some implementations, the light beam is associated with an LO signal. The method 500 includes splitting 504 the light beam into a first split light beam and a second split light beam. The method 500 includes transmitting 506 the first split light beam and the second split light beam to an optical device. The method 500 includes receiving 508 from the optical device a first reflected beam associated with the first split light beam and a second reflected beam associated with the second split light beam. The method 500 includes pairing 510 the first reflected beam with the LO signal and pairing the second reflected beam with the LO signal.
[0114] The above description is provided to enable one skilled in the art to practice the various aspects described herein. Various modifications to such aspects will be apparent to those skilled in the art, and the generic principles defined herein apply to other aspects. Thus, the claims are not limited to the aspects set forth herein, but are to be accorded the full scope consistent with the language of the claims, and the singular references herein to elements do not mean "one and only one" unless expressly stated otherwise, but rather "one or more." Unless expressly stated otherwise, the term "a part" refers to one or more. All structural and functional equivalents to the elements of the various aspects described through the description or known to those skilled in the art are expressly incorporated herein by reference and are achieved by the claims. Furthermore, nothing disclosed herein is to be designated as common, regardless of whether such disclosure is expressly recited in the claims. Any claim element should be construed as a means and function unless the element is expressly recited as a "means."
[0115] It should be understood that any particular order or hierarchy of blocks in the processes disclosed is an example of a descriptive approach. Based on design preferences, it should be understood that the particular order of steps or hierarchy of blocks in the processes may be rearranged while remaining within the scope of the above description. The accompanying methods claim the present composition of the various blocks in a sample order and are not meant to be limited to the particular order or hierarchy presented.
[0116] The above description of the disclosed embodiments is provided to enable one skilled in the art to make or use the subject matter disclosed herein. Various modifications to such embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments without departing from the spirit or scope of the description. Thus, the above description is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
[0117] The various examples shown and described are provided merely as examples to illustrate various features of the claims. Features shown and described for any given example are not necessarily limited to the associated example, but may be used or combined with other examples shown and described. Furthermore, the claims are not intended to be limited to any one example.
[0118] The above method descriptions and processor flow charts are provided merely as illustrative examples and are not intended to require or imply that the blocks of the various examples should be performed in the order presented. Those skilled in the art will appreciate that the order of the blocks in the above examples may be performed in any order. Words such as "then," "then," and "next" do not limit the order of the blocks. These words are merely used to guide the reader in describing the method. Additionally, any reference to a claim element in the singular should not be construed to limit the element to the singular.
[0119] The various exemplary logic blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be embodied as electronic hardware, computer software, or a combination thereof. To clearly illustrate such interchangeability of hardware and software, the various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is embodied as hardware or software depends on the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
[0120] Various example logic blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed by a general purpose processor, a DSP, an ASIC, an FPGA, or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. A general purpose processor may be a microprocessor, but alternatively the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors with a DSP core, or any other such configuration. Alternatively, some blocks or methods may be performed by circuitry specific to a given function.
[0121] In some illustrative examples, the functions described may be embodied in hardware, software, firmware, or any combination thereof. When embodied as software, the functions may be stored as one or more instructions or codes in a non-transitory computer-readable storage medium or a non-transitory processor-readable storage medium. Blocks of the methods or algorithms disclosed herein may be embodied in a processor-executable software module resident in a non-transitory computer-readable storage medium or a non-transitory processor-readable storage medium. A non-transitory computer-readable storage medium or a non-transitory processor-readable storage medium is any storage medium that can be accessed by a computer or processor. By way of example, but not by way of limitation, such non-transitory computer-readable storage medium or a non-transitory processor-readable storage medium may include RAM, ROM, EEPROM, flash memory, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can store desired program code in the form of instructions or data structures and that can be accessed by a computer. As used herein, disk and disc include compact discs (CDs), laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically while discs reproduce data optically using a laser. Combinations of the above are also included within the scope of non-transitory computer-readable and processor-readable media. Additionally, operations of a method or algorithm may reside as one or any combination or set of code and / or instructions on a non-transitory processor-readable and / or computer-readable storage medium, which may be embodied in a computer program product.
[0122] The above description of the disclosed examples is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to such examples will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments without departing from the spirit or scope of the above description. Thus, the above description is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
[0123] Notwithstanding that the numerical ranges and parameters set forth in the broad scope are approximations, the numerical values set forth in the non-limiting examples are reported as precisely as possible. However, all numerical values inherently contain certain errors resulting from the standard deviation found in the respective testing measurements made in preparing this specification. Additionally, unless otherwise clear from the context, the numerical values set forth herein have an indicative precision given by the lowest digit. Thus, a value of 1.1 means a value from 1.05 to 1.15. The term "about" is used to indicate a broader range around a given value, but unless otherwise clear from the context, it means a broader range around the lowest digit, such as "about 1.1" meaning a range of 1.0 to 1.2. If the lowest digit is unclear, the term "about" means a factor of two. For example, "about X" means a value in the range of 0.5X to 2X. For example, about 100 means a value in the range of 50 to 200. Additionally, all ranges disclosed herein should be understood to include any and all subranges contained therein. For example, the range "less than 10" includes any and all subranges between (and including) a minimum value of 0 and a maximum value of 10. That is, any and all subranges having a minimum value equal to or greater than 0 and a maximum value equal to or less than 10 (e.g., 1 to 4) are included.
[0124] Although some embodiments of the invention have been described in the context of one or more high resolution Doppler LIDAR systems mounted on certain areas (e.g., front, rear, side, top and / or bottom) of a personal vehicle, embodiments are not limited to this context. In other embodiments, one or multiple systems of the same type, or other high resolution LIDARs with or without a Doppler component and overlapping or non-overlapping fields of view, or one or more such systems mounted on large or small, driverless or autonomous ground, sea or air vehicles are employed. In other embodiments, a scanning high resolution LIDAR is mounted in a temporarily or permanently fixed location on land or sea. [Item of invention] [Item 1] 1. A light detection and ranging (LIDAR) system including a semiconductor substrate and one or more optical components attached to the semiconductor substrate, the one or more optical components comprising: Receiving a light beam from a laser light source, said light beam being associated with a local oscillator (LO) signal; Splitting the light beam into a first split light beam and a second split light beam; transmitting the first split light beam and the second split light beam to an optical device; receiving a first reflected beam associated with the first split light beam and a second reflected beam associated with the second split light beam from the optical device; A LIDAR system configured to pair the first reflected beam with the LO signal and pair the second reflected beam with the LO signal. [Item 2] The one or more optical components include: receiving a second optical beam generated by the laser source or the second laser source, the second optical beam being associated with an LO signal; splitting the second light beam into a third split light beam and a fourth split light beam; Sending the third split light beam and the fourth split light beam to the optical device; receiving a third reflected beam associated with the third split light beam and a fourth reflected beam associated with the fourth split light beam from the optical device; 2. The LIDAR system of claim 1, further configured to pair the third reflected beam with the second LO signal and pair the fourth reflected beam with the second LO signal. [Item 3] The one or more optical components include: receiving the LO signal; Item 2. The LIDAR system of item 1, further configured to split the LO signal into a first split LO signal and a second split LO signal. [Item 4] 4. The LIDAR system of claim 3, wherein the one or more optical components receive the LO signal from an LO input, and the LO signal at the LO input is less than 5 watts. [Item 5] A first optical detector; and a second optical detector, The one or more optical components include: providing the first split LO signal and the first reflected beam to the first photodetector, such that the first photodetector generates a first electrical signal according to the first split LO signal and the first reflected beam; 4. The LIDAR system of item 3, further configured to provide the second split LO signal and the second reflected beam to the second photodetector, causing the second photodetector to generate a second electrical signal according to the second split LO signal and the second reflected beam. [Item 6] 6. The LIDAR system of claim 5, wherein a signal crosstalk associated with the first electrical signal and the second electrical signal is less than or equal to −55 dB within 1 MHz and 200 MHz. [Item 7] 6. The LIDAR system according to item 5, wherein the first optical detector includes a pair of photodiodes, the pair of photodiodes having a CMRR (common mode rejection ratio) of 30 dB or more. [Item 8] 6. The LIDAR system of claim 5, wherein the first optical detector has a bandwidth of 3 dB between 80 kHz and 650 MHz. [Item 9] 6. The LIDAR system of item 5, wherein the first optical detector has a responsivity of 0.9 A / W (amperes per watt) or more, and the optical beam has an operating wavelength equal to or substantially equal to 1550 nanometers. [Item 10] 6. The LIDAR system of claim 5, further comprising a transimpedance amplifier (TIA) having a peak noise-equivalent power (NEP) of less than 5×10-12 Watts per square root Hertz, the first photodetector configured to provide the first electrical signal to the TIA. [Item 11] 6. The LIDAR system of claim 5, further comprising a TIA having a gain between 4 kilo-ohms and 25 kilo-ohms, the first photodetector configured to provide the first electrical signal to the TIA. [Item 12] 2. The LIDAR system of item 1, wherein a semiconductor substrate includes the one or more optical components, the semiconductor substrate includes a plurality of outputs, each of the plurality of outputs associated with a pitch between 31.75 micrometers and 381 micrometers. [Item 13] 2. The LIDAR system of claim 1, wherein the light beam has an operating wavelength between 1400 nanometers and 1600 nanometers. [Item 14] In autonomous vehicles, at least one of a steering system or a braking system; a vehicle controller including one or more processors, the one or more processors including: one or more optical components disposed on the semiconductor substrate receiving an optical beam generated by the laser optical source, the optical beam being related to the LO signal; the one or more optical components splitting the light beam into a first split light beam and a second split light beam; causing the one or more optical components to transmit the first split light beam and the second split light beam to an optical device; the one or more optical components receiving from an optical device a first reflected beam associated with the first split optical beam and a second reflected beam associated with the second split optical beam; the one or more optical components pairing the first reflected beam with an LO signal and pairing the second reflected beam with an LO signal; An autonomous vehicle that controls at least one of the steering system or the braking system using the first reflected beam paired with the LO signal and the second reflected beam paired with the LO signal. [Item 15] 14. An autonomous vehicle control system including the LIDAR system according to any one of items 1 to 13.
Claims
1. A light detection and ranging (LIDAR) sensor system for a vehicle, comprising: the LIDAR sensor system includes a transceiver; The transceiver includes: a plurality of inputs configured to receive one or more local oscillator (LO) signals and one or more optical signals received from a laser source; a plurality of transmit (TX) outputs configured to transmit the one or more optical signals to an environment of the vehicle via the plurality of TX outputs; a plurality of receive (RX) inputs configured to receive first and second return light reflected from one or more objects in the environment; a plurality of first RX outputs configured to receive the first return light and a first LO signal of the one or more LO signals; a plurality of second RX outputs configured to receive the second return light and a second LO signal of the one or more LO signals; 1. A LIDAR sensor system comprising:
2. 2. The LIDAR sensor system of claim 1, wherein the plurality of TX outputs and the plurality of RX inputs are provided on a first side of the transceiver.
3. The plurality of inputs include: one or more LO inputs through which the one or more LO signals are provided to the transceiver; one or more TX inputs through which the one or more optical signals are provided to the transceiver; 3. The LIDAR sensor system of claim 2, comprising:
4. 4. The LIDAR sensor system of claim 3, wherein the one or more LO inputs, the one or more TX inputs, and the first plurality of RX outputs are disposed on a second side of the transceiver.
5. 4. The LIDAR sensor system of claim 3, wherein the one or more LO inputs, the one or more TX inputs, the first plurality of RX outputs, and the second plurality of RX outputs are disposed on a second side of the transceiver.
6. 6. The LIDAR sensor system of claim 5, wherein the one or more LO inputs and the one or more TX inputs are located between (1) the first plurality of RX outputs and (2) the second plurality of RX outputs.
7. a first detector to which the first return light and the first LO signal are output; a second detector to which the second return light and the second LO signal are output; 10. The LIDAR sensor system of claim 1 further comprising:
8. The transceiver includes: a first semiconductor substrate including the plurality of TX outputs; a second semiconductor substrate including the plurality of RX inputs; 10. The LIDAR sensor system of claim 1 further comprising:
9. 9. The LIDAR sensor system of claim 8, wherein the first semiconductor substrate and the second semiconductor substrate are arranged at an interval corresponding to a pitch of the plurality of TX outputs or a pitch of the plurality of RX inputs.
10. 1. An autonomous vehicle control system for an autonomous vehicle, comprising: A light detection and ranging (LIDAR) sensor system including a transceiver; one or more processors; Equipped with The transceiver includes: a plurality of inputs configured to receive one or more local oscillator (LO) signals and one or more optical signals received from a laser source; a plurality of transmit (TX) outputs configured to transmit the one or more optical signals to an environment of the autonomous vehicle via the plurality of TX outputs; a plurality of receive (RX) inputs configured to receive first and second return light reflected from one or more objects in the environment; a plurality of first RX outputs configured to receive the first return light and a first LO signal of the one or more LO signals; a plurality of second RX outputs configured to receive the second return light and a second LO signal of the one or more LO signals; Including, The one or more processors are configured to control operation of an autonomous vehicle using the first return light and the first LO signal.
11. The autonomous vehicle control system of claim 10 , wherein the plurality of TX outputs and the plurality of RX inputs are provided on a first side of the transceiver.
12. The plurality of inputs include: one or more LO inputs through which the one or more LO signals are provided to the transceiver; one or more TX inputs through which the one or more optical signals are provided to the transceiver; The autonomous vehicle control system of claim 11 .
13. The autonomous vehicle control system of claim 12 , wherein the one or more LO inputs, the one or more TX inputs, and the first plurality of RX outputs are disposed on a second side of the transceiver.
14. 13. The autonomous vehicle control system of claim 12, wherein the one or more LO inputs, the one or more TX inputs, the first plurality of RX outputs, and the second plurality of RX outputs are disposed on a second side of the transceiver.
15. 15. The autonomous vehicle control system of claim 14, wherein the one or more LO inputs and the one or more TX inputs are located between (1) the first plurality of RX outputs and (2) the second plurality of RX outputs.
16. The LIDAR sensor system includes: a first detector to which the first return light and the first LO signal are output; a second detector to which the second return light and the second LO signal are output; The autonomous vehicle control system of claim 10 further comprising:
17. The transceiver includes: a first semiconductor substrate including the plurality of TX outputs; a second semiconductor substrate including the plurality of RX inputs; The autonomous vehicle control system of claim 10 further comprising:
18. The autonomous vehicle control system of claim 17 , wherein the first semiconductor substrate and the second semiconductor substrate are arranged at an interval corresponding to a pitch of the plurality of TX outputs or a pitch of the plurality of RX inputs.
19. In autonomous vehicles, at least one of a steering system or a braking system; A light detection and ranging (LIDAR) sensor system including a transceiver; one or more processors; Equipped with The transceiver includes: a plurality of inputs configured to receive one or more local oscillator (LO) signals and one or more optical signals received from a laser source; a plurality of transmit (TX) outputs configured to transmit the one or more optical signals to an environment of the autonomous vehicle via the plurality of TX outputs; a plurality of receive (RX) inputs configured to receive first and second return light reflected from one or more objects in the environment; a plurality of first RX outputs configured to receive the first return light and a first LO signal of the one or more LO signals; a plurality of second RX outputs configured to receive the second return light and a second LO signal of the one or more LO signals; Including, The one or more processors are configured to control operation of at least one of a steering system or a braking system using the first return light and the first LO signal.
20. the plurality of TX outputs and the plurality of RX inputs are interleaved at a first side of the transceiver; 20. The autonomous vehicle of claim 19, wherein the plurality of inputs, the first plurality of RX outputs, and the second plurality of RX outputs are disposed on a second side of the transceiver.
Citation Information
Patent Citations
Light wave radar apparatus
JP2010127918A
Method for processing signals from a coherent lidar to reduce noise and related lidar system
JP2020503530A
Modular 3D Optical Sensing System
JP2020510882A
Lidar system
US20190154832A1
Method and system for laser phase tracking for internal reflection subtraction in phase-encoded lidar
US20200150251A1