SYSTEMS AND METHODS FOR MODULAR LADAR SCANNING

A LADAR array with synchronized, multiple modules addresses interference and complexity issues, providing a wider field of view and improved resolution at lower cost.

DE102016103302B4Active Publication Date: 2024-12-05THE BOEING CO
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
DE102016103302
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2015-04-15
Filing Date
2016-02-25
Publication Date
2024-12-05
Estimated Expiration
2036-02-25

AI Technical Summary

Technical Problem

Existing LADAR systems with large fields of view are complex, expensive, and time-consuming due to reliance on time-of-flight concepts and require slow rotation of laser sources, while systems with wider FOVs often suffer from interference and high complexity.

Method used

A LADAR array comprising multiple LADAR modules with non-overlapping or partially overlapping fields of view, synchronized by a central processing device to combine signals and adjust clock speeds, reducing interference and complexity.

Benefits of technology

The array achieves a wider field of view and improved image resolution with reduced cost and complexity, enabling efficient three-dimensional imaging applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Laser distance and range measurement (LADAR) system comprising: a plurality of LADAR modules (100, 602, 604), each LADAR module being configured to scan a laser beam through a separate field of view, FOV, (112) and to output a signal indicating a distance between each of the LADAR modules and objects in the field of view onto which the laser beam is incident; and a central processing unit (302) that is communicatively coupled to the multitude of LADAR modules, wherein the central processing unit is configured to generate an output based at least partially on the signals from each of the LADAR modules; wherein the plurality of LADAR modules (100) comprises at least a first LADAR module (602) with a first field of view (112) and a second LADAR module (604) with a second field of view (112) and wherein the first and second LADAR modules are arranged such that the first field of view does not overlap with the second field of view and is adjacent to the second field of view to cover a wider overall FOV.
Need to check novelty before this filing date? Find Prior Art

Description

BACKGROUND

[0001] The field of the disclosure relates generally to laser distance and range finding (LADAR) modules, and more particularly to a LADAR array that combines outputs from a plurality of individual LADAR modules.

[0002] Laser ranging and distance measurement (LADAR) systems generate images by emitting a laser, collecting scatter information when the laser contacts an object, and generating an image using the scatter information. At least some known LADAR systems have a lateral field of view (FOV) of approximately 50°. Various techniques can be implemented to increase this FOV.

[0003] For example, at least some LADAR systems use one or more laser beams generated by attaching a laser source to a gimbal. The laser source is then rotated, and multiple images are acquired at different angles and combined to form a single image. However, such LADAR systems rely on a time-of-flight concept to acquire backscatter information, which is relatively time-consuming. In particular, the laser source must be rotated at a sufficiently low speed to transmit the laser beam toward the object and receive backscatter from the object. Furthermore, at least some known LADAR systems with larger FOVs are relatively complex, relatively expensive, and relatively difficult to repair.

[0004] Document EP 2 806 288 A1 discloses additional LADAR sensors in the automotive sector. SHORT DESCRIPTION

[0005] According to one aspect, a laser distance and range measuring (LADAR) arrangement is provided.The LADAR array includes a plurality of LADAR modules, each LADAR module configured to scan a laser beam through a separate field of view (FOV) and output a signal indicative of a distance between each LADAR module and objects in the field of view upon which the laser beam is incident, and a central processing device communicatively coupled to the plurality of LADAR modules, the central processing device configured to generate an output based at least in part on the signals from each of the LADAR modules, the plurality of LADAR modules including at least a first LADAR module having a first field of view and a second LADAR module having a second field of view, and the first and second LADAR modules arranged such that the first field of view does not overlap with the second field of view and is adjacent to the second field of view to cover a wider overall FOV.

[0006] According to another aspect, a method for assembling a laser distance and range finding (LADAR) assembly is provided. The method comprises arranging a plurality of LADAR modules, each LADAR module configured to scan a laser beam through a field of view (FOV) and output a signal indicative of a distance between each LADAR module and objects in the field of view upon which the laser beam is incident, and communicatively coupling the plurality of LADAR modules to a central processing device, the central processing device configured to generate an output based at least in part on the signal outputs output by each of the LADAR modules, the plurality of LADAR modules comprising at least a first LADAR module having a first field of view and a second LADAR module having a second field of view, and the first and second LADAR modules being arranged such thatthat the first field of view does not overlap with the second field of view and is adjacent to the second field of view to cover a wider overall FOV. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 shows a perspective view of an exemplary LADAR module. Fig. 2 shows a schematic diagram of the Fig. 1 shown LADAR module. Fig. Figure 3 shows a schematic diagram of an exemplary LADAR arrangement. Fig. 4 shows a block diagram of an implementation of a data flow within the Fig. 3 shown LADAR arrangement. Fig. 5 shows a block diagram of another implementation of a data flow within the Fig. 3 shown LADAR arrangement. Fig. Figures 6A-6D are diagrams illustrating examples of how fields of view (FOV) from multiple LADAR modules can be combined. Fig. Figure 7 is a block diagram of an exemplary computing device that can be used with the Fig. 3 shown LADAR arrangement can be used. DETAILED DESCRIPTION

[0007] The implementations described here are directed to a laser ranging and distance measuring (LADAR) array that utilizes a plurality of separate LADAR modules. A central processing device combines signals from each of the plurality of LADAR modules to generate an output (e.g., a three-dimensional image of an environment within the field of view (FOV) of the LADAR modules). By using a plurality of LADAR modules, a total field of view and image resolution of the array are greater than the field of view and image resolution of a single LADAR module operating alone. Furthermore, individual LADAR modules are relatively inexpensive, relatively small, and not overly complex, which reduces the cost of the LADAR array described here compared to other LADAR systems with relatively large fields of view.

[0008] Combining multiple LADAR modules in a single array without other modifications may cause the individual LADAR modules to interfere with each other. Multiple LADAR modules may interfere with each other if the light from one LADAR module scatters in many directions, including into other LADAR modules, resulting in false detections. Furthermore, signals from different LADAR modules will interfere or cancel each other unless the clock speeds of each LADAR module are properly adjusted. Accordingly, in the implementations described here, a central processing unit includes a common clock, which facilitates synchronizing the clock speeds of each LADAR module. The central processing unit may also track the orientation and position of the LADAR modules relative to each other.

[0009] Fig. 1 illustrates a perspective view of an exemplary laser ranging (LADAR) or LIDAR module 100. Fig. Figure 2 illustrates a schematic diagram of a LADAR module 100. In the exemplary implementation, the LADAR module 100 includes a dual-axis scanning mirror 102 (i.e., a mirror that can rotate about two separate axes of rotation (e.g., a tip axis and a tilted axis) that are orthogonal to each other) and a laser source 104 that emits a laser beam 106 onto a scanning mirror 102 such that the laser beam 106 is reflected by the scanning mirror 102 to produce a reflected laser beam 108. The laser beam 106 may be of any type or laser wavelength that has been focused into a beam with a relatively low divergence.

[0010] To scan an environment, the scanning mirror 102 rotates or is tilted so that the reflected laser beam 108 scans or sweeps an environment to create a three-dimensional map or image of the environment. It is worth noting that the scanning mirror 102 has a finite size and a finite scanning angle. A "scanning angle," as used herein, refers to an angle over which the scanning mirror 102 can sweep the reflected laser beam 108 (e.g., about the tip axis or the tilted axis). For example, a scanning angle 112 of the LADAR module 100 may be approximately 25°. In the exemplary implementation, the scanning mirror 102 represents a microelectromechanical system (MEMS) mirror with a relatively small size, light weight, and low power.Alternatively, the scanning mirror 102 may be any mirror that enables the LADAR module 100 to function as described herein.

[0011] Fig. 3 shows a schematic diagram of a LADAR arrangement 300. As in Fig. 3, the LADAR array 300 includes a plurality of LADAR modules 100. In the exemplary implementation, the LADAR array 300 includes three LADAR modules 100. Alternatively, the LADAR array 300 may include any number of LADAR modules 100. Each LADAR module 100 is communicatively coupled (e.g., via a wired connection or wirelessly) to a central processing device 302, which combines signal outputs from each of the LADAR modules 100, as described in detail below. It should be noted that the configuration of the LADAR array 300 is modular. Accordingly, the LADAR modules 100 can be selectively added to and / or removed from the LADAR array 300 to adjust a total field of view (FOV) and image resolution of the LADAR array 300, as described herein.

[0012] The LADAR array 300 can be implemented with any suitable configuration. For example, the LADAR array 300 can be installed on board a manned vehicle (e.g., an aircraft), on board an unmanned vehicle (e.g., an unmanned aerial vehicle (UAV)), or on board a robotic platform. Furthermore, the LADAR array 300 can be used in a variety of applications, including imaging applications, obstacle detection applications, and mapping applications. Furthermore, the LADAR array 300 can be coupled to other sensors (e.g., GPS sensors) and / or communicate with other sensors (e.g., GPS sensors) in a system.

[0013] It should be noted that each LADAR module 100 has a separate field of view (FOV). In some implementations, each LADAR module 100 has the same FOV (i.e., an FOV with the same dimensions). Optionally, a portion of the LADAR modules 100 may have a first FOV, and at least one LADAR module 100 may have a second, different FOV. Accordingly, the LADAR modules 100 (as in Fig. 3) such that the FOV of each of the LADAR modules 100 does not overlap with the FOV of the other LADAR modules 100. This allows the LADAR array 300 to capture a significantly wider FOV than would be possible using a single LADAR module 100. In some implementations, for example, the LADAR array 300 may include a sufficient number of LADAR modules 300 such that the total FOV of the array 300 is approximately 360° by 360°. Alternatively, the LADAR modules 100 may be arranged such that at least a portion of the FOV of the LADAR modules 100 overlap. Overlapping FOVs of the LADAR modules 100 result in increased resolution of the LADAR array 300, as described herein. In some implementations, the LADAR modules 100 have a layout with a common aperture.

[0014] Fig. 4 illustrates a block diagram of an implementation of a data flow 400 within the LADAR array 300. As in Fig. As shown in Figure 4, each LADAR module 100 for scanning the environment includes a laser source 104, a scanning mirror 102, and a detector 402 that detects the distance from the LADAR module 100 to an object upon which the reflected laser beam 108 is incident. Specifically, as the reflected laser beam 108 scans the environment, the detector 402 detects the distance between the LADAR module 100 and an object upon which the reflected laser beam 108 is currently incident (e.g., based on backscattering from the object) and outputs a corresponding signal. The distance detection can be either coherent or incoherent. In the incoherent case, the detector 402 is sampled at a high sampling frequency. Collected samples are then compared to a threshold to find a peak indicative of an optical return pulse. The sample value at which the peak occurs corresponds to the distance of the object.In the coherent case, the return signal of the reflected laser beam 108 is coherently mixed with a reference signal to generate a beat frequency signal. The beat frequency signal is then passed to a fast Fourier transform (FFT) algorithm, which generates a peak frequency proportional to the distance of the object.

[0015] To process the analog signal outputs by the detector 402, each LADAR module 100 includes, in the implementation of the Fig. 4 an analog-to-digital converter unit 404 and a fast Fourier transform unit 406. The analog-to-digital converter unit 404 and the fast Fourier transform unit 406 may be implemented using a calculation device, as described in detail below. The processed signals are output from each LADAR module 100 to a block 410 for display to an end user and / or for further application-specific processing. At block 410, for example, the processed signals received from each LADAR module 100 may be integrated with each other to generate a comprehensive three-dimensional image of the environment that includes data from all LADAR modules 100 in the array 300. In the exemplary implementation, the display and / or processing of block 410 may be performed, for example, by the central processing device 302.

[0016] Fig. 5 shows a block diagram of an alternative implementation of a data flow 500 within the arrangement 300. In the Fig. 5, in contrast to the data flow 400, instead of processing signals from the detectors 402, at each LADAR module 100 analog signals are transmitted from the detectors 402 to processing electronics 502 for processing by a central analog-to-digital converter unit 504 and a central fast Fourier transform unit 506. In the exemplary implementation, the processing electronics 502 can be implemented, for example, as part of the central processing device 302. The processed signals are output from the processing electronics 502 to a block 510 for display to an end user and / or for further application-specific processing. At block 510, the processed signals received by the processing electronics 502 can be used to generate a comprehensive three-dimensional image of the environment that includes data from all LADAR modules 100 in the array 300.In the exemplary implementation, the display and / or processing of block 510 may be performed, for example, by the central processing device 302 or by a separate computing device. In yet another implementation, each LADAR module 100 may include an analog-to-digital converter unit and provide outputs to a common Fourier transform unit. The arrangement of the analog-to-digital converter unit(s) and the Fourier transform unit(s) may depend, for example, on cost considerations, size considerations, weight considerations, power considerations, and / or other considerations.

[0017] In the exemplary implementation, the central processing device 302 includes a common clock (e.g., implemented using a processor) that facilitates synchronizing a respective clock of each of the LADAR modules 100. Without synchronizing the clocks of each of the LADAR modules 100, the signals from the LADAR modules 100 may interfere with each other. Furthermore, to combine data from multiple LADAR modules 100, the central processing device 302 may track an orientation and position (e.g., relative to other LADAR modules 100) of each LADAR module 100. In one implementation, for example, each LADAR module 100 transmits position and orientation data to the central processing device 302.The position and orientation data may, for example, be calculated relative to Earth's gravity and magnetic field and may be generated using an inertial measurement unit or equivalent device. Using the position and orientation data, the central processing unit 302 combines signals from each of the LADAR modules 100 into a comprehensive, absolute reference frame.

[0018] Fig. 6A-6D are diagrams illustrating how the FOVs of multiple LADAR modules 100 can be combined to cover a wider overall FOV and / or increase image resolution. As shown in Fig. As shown in Figure 6A, a first LADAR module 602 is assumed to have a field of view of 25° by 25° and a pixel rate of 1 megahertz (MHz). Furthermore, a second, third, and fourth LADAR modules 604, 606, and 608 are assumed to have the same parameters.

[0019] As in Fig. 6B, by arranging the first, second, third, and fourth LADAR modules 602, 604, 606, and 608 such that the FOVs of the modules 602, 604, 606, and 608 are adjacent but do not overlap, a total FOV of 50° by 50° at a pixel rate of 1 MHz can be achieved. In addition, and as shown in Fig. 6C, by arranging the first, second, third, and fourth LADAR modules 602, 604, 606, and 608 such that the FOVs of modules 602, 604, 606, and 608 completely overlap, the total FOV is the same as it would be for one module (e.g., 25° by 25°), but the pixel rate is now 4 MHz.

[0020] As a further example, Fig. 6D, first and second LADAR modules 602 and 604 are arranged to completely overlap, and third and fourth LADAR modules 606 and 608 are arranged to completely overlap. This results in a total FOV of 25° by 50° at a pixel rate of 2 MHz. It should be noted that the arrangements shown in Fig. 6B-6D are merely examples, and one skilled in the art will recognize that many different arrangements of multiple LADAR modules 100 are within the scope of the disclosure.

[0021] In implementations where the FOVs of multiple LADAR modules 100 overlap, the phases of the overlapping modules 100 may be offset to avoid interference. For example, control of the laser sources 104 for each of the laser modules 100 may be modulated with different portions of the common clock of the central processing unit 302. In some implementations, the laser sources 104 are controlled so that the laser transmits pulses that are offset such that the time required for a first LADAR module 100 to transmit and receive does not overlap with a transmission of a second LADAR module 100.

[0022] Fig.7 illustrates a block diagram of a computing device 700 that may be used in the implementations described herein. The LADAR modules 100, the central processing device 302, and / or the processing electronics 502 may, for example, be implemented using the computing device 700. The computing device 700 includes at least one memory device 710 and a processor 715 coupled to the memory device 710 for executing instructions. In some implementations, executable instructions are stored in the memory device 710. In the exemplary implementation, the computing device 700, via the programming processor 715, performs one or more operations described herein.For example, the processor 715 may be programmed by encoding an operation as one or more executable instructions and by providing the executable instructions in the memory device 710.

[0023] The processor 715 may include one or more processing units (e.g., in a multi-core configuration). Furthermore, the processor 715 may be implemented using one or more heterogeneous processor systems in which a main processor with secondary processors is present on a single chip. In another illustrative example, the processor 715 may be a symmetric multiprocessor system including multiple processors of the same type. Furthermore, the processor 715 may be implemented using any suitable programmable circuitry, including one or more systems and microcontrollers, microprocessors, reduced instruction set integrated circuits (RISC), application-specific integrated circuits (ASIC), programmable logic circuits, field-programmable gate arrays (FPGAs), and any other circuitry capable of performing the functions described herein.

[0024] In the exemplary implementation, storage device 710 represents one or more devices that enable storage and retrieval of information, such as executable instructions and / or other data. Storage device 710 may include, without limitation, one or more computer-readable media, such as dynamic random access memory (DRAM), static random access memory (SRAM), a solid-state disk, and / or a hard disk. Storage device 710 may be configured, without limitation, to store application source code, application object code, source code portions of interest, object code portions of interest, configuration data, execution events, and / or other data types.

[0025] In the exemplary implementation, the computing device 700 includes a presentation interface 720 coupled to the processor 715. The presentation interface 720 presents information to a user 725. The presentation interface 720 may, for example, include a display adapter (not shown) that can be coupled to a display device, such as a cathode ray tube (CRT), a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, and / or an electronic ink display.

[0026] In some implementations, the presentation interface 720 includes one or more display devices.

[0027] In the exemplary implementation, the computing device 700 includes a user input interface 735. The user input interface 735 is coupled to the processor 715 and receives input from the user 725. The user input interface 735 may include, for example, a keyboard, a pointing device, a mouse, a stylus, a touch-sensitive panel (e.g., a touch pad or touch screen), a gyroscope, an accelerometer, a position detector, and / or an audio user input interface. A single component, such as a touch screen, may function as both the display device of the presentation interface 720 and the user input interface 735.

[0028] In the exemplary implementation, the computing device 700 includes a communication interface 740 coupled to the processor 715. The communication interface 740 communicates with one or more remote devices. To communicate with the remote devices, the communication interface 740 may include, for example, a wired network adapter, a wireless network adapter, and / or a mobile communication adapter.

[0029] The systems and methods described herein are directed to a laser ranging and distance measuring (LADAR) array that utilizes a plurality of separate LADAR modules. A central processing device combines signals from each of the plurality of LADAR modules to produce an output (e.g., a three-dimensional image of an environment within a field of view (FOV) of the LADAR modules). By using a plurality of LADAR modules, the overall FOV and image resolution of the array are better than the FOV and image resolution of a single LADAR module operating alone. Furthermore, the individual LADAR modules are relatively inexpensive, relatively small, and not overly complex, which reduces the cost of the LADAR array described herein compared to other LADAR systems with relatively large FOVs. These advantages directly enable significant benefits for a wide range of LADAR applications.

[0030] This written description uses examples to disclose various implementations that encompass the best mode to enable any person skilled in the art to practice these implementations, including making and using any devices or systems and performing any integrated method. The patentable scope is defined by the claims and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they include structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.

Claims

[1] Laser distance and range measuring (LADAR) arrangement comprising: a plurality of LADAR modules (100, 602, 604), each LADAR module configured to scan a laser beam through a separate field of view, FOV, (112) and output a signal indicative of a distance between each of the LADAR modules and objects in the field of view upon which the laser beam is incident; and a central processing device (302) communicatively coupled to the plurality of LADAR modules, the central processing device configured to generate an output based at least in part on the signals from each of the LADAR modules; wherein the plurality of LADAR modules (100) comprises at least a first LADAR module (602) having a first field of view (112) and a second LADAR module (604) having a second field of view (112), and wherein the first and second LADAR modules are arranged such that the first field of view does not overlap with the second field of view and is adjacent to the second field of view to cover a wider overall FOV. [2] The LADAR array (300) of claim 1, wherein each of the LADAR modules (100) has a field of view (112) of equal dimensions, and wherein the central processing device (302) is configured to generate an image having a total field of view with a dimension greater than that of the field of view of equal dimensions. [3] LADAR arrangement (300) according to claim 1 or 2, wherein the central processing device comprises: a central analog-to-digital converter unit (504); and a central fast Fourier transform unit (506), wherein the central analog-to-digital converter unit and the central fast Fourier transform unit are configured to process the signals from each of the LADAR modules (100). [4] The LADAR arrangement (300) of any one of claims 1 to 3, wherein the plurality of LADAR modules (100) comprises at least the first LADAR module (602) operating at a first phase and the second LADAR module (604) operating at a second phase, and wherein the first phase is offset with respect to the second phase. [5] A method of assembling a laser distance and range finding (LADAR) assembly (300), the method comprising: Arranging a plurality of LADAR modules (100), each LADAR module configured to scan a laser beam through a separate field of view, FOV, (112) and to output a signal indicative of a distance between each of the LADAR modules and objects in the field of view upon which the laser beam is incident; and communicatively coupling the plurality of LADAR modules (100) to a central processing device (302), the central processing device being configured to generate an output based at least in part on the signal outputs from each of the LADAR modules; wherein the plurality of LADAR modules (100) comprises at least a first LADAR module (602) having a first field of view (112) and a second LADAR module (604) having a second field of view (112), and wherein the first and second LADAR modules are arranged such that the first field of view does not overlap with the second field of view and is adjacent to the second field of view to cover a wider overall FOV. [6] The method of claim 5, wherein arranging a plurality of LADAR modules (100) comprises arranging a plurality of LADAR modules (100), each having a field of view (112) of equal dimension, and wherein communicatively coupling the plurality of LADAR modules to the central processing device comprises communicatively coupling the plurality of LADAR modules to a central processing device (302) configured to generate an image having a total field of view having a dimension greater than that of the field of view (112) of equal dimension. [7] The method of claim 5 or 6, wherein communicatively coupling the plurality of LADAR modules (100) to a central processing device (302) comprises communicatively coupling the plurality of LADAR modules to a central processing device (302) comprising a central analog-to-digital converter unit (502) and a central fast Fourier transform unit (504), the central analog-to-digital converter unit and the central fast Fourier transform unit being configured to process the signals from each of the plurality of LADAR modules. [8] The method of any one of claims 5 to 7, wherein arranging a plurality of LADAR modules (100) comprises arranging the first LADAR module (602) operating at a first phase and the second LADAR module (604) operating at a second phase, and wherein the first phase is offset with respect to the second phase.

Citation Information

Patent Citations

  • Automotive auxiliary ladar sensor

    EP2806288A1

  • Security system using ladar-based sensors

    US20100053330A1

  • METHODS AND APPARATUS OF FUSING RADAR / CAMERA OBJECT DATA AND LiDAR SCAN POINTS

    US20130242284A1

  • Methods and Apparatus for Array Based Lidar Systems with Reduced Interference

    US20150131080A1