Frequency-modulated continuous wave single-pixel three-dimensional imaging system based on compressed sensing algorithm

Through the combination of frequency modulated continuous wave lidar and compression perception technology, the Hadamma matrix modulation echo and reconstruction of two-dimensional information is solved, and the problem of lidar data redundancy and distance resolution is achieved efficient and real-time three-dimensional Imaging and expanding application prospects.

CN119001752APending Publication Date: 2024-11-22BEIJING INST OF TECH

Patent Information

Application Number
CN202411107287.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing lidar has data redundancy problems during the three-dimensional imaging process, resulting in inefficient system. The distance resolution of traditional amplitude modulated continuous wave lidar is limited, making it difficult to achieve high resolution and real-time measurement.

Method used

Frequency-modulated continuous wave lidar combined with compression perception technology is used to spatially modulate the echo through loading the Hadamma matrix on DMD, interferometric signals are collected using a single-pixel detector, and two-dimensional information is reconstructed through a compression perception algorithm to achieve three-dimensional imaging.

Benefits of technology

It reduces data memory, improves detection efficiency, realizes high-resolution and real-time three-dimensional imaging, expands the application prospects of lidar, and supports four-dimensional imaging.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119001752A_ABST
    Figure CN119001752A_ABST
Patent Text Reader

Abstract

The invention relates to a frequency-modulated continuous wave single-pixel three-dimensional imaging system based on a compressed sensing algorithm. According to the implementation mode, a frequency-modulated continuous wave laser radar emits linear frequency-modulated continuous waves, after laser beam splitting, one beam serves as reference light, the other beam serves as detection light and irradiates a target scene after passing through a half-wave plate, echo waves firstly enter a digital micromirror device loaded with Hadamard matrix pictures and serve as spatial sampling of the target scene, and the Hadamard matrix pictures are sent to a digital micromirror device loaded with Hadamard matrix pictures; and the modulated light beam interferes with the reference light and is received by the single-pixel detector. Depth information is recovered by taking the frequency-modulated continuous wave as a light source and combining the frequency-modulated continuous wave ranging principle, the required information is included in the echo frequency, the anti-interference capability of the system is improved, the system is more suitable for long-distance detection, two-dimensional information is reconstructed by using a compressed sensing reconstruction algorithm, the data memory of detection is reduced, and the detection efficiency is improved. Real-time and high-speed three-dimensional imaging becomes possible, and the method can be importantly applied to the fields of topographic surveying and mapping, automatic driving, underwater detection and the like.
Need to check novelty before this filing date? Find Prior Art

Description

Technical field:

[0001] The present invention relates to frequency modulated continuous wave single-pixel three-dimensional imaging technology, which has potential application value in the fields of terrain mapping, intelligent driving, high-resolution imaging, etc. Background technology:

[0002] LiDAR uses laser beams as detection waves and combines the advantages of laser high brightness, good coherence, and good directionality. Compared with microwave radar, it has better detection accuracy and higher detection efficiency. Laser beams are used to capture target information and are widely used in terrain surveying and mapping, autonomous driving, underwater detection, and ecological science.

[0003] LiDAR needs to obtain the x, y, and z coordinate information of the scene to achieve three-dimensional imaging. When obtaining z-axis information, it is necessary to use LiDAR distance detection related technologies, mainly emitting pulsed lasers or continuous waves. Compared with pulsed LiDAR, continuous wave LiDAR has a smaller working peak power and can be effectively detected by slow square-law detectors, and the system cost is relatively low. There are two main forms of continuous wave LiDAR: amplitude modulated continuous wave LiDAR (AMCW) and frequency modulated continuous wave LiDAR (FMCW). The information required by FMCW LiDAR is contained in the echo frequency and does not directly depend on the laser wavelength, which makes it have good anti-interference ability for background light, and by increasing the bandwidth of the signal, higher distance resolution can be achieved, even up to the millimeter level. In contrast, the distance resolution of AM CW LiDAR is limited by its modulation method and signal processing technology. At the same time, FMCW LiDAR can not only measure distance, but also use optical Doppler frequency shift to measure the speed of the target in real time. This function is particularly important in the fields of autonomous driving and three-dimensional imaging.

[0004] When laser radar acquires two-dimensional information of the xy plane, it can be divided into scanning and non-scanning types according to different detection methods. Scanning laser radar relies on a complex scanning structure and has high requirements for parameters such as the energy and frequency of the emitted laser. Non-scanning laser radar can quickly acquire the target two-dimensional plane information through a planar array detection system, but this process will generate a huge amount of data. The present invention selects a non-scanning scheme and combines compressed sensing imaging technology to collect and process spatial information. Compressed sensing technology can break through the limitations of the Nyquist sampling theorem. The principle of this technology proposes that only a very small number of sparse signals are needed to restore the original signal through a related reconstruction algorithm, which solves the problem of data redundancy. While ensuring the recovery accuracy, it enables three-dimensional imaging laser radar to develop in the direction of high speed and real-time, thereby improving the detection efficiency of the system. There are currently two methods for sampling two-dimensional information space. One is to directly project light fields of different structures onto the target scene, which is called "structured illumination"; the other is to use a digital micromirror device (DMD) to modulate the echo, which is called "structured detection". The former can only achieve effective detection under close-range conditions due to the structural characteristics of the projected light field, and is suitable for applications such as close-range three-dimensional surface measurement. The latter has the ability of long-range detection and is suitable for the application requirements of LiDAR. The present invention adopts a structured detection scheme, places the DMD at the image plane of the target scene at the detection end, realizes sparse sampling by quickly loading different spatial modulation matrices, and collects the echo reflected by the micromirror through a single-pixel detector and further calculates and processes it.

[0005] The present invention proposes a compressed sensing three-dimensional imaging technology based on frequency modulated continuous wave laser ranging, and realizes at the same time. The Hadamard matrix is ​​loaded on the DMD to perform spatial modulation on the echo to achieve sparse sampling, and the compressed sensing recovery algorithm is used to reconstruct the two-dimensional information. The method uses a frequency modulated continuous wave laser radar as the transmitting light source, and a single-pixel detector receives the interference signal of the reference light and the modulated echo respectively. After sampling and solving the frequency shift information, the compressed sensing algorithm is processed on the different frequency slice data, so as to restore the two-dimensional images at different distances to realize the three-dimensional imaging function. The present invention integrates the compressed sensing two-dimensional information reconstruction on the basis of frequency modulated continuous wave ranging, so as to realize single-pixel three-dimensional detection, reduce data memory, and improve detection efficiency. At the same time, it lays the foundation for frequency modulated continuous wave laser radar to use Doppler frequency shift to measure speed, and makes the concept of 4D imaging possible, which has great application prospects. Summary of the invention:

[0006] The present invention provides a design of a frequency modulated continuous wave single-pixel three-dimensional imaging system based on a compressed sensing algorithm. A frequency modulated continuous wave laser radar is used as a light source. The radar emits a linear frequency modulated continuous wave, which is divided into two beams by a spectroscope. The detection light is irradiated on the target terrain, and the echo first enters the DMD. The DMD is loaded with a designed Hadamard matrix image as an observation matrix of the compressed sensing algorithm. The Hadamard matrix is ​​used to modulate the echo to perform spatial sampling on the target. The modulated echo interferes with the reference light and is received by a single-pixel detector. Finally, the compressed sensing algorithm is used to reconstruct the two-dimensional information, and the depth information is obtained in combination with the frequency modulated continuous wave ranging principle to achieve three-dimensional imaging.

[0007] The technical solution adopted by the present invention is: a continuous wave with linear frequency modulation is emitted by a laser, which is divided into two beams after passing through a collimating beam expander and a beam splitter. One beam is used as a reference light, and the other beam is used as a detection light. It first passes through a half-wave plate and then irradiates the target scene. The echo first enters the DMD, and the Hadamard matrix image is loaded on the DMD. The echo is modulated by the Hadamard matrix of different modes, interferes with the reference light and is received by a single-pixel detector. The detector time domain signal is sampled and demodulated, and then the compressed sensing algorithm is used to achieve image reconstruction at different frequency shifts through low-pass filtering, Fourier transform and other related processing, and then multiple two-dimensional reconstructed images are fused into a three-dimensional image. The specific technology is as follows:

[0008] The above system uses a linear frequency modulated continuous wave as the detection light source, and modulates the continuous wave with a modulation frequency μ. The light source passes through a collimating beam expander and is split into two beams by a beam splitter, one as a reference light and the other as a detection light. The beam first passes through a half-wave plate to facilitate subsequent frequency mixing before being irradiated on the target scene.

[0009] The detection method of the above system replaces structured illumination with structured detection. The echo reflected by the target scene first enters the DMD. The generated Hadamard matrix image is loaded on the DMD. The specific design method is that if you want to detect an imaging resolution of m×m, you need to generate m 2 ×m 2 The Hadamard matrix is ​​obtained by replacing the -1 elements with 0 elements. Each row of the matrix is ​​then rearranged into a matrix of m×m pixels to meet the imaging resolution, and combined with the specific DMD size scaling, it is used as a modulation image. Finally, the generated image is loaded at a suitable sampling rate for observation.

[0010] The detection echo of the above system is modulated by the DMD, focused by the lens system, reflected by the plane mirror and enters the beam combiner, where it is mixed with the reference light. The mixed signal is collected by a single-pixel detector, and combined with the frequency-modulated continuous wave ranging theory, the frequency information can be obtained after low-pass filtering, Fourier transform and other processing. The frequency information contains the echo delay τ, and the depth information of the target scene can be finally analyzed from the delay. The echo can spatially sample the scene through the structured modulation of the DMD and combined with the compressed sensing algorithm, and the two-dimensional information of the target scene can be reconstructed from the received intensity information, and finally three-dimensional imaging can be achieved.

[0011] Compared with the prior art, the present invention has the following beneficial effects:

[0012] (1) Use frequency-modulated continuous-wave laser radar instead of traditional pulse laser radar. Continuous-wave light sources carry rich information and are easy to demodulate. In theory, there is no ranging blind spot that exists in pulse radar, making it easier to achieve high-resolution and high-accuracy detection.

[0013] (2) Use frequency modulated continuous wave laser radar instead of traditional amplitude modulated continuous wave laser radar as the transmitting light source, and detect based on the modulated signal of the echo. The required information is contained in the echo frequency, which makes it have good anti-interference ability against background light. The transmission power of frequency modulated continuous wave laser radar is small, and the requirements for the detector carrying capacity are relatively low, which makes it easier to achieve on-chip integration. Moreover, frequency modulated continuous wave laser radar can not only measure distance, but the frequency information carried by its echo can also use optical Doppler frequency shift to measure the speed of the target. When combined with three-dimensional imaging, the detection dimension can be increased to four dimensions.

[0014] (3) For single-pixel three-dimensional imaging, structured detection is used, and the DMD is placed behind the target scene to modulate the echo. The designed modulation matrix is ​​loaded on the DMD to collect the two-dimensional information of the target scene, and the two-dimensional morphology of the target terrain can be reconstructed in combination with the compressed sensing algorithm. This method is combined with frequency modulated continuous wave ranging to expand the application of frequency modulated continuous wave lidar. At the same time, the present invention combines the compressed sensing algorithm to solve the problem of large data volume in two-dimensional detection of non-scanning lidar, breaking through the limitations of traditional sampling theorem, reducing data memory, and improving detection efficiency, making real-time detection and video imaging possible. Description of the drawings:

[0015] The specific implementation modes of the present invention are described in detail below in conjunction with the accompanying drawings.

[0016] Figure 1This is a design diagram of the system of the present invention, which specifically includes 1. a frequency modulated continuous wave laser radar, 2. a collimating beam expander, 3. a spectroscope, 4. a half-wave plate, 5. a target scene, 6. a lens system, 7. a digital micromirror device, 8. a plane reflector, 9. a beam combiner, 10. a single pixel detector, 11. an acquisition card, and 12. a PC terminal.

[0017] Figure 2 This is the schematic diagram of the three-dimensional imaging system that combines FCM laser radar with compressed sensing algorithm. The following are marked in the figure: 1. FCM laser radar, 2. target scene, 3. Hadamard matrix image loaded on DMD and two-dimensional information reconstruction process, 4. FCM ranging principle and depth information acquisition process, 5. three-dimensional imaging result. Specific implementation method:

[0018] The present invention provides a design of a frequency modulated continuous wave single-pixel three-dimensional imaging system based on a compressed sensing algorithm. A frequency modulated continuous wave laser radar emits a linear frequency modulated continuous wave. After the laser is split, one beam is used as a reference light, and the other beam is used as a detection light. It first passes through a half-wave plate and then irradiates the target scene. The echo is received and modulated by the DMD. The modulated light is focused by a lens system and reflected by a plane mirror into a beam combiner. After interfering with the reference light, it is received by a single-pixel detector. The received signal enters an acquisition card to detect the time domain signal and demodulate it. Finally, it is processed on the PC side. The frequency modulated continuous wave ranging principle and the compressed sensing algorithm are combined to realize image reconstruction at different frequency shifts, and then multiple two-dimensional reconstructed images are fused into a three-dimensional image, thereby realizing three-dimensional imaging. The specific device design is as follows: Figure 1 shown.

[0019] Based on the above system design, the specific technical implementation steps are as follows:

[0020] The FMCW laser radar emits a linear frequency modulated continuous wave with a carrier frequency of f0, a bandwidth of B, a time width of T, and a frequency modulation rate of The transmitted signal can be expressed as After the emission light source is expanded and collimated, it is divided into two beams by a beam splitter. One beam is used as the reference light, and the other is used as the detection light. It first passes through a half-wave plate and then irradiates the target scene. When the target distance is x0, the echo will have a time delay. c is the speed of light. Then the echo signal can be expressed as A is the amplitude information of the target scene.

[0021] The echo reflected by the target scene first enters the digital micromirror device (DMD), on which the designed Hadamard matrix is ​​loaded. Assuming that an imaging resolution of m×m is required, m 2 ×m 2The Hadamard matrix is ​​replaced by -1 elements with 0 elements, and each row of the matrix is ​​rearranged into a matrix of m×m pixels to meet the imaging resolution. It is scaled according to the actual DMD size. As a modulated image, the sampling and quantization capabilities of the system must be considered. Finally, the image is loaded on the DMD for observation at an appropriate sampling rate.

[0022] The echo modulated by DMD is focused by the lens group and reflected by the plane mirror into the beam combiner. The reference light is mixed with the echo. Only the real part is considered. The local oscillator signal is multiplied by the echo signal to obtain This processing will obtain two frequencies, namely f1=2f0-μτ+2μt, f2=μτ, and f1>>f2. The mixed information is received by the single-pixel detector, converted by the acquisition card and transmitted to the PC for processing. Considering the principle of frequency-modulated continuous wave ranging, the mixed information can be low-pass filtered to filter out the high-frequency part f1, and only retain the frequency f2=μτ carrying the delay information. Pixels with the same distance correspond to a peak in the frequency domain, and a corresponding delay τ. Through the relevant algorithm processing, the formula The depth information of the target can be obtained.

[0023] The Hadamard matrix image modulated echo is loaded on the DMD to perform spatial sampling of the target scene. After being collected by a single-pixel detector, the two-dimensional information of the target scene can be reconstructed in combination with the compressed sensing theory. The compressed sensing theory is an undersampling theory. The measurement process can be expressed as y=Φx=ΦΨs, where y is the detected signal, and in this system, the mixed signal is collected by the single-pixel detector; Φ is the artificially set observation matrix, and in this system, it is the Hadamard matrix loaded on the DMD; x is the original signal, and in this system, it is the target information to be reconstructed; s is the sparse signal, and in this system, it is the sparse peak in the frequency domain after Fourier transform Ψ and other processing. Ψ is usually a transformation form such as Fourier transform, so that any signal in nature is projected into the sparse domain for the compressed sensing reconstruction algorithm to proceed. This system uses the TVAL3 compressed sensing algorithm to restore the two-dimensional information, reconstruct the target terrain using the collected intensity information, and combines the depth information obtained by the frequency corresponding to the peak in the frequency domain, and finally realizes three-dimensional imaging.

Claims

1. A frequency modulated continuous wave single pixel three-dimensional imaging system based on compressed sensing algorithm, characterized in that: The system uses a frequency modulated continuous wave laser radar (1) to emit a linear frequency modulated continuous wave, which is then divided into two beams after passing through a collimating beam expander (2) and a beam splitter (3). One beam is used as a reference light, and the other beam is used as a detection light. The light first passes through a half-wave plate (4) to facilitate subsequent mixing, and then is irradiated on a target scene (5). The echo reflected by the target scene is focused by a lens (6) and enters a digital micromirror device (7). A Hadamard matrix is ​​loaded on the DMD to perform spatial modulation on the echo. The modulated light is focused by a lens system (6) and reflected by a plane mirror (8) into a beam combiner (9). The reference light interferes with the modulated echo and is received by a single pixel detector (10). The received signal enters an acquisition card (11) to detect the time domain signal and demodulate it. Finally, it is processed on a PC (12). The frequency modulated continuous wave ranging principle and a compressed sensing algorithm are combined to realize image reconstruction at different frequency shifts, and then multiple two-dimensional reconstructed images are fused into a three-dimensional image, thereby realizing three-dimensional imaging.

2. The frequency modulated continuous wave single pixel three-dimensional imaging system based on compressed sensing algorithm according to claim 1, characterized in that: The system uses the "structured detection" method instead of the traditional "structured illumination", placing the DMD at the image plane of the target scene at the detection end, loading the generated Hadamard matrix image on the DMD in advance, and modulating the echo by the reflective projection of the flipped micromirror. The echo reflected by the micromirror is collected by a single-pixel detector and further calculated and processed.

3. The frequency modulated continuous wave single pixel three-dimensional imaging system based on compressed sensing algorithm according to claim 1, characterized in that: This system generates a Hadamard matrix as the observation matrix in compressed sensing theory, replaces the -1 element with a 0 element, rearranges each row of the matrix to meet the imaging resolution, generates a corresponding modulated image, loads the image on the DMD at an appropriate sampling rate and observes it, realizes sparse sampling by quickly loading different spatial modulation matrices, and restores the two-dimensional target terrain in combination with the compressed sensing reconstruction algorithm.

4. The frequency modulated continuous wave single pixel three-dimensional imaging system based on compressed sensing algorithm according to claim 1, characterized in that: The system uses frequency modulated continuous wave as the light source instead of the traditional pulsed lidar or amplitude modulated continuous wave. The light source emits linear frequency modulated continuous wave, and uses a single-pixel detector to collect reference light and detection light. Combined with mixing, low-pass and other processing, the time delay in the echo frequency is analyzed to obtain the depth information of the target, and finally combined with two-dimensional information to achieve three-dimensional imaging. This system uses frequency as the signal processing basis and combines with Doppler frequency shift to upgrade the system to a four-dimensional imaging system capable of real-time speed measurement.

Citation Information

Patent Citations

  • Three-dimensional compressed imaging method and device based on phase position distance measurement principle

    CN103983981A

  • Three-dimensional imaging system based on digital micromirror device (DMD) and imaging method

    CN106443691A

  • Compressive scanning lidar

    CN106461785A

  • Single pixel laser calculation imaging device and method

    CN110471082A

  • Lidar system with spatial light modulator

    US20200256960A1

Cited By

  • Longitudinal large-scale three-dimensional shape measurement method based on non-uniform sparse sampling

    CN120274670A

  • Rapid and efficient laser fuze signal high-repetition-frequency and high-speed modulation system based on DMD (Digital Micromirror Device)

    CN121091312A