Multispectral imaging method and device based on high-speed adjustable multi-color LED light source
By using high-speed adjustable multi-color LED light source and spatial light modulator in single-pixel multi-spectral imaging technology, the problems of expensive and bulky systems and low imaging efficiency in the prior art are solved, and low-cost and high-quality multi-spectral imaging is achieved. , and the spectral range was expanded.
Patent Information
- Application Number
- CN202111667075.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-31
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-12-31
AI Technical Summary
The existing single-pixel multispectral imaging technology has problems such as expensive and bulky systems, low imaging efficiency and limited spectral range.
Using a method based on high-speed adjustable multi-color LED light source, by modulating the sine intensity of LEDs in different spectral segments, the velocity gap between the spatial light modulator and the detector response is used to encode the spectral information into the velocity gap, and through the Four Leaf decomposition and separation of multispectral response signals to achieve low-cost and high-quality multispectral imaging.
Low-cost and high-quality multi-spectral imaging is achieved, expanding the band range, reducing the system's volume and cost, and improving imaging efficiency.
Smart Images

Figure CN114441035B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of multi-spectral imaging, and in particular to a multi-spectral imaging method and device based on a high-speed adjustable multi-color LED light source. Background Art
[0002] Spectral images are composed of a two-dimensional spatial data set and a three-dimensional data set in the one-dimensional spectral domain. Since spectral imaging can obtain spatial and spectral information at the same time, more information is helpful for the detection and judgment of targets. This technology has been widely used in many fields such as mineral exploration, remote sensing agricultural assessment, cultural relics restoration, medical spectral imaging diagnosis, military target reconnaissance and detection, etc.
[0003] Single-pixel imaging is an emerging imaging technology that uses two-dimensional spatial coding patterns to perform spatial light modulation on the detection target, and can reconstruct the spatial information of the object from the one-dimensional signal obtained by the single-pixel detector. Single-pixel imaging provides a new technical approach for multispectral imaging. By using single-pixel detectors to detect light waves of different bands, multispectral images can be obtained. Most of the existing single-pixel multispectral imaging technologies use dispersion elements or filters to separate light of different wavelengths, and then use array detectors to record them separately. These single-pixel multispectral imaging technologies can obtain the spectral information of the image, but they all have the problems of expensive and bulky systems, low imaging efficiency and limited spectral range. Summary of the invention
[0004] In order to solve the above problems existing in the prior art, one of the purposes of the present invention is to propose a multi-spectral imaging method and device based on a high-speed adjustable multi-color LED light source. The speed difference between the switching of the spatial light modulator and the response of the detector is used to encode the spectral information of the target scene into this speed gap. The present invention performs sinusoidal intensity modulation of the LED illumination of each spectral band at different frequencies. Therefore, different spectral bands are multiplexed into a one-dimensional density measurement sequence of the detector in a frequency division multiplexing manner. After Fourier decomposition, the multi-spectral response signal can be separated and the system noise can be suppressed, effectively restoring the three-dimensional spectral cube information of the scene to be measured, and realizing low-cost, high-quality, and band-expandable single-pixel multi-spectral imaging.
[0005] The purpose of the present invention can be achieved by the following technical solutions:
[0006] A multi-spectral imaging method based on a high-speed adjustable multi-color LED light source, comprising:
[0007] configuring intensity modulation frequencies corresponding to each spectrum;
[0008] modulating each spectrum at a preconfigured intensity modulation frequency;
[0009] Emitting a modulated multi-spectrum to a target scene;
[0010] Performing spatial coding modulation on the outgoing light passing through the target scene;
[0011] Receive light modulated by spatial coding, obtain electrical signals after photoelectric conversion, and perform A / D conversion;
[0012] The light intensity response signal of each spectral band of the target scene is obtained based on the electrical signal after A / D conversion, and the spectrum and image information are restored through the reconstruction algorithm.
[0013] The intensity of each spectrum varies like a sinusoidal function.
[0014] The method of obtaining the light intensity response signal of each spectral band of the target scene based on the electrical signal after A / D conversion is specifically: performing Fourier transform on the electrical signal after A / D conversion, and decomposing multi-channel spectral information in the Fourier transform domain.
[0015] Decomposing the multi-channel spectral information in the Fourier transform domain specifically includes: extracting the coefficients of the measurement sequence at the corresponding modulation frequency in the Fourier domain as the response signal of the corresponding spectrum.
[0016] The intensity modulation frequencies of the spectra are different from each other.
[0017] A multi-spectral imaging device based on a high-speed adjustable multi-color LED light source, comprising:
[0018] A signal generator configured to send a light intensity frequency signal of specified frequency, phase and amplitude;
[0019] A multicolor LED light source, a transmitting lens, a scene, a lens, a spatial light modulator, a receiving lens and a single-point detector are sequentially arranged along the light beam direction, wherein the spatial light modulator is configured to perform spatial coding modulation on the outgoing light passing through the target scene;
[0020] An A / D conversion module is configured to perform A / D conversion on the electrical signal obtained after the photoelectric conversion;
[0021] The data processing module is configured to obtain the light intensity response signal of each spectral band of the target scene based on the electrical signal after A / D conversion, and restore the spectrum and image information through a reconstruction algorithm.
[0022] The multicolor LED light source includes a plurality of LED lights of different wavelength bands, the spectrum bands being within the visible light spectrum range, and the multicolor LED light source independently controls the light intensity frequency of each sub-light source according to the light intensity frequency signal sent by the signal generator.
[0023] The light intensity frequency signal is a sinusoidal function.
[0024] The frequencies of light intensity frequency signals of different spectra are different from each other.
[0025] The spatial light modulator is a digital micromirror array.
[0026] Compared with the prior art, the present invention has the following beneficial effects:
[0027] 1. The present invention performs sinusoidal intensity modulation on LEDs of different spectral bands, that is, different wavelengths have different temporal sinusoidal intensity transformations. After spatial and spectral modulation of the target scene, the detector records the measured values. After spectrally demultiplexing the measured values using Fourier decomposition, it is easy to decompose the multi-spectral response signals in the frequency domain and suppress noise. Compared with the prior art, the present invention has higher quality of target scene reconstruction.
[0028] 2. The present invention uses LEDs with multiple spectrum bands, and can realize multi-spectral imaging technology through its simple structure. The LED spectrum bands are selectable and have a small size and low cost, which can realize the practicality, miniaturization and lightweight of the multi-spectral imaging system. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 It is a light path diagram of a multi-spectral imaging system based on a high-speed adjustable multi-color LED light source in a specific embodiment of the present invention;
[0030] Figure 2 It is a flow chart of a multi-spectral imaging system based on a high-speed adjustable multi-color LED light source in a specific embodiment of the present invention;
[0031] Figure 3 It is a schematic diagram of a signal obtained by superimposing multiple sinusoidal light source control signals in a specific implementation manner of the present invention;
[0032] Figure 4 It is a schematic diagram of performing signal decoupling and separating multi-spectral response signals from a measurement sequence of each spatial modulation mode in a specific implementation manner of the present invention;
[0033] Among them: 1. signal generator, 2. multi-color LED light source, 3. transmitting lens, 4. scene, 5. lens, 6. spatial light modulator, 7. receiving lens, 8. single point detector, 9. A / D conversion module, 10. data processing module. DETAILED DESCRIPTION
[0034] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is implemented based on the technical solution of the present invention, and provides a detailed implementation method and specific operation process, but the protection scope of the present invention is not limited to the following embodiments.
[0035] The present application provides a multi-spectral imaging method based on a high-speed adjustable multi-color LED light source. First, a high-speed sinusoidal intensity modulation related to the spectrum is introduced into the illumination process of each spatial modulation mode by utilizing the speed difference between the switching of a spatial light modulator and the response of a detector. Then, the target scene of the multi-spectral illumination after the sinusoidal modulation is imaged, and spatial light modulation is performed on the imaging surface. Then, the high-speed detector collects a dense measurement sequence during each spatial modulation illumination mode, and different spectral information is multiplexed into a one-dimensional dense measurement sequence in a frequency division multiplexing manner. The spatial dimension light field information is also collected by coupling with the detector after being focused by a lens. Then, the measurement sequence of each spatial modulation mode is subjected to signal decoupling to separate the multi-spectral response signal. Finally, the multi-spectral image is reconstructed through a reconstruction algorithm.
[0036] Among them, the spectrum-related high-speed sinusoidal intensity modulation is to select multiple LED light sources in different spectral bands for sinusoidal modulation of different frequencies. The light intensity of each spectral component varies sinusoidally over time, and the modulation frequency is much higher than the switching frequency of the spatial light modulator.
[0037] The one-dimensional dense measurement sequence multiplexed by frequency division multiplexing is to multiplex the spectral information of the target scene into the measurement sequence in the process of each spatial mode.
[0038] Signal decoupling is performed on the measurement sequence of each spatial modulation mode to separate the multi-spectral response signal, that is, Fourier transform is performed on the spectrally coupled acquisition signal, and the multi-channel spectral information is decomposed in the Fourier transform domain. In the Fourier domain, the coefficients of the measurement sequence at the corresponding modulation frequency are the response signals corresponding to different wavelength bands.
[0039] The reconstruction algorithm recovers the spatial information of the scene from the coupled acquired measurement sequence and optimizes the reconstruction quality of the spatial-spectral 3D information by exploiting the continuity of the spatial information and the continuity priors of the multispectral information.
[0040] like Figure 1-2As shown, a multi-spectral imaging system based on a high-speed adjustable multi-color LED light source comprises a signal generator 1, a multi-color LED light source 2, a transmitting lens 3, a scene 4, a lens 5, a spatial light modulator 6, a receiving lens 7, a single-point detector 8, an A / D conversion module 9, and a data processing module 10, which are sequentially arranged along the light beam direction; first, the signal generator 1 controls each LED of the multi-color LED light source 2 to perform sinusoidal illumination at a set frequency, and then projects the illumination light to the scene 4 through the transmitting lens 3, and projects it to the spatial light modulator 6 through the lens 5, the spatial light modulator 6 performs spatial encoding on the reflected light of the scene 4, and then enters the single-point detector 8 through the receiving lens 7, the A / D conversion module 9 performs analog-to-digital conversion on the electrical signal generated after the photoelectric conversion of the single-point detector 8, and finally sends it to the data processing module 10 for reconstruction, thereby realizing multi-spectral single-pixel imaging based on a high-speed adjustable multi-color LED light source.
[0041] The signal generator 1 can be a large-scale integrated circuit, or an FPGA chip to generate a function signal. In this specific implementation example, the signal generator module selects three four-channel DDS modules, and each channel can provide independent frequency, phase and amplitude control; wherein, the signal generator 1 can be implemented by a function generator composed of discrete components, a large-scale integrated circuit, a function generator of a monolithic integrated chip, or a dedicated direct digital synthesis DDS chip.
[0042] The multicolor LED light source 2 in this example uses 3*4 LED lights of different wavelength bands, which are crimson, red, orange-red, orange, yellow-green, green, emerald green, grass green, blue, sapphire blue, blue-purple, and purple, and the spectrum bands cover the visible light spectrum range. In the preferred embodiment of the present invention, the multicolor LED light source 2 independently controls the frequency of each sub-light source according to the control signal sent by the signal generator 1 to generate a sinusoidally changing light field. Each wavelength band corresponds to a specific sinusoidal modulation frequency, which is set at the MHZ level. The modulation frequency is much higher than the switching frequency of the spatial light modulator, and the 12 LED frequencies are different;
[0043] The emission lens 3 focuses the light source onto the scene 4;
[0044] Scene 4 is a color target scene;
[0045] The spatial light modulator 6 spatially encodes the reflected light of the scene 4, wherein the spatial light modulator 6 is a digital micromirror array (DMD) which is a reflective device. After the light source is encoded, it is projected onto a single-point detector 8 through a lens 7, wherein the spatial light modulator 6 is a digital micromirror array DMD, which is a micro-electromechanical system that can realize high-speed binary encoding of light fields.
[0046] The receiving lens 7 collects the reflected light of the target scene and focuses it on the single point detector 8;
[0047] The single-point detector 8 receives the light signal reflected by the spatial light modulator that is converged by the receiving lens 7. The single-point detector has the characteristics of wide bandwidth and high response, and can select imaging in the visible light band, near-infrared band, terahertz band and other bands. In the preferred embodiment of the present invention, a single-point detector suitable for the visible light band is selected, wherein the single-point detector 8 uses a photodiode, a photomultiplier tube or a single-photon detector to detect the total light intensity of the spatial light field, without the need to use an array detector to record the complete spatial distribution information. The single-point detector can support a higher bandwidth, thereby supporting high-speed imaging. In addition, it also has the advantages of low cost and small size, which is conducive to the integration and miniaturization of the imaging system.
[0048] The A / D module 9 performs analog-to-digital conversion on the electrical signal generated by the single-point detector 8 after photoelectric conversion, and sends it to the data processing module;
[0049] The data processing module 10 performs fast Fourier transform on the one-dimensional measurement sequence collected from each spatial mode to obtain the light intensity response signal of each spectral band of the target scene, and restores the spectrum and image information through a convex optimization algorithm based on compressed sensing theory.
[0050] The imaging system of this embodiment uses a low-cost LED array with different spectral bands as a light source to perform spectral modulation on the target scene. Compared with the traditional spectral imaging system using any dispersion element or spatially varying color filter, the LED array can realize multi-spectral imaging technology through a simpler structure; and the LED array is small in size and easy to change, making it easier to realize the miniaturization and practicality of the spectral imaging system;
[0051] The single-point detector 8 used in the imaging system of this embodiment is a single-pixel light intensity detector, and a photodiode or a single-photon detector can be selected. The present invention does not require the use of an array detector, and only requires a single-point detector for imaging, which has important application value when a larger array detector is not suitable;
[0052] The imaging system of this embodiment utilizes the speed difference between the slow spatial illumination mode and the fast detector response, and performs sinusoidal modulation on 12 light sources of different wavelength bands. Figure 3 Represents the signal after the addition of 12 sinusoidal signals. The high-speed detector collects dense measurement sequences during each spatial modulation illumination mode, and different spectral information is multiplexed into a one-dimensional dense measurement sequence in a frequency division multiplexing manner. During data processing, the measurement sequence of each spatial modulation mode is signal decoupled to separate the multi-spectral response signal. Figure 4It means that the multi-spectral response signal is separated after decoupling the measurement sequence. The spatial information of the scene is restored from the coupled measurement sequence, and the continuity of the spatial information and the continuity of the multi-spectral information are used to optimize the reconstruction quality of the spatial-spectral three-dimensional information. Compared with the prior art, the present invention greatly improves the quality of data reconstruction.
Claims
1. A multi-spectral imaging method based on a high-speed adjustable multi-color LED light source, characterized in that: include: configuring intensity modulation frequencies corresponding to each spectrum; modulating each spectrum at a preconfigured intensity modulation frequency; Emitting a modulated multi-spectrum to a target scene; Performing spatial coding modulation on the outgoing light passing through the target scene; Receive light modulated by spatial coding, obtain electrical signals after photoelectric conversion, and perform A / D conversion; Based on the electrical signal after A / D conversion, the light intensity response signal of each spectral band of the target scene is obtained, and the spectrum and image information are restored through the reconstruction algorithm; The modulation of the spectrum is high-speed sinusoidal intensity modulation. The light intensity of each spectral component varies sinusoidally with time. The modulation frequency is higher than the switching frequency of the spatial light modulator, and the intensity modulation frequencies of each spectrum are different. The multi-color LED light source uses 3*4 LED lights with different wavelengths, which are crimson, red, orange-red, orange, yellow-green, green, turquoise, grass green, blue, sapphire blue, blue-violet, and purple. The spectrum covers the visible light spectrum. The multi-color LED light source independently controls the frequency of each sub-light source to produce a sinusoidally changing light field. Each wavelength band corresponds to a specific sinusoidal modulation frequency, which is set at the MHZ level. The modulation frequency is much higher than the switching frequency of the spatial light modulator, and the 12 LED frequencies are different. The single-point detector receives the light signal reflected by the spatial light modulator after being focused by the receiving lens. The single-point detector uses a photodiode, a photomultiplier tube or a single-photon detector to detect the total light intensity of the spatial light field. Different spectrum information is multiplexed into a one-dimensional dense measurement sequence in a frequency division multiplexing manner. During data processing, the measurement sequence of each spatial modulation mode is signal decoupled to separate the multi-spectral response signal.
2. A multi-spectral imaging method based on a high-speed adjustable multi-color LED light source according to claim 1, characterized in that: The method of obtaining the light intensity response signal of each spectral band of the target scene based on the electrical signal after A / D conversion is specifically: performing Fourier transform on the electrical signal after A / D conversion, and decomposing multi-channel spectral information in the Fourier transform domain.
3. A multi-spectral imaging method based on a high-speed adjustable multi-color LED light source according to claim 2, characterized in that: Decomposing the multi-channel spectral information in the Fourier transform domain specifically includes: extracting the coefficients of the measurement sequence at the corresponding modulation frequency in the Fourier domain as the response signal of the corresponding spectrum.
4. A multi-spectral imaging device based on a high-speed adjustable multi-color LED light source, characterized in that: include: A signal generator configured to send a light intensity frequency signal of specified frequency, phase and amplitude; A multicolor LED light source, a transmitting lens, a scene, a lens, a spatial light modulator, a receiving lens and a single-point detector are sequentially arranged along the light beam direction, wherein the spatial light modulator is configured to perform spatial coding modulation on the outgoing light passing through the target scene; An A / D conversion module is configured to perform A / D conversion on the electrical signal obtained after the photoelectric conversion; A data processing module is configured to obtain the light intensity response signal of each spectral band of the target scene based on the electrical signal after A / D conversion, and restore the spectrum and image information through a reconstruction algorithm; The modulation of the spectrum is high-speed sinusoidal intensity modulation, the light intensity of each spectral component varies sinusoidally with time, and the modulation frequency is higher than the switching frequency of the spatial light modulator; The frequencies of light intensity frequency signals of different spectra are different from each other; The multi-color LED light source uses 3*4 LED lights with different wavelengths, which are crimson, red, orange-red, orange, yellow-green, green, turquoise, grass green, blue, sapphire blue, blue-violet, and purple. The spectrum covers the visible light spectrum. The multi-color LED light source independently controls the frequency of each sub-light source to produce a sinusoidally changing light field. Each wavelength band corresponds to a specific sinusoidal modulation frequency, which is set at the MHZ level. The modulation frequency is much higher than the switching frequency of the spatial light modulator, and the 12 LED frequencies are different. The single-point detector receives the light signal reflected by the spatial light modulator after being focused by the receiving lens. The single-point detector uses a photodiode, a photomultiplier tube or a single-photon detector to detect the total light intensity of the spatial light field. Different spectrum information is multiplexed into a one-dimensional dense measurement sequence in a frequency division multiplexing manner. During data processing, the measurement sequence of each spatial modulation mode is signal decoupled to separate the multi-spectral response signal.
5. A multi-spectral imaging device based on a high-speed adjustable multi-color LED light source according to claim 4, characterized in that: The multicolor LED light source includes a plurality of LED lights of different wavelength bands, the spectrum bands being within the visible light spectrum range, and the multicolor LED light source independently controls the light intensity frequency of each sub-light source according to the light intensity frequency signal sent by the signal generator.
6. A multi-spectral imaging device based on a high-speed adjustable multi-color LED light source according to claim 4, characterized in that: The spatial light modulator is a digital micromirror array.
