Multi-spectral imaging system and imaging method for single-pixel type ultraviolet-visible-infrared wide spectral range

By using a barrel-shaped structure detection module composed of multiple narrowband detectors in a multi-spectral imaging system, the problems of insufficient imaging capabilities and high system complexity in traditional systems under low-light conditions are solved, and efficient multi-spectral imaging is achieved, with the characteristics of single-pixel imaging, multi-spectral number, wide spectral range, fast imaging speed and good spatial and temporal resolution.

CN119509696AActive Publication Date: 2025-02-25XIDIAN UNIV

Patent Information

Application Number
CN202411663529.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-20
Publication Date
2025-02-25
Estimated Expiration
2044-11-20

AI Technical Summary

Technical Problem

Traditional multispectral imaging systems lack imaging capabilities under low light conditions, and have high system complexity, slow imaging speed, small spectra, and the difference in pixel count and shooting angles of different cameras leads to difficulty in image registration.

Method used

A barrel-shaped multi-spectral detection module consisting of a narrowband detector with different spectral responses is used to avoid the addition of additional spectral devices and filter devices. The single-pixel reduction algorithm and image superposition algorithm are used to reconstruct and fusion, and multi-spectral imaging in a wide spectral range of ultraviolet-visible-infrared.

Benefits of technology

It significantly improves the imaging ability of the imaging system under low-light conditions, simplifies the system complexity, improves the imaging speed, increases the number and range of spectra, avoids image registration problems, and achieves single-pixel imaging, large number of spectras, wide spectrum, fast imaging speed, and good spatial and temporal resolution.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119509696A_ABST
    Figure CN119509696A_ABST
Patent Text Reader

Abstract

The invention discloses a multi-spectral imaging system and method in a single-pixel type ultraviolet-visible-infrared wide spectral range. The system comprises a light source module, a modulation device, a lens group, a multi-spectral detection module, a multi-channel data acquisition module and a data processing module, according to the invention, a plurality of narrow-band detectors with different spectral responses are introduced into the multispectral detection module, so that additional light splitting devices and light filtering devices are avoided, parameters such as view fields, view angles and pixel numbers of images obtained by using different narrow-band detectors are completely the same, the problem of image registration does not exist, and data analysis and image fusion are facilitated; in addition, the size of the narrow-band detector is basically not limited and can reach the centimeter magnitude, and the imaging capability is improved under the condition of weak light. The multispectral imaging system provided by the invention has the characteristics of single-pixel imaging, large number of spectrums, wide spectral range, high imaging speed, good temporal-spatial resolution and small size.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of multispectral imaging, and in particular relates to a single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging system and an imaging method. Background Art

[0002] Traditional optical imaging systems use array silicon photodetectors (such as CCD and CMOS). Array detectors usually have more than one million pixels. The preparation of high-resolution multispectral imaging is often complex and expensive. In addition, the size of a single image sensor pixel in an array detector is usually very small, resulting in poor imaging capabilities under low-light conditions, especially in multispectral imaging, where only a portion of the energy in a narrow spectral range can be used. The size of a single-point detector can reach the centimeter level, and the imaging capability under low-light conditions is significantly improved, but this improvement still has certain limitations. In extremely low-light or long-distance imaging scenes, even large-sized single-point detectors may face the problem of insufficient light collection efficiency. The light collection area of ​​a single detector is still limited relative to the entire imaging scene, which limits its performance in capturing weak signals. In traditional imaging, image sensors do not have spectral resolution capabilities. In order to achieve spectral resolution, narrow-band single-wavelength array detectors can be made or composite light can be split and filtered. For narrow-band single-wavelength array detectors, specific materials are required to achieve the required wavelength selectivity. Silicon detectors have been significantly reduced in cost due to their large production scale and mature technology. However, to achieve better spectral resolution, it is often very expensive to make narrow-band single-wavelength detectors or array detectors based on other materials. In the prior art, the use of spectroscopic devices such as prisms, gratings, and interferometers usually increases the complexity of the system and affects the overall size of the system. Commonly used filter devices include rotary filters, linear gradient filters, acousto-optic tunable filters, etc., but after using these filter devices, the number of spectra available to the system is reduced, and it takes a long time to switch the filter wavelength, which will cause the imaging speed to slow down. Due to the differences in the band gaps of various semiconductor materials, each material has its specific optimal wavelength response range. For example, the response range of silicon is about 300-1100nm, while the response range of arsenic is about 900-2000nm. Therefore, in order to achieve multispectral imaging with a wide spectral range, multiple multispectral cameras have to be used to shoot the same object from different angles. However, this method is not only bulky, but also the number of pixels and shooting angles of different cameras may be different, resulting in registration problems in the synthesized image.

[0003] Tian Jie et al. (Hu Z, Fang C, Li B, et al. First-in-human liver-tumour surgery guided by multispectral fluorescence imaging in the visible and near-infrared-I / II windows[J]. Nature Biomedical Engineering, 2020, 4(3): 1-13. DOI: 10.1038 / s41551-019-0494-0.) proposed the first human liver tumor surgery guided by multispectral fluorescence imaging in the visible and near-infrared I / II windows. The article used three cameras: a visible light camera, a near-infrared I zone camera, and a near-infrared II zone camera. Since the number of pixels and shooting angles of different cameras may be different, there is an image registration problem, which brings difficulties to image fusion and image analysis. Summary of the invention

[0004] In order to overcome the shortcomings of the above-mentioned prior art, the purpose of the present invention is to provide a single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging system and imaging method. By introducing multiple narrow-band detectors with different spectral responses, the present invention can avoid adding additional spectroscopic devices and filtering devices compared with traditional multispectral imagers, and the field of view, viewing angle, number of pixels and other parameters of the images obtained using different narrow-band detectors are exactly the same, there is no image registration problem, and data analysis and image fusion are convenient; in addition, the size of the narrow-band detector is basically not limited and can reach the centimeter level, which can improve the imaging capability under weak light conditions; the multispectral imaging system of the present invention has the characteristics of single-pixel imaging, a large number of spectra, a wide spectral range, fast imaging speed, good temporal and spatial resolution and small size.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] A single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging system, comprising:

[0007] Light source module 1: used to emit uniform light, the uniform light output end of the light source module 1 is connected to the uniform light input end of the modulation device 2;

[0008] Modulator 2: modulates the uniformly distributed outgoing light according to the loaded modulation matrix to convert it into structured light. The structured light emitted by the modulator 2 is converged onto the imaging object 4 through the lens group 3;

[0009] Lens group 3: used to converge the structured light onto the imaging object 4, and the structured light reflected by the imaging object 4 is focused onto the multi-spectral detection module 5;

[0010] Multi-spectral detection module 5: used to detect optical signals and convert them into photoelectric signals covering the ultraviolet-visible-infrared bands;

[0011] Multi-channel data acquisition module 7: used for collecting photoelectric signals, the photoelectric signal output end of the multi-channel data acquisition module 7 is connected to the photoelectric signal input end of the data processing module 8;

[0012] Data processing module 8: used to control the modulation process of the modulation device 2 and the sampling rate when the multi-channel data acquisition module 7 collects the photoelectric signal, and processes the photoelectric signal collected by the multi-channel data acquisition module 7 to obtain a multispectral image in a wide spectral range of ultraviolet-visible-infrared.

[0013] The uniform light in the light source module 1 is natural light or broad-spectrum light, and the wavelength of the broad-spectrum light covers a range from ultraviolet to infrared.

[0014] The modulation device 2 is a digital micromirror array modulator (DMD).

[0015] The modulation matrix loaded by the modulation device 2 is a random speckle matrix, a Hadamard matrix or a Fourier matrix.

[0016] The lens group 3 includes a condenser and a reflector. The structured light is condensed onto the reflector through the condenser and then reflected onto the imaging object 4 .

[0017] The multi-spectral detection module 5 is a barrel-shaped structure, including a barrel-shaped shell 10, inside which a plurality of narrow-band detectors 9 with different spectral responses are arranged, and the plurality of narrow-band detectors 9 are arranged in a concentric circle manner to form a plurality of detection rings, each detection ring corresponding to a specific spectral range; the number of narrow-band detectors 9 in the multi-spectral detection module 5 corresponds one-to-one to the number of channels of the multi-channel data acquisition module 7.

[0018] The multi-spectral imaging system further comprises an amplifying module 6 for amplifying the photoelectric signal output by the multi-spectral detection module 5 . The photoelectric signal output end of the amplifying module 6 is connected to the photoelectric signal input end of the multi-channel data acquisition device 7 .

[0019] The data processing module 8 uses a single pixel restoration algorithm to reconstruct the photoelectric signal collected by the multi-channel data acquisition module 7 and restore it into a multispectral image; an image superposition algorithm or a signal superposition algorithm is used to superimpose and synthesize the multispectral image; and then an image fusion algorithm is used to synthesize a multispectral image with a wide spectral range of ultraviolet, visible and infrared.

[0020] A single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging method, comprising:

[0021] Step 1: Obtain uniformly distributed output light through the light source module 1;

[0022] Step 2: Determine the modulation matrix type, and modulate the uniformly distributed outgoing light to convert it into structured light by adjusting the determined modulation matrix pattern, and then converge it onto the multi-spectral detection module 5 to detect the photoelectric signal;

[0023] Step 3: directly collecting the photoelectric signal detected in step 2 through the multi-channel data acquisition module 7 and storing it in the data processing module 8; or, amplifying the photoelectric signal detected in step 2 through the amplification module 6, and then collecting it through the multi-channel data acquisition module 7 and storing it in the data processing module 8;

[0024] Step 4: The photoelectric signal stored in the data processing module 8 in step 3 is reconstructed using a single pixel restoration algorithm to restore it into a multispectral image; then the multispectral image is superimposed and synthesized using an image superposition algorithm or a signal superposition algorithm; finally, the image fusion algorithm is used to fuse the image to synthesize a multispectral image covering a wide spectral range of ultraviolet, visible and infrared.

[0025] In step 2, the number of playbacks, the playback rate, and the number of sampling points of the modulation matrix pattern are adjusted to control the modulation device 2 to change the light intensity distribution of the evenly distributed output light, thereby obtaining structured light.

[0026] Compared with the prior art, the present invention has the following beneficial effects:

[0027] 1. Compared with the existing high-density array detectors with complex processes, the present invention adopts a multi-spectral detection module with a barrel-shaped structure composed of multiple narrow-band detectors, so that each narrow-band detector only captures light within a specific wavelength range, which significantly improves the imaging ability of the imaging system under weak light conditions; in addition, the barrel-shaped structure further enhances the sensitivity of the narrow-band detector to weak light by increasing the light collection area, so that the performance of the entire imaging system in capturing weak signals is significantly improved; the use of narrow-band detectors can avoid adding additional spectroscopic devices or filtering devices, simplify the complexity of the system, reduce the system size, and improve the imaging speed; at the same time, multiple narrow-band detectors can cover multiple different spectral ranges, allowing information from multiple spectral bands to be obtained simultaneously, increasing the number and range of spectra.

[0028] 2. The present invention generates light signals by arranging a plurality of narrow-band detectors with different spectral responses in a multi-spectral detection module and converting the light signals into photoelectric signals covering the ultraviolet-visible-infrared bands. At the same time, a single-pixel restoration algorithm is used in a data processing module to reconstruct the photoelectric signals to obtain a multi-spectral image, thereby avoiding the addition of additional spectroscopic devices and filtering devices, and solving the technical problems of large system volume, slow imaging speed, and small number of spectra. Moreover, in single-pixel imaging, the parameters such as the field of view, viewing angle, and number of pixels of images obtained using different narrow-band detectors are exactly the same, and there is no image registration problem, which facilitates data analysis and image fusion.

[0029] 3. The present invention improves the intensity of the photoelectric signal by adopting an amplification module, ensuring that the signal will not lose information due to attenuation during transmission, which helps the multi-channel data acquisition module to collect the photoelectric signal; in addition, the amplification module significantly improves the signal-to-noise ratio of the system, ensuring the clarity and reliability of the photoelectric signal, thereby optimizing the overall system performance.

[0030] In summary, compared with the traditional multi-spectral imager, the present invention can avoid adding additional spectroscopic devices and filtering devices by introducing multiple narrow-band detectors with different spectral responses, and the parameters such as the field of view, viewing angle, number of pixels, etc. of the images obtained using different narrow-band detectors are exactly the same, there is no image registration problem, and it is convenient for data analysis and image fusion; in addition, the size of the narrow-band detector is basically not limited and can reach the centimeter level, which can improve the imaging capability under weak light conditions; the multi-spectral imaging system of the present invention has the characteristics of single-pixel imaging, a large number of spectra, a wide spectral range, fast imaging speed, good temporal and spatial resolution, and a small size. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 This is a schematic structural diagram of a single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging system provided by the present invention.

[0032] Figure 2 This is a schematic structural diagram of the barrel-type multi-spectral detection module provided by the present invention.

[0033] In the figure: 1-light source module, 2-modulation device, 3-lens group, 4-imaging object, 5-multi-spectral detection module, 6-amplification module, 7-multi-channel data acquisition module, 8-data processing module, 9-narrow-band detector, barrel-shaped shell 10.

[0034] Figure 3 This is a flow chart of the multispectral image fusion model of CNN provided by the present invention.

[0035] Figure 4 The multispectral image before image fusion provided by the present invention; wherein, Figure 4(a) is the wavelength of 433.8nm, Figure 4 (b) is 515.2nm in wavelength, Figure 4 (c) is 539.4nm in wavelength, Figure 4 (d) The wavelength is 638.3nm. DETAILED DESCRIPTION

[0036] The technical solution of the present invention is described in detail below in conjunction with the accompanying drawings.

[0037] like Figure 1 As shown, a single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system comprises:

[0038] Light source module 1: used to emit uniform light, the uniform light output end of the light source module 1 is connected to the uniform light input end of the modulation device 2;

[0039] The uniform light is natural light or broad-spectrum light; a xenon lamp is used to emit broad-spectrum light; the model of the xenon lamp is Zhuoli Hanguang GLORIA-X450A, and its wavelength coverage ranges from ultraviolet to infrared;

[0040] Modulator 2: modulates the uniformly distributed outgoing light according to the loaded modulation matrix to convert it into structured light. The structured light emitted by the modulator 2 is converged onto the imaging object 4 through the lens group 3;

[0041] The modulation device 2 is a digital micromirror array modulator (DMD), which is composed of tens of thousands of independently flippable micromirror arrays, each of which can be flipped by ±12° on the array plane; the model of the digital micromirror array modulator (DMD) is the V-6501VIS spatial light modulator of ViALUX of Germany, which is composed of 1920×1080 digital micromirrors with a size of 7.56 μm, and can realize the modulation of light in the range of 400-2200 nm;

[0042] The modulation matrix loaded by the modulation device 2 is a random speckle matrix, a Hadamard matrix or a Fourier matrix;

[0043] In this embodiment, the modulation matrix adopts a Fourier matrix;

[0044] Lens group 3: used to converge the structured light onto the imaging object 4, including a condenser and a reflector. The structured light is converged onto the reflector through the condenser and then reflected onto the imaging object 4. The structured light reflected by the imaging object 4 is focused onto the multi-spectral detection module 5;

[0045] The condenser is LBTEK MAC4202; the reflector is a customized model of LBTEK, that is, the diameter is 25mm, the focal length is 100mm, and the wavelength coverage range is 350nm-2.1μm;

[0046] Multi-spectral detection module 5: used to detect optical signals and convert them into photoelectric signals covering the ultraviolet-visible-infrared bands. The photoelectric signal output end of the multi-spectral detection module 5 is connected to the photoelectric signal input end of the amplification module 6;

[0047] like Figure 2 As shown, the multi-spectral detection module 5 is a barrel-shaped structure, including a barrel-shaped shell 10, and a plurality of narrow-band detectors 9 with different spectral responses are arranged inside the barrel-shaped shell 10. The plurality of narrow-band detectors 9 are arranged in a concentric circle manner to form a plurality of detection rings, and each detection ring corresponds to a specific spectral range; the barrel-shaped structure enables each narrow-band detector 9 to capture only light within a specific wavelength range, significantly improving the imaging capability of the imaging system under weak light conditions; in addition, the barrel-shaped structure further enhances the sensitivity of the narrow-band detector 9 to weak light by increasing the light collection area, so that the performance of the entire imaging system in capturing weak signals is significantly improved;

[0048] Amplifying module 6: used to amplify the photoelectric signal output by the multi-spectral detection module 5, and the photoelectric signal output end of the amplifying module 6 is connected to the photoelectric signal input end of the multi-channel data acquisition device 7;

[0049] The amplification module 6 adopts an OPA1611 operational amplifier;

[0050] Multi-channel data acquisition module 7: used to collect photoelectric signals, the photoelectric signal output end of the multi-channel data acquisition module 7 is connected to the photoelectric signal input end of the data processing module 8; the number of narrow-band detectors 9 in the multi-spectral detection module 5 corresponds to the number of channels of the multi-channel data acquisition module 7;

[0051] The multi-channel data acquisition module 7 used adopts a multi-channel data acquisition card, model NI 6361, with a maximum single-ended analog input channel number of 16; the use of a multi-channel acquisition card not only ensures that multiple narrow-band detectors work simultaneously, but also meets the requirements for imaging speed;

[0052] Data processing module 8: used to control the modulation process of the modulation device 2 and the sampling rate when the multi-channel data acquisition module 7 collects the photoelectric signal, and processes the photoelectric signal collected by the multi-channel data acquisition module 7 to obtain a multispectral image in a wide spectral range of ultraviolet-visible-infrared; the data processing module 8 is a computer;

[0053] The processing process is as follows:

[0054] A single pixel restoration algorithm is used to reconstruct the photoelectric signal collected by the multi-channel data acquisition module 7 and restore it into a multispectral image; an image superposition algorithm or a signal superposition algorithm is used to superimpose and synthesize the multispectral image to eliminate the shadow caused by the angle limitation of the narrow-band detector 9; and then an image fusion algorithm is used to synthesize a multispectral image in a wide spectral range of ultraviolet, visible and infrared.

[0055] A single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging method, comprising:

[0056] Step 1: Obtain uniformly distributed output light through the light source module 1;

[0057] Step 2: Determine the modulation matrix type, and modulate the uniformly distributed outgoing light to convert it into structured light by adjusting the determined modulation matrix pattern, and then converge it onto the multi-spectral detection module 5 to detect the photoelectric signal;

[0058] By adjusting the number of playbacks, playback rate and sampling points of the modulation matrix pattern, the modulation device 2 is controlled to change the light intensity distribution of the evenly distributed output light to obtain structured light;

[0059] In this embodiment, the number of modulation matrix patterns played is 10,000, the playback rate is 100 frames / second, and the sampling rate of the multi-channel data acquisition device 7 is 100,000 Hz, that is, one modulation matrix pattern collects 1,000 points;

[0060] Step 3: directly collecting the photoelectric signal detected in step 2 through the multi-channel data acquisition module 7 and storing it in the data processing module 8; or, amplifying the photoelectric signal detected in step 2 through the amplification module 6, and then collecting it through the multi-channel data acquisition module 7 and storing it in the data processing module 8;

[0061] Step 4: The photoelectric signal stored in the data processing module 8 in step 3 is reconstructed using a single pixel restoration algorithm to restore it into a multispectral image; then the multispectral image is superimposed and synthesized using an image superposition algorithm or a signal superposition algorithm to eliminate the shadow caused by the angle limitation of the narrow-band detector; finally, the image fusion algorithm is used to fuse the image to synthesize a multispectral image with a wide spectral range of ultraviolet, visible and infrared;

[0062] The image reconstruction process is as follows:

[0063] In the spatial domain, the basic component element of an image is a pixel, and in the Fourier domain, the basic component element of an image is a Fourier coefficient. To obtain a Fourier coefficient C (fx, fy) in the Fourier spectrum of a multispectral image, a modulation device 2 is used to project four Fourier matrix patterns with spatial frequencies (fx, fy) and initial phases of 0, π / 2, π, and 3π / 2, respectively, onto an imaging object 4, and the corresponding four response values ​​D1, D2, D3, and D4 are obtained through a multispectral detection module 5. Finally, the required Fourier coefficient is calculated by the formula, which is as follows:

[0064] C(fx,fy)=[D1(fx,fy)-D3(fx,fy)]+j[D2(fx,fy)-D4(fx,fy)]

[0065] Among them, x, y represent the rectangular coordinates of the plane where the imaging object is located, and f x and f y are the spatial frequencies corresponding to the x and y directions, respectively, C(fx, fy) represents the Fourier coefficient, D1, D2, D3 and D4 represent the Fourier matrix patterns with spatial frequencies (fx, fy) and initial phases of 0, π / 2, π, 3π / 2, and the corresponding four response values ​​are obtained by the multi-spectral detection module 5, and j represents an imaginary number;

[0066] Each Fourier coefficient C(fx,fy) can be obtained by projecting four Fourier matrix patterns with the same spatial frequency and initial phases of 0, π / 2, π, and 3π / 2 onto the imaging object; by projecting four-step phase-shifted Fourier matrix patterns with different spatial frequencies onto the target object, the Fourier coefficients corresponding to different spatial frequencies in the Fourier spectrum of the imaging object image can be obtained; the inverse Fourier transform is performed on the obtained object image Fourier spectrum to realize the reconstruction of the multispectral image I(x,y), and the expression is as follows:

[0067] I(x,y)=F- 1 {C(fx,fy)}

[0068] =F- 1 {[D1(fx,fy)-D3(fx,fy)]+j[D2(fx,fy)-D4(fx,fy)]}

[0069] Among them, F- 1 {*} denotes inverse Fourier transform;

[0070] The multispectral images are superimposed and synthesized by using an image superposition algorithm or a signal superposition algorithm to eliminate the shadows caused by the angle limitation of the narrow-band detector 9; the image superposition algorithm process is as follows:

[0071] By analyzing the standard deviation and mean of the image, the shadow area is identified; the shadow area usually has a lower reflectivity and a higher standard deviation; the signals obtained by a single narrow-band detector are superimposed according to a specific weight to enhance the characteristics of the non-shadow area and suppress the shadow area; by comparing the superimposed signal with the original signal, the shadow area is identified and corrected, thereby effectively eliminating the shadow and improving the quality of the multispectral image;

[0072] The basic principle of the signal superposition algorithm can be described by the following expression:

[0073] y(t)=x1(t)+x2(t)+x3(t)+x4(t)+...x n (t)

[0074] Among them, y(t) represents the output signal after superposition, x1(t), x2(t), x3(t)…x n (t) represents the output signal of a single narrowband detector, x n (t) is composed of the response value obtained by the multi-spectral detection module 5;

[0075] The image fusion process is as follows:

[0076] The image fusion method is used to fuse the shadow-free multispectral images, and a multispectral image fusion model based on CNN is adopted, such as Figure 3 As shown in the figure, by designing the network structure and loss function, end-to-end feature extraction, feature fusion and image reconstruction are achieved, thus avoiding the tediousness of manually designing fusion rules; the network layer contains multiple convolutional layers, which are responsible for extracting features from the input multispectral image; the loss function is constructed by measuring the similarity between the input n multispectral images and the multispectral fusion image to guide the network to perform end-to-end training; finally, the fused multispectral images in the ultraviolet-visible-infrared wide spectral range are output, and these images are enhanced in spatial resolution and spectral information.

[0077] Figure 4 The multispectral image before image fusion provided by the present invention is as follows: Figure 4 As shown, narrow-band detectors combined with single-pixel imaging algorithms can achieve multi-spectral imaging. Figure 4 Different colored gourds have different responses to different wavelengths of light. Multispectral images can see what color images (RGB, i.e. 3-spectral imaging) cannot see. It can simultaneously obtain image information and spectral information of the object to be tested, and has the advantage of unified image and spectrum. It can play an important role in agriculture, industrial testing, medical and health industry, basic scientific research, cutting-edge technological exploration and military applications.

Claims

1. A single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging system, characterized in that: include: A light source module (1) is used to emit uniform light, and a uniform light output end of the light source module (1) is connected to a uniform light input end of the modulation device (2); A modulation device (2) modulates the uniformly distributed output light according to the loaded modulation matrix to convert it into structured light. The structured light emitted by the modulation device (2) is converged onto the imaging object (4) through the lens group (3); A lens group (3) is used to converge the structured light onto the imaging object (4), and the structured light reflected by the imaging object (4) is focused onto the multi-spectral detection module (5); Multi-spectral detection module (5): used for detecting optical signals and converting the optical signals into photoelectric signals covering the ultraviolet-visible-infrared band; A multi-channel data acquisition module (7): used for collecting photoelectric signals, the photoelectric signal output end of the multi-channel data acquisition module (7) is connected to the photoelectric signal input end of the data processing module (8); The data processing module (8) is used to control the modulation process of the modulation device (2) and the sampling rate of the multi-channel data acquisition module (7) when collecting photoelectric signals, and to process the photoelectric signals collected by the multi-channel data acquisition module (7) to obtain a multi-spectral image in a wide ultraviolet-visible-infrared spectral range.

2. A single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1, characterized in that: The uniform light in the light source module (1) is natural light or broad-spectrum light, and the wavelength of the broad-spectrum light covers a range from ultraviolet to infrared.

3. The single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1, characterized in that: The modulator (2) is a digital micromirror array modulator (DMD).

4. A single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1 or 3, characterized in that: The modulation matrix loaded by the modulation device (2) is a random speckle matrix, a Hadamard matrix or a Fourier matrix.

5. The single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1, characterized in that: The lens group (3) comprises a condenser and a reflector, and the structured light is concentrated onto the reflector through the condenser and then reflected onto the imaging object (4).

6. The single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1, characterized in that: The multi-spectral detection module (5) is a barrel-shaped structure, comprising a barrel-shaped shell (10), wherein a plurality of narrow-band detectors (9) having different spectral responses are arranged inside the barrel-shaped shell (10), wherein the plurality of narrow-band detectors (9) are arranged in a concentric circle manner to form a plurality of detection rings, each detection ring corresponding to a specific spectral range; and the number of narrow-band detectors (9) in the multi-spectral detection module (5) corresponds one-to-one to the number of channels of the multi-channel data acquisition module (7).

7. The single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1, characterized in that: The multi-spectral imaging system further comprises an amplification module (6) for amplifying the photoelectric signal output by the multi-spectral detection module (5); the photoelectric signal output end of the amplification module (6) is connected to the photoelectric signal input end of the multi-channel data acquisition device (7).

8. The single-pixel ultraviolet-visible-infrared wide spectral range multi-spectral imaging system according to claim 1, characterized in that: The data processing module (8) uses a single pixel restoration algorithm to reconstruct the photoelectric signal collected by the multi-channel data collection module (7) to restore it into a multispectral image; uses an image superposition algorithm or a signal superposition algorithm to superimpose and synthesize the multispectral image; and then uses an image fusion algorithm to synthesize the multispectral image in the ultraviolet-visible-infrared wide spectral range.

9. A single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging method, characterized in that: include: Step 1: Obtaining uniformly distributed output light through the light source module (1); Step 2: Determine the modulation matrix type, and modulate the uniformly distributed outgoing light by adjusting the determined modulation matrix pattern to convert it into structured light, and then converge it onto the multi-spectral detection module (5) to detect the photoelectric signal; Step 3: directly collecting the photoelectric signal detected in step 2 through the multi-channel data acquisition module (7) and storing it in the data processing module (8); or, amplifying the photoelectric signal detected in step 2 through the amplification module (6), and then collecting it through the multi-channel data acquisition module (7) and storing it in the data processing module (8); Step 4: The photoelectric signal stored in the data processing module (8) in step 3 is reconstructed using a single pixel restoration algorithm to restore it into a multispectral image; then the multispectral image is superimposed and synthesized using an image superposition algorithm or a signal superposition algorithm; finally, the image fusion algorithm is used to fuse the images to synthesize a multispectral image covering a wide spectral range of ultraviolet, visible and infrared.

10. The single-pixel ultraviolet-visible-infrared wide spectral range multispectral imaging method according to claim 9, characterized in that: In the step 2, the number of playbacks, the playback rate and the number of sampling points of the modulation matrix pattern are adjusted to control the modulation device (2) to change the light intensity distribution of the evenly distributed output light, thereby obtaining structured light.

Citation Information

Patent Citations

  • Ultra-weak light multispectral imaging method and system

    CN102353449A

  • Mixed material multispectral staring array sensor

    CN103808409A

  • Single-pixel imaging system and method based on array light source

    CN106019307A

  • Single-pixel multispectral imaging method and device based on macro-pixel segmentation

    CN113048907A

  • Multispectral camera based on computational imaging

    CN114923569A

Cited By

  • Multispectral camera based on computational imaging

    CN114923569A

  • A multispectral camera based on computational imaging

    CN114923569B