Visible infrared hyperspectral imaging device and method

Abstract

The invention discloses a visible infrared hyperspectral imaging device and method, and the device comprises an FPI light filtering assembly and an RGB image sensor, and is characterized in that the device also comprises a filtering part and a main control unit, and the filtering part is connected with the main control unit; the filtering component comprises at least two optical filters containing different light transmission range parameters or at least two light sources containing different wavelength range parameters; the main control unit is configured to be used for switching the optical filter or the light source in the filtering component and controlling the mirror surface of the FPI filtering assembly to move under the corresponding optical filter or the light source, continuous spectral image output of 400-lambda nm is achieved, and lambda is larger than 780 nm and smaller than or equal to 1000 nm. And the mirror surface spacing of the FPI light filtering assembly is matched with the switching light filter assembly / light source assembly, so that the influence of a secondary peak can be effectively eliminated.

Description

Technical Field

[0001] The present invention belongs to the technical field of image detection, and in particular relates to a visible infrared hyperspectral imaging device and method. Background Art

[0002] The hyperspectral imaging system divides an object or scene into many small spectral pixels and collects a continuous spectral data at each pixel. Each pixel records the intensity or reflectivity of light in the entire spectral range. The collected spectral data is combined with the position information of each pixel to form a hyperspectral image.

[0003] Compared with traditional color imaging, hyperspectral imaging can provide more detailed and comprehensive information. It can capture more spectral details, allowing users to analyze and identify different materials, components and features in objects or scenes. Hyperspectral imaging can identify and classify different substances by analyzing the spectral characteristics of objects or scenes. This is of great significance in fields such as agriculture, environmental monitoring, geological exploration, and medical diagnosis. Hyperspectral imaging systems can provide high spectral resolution while maintaining high spatial resolution. This means that detailed spatial information and spectral information can be obtained at the same time, making the analysis more accurate and reliable. Hyperspectral imaging can be performed at a long distance and without contact, without intervention or contact with the observed object. This is very valuable in certain application scenarios, such as long-distance remote sensing, aerospace, etc.

[0004] Hyperspectral imaging is widely used in agriculture, environmental monitoring, geological exploration, meteorology, remote sensing, medicine, etc. It can be used for soil analysis, crop health monitoring, mineral exploration, climate change research, pathological diagnosis, etc., providing important tools and data sources for scientific research and engineering applications.

[0005] The adjustable Fabry-Perot filter (FPI) is a narrow-band adjustable filter, which consists of a pair of high-reflectivity mirrors that are parallel to each other and at a certain distance, and a power device to adjust the distance between the two. According to the principle of interference, a group of plane mirrors with different spacing can filter different wavelengths, so the output wave can be controlled by adjusting the spacing between the parallel mirrors of the cavity. Due to the small size and low cost of the FPI filter component, by replacing the current transmission grating for spectroscopy, it can greatly simplify the structure of the hyperspectral imaging system and realize the miniaturization of the hyperspectral system.

[0006] Since the free spectral range of FPI is FSR=λm-λm+1=λ2 / 2L, it can be seen from the formula that the smaller the spacing, the larger the free spectral range. At the same time, when the spacing is constant, the first-level peak spectrum is used, and the free spectral range is the largest. Therefore, in order to achieve a spectral output of 400-1000nm, the most ideal way is to make the spacing of FPI between 200-500nm, but there is overlap between the first-level peak and the second-level peak at 400-500nm, and continuous filtering cannot be achieved. At the same time, when the FPI spacing is smaller, the process requirements are higher and the stability is worse. Therefore, in practical applications, it is hoped that the FPI spacing is as large as possible to reduce the process requirements. Therefore, how to enable FPI to achieve a spectral output of 400-1000nm is the key point in realizing the FPI hyperspectral camera.

[0007] At present, the existing patent CN 113884186 A discloses the combination of RGB image sensor and FPI filter component to realize the output of high-spectral image in the visible light band of 400-780nm, but it cannot realize the spectral image greater than 780nm. Summary of the invention

[0008] In order to solve the problem that it is difficult to achieve a high-spectrum output of 400-1000nm within a large spacing range of FPI, the present invention provides a visible infrared hyperspectral imaging device and method to solve the above-mentioned technical defects.

[0009] In the first aspect, the present invention proposes a visible infrared hyperspectral imaging device, including an FPI filter assembly and an RGB image sensor, characterized in that it also includes a filtering component and a main control unit, and the filtering component and the main control unit are connected; the filtering component includes at least two filters with different transmittance range parameters or at least two light sources with different wavelength range parameters; the main control unit is configured to switch the filters or light sources in the filtering component, and control the mirror of the FPI filter assembly to move under the corresponding filter or light source, so as to achieve 400-λnm continuous spectrum image output, wherein 780nm<λ≤1000nm.

[0010] Preferably, the RGB image sensor includes spectral response bands of R channel, G channel and B channel, the spectral response band of the R channel is R1 to 1000nm, the spectral response band of the G channel is G1 to 1000nm, and the spectral response band of the B channel is 400nm to B1, B2 to 1000nm; R1, G1, B2 are preset starting response wavelengths corresponding to the R channel, G channel and B channel in the RGB image sensor, and B1 is a preset cutoff response wavelength corresponding to the B channel in the RGB image sensor.

[0011] Preferably, the filtering component includes a first filter whose transmittance range parameters at least include the R1-2λ / 3nm band, and a second filter whose transmittance range parameters at least do not include the R1-2λ / 3nm band; wherein the transmittance range parameters of the first filter and the second filter overlap to cover the 400-λnm band, 780nm<λ≤1000nm.

[0012] Preferably, the transmittance range parameter of the first filter is 400-L1nm band, the transmittance range parameter of the second filter is L2-1000nm band, L1≥L2, L1<3R1 / 2, L2>2λ / 3.

[0013] Preferably, the transmittance range parameter of the first filter is 400-L1nm band, the transmittance range parameter of the second filter is L2-1000nm band, L1≥L2, L1>3R1 / 2, L2>2λ / 3.

[0014] Preferably, the light transmission range parameter of the first filter is 400-L1nm band, the light transmission range parameter of the second filter is L2-1000nm band, B2≥L1≥L2, L2>2λ / 3; the main control unit is configured to control the mirror of the FPI filter assembly to move once at the L1-900nm spacing under different filters, and the mirror spacing of the FPI filter assembly is above 600nm. Further reducing the moving distance of the FPI, under different light sources, the mirror spacing of the FPI filter assembly is moved to a partial spacing twice, and the output of different level peaks can be achieved.

[0015] Preferably, the light transmission range parameter of the first filter is 400-L1nm, the light transmission range parameter of the second filter is L2-1000nm, B2>L1>3G1 / 2, L2>2λ / 3. In order to make the 2L1 / 3-2B2 / 3 band have a stronger response in the G channel, 2L1 / 3>G1, that is, L1>3G1 / 2.

[0016] Preferably, the filtering component includes a first light source with a wavelength range parameter of R1-2λ / 3nm spectrum, a second light source with a wavelength range parameter of a spectrum outside R1-2λ / 3nm, and the combined spectrum of the first light source and the second light source overlaps and covers 400-λnm, 780nm<λ≤1000nm.

[0017] Preferably, the wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, L1≥L2, L1≥3R1 / 2, L2>2λ / 3.

[0018] Preferably, the wavelength range parameter of the first light source is 400-L1 nm, the wavelength range parameter of the second light source is L2-1000 nm, 3R1 / 2>L1≥L2, L2>2λ / 3.

[0019] Preferably, the wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, B2≥L1≥L2, L2>2λ / 3; the main control unit is configured to control the mirror of the FPI filter assembly to move once at the L1-900nm interval under different light sources. Further reducing the moving distance of the FPI, the mirror interval of the FPI filter assembly is moved to a partial interval twice under different light sources, so that the output of different level peaks can be achieved.

[0020] Preferably, the wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, 3G1 / 2<L1<B2, L2>2λ / 3 and L1≥L2. In order to make the 2L1 / 3-2B2 / 3 band have a stronger response in the G channel, 2L1 / 3>G1, that is, L1>3G1 / 2.

[0021] Preferably, the main control unit is also configured to capture and store the spectral response images of the R channel, G channel and B channel respectively received by the RGB image sensor during the process of controlling the movement of the FPI filter component, and process the spectral response images of the R channel, G channel and B channel respectively to obtain continuous hyperspectral images.

[0022] In a second aspect, an embodiment of the present invention provides a visible infrared hyperspectral imaging method using the above device, comprising:

[0023] Based on the filtering characteristics of the FPI filter assembly and the RGB image sensor, a 400-λnm spectral output RGB three-channel spectral response curve is constructed, where 780nm<λ≤1000nm;

[0024] Based on the spectral response characteristics corresponding to the R channel, the G channel and the B channel in the RGB three-channel spectral response curve, selecting at least two filters with different light transmittance range parameters for filtering out the secondary peaks of the corresponding channels in the filtering component, or selecting at least two light sources with different wavelength ranges for filtering out the secondary peaks of the corresponding channels;

[0025] Based on the main control unit, the optical filter or light source in the filter component is switched, and the mirror of the FPI filter assembly is controlled to move under the corresponding optical filter or light source;

[0026] Capture and store spectral response images corresponding to the R channel, G channel, and B channel received by the RGB image sensor;

[0027] The spectral response images corresponding to the R channel, the G channel, and the B channel are processed to obtain continuous hyperspectral images.

[0028] Compared with the prior art, the beneficial results of the present invention are:

[0029] The technical solution of the present invention is based on adjustable FPI hyperspectral imaging, has a simple structure, can simultaneously achieve high spectral resolution and high spatial resolution, adopts existing RGB image sensors, has a simple process, can be quickly industrialized, and has low cost; when the mirror of the FPI filter component moves, the filter component / light source component is switched to effectively eliminate the influence of the secondary peak, and ensure that the high spectral output of 400-1000nm is achieved within a large spacing range of FPI, thereby achieving continuous output of the spectrum. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings are included to provide a further understanding of the embodiments and are incorporated into and constitute a part of this specification. The accompanying drawings illustrate the embodiments and are used together with the description to explain the principles of the present invention. It will be easy to recognize other embodiments and many expected advantages of the embodiments because they become better understood by reference to the following detailed description. The elements of the drawings are not necessarily to scale with each other. The same reference numerals refer to corresponding similar parts.

[0031] Figure 1 is a schematic structural diagram of a visible infrared hyperspectral imaging device according to an embodiment of the present invention;

[0032] Figure 2 It is a schematic diagram of the spectral response curves of the RGB three channels in the visible infrared hyperspectral imaging method of an embodiment of the present invention;

[0033] Figure 3 Schematic diagram of the process of the visible infrared hyperspectral imaging method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0034] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0035] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0036] In order to meet the output requirements of a 400-1000nm hyperspectral spectrum within a large FPI spacing range, the visible infrared hyperspectral imaging method of the present invention is designed. The embodiment of the present invention combines the filtering of the FPI with the RGB filter of the image sensor, and switches the filter assembly / light source assembly while changing the FPI filtering spacing, so as to achieve 400-1000nm hyperspectral imaging within a large FPI spacing range.

[0037] In a first aspect, this embodiment discloses a visible infrared hyperspectral imaging device, such as Figure 1 As shown, the device includes an FPI filter component 31, an RGB image sensor 32, a filter component 34 and a main control unit 33, and the filter component 34 is connected to the main control unit 33; the filter component 34 includes at least two filters with different transmittance range parameters or at least two light sources with different wavelength range parameters; the main control unit 33 is configured to switch the filter or light source in the filter component 34, and control the mirror of the FPI filter component 31 to move under the corresponding filter or light source.

[0038] Figure 2 Schematic diagram of spectral response curves of RGB three channels in the visible infrared hyperspectral imaging method of an embodiment of the present invention, refer to Figure 2 The RGB image sensor 32 includes spectral response bands of the R channel, the G channel and the B channel. The spectral response band of the R channel is R1 to 1000nm, the spectral response band of the G channel is G1 to 1000nm, and the spectral response band of the B channel is 400nm to B1, B2 to 1000nm; R1, G1, B2 are the preset starting response wavelengths corresponding to the R channel, G channel and B channel in the RGB image sensor 32, and B1 is the preset cutoff response wavelength corresponding to the B channel in the RGB image sensor 32. According to the spectral response characteristics of different channels, the peaks formed by the spacing of the FPI filter component 31 are analyzed to obtain Table 1; as shown in Table 1, when the mirror spacing of the FPI filter component 31 moves from 400nm to 800nm, individual band images of 400-1000nm can be directly output from each channel, but since the smaller the spacing of the FPI filter component 31, the worse the stability of the FPI filter component 31, it is hoped to achieve a high spectral output of 400-1000nm within a large spacing range of the FPI filter component 31.

[0039] Table 1

[0040]

[0041]

[0042] In this embodiment, according to the spectral response characteristics of the FPI mirror spacing corresponding to the R channel, the G channel, and the B channel in Table 1, the first filter including at least the R1-2λ / 3nm band and the second filter whose light transmission range parameter does not include the R1-2λ / 3nm band are selected as the filter component 34; wherein the light transmission range parameters of the first filter and the second filter are superimposed to cover the 400-λnm band, 780nm<λ≤1000nm. And the main control unit 33 is also connected to the filter switching device, and the switching of different filters is controlled by the filter switching device;

[0043] It should be noted that an optical filter is an optical film used to allow light in a specific spectral range to pass through.

[0044] Specifically, the filter switching device is a filter wheel or a dual filter switch or other power structure for implementing filter switching.

[0045] Optionally, a first filter and a second filter with corresponding transmittance range parameters are selected according to Table 1, the transmittance range parameter of the first filter is 400-L1nm band, the transmittance range parameter of the second filter is L2-1000nm band, L1≥L2, L1<3R1 / 2, L2>2λ / 3.

[0046] In actual use, the first filter is preferably used. When the mirror spacing of the FPI filter component 31 is at 500-R1nm, the G channel outputs a 500-600nm spectral image; when the mirror spacing of the FPI filter component 31 is at 600-L1nm, B outputs a spectral image of 400-2B2 / 3nm, and the R channel outputs a spectral image of 600-L1nm; at this time, switch the filter to the second filter, adjust the FPI spacing at L1-λ, and output the spectral image of L1-λ through the R channel, so as to filter out the secondary peak and achieve the effect of 400-λnm, 780nm<λ≤1000nm high spectral output.

[0047] Optionally, the light transmission range parameter of the first filter is 400-L1nm band, the light transmission range parameter of the second filter is L2-1000nm band, L1≥L2, L1>3R1 / 2, L2>2λ / 3. The first filter and the second filter with the light transmission range parameter can also achieve the effect of filtering out the secondary peak.

[0048] In actual use, the first filter is preferably used. When the mirror spacing of the FPI filter component 31 is at 500-R1nm, the G channel outputs a 500-600nm spectral image; when the mirror spacing of the FPI filter component 31 is at 600-3R1 / 2nm, B outputs a spectral image of 400-2B2 / 3nm, and the R channel outputs a spectral image of 600-3R1 / 2; at this time, switch the filter to the second filter, adjust the FPI spacing to 3R1 / 2-λ, and output a spectral image of 3R1 / 2-λ through the R channel, so as to filter out the secondary peak and achieve the effect of 400-λnm, 780nm<λ≤1000nm high spectral output.

[0049] Optionally, the light transmission band of the first filter includes R1-2λ / 3nm, and the second filter filters the band of R1-2λ / 3nm;

[0050] In actual use, it can be found from Table 1 that when the mirror spacing of the FPI filter component 31 is between G1-R1, there are two peaks in the G channel and one peak in the R channel, and the spectral responses of the G and R channels are fixed. Therefore, the main control unit 33 is configured to obtain the spectrum of the G1-R1 band through mathematical calculation, so that the mirror spacing of the FPI filter component 31 can be increased to R1; the first filter is preferably used, and when the mirror spacing of the FPI filter component 31 is between R1-600nm, the G channel outputs the R1-600nm spectral image; when the mirror spacing of the FPI filter component 31 is between When it is at 600-3R1 / 2nm, B outputs a spectral image of 400-2B2 / 3nm, and the R channel outputs a spectral image of 600-3R1 / 2nm. The main control unit 33 is configured to calculate the spectral images of the G and R channels at this time to obtain a spectral image of 2B2 / 3nm-R1; at this time, the filter is switched to the second filter, and the FPI spacing is adjusted to 3R1 / 2-2λ / 3nm. The spectral image of 3R1 / 2-2λ / 3nm is output through the R channel, and the secondary peak can be filtered out to achieve the effect of 400-λnm, 780nm<λ≤1000nm high-spectral output.

[0051] Optionally, in order to further reduce the mirror movement distance of the FPI filter assembly 31, it can move to a partial spacing twice under different light sources to achieve the output of different levels of peaks; the wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, B2≥L1≥L2, L2>2λ / 3; the main control unit is configured to control the mirror of the FPI filter assembly to move once at the L1-900nm spacing under different light sources.

[0052] In actual use, as shown in Table 2, the FPI mirror spacing is run twice at L1-900nm to output a 400-λnm full spectrum image.

[0053] Table 2

[0054]

[0055] Optionally, in order to make the 2L1 / 3-2B2 / 3 band have a stronger response in the G channel, 2L1 / 3>G1, that is, L1>3G1 / 2; the wavelength range parameter of the first light source is selected as 400-L1nm, the wavelength range parameter of the second light source is selected as L2-1000nm, 3G1 / 2<L1<B2, L2>2λ / 3 and L1≥L2. In order to make the 2L1 / 3-2B2 / 3 band have a stronger response in the G channel, 2L1 / 3>G1, that is, L1>3G1 / 2. The first filter and the second filter with this parameter are switched in coordination, and the mirror spacing of the FPI filter component 31 and the spectral responses of the three channels of R, G, and B are shown in Table 3, which can output a 400-λnm full-spectrum image.

[0056] Table 3

[0057]

[0058] In another embodiment, according to the spectral response characteristics of the R channel, G channel and B channel corresponding to the FPI mirror spacing in Table 1, when the FPI mirror spacing is 400-500nm, a spectrum image of 800-1000nm can be output, and when the FPI mirror spacing is greater than 500nm, a spectrum of 800-3R1 / 2nm can be output through the R channel with a spacing of 800-3R1 / 2nm, but the spectrum output of 3R1 / 2-1000nm cannot be achieved. It can be seen from Table 1 that the output of the 3R1 / 2-1000nm band is affected by the simultaneous existence of the 2nd and 3rd order peaks in the R channel, so if the 3rd order peak here can be filtered, the spectrum of the 3R1 / 2-1000nm band can be output from the R channel.

[0059] This embodiment adopts active light source control to eliminate the level 3 peak. A filter component 34 including a first light source with a wavelength range parameter of R1-665nm spectrum and a second light source with a wavelength range parameter of a spectrum other than R1-665nm is selected, and the combined spectrum of the first light source and the second light source overlaps 400-λnm, 780nm<λ≤1000nm; the main control unit 33 is connected to the filter component 34, and the first light source and the second light source are lit in time.

[0060] Optionally, a wavelength range parameter of the first light source is 400-L1 nm, a wavelength range parameter of the second light source is L2-1000 nm, L1≥L2, L1≥3R1 / 2, L2>2λ / 3.

[0061] As an example, a first light source with a wavelength range parameter of 400-1000nm and a second light source with a wavelength range parameter of 700-1000nm are selected. When the mirror spacing of the FPI is from 500-700nm, the first part of the light source is used for irradiation; when the spacing is greater than 700nm, the second part of the light source is used for irradiation, thereby achieving the effect of 400-λnm, 780nm<λ≤1000nm high-spectrum output.

[0062] Optionally, the wavelength range parameter of the first light source is a spectrum of R1-665nm, and the wavelength range parameter of the second light source is a spectrum other than the wavelength range parameter of R1-665nm;

[0063] In actual use, it can be found from Table 1 that when the mirror spacing of the FPI filter component 31 is between G1-R1, there are two peaks in the G channel and one peak in the R channel, and the spectral responses of the G and R channels are fixed. Therefore, the main control unit 33 is configured to obtain the spectrum of the G1-R1 band through mathematical calculation, so that the mirror spacing of the FPI filter component 31 can be increased to R1; the first light source is preferentially used, and when the mirror spacing of the FPI filter component 31 is between R1-600nm, the G channel outputs the R1-600nm spectral image; when the mirror spacing of the FPI filter component 31 is between When it is at 600-3R1 / 2nm, B outputs a spectral image of 400-2B2 / 3nm, and the R channel outputs a spectral image of 600-3R1 / 2nm. The main control unit 33 is configured to calculate the spectral images of the G and R channels at this time to obtain a spectral image of 2B2 / 3nm-R1; at this time, the filter is switched to the second light source, and the FPI spacing is adjusted to 3R1 / 2-1000nm. The spectral image of 3R1 / 2-1000nm is output through the R channel, and the secondary peak can be filtered out to achieve the effect of 400-λnm, 780nm<λ≤1000nm high-spectral output.

[0064] Optionally, a wavelength range parameter of the first light source is 400-L1 nm, a wavelength range parameter of the second light source is L2-1000 nm, L1≥L2, L1≥3R1 / 2, L2>2λ / 3.

[0065] Optionally, a wavelength range parameter of the first light source is 400-L1 nm, a wavelength range parameter of the second light source is L2-1000 nm, 3R1 / 2>L1≥L2, L2>2λ / 3.

[0066] Optionally, in order to further reduce the moving distance of the mirror of the FPI filter assembly 31, it can be moved to a partial spacing twice under different light sources to achieve the output of different level peaks. The wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, B2≥L1≥L2, L2>2λ / 3; the main control unit is configured to control the mirror of the FPI filter assembly to move once at the L1-900nm spacing under different light sources.

[0067] In actual use, as shown in Table 4, the FPI mirror spacing is run twice at L1-900nm to output a 400-λnm full spectrum image.

[0068] Table 4

[0069]

[0070] Optionally, in order to make the 2L1 / 3-2B2 / 3 band have a stronger response in the G channel, 2L1 / 3>G1, that is, L1>3G1 / 2; the wavelength range parameter of the first light source is selected as 400-L1nm, the wavelength range parameter of the second light source is selected as L2-1000nm, 3G1 / 2<L1<B2, L2>2λ / 3 and L1≥L2, the mirror spacing of the FPI filter component 31 and the spectral response of the three channels of R, G, and B are shown in Table 5, which can achieve the output of a 400-λnm full-spectrum image.

[0071] Table 5

[0072]

[0073] In a second aspect, an embodiment of the present invention further discloses a visible infrared hyperspectral imaging method, using the above-mentioned device, the method comprising:

[0074] S1. Constructing a 400-λnm spectral output RGB three-channel spectral response curve based on the filtering characteristics of the FPI filter assembly and the RGB image sensor, wherein 780nm<λ≤1000nm;

[0075] S2. Based on the spectral response characteristics corresponding to the R channel, the G channel and the B channel in the RGB three-channel spectral response curve, select at least two filters with different light transmittance range parameters for filtering out the secondary peaks of the corresponding channels in the filtering component, or select at least two light sources with different wavelength ranges for filtering out the secondary peaks of the corresponding channels;

[0076] S3, switching the filter or light source in the filter component based on the main control unit, and controlling the mirror of the FPI filter assembly to move under the corresponding filter or light source;

[0077] S4, capturing and storing the spectral response images corresponding to the R channel, the G channel, and the B channel received by the RGB image sensor;

[0078] S5. Process the spectral response images corresponding to the R channel, the G channel, and the B channel to obtain a continuous hyperspectral image.

[0079] The present invention is based on adjustable FPI hyperspectral imaging, has a simple structure, can simultaneously achieve high spectral resolution and high spatial resolution, adopts the existing RGB image sensor 32, has a simple process, can be quickly industrialized, and has low cost; when the mirror of the FPI filter component 31 moves, it cooperates with the switching filter component / light source component to effectively eliminate the influence of the secondary peak and realize continuous output of the spectrum.

[0080] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present invention is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present invention (but not limited to) to form a technical solution.

Claims

1. A visible infrared hyperspectral imaging device, comprising an FPI filter assembly and an RGB image sensor, characterized in that: It also includes a filtering component and a main control unit, which are connected to the main control unit; the filtering component includes at least two filters with different transmittance range parameters or at least two light sources with different wavelength range parameters; the main control unit is configured to switch the filters or light sources in the filtering component, and control the mirror of the FPI filtering assembly to move under the corresponding filters or light sources to achieve 400-λnm continuous spectrum image output, where 780nm<λ≤1000nm.

2. The device according to claim 1, characterized in that The RGB image sensor includes spectral response bands of an R channel, a G channel and a B channel, the spectral response band of the R channel is R1 to 1000nm, the spectral response band of the G channel is G1 to 1000nm, and the spectral response band of the B channel is 400nm to B1, B2 to 1000nm; the R1, the G1, and the B2 are preset starting response wavelengths corresponding to the R channel, the G channel and the B channel in the RGB image sensor, and the B1 is a preset cutoff response wavelength corresponding to the B channel in the RGB image sensor.

3. The device according to claim 2, characterized in that The filtering component includes a first filter whose light transmission range parameter at least includes the R1-2λ / 3nm band, and a second filter whose light transmission range parameter at least does not include the R1-2λ / 3nm band; wherein the light transmission range parameters of the first filter and the second filter overlap and cover the 400-λnm band, 780nm<λ≤1000nm.

4. The device according to claim 3, characterized in that The light transmission range parameter of the first filter is 400-L1nm band, and the light transmission range parameter of the second filter is L2-1000nm band. ≥ L2, L1<3R1 / 2, L2>2λ / 3.

5. The device according to claim 3, characterized in that The light transmission range parameter of the first filter is 400-L1nm band, and the light transmission range parameter of the second filter is L2-1000nm band. ≥ L2, L1>3R1 / 2, L2>2λ / 3.

6. The device according to claim 3, characterized in that The light transmission range parameter of the first filter is 400-L1nm band, the light transmission range parameter of the second filter is L2-1000nm band, B2 ≥ L1 ≥ L2, L2>2λ / 3; the main control unit is configured to control the mirror of the FPI filter component to move once at a spacing of L1-900nm under different filters, and the mirror spacing of the FPI filter component is above 600nm.

7. The device according to claim 3, characterized in that The light transmission range parameter of the first filter is 400-L1nm, the light transmission range parameter of the second filter is L2-1000nm, B2 ＞ L1 ＞ 3G1 / 2, L2 ＞ 2λ / 3.

8. The device according to claim 2, characterized in that The filtering component includes a first light source with a wavelength range parameter of R1-2λ / 3nm spectrum, and a second light source with a wavelength range parameter of a spectrum outside R1-2λ / 3nm. The combined spectrum of the first light source and the second light source overlaps and covers 400-λnm, 780nm<λ≤1000nm.

9. The device according to claim 8, characterized in that The wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, L1 ≥ L2, L1≥3R1 / 2, L2>2λ / 3.

10. The device according to claim 8, characterized in that The wavelength range parameter of the first light source is 400-L1 nm, the wavelength range parameter of the second light source is L2-1000 nm, 3R1 / 2>L1≥L2, L2>2λ / 3.

11. The device according to claim 8, characterized in that The wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, B2≥L1≥L2, L2>2λ / 3; the main control unit is configured to control the mirror of the FPI filter assembly to move once at an interval of L1-900nm under different light sources.

12. The device according to claim 8, characterized in that The wavelength range parameter of the first light source is 400-L1nm, the wavelength range parameter of the second light source is L2-1000nm, 3G1 / 2<L1<B2, L2>2λ / 3 and L1≥L2.

13. The device according to claim 1, characterized in that The main control unit is also configured to capture and store the spectral response images of the R channel, the G channel and the B channel respectively received by the RGB image sensor during the process of controlling the movement of the FPI filter component, and process the spectral response images of the R channel, the G channel and the B channel respectively to obtain continuous hyperspectral images.

14. A visible infrared hyperspectral imaging method, using the device according to any one of claims 1 to 13, characterized in that: include: Constructing a 400-λnm spectral output RGB three-channel spectral response curve based on the filtering characteristics of the FPI filter assembly and the RGB image sensor, wherein 780nm<λ≤1000nm; Based on the spectral response characteristics corresponding to the R channel, the G channel and the B channel in the RGB three-channel spectral response curve, selecting at least two filters with different light transmittance range parameters for filtering out the secondary peaks of the corresponding channels in the filtering component, or selecting at least two light sources with different wavelength ranges for filtering out the secondary peaks of the corresponding channels; Switching the filter or light source in the filter component based on the main control unit, and controlling the mirror of the FPI filter assembly to move under the corresponding filter or light source; Capturing and storing spectral response images corresponding to the R channel, the G channel, and the B channel received by the RGB image sensor; The spectral response images corresponding to the R channel, the G channel, and the B channel are processed to obtain a continuous hyperspectral image.

Images