Hyperspectral and visible light imaging fused optical system
By employing a coaxial beam splitting structure and a field-of-view alignment design for hyperspectral and visible light sensors in the optical system, the problems of low efficiency, large error, and low light intake in multispectral image fusion technology are solved, achieving efficient hyperspectral and visible light image fusion.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- UNION OPTECH
- Filing Date
- 2025-04-30
- Publication Date
- 2026-05-05
AI Technical Summary
Existing multispectral image fusion techniques are inefficient, have large errors, and low light intake, making it impossible to effectively fuse hyperspectral and visible light images.
The beam-splitting structure is set up in a coaxial manner. The beam-splitting structure has a light-transmitting area and a reflective area. The light-transmitting area is used to directly transmit light, and the reflective area is used to reflect light in the visible light band. The field of view of the hyperspectral sensor and the visible light sensor are equal, and the pixel positions on the imaging surface correspond one-to-one, realizing physical-level pixel alignment.
It increases the amount of light entering the optical system, reduces the complexity of post-processing, improves the efficiency of image fusion, and achieves physical-level pixel alignment of hyperspectral and visible light images without the need for complex post-processing algorithms.
Smart Images
Figure CN224203524U_ABST
Abstract
Description
Technical Field
[0001] This utility model relates to the field of optical imaging technology, and in particular to an optical system for the fusion of hyperspectral and visible light imaging. Background Technology
[0002] Hyperspectral sensors combine imaging and spectral techniques to detect the two-dimensional geometric space and one-dimensional spectral information of targets. They possess high spectral resolution, enabling the acquisition of continuous, narrow-band image data with high spectral resolution. Hyperspectral images effectively reflect the properties of different materials and are widely used in fields such as food safety, medical diagnostics, remote sensing, agriculture, geological exploration, and archaeology. While hyperspectral images offer a rich spectral range, their relatively low spatial resolution limits their further applications. Visible light sensors have very high spatial resolution, but their spectral resolution (R / G / B) is relatively low. Therefore, fusing hyperspectral and visible light images captured in the same scene, and using the hyperspectral image information to enhance the visible light image, would be of great significance to the field of optical imaging technology.
[0003] However, most current multispectral image fusion technologies use time-division shooting or off-axis optical design to acquire different types of images. The separation of optical paths leads to errors in image registration, requiring complex post-processing algorithms and processors for image correction and alignment, resulting in low efficiency, large errors, and generally using semi-reflective lenses, which leads to low light intake of the sensor. Utility Model Content
[0004] The main purpose of this invention is to propose an optical system for the fusion of hyperspectral and visible light imaging, which aims to solve the problems of low efficiency, large error and low light intake in current multispectral image fusion technology.
[0005] To achieve the above objectives, this utility model proposes an optical system for hyperspectral and visible light imaging fusion, comprising:
[0006] An imaging lens assembly is used to receive and focus incident light.
[0007] The beam-splitting structure is coaxially arranged with the imaging lens group and tilted relative to the optical axis. The beam-splitting structure has a light-transmitting area in the middle and a reflective area around the light-transmitting area. The light-transmitting area is used to allow some light to pass through directly, and the reflective area is coated with a visible light band reflective film to reflect some visible light band light.
[0008] A hyperspectral sensor for receiving light passing through the light-transmitting region and generating a hyperspectral image based on the received light; and,
[0009] A visible light sensor is used to receive light reflected by the reflective area and generate a visible light image based on the received light.
[0010] The hyperspectral sensor and the visible light sensor have the same field of view, and the pixel positions on the imaging surface correspond one-to-one, so as to achieve physical-level pixel alignment between the hyperspectral image and the visible light image.
[0011] In one embodiment, the transmission spectrum of the light-transmitting region is between 400 nm and 2500 nm, and the reflection spectrum of the reflective region is between 400 nm and 700 nm.
[0012] In one embodiment, the pixel size of the hyperspectral sensor is 2μm to 16μm, the spectral range of the hyperspectral sensor is between 400nm and 2500nm, and the spatial resolution of the hyperspectral sensor is between 640×480 and 1920×1080.
[0013] The visible light sensor has a pixel size of 1μm to 8μm, the hyperspectral sensor has a spectral range of 400nm to 700nm, and the hyperspectral sensor has a spatial resolution range of 1280×960 to 3840×2160.
[0014] In one embodiment, the hyperspectral sensor includes one of a scanning hyperspectral camera and a snapshot hyperspectral camera.
[0015] In one embodiment, the visible light sensor includes either a CMOS sensor or a CCD sensor.
[0016] In one embodiment, the phase height of the visible light sensor is equal to the image height of the hyperspectral sensor.
[0017] In one embodiment, the image height of the visible light sensor is not equal to the image height of the hyperspectral sensor;
[0018] The optical system for fusion of hyperspectral and visible light imaging also includes a zoom lens group, which is disposed between the hyperspectral sensor and the beam splitting structure or between the visible light sensor and the beam splitting structure, for changing the focal length of the hyperspectral sensor or the focal length of the visible light sensor.
[0019] The hyperspectral sensor has a focal length of f1, the visible light sensor has a focal length of f2, the hyperspectral sensor has an image height of Y1, and the visible light sensor has an image height of Y2, satisfying the condition: Y1 / f1=Y2 / f2.
[0020] In one embodiment, the reflectivity of the visible light band reflective film is greater than or equal to 92%.
[0021] This invention also proposes a method for hyperspectral and visible light imaging fusion, based on the aforementioned optical system for hyperspectral and visible light imaging fusion, wherein the optical system for hyperspectral and visible light imaging fusion includes:
[0022] An imaging lens assembly is used to receive and focus incident light.
[0023] The beam-splitting structure is coaxially arranged with the imaging lens group and tilted relative to the optical axis. The beam-splitting structure has a light-transmitting area in the middle and a reflective area around the light-transmitting area. The light-transmitting area is used to allow some light to pass through directly, and the reflective area is coated with a visible light band reflective film to reflect some visible light band light.
[0024] A hyperspectral sensor for receiving light passing through the light-transmitting region and generating a hyperspectral image based on the received light; and,
[0025] A visible light sensor is used to receive light reflected by the reflective area and generate a visible light image based on the received light.
[0026] The hyperspectral sensor and the visible light sensor have the same field of view, and the pixel positions on the imaging surface correspond one-to-one, so as to achieve physical-level pixel alignment between the hyperspectral image and the visible light image.
[0027] The method for fusion of hyperspectral and visible light imaging includes the following steps:
[0028] The incident light is received by the imaging lens group, and after being split by the beam-splitting structure, the hyperspectral image I of the hyperspectral sensor is acquired simultaneously. HS and the visible light image I of the visible light sensor RGB ;
[0029] Based on hyperspectral image I HS With visible light image I RGB The pixel correspondence for hyperspectral image I HS Spatial registration is performed to generate a registered hyperspectral data cube.
[0030] Acquiring Hyperspectral Data Cube Spectral characteristic matrix F spectral ;
[0031] The spectral feature matrix F spectral With visible light image I RGB Spatial detail information is fused at the pixel level to generate an enhanced image. fused ,satisfy: in,α and β ω is the weighting coefficient. λ λ represents the spectral band weights, and λ represents the band.
[0032] In one embodiment, the image height of the visible light sensor is not equal to the image height of the hyperspectral sensor;
[0033] The optical system for fusion of hyperspectral and visible light imaging also includes a zoom lens group, which is disposed between the hyperspectral sensor and the beam splitting structure and is used to change the focal length of the hyperspectral sensor.
[0034] The hyperspectral image I HS Spatial registration specifically includes:
[0035] The focal length of the hyperspectral sensor is f1, the focal length of the visible light sensor is f2, the image height of the hyperspectral sensor is Y1, and the image height of the visible light sensor is Y2. By changing the f1 of the hyperspectral sensor, Y1 / f1 = Y2 / f2 is achieved.
[0036] The technical solution provided by this utility model, by setting the beam-splitting structure, has a light-transmitting area in the middle and a reflective area around the light-transmitting area. The light-transmitting area is used to allow some light to pass directly through, and the reflective area is coated with a visible light band reflective film to reflect some visible light. This makes the incident light split into transmitted light that passes directly through the beam-splitting structure and reflected light after being reflected by the reflective film, thereby reducing the energy loss of the incident light at the beam-splitting structure and increasing the amount of light entering the hyperspectral sensor and the visible light sensor. Furthermore, the field of view of the hyperspectral sensor and the visible light sensor are equal, and the pixel positions of the imaging surface correspond one-to-one. With this setting, the hyperspectral image and the visible light image can achieve physical-level pixel alignment without the need for complex post-processing algorithms and processors, thereby reducing post-processing complexity and improving work efficiency. Attached Figure Description
[0037] To more clearly illustrate the technical solutions in the embodiments of this utility model or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this utility model. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.
[0038] Figure 1 A schematic diagram of an embodiment of the optical system for hyperspectral and visible light imaging fusion provided by this utility model;
[0039] Figure 2 for Figure 1 Front view of the beam splitter structure;
[0040] Figure 3 for Figure 1 Schematic diagrams of mid-visible and hyperspectral images;
[0041] Figure 4 A flowchart illustrating an embodiment of the hyperspectral and visible light imaging fusion method provided by this utility model.
[0042] Explanation of icon numbers:
[0043] 1000. Optical system for fusion of hyperspectral and visible light imaging; 1. Imaging lens group; 2. Beam splitting structure; 21. Transmitting area; 22. Reflecting area; 3. Hyperspectral sensor; 4. Visible light sensor.
[0044] The realization of the purpose, functional features and advantages of this utility model will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0045] The technical solutions of the present utility model will be clearly and completely described below with reference to the accompanying drawings of the embodiments. Obviously, the described embodiments are only some embodiments of the present utility model, and not all embodiments. Based on the embodiments of the present utility model, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present utility model.
[0046] It should be noted that if the embodiments of this utility model involve directional indicators (such as up, down, left, right, front, back, etc.), the directional indicators are only used to explain the relative positional relationship and movement of the components in a specific posture. If the specific posture changes, the directional indicators will also change accordingly.
[0047] Furthermore, if the embodiments of this utility model involve descriptions such as "first" or "second," these descriptions are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the use of "and / or" or "and / or" throughout the text includes three parallel solutions. For example, "A and / or B" includes solution A, solution B, or a solution where both A and B are satisfied simultaneously. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. When the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed by this utility model.
[0048] Hyperspectral sensors combine imaging and spectral techniques to detect the two-dimensional geometric space and one-dimensional spectral information of targets. They possess high spectral resolution, enabling the acquisition of continuous, narrow-band image data with high spectral resolution. Hyperspectral images effectively reflect the properties of different materials and are widely used in fields such as food safety, medical diagnostics, remote sensing, agriculture, geological exploration, and archaeology. While hyperspectral images offer a rich spectral range, their relatively low spatial resolution limits their further applications. Visible light sensors have very high spatial resolution, but their spectral resolution (R / G / B) is relatively low. Therefore, fusing hyperspectral and visible light images captured in the same scene, and using the hyperspectral image information to enhance the visible light image, would be of great significance to the field of optical imaging technology.
[0049] However, most current multispectral image fusion technologies use time-division shooting or off-axis optical design to acquire different types of images. The separation of optical paths leads to errors in image registration, requiring complex post-processing algorithms and processors for image correction and alignment, resulting in low efficiency, large errors, and generally using semi-reflective lenses, which leads to low light intake of the sensor.
[0050] The main purpose of this invention is to propose an optical system for the fusion of hyperspectral and visible light imaging, which aims to solve the problems of low efficiency, large error and low light intake in current multispectral image fusion technology.
[0051] Please see Figures 1 to 2To achieve the above objectives, this invention proposes an optical system 1000 for hyperspectral and visible light imaging fusion, comprising an imaging lens group 1, a beam splitter 2, a hyperspectral sensor 3, and a visible light sensor 4. The imaging lens group 1 receives and focuses incident light. The beam splitter 2 is coaxially arranged with the imaging lens group 1 and tilted relative to the optical axis. The beam splitter 2 has a light-transmitting region 21 in the center and a reflective region 22 surrounding the light-transmitting region 21. The light-transmitting region 21 allows some light rays to pass through directly, and the reflective region 22... Region 22 is coated with a visible light band reflective film to reflect a portion of the visible light band; the hyperspectral sensor 3 is used to receive light passing through the light-transmitting region 21 and generate a hyperspectral image based on the received light; the visible light sensor 4 is used to receive light reflected by the reflective region 22 and generate a visible light image based on the received light; wherein, the hyperspectral sensor 3 and the visible light sensor 4 have the same field of view, and the pixel positions of the imaging surfaces correspond one-to-one, so as to achieve physical-level pixel alignment between the hyperspectral image and the visible light image.
[0052] The technical solution provided by this utility model, by setting the beam-splitting structure 2, has a light-transmitting region 21 located in the middle and a reflective region 22 located around the light-transmitting region 21. The light-transmitting region 21 is used to allow some light to pass directly through, and the reflective region 22 is coated with a visible light band reflective film to reflect some visible light band light. This makes the incident light split into transmitted light that directly passes through the beam-splitting structure 2 and reflected light after being reflected by the reflective film, thereby reducing the energy loss of the incident light at the beam-splitting structure 2, and thus increasing the amount of light entering the hyperspectral sensor 3 and the visible light sensor 4. Furthermore, the field of view of the hyperspectral sensor 3 and the visible light sensor 4 are equal, and the pixel positions of the imaging surface correspond one-to-one. With this setting, the hyperspectral image and the visible light image can achieve physical-level pixel alignment without the need for complex post-processing algorithms and processors, thereby reducing post-processing complexity and improving work efficiency.
[0053] It's understandable that physical pixel alignment between hyperspectral and visible light images refers to a one-to-one correspondence between pixels or pixel blocks in their respective spatial dimensions. This one-to-one correspondence doesn't necessarily mean that the pixel positions are completely identical; it could also mean that one pixel corresponds to a pixel block composed of multiple pixels. Please refer to [reference needed]. Figure 3 In the figure, a pixel in one hyperspectral image corresponds to nine pixels in a square arrangement of visible light images, thus achieving physical-level pixel alignment between the hyperspectral image and the visible light image.
[0054] It should be noted that this utility model does not limit the specific implementation of the light-transmitting area 21. In a preferred embodiment of this solution, the beam-splitting structure 2 is a reflector with a hollow center, wherein the hollow part is coaxially arranged with the reflector, and the hollow part corresponds to the light-transmitting area 21, allowing some light to pass through directly. With this arrangement, some reflected light can directly pass through the beam-splitting structure 2 and enter the hyperspectral sensor 3, thereby avoiding light loss at the beam-splitting structure 2. Furthermore, by coaxially arranging the hollow part with the reflector, the transmission area and the reflection area 22 are coaxial, which facilitates physical-level pixel alignment between the hyperspectral image and the visible light image.
[0055] It is worth mentioning that the reflectivity of the visible light band reflective film is greater than or equal to 92%. This configuration reduces the loss of incident light at the beam splitter 2 and increases the amount of light entering the visible light sensor 4.
[0056] In another embodiment of this utility model, the beam-splitting structure 2 is configured as ultra-clear glass, on which an annular reflective film is adhered to form the reflective area 22, and the portion without the reflective film is the light-transmitting area 21. This configuration results in a simpler structure, facilitates manufacturing, and the ultra-clear glass has strong light transmittance, thus meeting the requirements of the light-transmitting area 21 in this solution.
[0057] Furthermore, the transmission spectrum of the light-transmitting region 21 is in the range of 400 nm to 2500 nm, and the reflection spectrum of the reflecting region 22 is in the range of 400 nm to 700 nm. This configuration ensures that the light-transmitting region 21 allows light to pass through a relatively wide wavelength range, and that the reflecting region 22 only reflects light within the visible light wavelength range. This guarantees that all light subsequently incident on the visible light sensor 4 is visible light, thus meeting the basic requirements of the system.
[0058] Furthermore, the pixel size of the hyperspectral sensor 3 is between 2μm and 16μm, the spectral range of the hyperspectral sensor 3 is between 400nm and 2500nm, and the spatial resolution range of the hyperspectral sensor 3 is between 640×480 and 1920×1080; the pixel size of the visible light sensor 4 is between 1μm and 8μm, the spectral range of the hyperspectral sensor 3 is between 400nm and 700nm, and the spatial resolution range of the hyperspectral sensor 4 is between 1280×960 and 3840×2160. By defining the parameters of the hyperspectral sensor 3 and the visible light sensor 4, it is convenient to subsequently register the generated hyperspectral image and visible light image.
[0059] For details, please refer to Figure 3In a preferred embodiment of this solution, the hyperspectral sensor 3 has a pixel size of 6 μm, a spectral range of 500 nm to 920 nm, a spectral resolution of 2.5 nm, and a spatial resolution of 1280×720; the visible light sensor 4 has a pixel size of 2 μm, a spectral range of 400 nm to 700 nm, and a spatial resolution of 3840×2160. A single pixel in the hyperspectral image corresponds to a 3×3 pixel area in the visible light image, and the pixel positions can correspond one-to-one, thus achieving physical-level pixel alignment between the hyperspectral image and the visible light image.
[0060] In one embodiment of this invention, the hyperspectral sensor 3 includes one of a scanning hyperspectral camera and a snapshot hyperspectral camera. The scanning hyperspectral camera acquires the spectral information of the target point-by-point or line-by-line, providing very fine spectral information, but requires a long acquisition time. The snapshot hyperspectral camera can acquire both spatial and spectral information of the target in a single exposure without scanning; however, the resulting image resolution is relatively low. In a preferred embodiment of this solution, a snapshot hyperspectral camera is used, which is more efficient.
[0061] In one embodiment of this invention, the visible light sensor 4 includes either a CMOS sensor or a CCD sensor. The CMOS sensor is a complementary metal-oxide-semiconductor sensor, which has a simple structure, low manufacturing cost, and each pixel has its own amplifier, enabling rapid imaging. The CCD sensor is a charge-coupled device image sensor, which has a more complex structure and higher manufacturing cost; however, it has higher image quality and can produce clear images even with low light intake. In a preferred embodiment of this solution, a CMOS sensor is used, which offers higher efficiency.
[0062] It should be noted that this invention does not limit the specific relationship between the phase height of the visible light sensor 4 and the image height of the hyperspectral sensor 3, where image height refers to the side length of the image (number of pixels × pixel size). In one embodiment of this invention, the phase height of the visible light sensor 4 is equal to the image height of the hyperspectral sensor 3. This setting facilitates subsequent registration of the generated hyperspectral image and visible light image.
[0063] In another embodiment of this invention, the image height of the visible light sensor 4 is not equal to the image height of the hyperspectral sensor 3; the optical system 1000 for hyperspectral and visible light imaging fusion further includes a zoom lens group, which is disposed between the hyperspectral sensor 3 and the beam splitting structure 2 or between the visible light sensor 4 and the beam splitting structure 2, for changing the focal length of the hyperspectral sensor 3 or the visible light sensor 4; the focal length of the hyperspectral sensor 3 is f1, the focal length of the visible light sensor 4 is f2, the image height of the hyperspectral sensor 3 is Y1, and the image height of the visible light sensor 4 is Y2, satisfying: Y1 / f1=Y2 / f2. By setting the zoom lens group, the focal length of the hyperspectral sensor 3 or the visible light sensor 4 is changed, making the equivalent focal lengths of the visible light sensor 4 and the hyperspectral sensor 3 equal, thereby achieving registration of the hyperspectral image and the visible light image.
[0064] Please refer to Figure 4 This invention also proposes a method for hyperspectral and visible light imaging fusion. Based on the aforementioned optical system 1000 for hyperspectral and visible light imaging fusion, the method includes the following steps:
[0065] S100: The incident light is received by the imaging lens group 1 and then split by the beam splitting structure 2, and the hyperspectral image I of the hyperspectral sensor 3 is acquired simultaneously. HS and the visible light image I of the visible light sensor 4 RGB ;
[0066] S200, Based on hyperspectral image I HS With visible light image I RGB The pixel correspondence for hyperspectral image I HS Spatial registration is performed to generate a registered hyperspectral data cube.
[0067] S300, Hyperspectral Data Acquisition Cube Spectral characteristic matrix F spectral ;
[0068] S400, The spectral feature matrix F spectral With visible light image I RGB Spatial detail information is fused at the pixel level to generate an enhanced image. fused ,satisfy: in, α β and ω are weighting coefficients. λ λ represents the spectral band weights, and λ represents the band.
[0069] In a specific embodiment of this utility model, the hyperspectral image I HSThe dimensions are 1280×720×168, where 1280×720 represents the resolution of the hyperspectral image, i.e., the spatial dimension, and 168 represents the spectral dimension, indicating that each pixel in the image contains 168 consecutive spectral bands of information. The visible light image I... RGB The dimensions are 3840×2160×3, where 3840×2160 represents the resolution of the visible light image, i.e., the spatial dimension, and 3 represents the RGB three channels used to represent the colors of visible light, thus reflecting its wavelength. In terms of spatial dimension, based on the hyperspectral image I... HS With visible light image I RGB The pixel correspondence relationship of the hyperspectral image I HS Sampling to 3840×2160×168 pixels at a 1:3 ratio generates a registration data cube. This process is entirely based on physical pixel correspondences, eliminating the need for interpolation calculations, thus simplifying the registration process and improving efficiency. Based on the obtained registration data cube... Spatial data in the target spectral range of 600 nm to 920 nm were extracted to obtain the spectral feature matrix F. spectral The spectral feature matrix F spectral With visible light image I RGB Spatial detail information is fused at the pixel level to generate an enhanced image. fused Based on the weighting of the required spectral and visible light characteristics, α is set to 0.6 and β to 0.4. Based on the importance of the required wavelength band, ω is set for the near-infrared band. 700-920 The value is 1.4, ω in the visible light band 600-700 The value is 0.4, therefore,
[0070] The technical solution provided by this utility model acquires the hyperspectral image and the visible light image, and performs spatial registration based on the pixel correspondence of the images. The steps are simple and the registration efficiency is improved. By extracting the spectral feature matrix from the registered hyperspectral data cube, data within the target spectral range can be obtained according to actual needs, improving data accuracy. By allocating the visible light image and the hyperspectral image of different bands according to the weight of each band in actual needs and the proportion of required spectral information, the spatial detail information of the spectral feature matrix and the visible light image is fused at the pixel level, thereby obtaining an enhanced image in a simple way without the need for complex post-processing algorithms and processors, reducing costs and improving work efficiency.
[0071] In one embodiment of this utility model, the image height of the visible light sensor 4 is not equal to the image height of the hyperspectral sensor 3; the optical system 1000 for hyperspectral and visible light imaging fusion further includes a zoom lens group, which is disposed between the hyperspectral sensor 3 and the beam splitting structure 2, and is used to change the focal length of the hyperspectral sensor 3; the hyperspectral image I HS Spatial registration specifically includes: the focal length of the hyperspectral sensor 3 is f1, the focal length of the visible light sensor 4 is f2, the image height of the hyperspectral sensor 3 is Y1, and the image height of the visible light sensor 4 is Y2. By changing the f1 of the hyperspectral sensor 3, Y1 / f1 = Y2 / f2 is achieved. By setting the zoom lens group and thereby changing the focal length of the hyperspectral sensor 3, the equivalent focal lengths of the visible light sensor 4 and the hyperspectral sensor 3 are made equal, which facilitates subsequent registration of the hyperspectral image and the visible light image and improves work efficiency.
[0072] The above description is merely an exemplary embodiment of the present utility model and does not limit the patent scope of the present utility model. Any equivalent structural transformations made based on the technical concept of the present utility model and the contents of the present utility model specification and drawings, or direct / indirect applications in other related technical fields, are included within the patent protection scope of the present utility model.
Claims
1. An optical system for fusion of hyperspectral and visible light imaging, characterized in that, include: An imaging lens assembly is used to receive and focus incident light. The beam-splitting structure is coaxially arranged with the imaging lens group and tilted relative to the optical axis. The beam-splitting structure has a light-transmitting area in the middle and a reflective area around the light-transmitting area. The light-transmitting area is used to allow some light to pass through directly, and the reflective area is coated with a visible light band reflective film to reflect some visible light band light. A hyperspectral sensor for receiving light passing through the light-transmitting region and generating a hyperspectral image based on the received light; and, A visible light sensor is used to receive light reflected by the reflective area and generate a visible light image based on the received light. The hyperspectral sensor and the visible light sensor have the same field of view, and the pixel positions on the imaging surface correspond one-to-one, so as to achieve physical-level pixel alignment between the hyperspectral image and the visible light image.
2. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The transmission spectrum of the light-transmitting area is between 400nm and 2500nm, and the reflection spectrum of the reflective area is between 400nm and 700nm.
3. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The pixel size of the hyperspectral sensor is between 2μm and 16μm, the spectral range of the hyperspectral sensor is between 400nm and 2500nm, and the spatial resolution range of the hyperspectral sensor is between 640×480 and 1920×1080. The visible light sensor has a pixel size between 1 μm and 8 μm, the hyperspectral sensor has a spectral range between 400 nm and 700 nm, and the hyperspectral sensor has a spatial resolution range between 1280×960 and 3840×2160.
4. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The hyperspectral sensor includes one of a scanning hyperspectral camera and a snapshot hyperspectral camera.
5. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The visible light sensor includes either a CMOS sensor or a CCD sensor.
6. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The phase height of the visible light sensor is equal to the image height of the hyperspectral sensor.
7. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The image height of the visible light sensor is not equal to the image height of the hyperspectral sensor; The optical system for fusion of hyperspectral and visible light imaging also includes a zoom lens group, which is disposed between the hyperspectral sensor and the beam splitting structure or between the visible light sensor and the beam splitting structure, for changing the focal length of the hyperspectral sensor or the focal length of the visible light sensor. The hyperspectral sensor has a focal length of f1, the visible light sensor has a focal length of f2, the hyperspectral sensor has an image height of Y1, and the visible light sensor has an image height of Y2, satisfying the condition: Y1 / f1=Y2 / f2.
8. The optical system for hyperspectral and visible light imaging fusion as described in claim 1, characterized in that, The reflectivity of the visible light band reflective film is greater than or equal to 92%.