Ultrahigh-gray-scale intelligent hyperspectral imaging method and device
Through intelligent hyperspectral imaging method, beam splitting and multiple exposure acquisition technologies of optical signal images are used to solve the problems of cumbersome and inconvenient existing spectral measurement methods, and high-precision and portable hyperspectral image acquisition and processing are achieved, and testing efficiency and data accuracy are improved.
Patent Information
- Application Number
- CN202411790387.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-06
- Publication Date
- 2025-03-11
- Estimated Expiration
- 2044-12-06
AI Technical Summary
The existing spectral measurement methods are relatively cumbersome and the camera position is inconvenient, which leads to prone to deviations in test results after fusion, which is not conducive to high-precision image acquisition. At the same time, the processing of hyperspectral image data is difficult, and the load pressure on the hardware is high, making it difficult to miniaturize and portable.
Using an intelligent hyperspectral imaging method with ultra-high grayscale, the captured light signal image is divided into at least two beams according to the preset light intensity allocation ratio before focusing, and focused on different slits for shaping, and fusion of multiple exposure acquisitions and hyperspectral image data is achieved.
The workflow of image acquisition is optimized, the labor intensity of operators is reduced, the limitations on sensor sampling hardware circuits are eliminated, the miniaturized portable design is realized, the testing efficiency and data response range is improved, and the accuracy and completeness of hyperspectral image data is enhanced.
Smart Images

Figure CN119595106A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of spectrum measurement technology, and in particular to an ultra-high grayscale intelligent hyperspectral imaging method and device. Background Art
[0002] Spectral measurement technology is currently being applied in more and more scenarios, and is increasingly being transferred from laboratory environments to natural environments. With the expansion of applications, the data range of a single hyperspectral camera is becoming increasingly limited, and the real-time requirements for data processing are becoming increasingly higher. The usual method is to use dual hyperspectral cameras for post-shooting processing, but the shooting time is relatively long, and data verification can only be analyzed after the shooting is completed. There may be a situation where the data does not meet the requirements and needs to be re-collected, resulting in very low test and analysis efficiency. At the same time, the installation positions of existing dual hyperspectral cameras are spaced far apart, which makes it easy for test results to deviate after fusion, and requires a lot of manpower to process dual hyperspectral camera images. At the same time, the data accuracy of existing hyperspectral data is often limited by the sensor sampling hardware circuit. It is easy for objects that are too bright or too dark to appear during image acquisition, resulting in data saturation or insufficient brightness, thereby losing data in some areas, affecting test analysis, and having the disadvantages of high difficulty in data processing, complex analysis process, and low test and analysis accuracy. Summary of the invention
[0003] The technical problem to be solved by the present invention is as follows: the existing spectral measurement method is relatively cumbersome, and the camera position arrangement is relatively inconvenient, which leads to easy deviation of the test results after fusion, which is not conducive to the use of high-precision image acquisition. At the same time, the existing hyperspectral image data processing is difficult, the hardware load pressure is high, and it is difficult to miniaturize and portability.
[0004] In order to solve the above technical problems, the first aspect of the present invention adopts the following technical solution: an ultra-high grayscale intelligent hyperspectral imaging method, comprising the following steps:
[0005] S1: Initialization of the intelligent hyperspectral imaging device, deployment of the intelligent hyperspectral imaging device to align with the measured area;
[0006] S2: before focusing, the captured light signal image is split into at least two beams according to a preset light intensity distribution ratio, and the two beams are respectively focused on different slits for shaping, and each split light beam is preprocessed;
[0007] S3: performing multiple exposure acquisition on a plurality of light beams respectively to obtain hyperspectral image data of each light beam;
[0008] S4: Fuse several pieces of hyperspectral image data according to anchor points, so that the several pieces of hyperspectral image data completely overlap in space, and complete the hyperspectral image fusion imaging with ultra-high grayscale.
[0009] When the present invention is working, multi-band hyperspectral imaging of a common imaging window is achieved by means of spectroscopic means, and no additional camera arrangement steps are required. The image acquisition workflow is optimized, the labor intensity of operators is reduced, and the limitation of the sensor sampling hardware circuit is eliminated, which facilitates miniaturization and portability. The test efficiency is improved while the hardware load pressure is reduced. The hyperspectral band range is greatly expanded by improving the data response range and data bit depth. At the same time, a hyperspectral image with ultra-high grayscale can be obtained by using a multiple exposure and fusion method, thereby improving the accuracy of the object spectral measurement.
[0010] Preferably, in step S2, the captured light signal image is split into two beams according to a preset light intensity distribution ratio before focusing, and the light intensity distribution ratio of the two beams is set to 1:1, 1:1.5 or 1:4, and they are respectively focused on different slits for shaping.
[0011] Preferably, in step S2, when processing each split light beam, the following steps are adopted:
[0012] A1: Collimate the beam after it passes through the slit for shaping;
[0013] A2: Perform diffraction and spectral splitting on the collimated light beam. When it is necessary to ensure complete spectral information, proceed to step S3, otherwise proceed to step B3;
[0014] A3: After filtering the required light beam after the splitting is completed, go to step S3.
[0015] Preferably, in step S3, when performing multiple exposure acquisition on a plurality of light beams to acquire the hyperspectral image data of each light beam, the following steps are adopted:
[0016] B1: According to the preset exposure parameter group, expose in sequence from low to high gradient, and obtain several hyperspectral image data of different exposure times for each light beam;
[0017] B2: Traverse all spatial points, and judge whether there are oversaturated pixels for each spatial point in order from high to low. When the spatial point has oversaturated pixels in the current hyperspectral image data, go to step B3; when the spatial point has no oversaturated pixels in the current hyperspectral image data, go to step B4;
[0018] B3: Determine whether there is an oversaturated pixel at the spatial point in the hyperspectral image data one level lower than the current hyperspectral image data. When the spatial point has an oversaturated pixel in the current hyperspectral image data, proceed to step B3; when the spatial point has no oversaturated pixel in the current hyperspectral image data, proceed to step B4;
[0019] B4: The hyperspectral data of all spatial points of each light beam is recorded as the ratio of the current hyperspectral image data to the corresponding exposure time to obtain the hyperspectral image data of each light beam.
[0020] When the present invention is working, by sequentially controlling the exposure time, it is possible to obtain several items of hyperspectral image data with different exposure times for each light beam, which have high spatial consistency, and are convenient for subsequent image fusion work. The method of judging oversaturated pixels is adopted, so that the fused hyperspectral image data has ultra-wide spectral characteristics while ensuring the data response range, and can avoid the defects of the collected image being too bright or too dark, resulting in saturation of the hyperspectral image data or insufficient brightness, and loss of data in some areas, thereby further improving the stability of the spectral test.
[0021] Preferably, in step S4, a plurality of hyperspectral image data are fused according to anchor points so that the plurality of hyperspectral image data completely overlap in space, and when ultra-high grayscale hyperspectral image fusion imaging is completed, the following steps are adopted:
[0022] C1: Obtain ultra-high grayscale hyperspectral image data for each light beam;
[0023] C2: mark the common points of the hyperspectral image data of each light beam, and set the hyperspectral image data of one of the light beams as the reference hyperspectral image data;
[0024] C3: Traverse all spatial points on the reference hyperspectral image data, and obtain the spectral curve of each spatial point. Calculate the corresponding spatial point on the hyperspectral image data of other light beams through linear interpolation. Calculate the linear interpolation value of each band according to the linear interpolation parameters to obtain the spectral curve of the corresponding spatial point.
[0025] C4: merge the spectral curve of each spatial point with the spectral curve of the corresponding spatial point to obtain a merged spectral curve;
[0026] C5: Complete the fusion imaging of ultra-high grayscale hyperspectral images by completely overlapping the data of several hyperspectral images in space.
[0027] When the present invention is working, the spectrum merging of the hyperspectral images of several light beams is completed through linear interpolation calculation, so that the data of several hyperspectral images are completely overlapped in space, the spatial consistency is good, and a certain degree of defect correction can be achieved, thereby enhancing the integrity of the hyperspectral image data, and being able to suppress the interference of noise on the hyperspectral image data while improving the resolution. At the same time, the computing power resources occupied by the linear interpolation calculation are low, the computing efficiency is high, and the test efficiency can be further improved.
[0028] To solve the above technical problems, the second aspect of the present invention adopts the following technical solution: an ultra-high grayscale intelligent hyperspectral imaging device, comprising a beam splitting mechanism for splitting light according to a preset light intensity distribution ratio, a plurality of hyperspectral modules and a processing module for data processing and overall control, the beam splitting mechanism is provided with at least two light-transmitting parts for exposing the light beams after splitting, the imaging parts of the plurality of hyperspectral modules are respectively optically connected to the corresponding light-transmitting parts on the beam splitting mechanism, the data output ends of the plurality of hyperspectral modules are data-connected to the processing module, and the processing module receives the ultra-high grayscale hyperspectral image data of each light beam after the imaging of the plurality of hyperspectral modules is completed to perform hyperspectral image fusion imaging.
[0029] Preferably, the hyperspectral module comprises a slit for beam shaping, a spectroscopic module for collimating the beam, a grating for diffraction spectrometry, and a grayscale camera for imaging. The slit, spectroscopic module, grating and imaging parts of the grayscale camera are arranged in sequence along the direction of light conduction and the light path is conducted. The slit is arranged at the focal position of the light-transmitting part of the beam-splitting mechanism and is located at the object-side focal position of the spectroscopic module. The imaging part of the grayscale camera is arranged at the image-side focal position of the spectroscopic module, and the grayscale camera is data-connected to the processing module.
[0030] Preferably, the hyperspectral module further comprises a filter for selectively transmitting or blocking light of a specific wavelength, and the filter is arranged in a focusing light path of the spectroscopic module.
[0031] Preferably, the grayscale camera synchronously sends control parameters of the grayscale camera when sending the hyperspectral image data after completing imaging, and the control parameters of the grayscale camera include at least one of frame rate, exposure time, ROI parameter and gain.
[0032] Preferably, the processing module includes a processing board and at least one computing chip, and the computing chip is configured as at least one of FPGA, DSP and GPU.
[0033] The beneficial technical effects of the present invention include:
[0034] 1. The present invention realizes multi-band hyperspectral imaging of a common imaging window by means of spectroscopic means, without the need for additional camera arrangement steps, and can optimize the workflow of image acquisition, reduce the labor intensity of operators, and get rid of the limitations of sensor sampling hardware circuits, facilitating miniaturization and portable design, while reducing hardware load pressure and improving test efficiency. By improving the data response range and data bit depth, the hyperspectral band range is greatly expanded, and multiple exposures and fusion methods are used to obtain ultra-high grayscale hyperspectral images, thereby improving the accuracy of object spectral measurement.
[0035] 2. The present invention can obtain several items of hyperspectral image data with different exposure times for each light beam by sequentially controlling the exposure time, and has high spatial consistency, which is convenient for subsequent image fusion work. The method of judging oversaturated pixels is adopted, so that the fused hyperspectral image data has ultra-wide spectral characteristics while ensuring the data response range, which can avoid the defects of too bright or too dark in the collected image, resulting in saturation or insufficient brightness of the hyperspectral image data, and loss of data in some areas, thereby further improving the stability of the spectral test.
[0036] 3. The present invention completes the spectral merging of the hyperspectral images of several light beams through linear interpolation calculation, so that the data of several hyperspectral images completely overlap in space, have good spatial consistency, and can achieve a certain degree of defect correction, thereby enhancing the integrity of the hyperspectral image data, and can suppress the interference of noise on the hyperspectral image data while improving the resolution. At the same time, the computing power resources occupied by the linear interpolation calculation are low, the computing efficiency is high, and the test efficiency can be further improved.
[0037] Other features and advantages of the present invention will be disclosed in detail in the following specific embodiments and drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The present invention will be further described below in conjunction with the accompanying drawings:
[0039] Attached Figure 1 It is a structural schematic diagram of an ultra-high grayscale intelligent hyperspectral imaging device;
[0040] Attached Figure 2 Workflow diagram for collecting multiple exposures of a beam to obtain hyperspectral image data;
[0041] Attached Figure 3 Workflow diagram for hyperspectral image fusion imaging;
[0042] Attached Figure 4 For reference of the second embodiment Figure 1 ;
[0043] Attached Figure 5 For reference of the second embodiment Figure 2 . DETAILED DESCRIPTION
[0044] The technical solutions of the embodiments of the present invention are explained and described below in conjunction with the drawings of the embodiments of the present invention, but the following embodiments are only preferred embodiments of the present invention, not all. Based on the embodiments in the implementation mode, other embodiments obtained by those skilled in the art without creative work are all within the protection scope of the present invention.
[0045] In the following description, terms such as "inside", "outside", "up", "down", "left", "right", etc. that indicate directions or positional relationships are only used to facilitate the description of the embodiments and simplify the description, and do not indicate or imply that the referred device or element must have a specific direction, be constructed and operate in a specific direction. Therefore, it should not be understood as a limitation of the present invention.
[0046] Embodiment 1:
[0047] Please refer to the attached Figure 1 and attached Figure 2 This embodiment discloses an ultra-high grayscale intelligent hyperspectral imaging method, comprising the following steps:
[0048] S1: Initialization of the intelligent hyperspectral imaging device, deployment of the intelligent hyperspectral imaging device to align with the measured area;
[0049] S2: before focusing, the captured light signal image is split into at least two beams according to a preset light intensity distribution ratio, and the two beams are respectively focused on different slits 21 for shaping, and each split light beam is preprocessed;
[0050] S3: performing multiple exposure acquisition on a plurality of light beams respectively to obtain hyperspectral image data of each light beam;
[0051] S4: Fuse several pieces of hyperspectral image data according to anchor points, so that the several pieces of hyperspectral image data completely overlap in space, and complete the hyperspectral image fusion imaging with ultra-high grayscale.
[0052] When the present embodiment is working, multi-band hyperspectral imaging of a common imaging window is achieved by means of spectroscopy, without the need for additional camera arrangement steps, which can optimize the image acquisition workflow, reduce the labor intensity of operators, and get rid of the limitations of the sensor sampling hardware circuit, making it convenient for miniaturization and portability. It improves the test efficiency while reducing the hardware load pressure, greatly expands the hyperspectral band range by improving the data response range and data bit depth, and simultaneously uses multiple exposures and fusion methods to obtain ultra-high grayscale hyperspectral images, thereby improving the accuracy of spectral measurement of objects.
[0053] Preferably, in step S2, the captured light signal image is split into two beams according to a preset light intensity distribution ratio before focusing, and the light intensity distribution ratio of the two beams is set to 1:1, 1:1.5 or 1:4, and are respectively focused on different slits 21 for shaping. In a specific implementation, the light intensity distribution ratio is optimized through the actual preferred band distribution of the measured object, which can further improve the data response range and realize the ultra-wide spectral characteristics of the collected hyperspectral image data.
[0054] Preferably, in step S2, when processing each split light beam, the following steps are adopted:
[0055] A1: After the light beam is shaped by the slit 21, it is collimated;
[0056] A2: Perform diffraction and spectral splitting on the collimated light beam. When it is necessary to ensure complete spectral information, proceed to step S3, otherwise proceed to step B3;
[0057] A3: After filtering the required light beam after the splitting is completed, go to step S3.
[0058] In this embodiment, in step S3, when performing multiple exposure acquisition on a plurality of light beams to obtain hyperspectral image data of each light beam, the following steps are adopted:
[0059] B1: According to the preset exposure parameter group, expose in sequence from low to high gradient, and obtain several hyperspectral image data of different exposure times for each light beam;
[0060] B2: Traverse all spatial points, and judge whether there are oversaturated pixels for each spatial point in order from high to low. When the spatial point has oversaturated pixels in the current hyperspectral image data, go to step B3; when the spatial point has no oversaturated pixels in the current hyperspectral image data, go to step B4;
[0061] B3: Determine whether there is an oversaturated pixel at the spatial point in the hyperspectral image data one level lower than the current hyperspectral image data. When the spatial point has an oversaturated pixel in the current hyperspectral image data, proceed to step B3; when the spatial point has no oversaturated pixel in the current hyperspectral image data, proceed to step B4;
[0062] B4: The hyperspectral data of all spatial points of each light beam is recorded as the ratio of the current hyperspectral image data to the corresponding exposure time to obtain the hyperspectral image data of each light beam.
[0063] Please refer to the attached Figure 2For the spatial point x1, y1, the Nth hyperspectral data with the largest exposure time is HSIx1, y1, b, N. At this time, whether there is an oversaturated pixel is determined for the spatial point x1, y1. When HSIx1, y1, b, N does not have an oversaturated pixel, the hyperspectral data of the spatial point x1, y1 is determined as HSIx1, y1, b, N = HSIx1, y1, b, tN / tN. When HSIx1, y1, b, N has an oversaturated pixel, whether there is an oversaturated pixel is determined for the N-1th hyperspectral data HSIx1, y1, b, N-1 with a smaller exposure time. This is repeated until there is no oversaturated pixel at the spatial point x1, y1, and all spatial points are traversed repeatedly in turn to obtain the hyperspectral image data of each light beam.
[0064] When the present embodiment is working, by sequentially controlling the exposure time, it is possible to obtain several items of hyperspectral image data with different exposure times for each light beam, which have high spatial consistency, and are convenient for subsequent image fusion work. The method of judging oversaturated pixels is adopted, so that the fused hyperspectral image data has ultra-wide spectral characteristics while ensuring the data response range, and can avoid the defects of the collected image being too bright or too dark, resulting in saturation of the hyperspectral image data or insufficient brightness, and loss of data in some areas, thereby further improving the stability of the spectral test.
[0065] Embodiment 2:
[0066] Please refer to the attached Figure 3 This embodiment provides an ultra-high grayscale intelligent hyperspectral imaging method. The same points as those in the first embodiment will not be repeated here. The differences will be described in detail below with reference to the accompanying drawings.
[0067] Please refer to the attached Figure 3 To Attachment Figure 5 In this embodiment, in step S4, a plurality of hyperspectral image data are fused according to anchor points so that the plurality of hyperspectral image data completely overlap in space. When ultra-high grayscale hyperspectral image fusion imaging is completed, the following steps are adopted:
[0068] C1: Obtain ultra-high grayscale hyperspectral image data for each light beam;
[0069] C2: mark the common points of the hyperspectral image data of each light beam, and set the hyperspectral image data of one of the light beams as the reference hyperspectral image data;
[0070] C3: Traverse all spatial points on the reference hyperspectral image data, and obtain the spectral curve of each spatial point. Calculate the corresponding spatial point on the hyperspectral image data of other light beams through linear interpolation. Calculate the linear interpolation value of each band according to the linear interpolation parameters to obtain the spectral curve of the corresponding spatial point.
[0071] C4: merge the spectral curve of each spatial point with the spectral curve of the corresponding spatial point to obtain a merged spectral curve;
[0072] C5: Complete the fusion imaging of ultra-high grayscale hyperspectral images by completely overlapping the data of several hyperspectral images in space.
[0073] Please refer to the attached Figure 4 and attached Figure 5 , the A-band hyperspectral image and the B-band hyperspectral image are fused, and the combined spectrum of the selected spatial point after fusion is shown in the attached figure. Figure 5 As shown in the figure, it can avoid collection interference by fusing the spectral information of band A and band B, and optimizing the collection of visible light band, near infrared band, short infrared band and other special bands, so as to obtain more comprehensive spectral data, covering a wider spectral range, so that the fused hyperspectral image data is as shown in the attached figure. Figure 4 As shown in the middle right image, its clarity and details are more complete and clear than the first and second left images, which can further improve the test accuracy.
[0074] When this embodiment is working, the spectrum merging of the hyperspectral images of several light beams is completed through linear interpolation calculation, so that the data of several hyperspectral images are completely overlapped in space, the spatial consistency is good, and a certain degree of defect correction can be achieved, thereby enhancing the integrity of the hyperspectral image data, and being able to suppress the interference of noise on the hyperspectral image data while improving the resolution. At the same time, the computing power resources occupied by the linear interpolation calculation are low, the computing efficiency is high, and the test efficiency can be further improved.
[0075] Embodiment three:
[0076] Please refer to the attached Figure 1 The present embodiment provides an ultra-high grayscale intelligent hyperspectral imaging device, which applies the intelligent hyperspectral imaging method of the above embodiment, including a beam splitting mechanism 1 for splitting light according to a preset light intensity distribution ratio, a plurality of hyperspectral modules 2 and a processing module 3 for data processing and overall control. The differences are described in detail below in conjunction with the accompanying drawings.
[0077] In this embodiment, the beam splitting mechanism 1 is provided with at least two light-transmitting parts for exposing the light beam after splitting. In the specific implementation, the beam splitting mechanism 1 includes an imaging lens 11 and a beam splitting system 12, wherein the beam splitting system 12 can be provided with a plurality of light-transmitting parts according to actual working requirements, and the imaging parts of a plurality of hyperspectral modules 2 are respectively optically connected with the light paths of the corresponding light-transmitting parts on the beam splitting mechanism 1, and the data output ends of the plurality of hyperspectral modules 2 are data-connected with the processing module 3. After the imaging of the plurality of hyperspectral modules 2 is completed, the processing module 3 receives the ultra-high grayscale hyperspectral image data of each light beam to perform hyperspectral image fusion imaging.
[0078] Preferably, the hyperspectral module 2 includes a slit 21 for beam shaping, a spectroscopic module for collimating the light beam, a grating 23 for diffraction spectrometry, and a grayscale camera 24 for imaging. The slit 21, the spectroscopic module, the grating 23 and the imaging parts of the grayscale camera 24 are arranged in sequence along the direction of the light path conduction and the light path conduction. The slit 21 is arranged at the focal position of the light-transmitting part of the beam splitting mechanism 1 and is located at the object side focal position of the spectroscopic module. The imaging part of the grayscale camera 24 is arranged at the image side focal position of the spectroscopic module, and the grayscale camera 24 is data-connected to the processing module 3.
[0079] In a specific implementation, the hyperspectral module 2 further includes a filter 25 for selectively transmitting or blocking light of a specific wavelength. The filter 25 is arranged in the focusing light path of the spectroscopic module to facilitate adjustment of the wavelength distribution.
[0080] Preferably, the grayscale camera 24 sends the control parameters of the grayscale camera 24 synchronously when sending the hyperspectral image data after completing the imaging. The control parameters of the grayscale camera 24 include at least one of the frame rate, exposure time, ROI parameter and gain, so as to facilitate the overall control of the processing module 3. Preferably, the processing module 3 includes a processing board 31 and at least one computing chip 32. The computing chip 32 is arranged on the processing board 31. The processing board 31 is connected to the grayscale camera 24 data through a corresponding data line. The computing chip 32 is set to at least one of FPGA, DSP and GPU. Of course, any other suitable chip can also be selected according to the actual working conditions. Through the coordinated processing of multiple computing chips 32, the computing efficiency and fusion effect can be guaranteed, thereby improving the accuracy of the test.
[0081] The beneficial technical effects of this embodiment include: the present invention realizes multi-band hyperspectral imaging of a common imaging window by means of spectroscopic means, does not require additional camera arrangement steps, can optimize the image acquisition workflow, reduces the labor intensity of operators, and can get rid of the limitations of the sensor sampling hardware circuit, facilitate miniaturization and portability design, improve test efficiency while reducing hardware load pressure, greatly expand the hyperspectral band range by improving the data response range and data bit depth, and simultaneously adopts a multiple exposure and fusion method to obtain ultra-high grayscale hyperspectral images, thereby improving the accuracy of object spectral measurement.
[0082] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Those skilled in the art should understand that the present invention includes but is not limited to the contents described in the drawings and the above specific embodiments. Any modification that does not deviate from the functional and structural principles of the present invention will be included in the scope of the claims.
Claims
1. An ultra-high grayscale intelligent hyperspectral imaging method, characterized in that: The following steps are involved: S1: Initialization of the intelligent hyperspectral imaging device, deployment of the intelligent hyperspectral imaging device to align with the measured area; S2: before focusing, the captured light signal image is split into at least two beams according to a preset light intensity distribution ratio, and the two beams are respectively focused on different slits (21) for shaping, and each split light beam is preprocessed; S3: performing multiple exposure acquisition on a plurality of light beams respectively to obtain hyperspectral image data of each light beam; S4: Fuse several pieces of hyperspectral image data according to anchor points, so that the several pieces of hyperspectral image data completely overlap in space, and complete the hyperspectral image fusion imaging with ultra-high grayscale.
2. The ultra-high grayscale intelligent hyperspectral imaging method according to claim 1, characterized in that: In step S2, the captured light signal image is split into two beams according to a preset light intensity distribution ratio before focusing, the light intensity distribution ratio of the two beams is set to 1:1, 1:1.5 or 1:4, and they are respectively focused on different slits (21) for shaping.
3. The ultra-high grayscale intelligent hyperspectral imaging method according to claim 1, characterized in that: In step S2, when processing each split light beam, the following steps are adopted: A1: collimating the light beam after it has been shaped by the slit (21); A2: Perform diffraction and spectral splitting on the collimated light beam. When it is necessary to ensure complete spectral information, proceed to step S3, otherwise proceed to step B3; A3: After filtering the required light beam after the splitting is completed, go to step S3.
4. The ultra-high grayscale intelligent hyperspectral imaging method according to claim 1, characterized in that: In step S3, when performing multiple exposure acquisition on a plurality of light beams to obtain hyperspectral image data of each light beam, the following steps are adopted: B1: According to the preset exposure parameter group, expose in sequence from low to high gradient, and obtain several hyperspectral image data of different exposure times for each light beam; B2: Traverse all spatial points, and judge whether there are oversaturated pixels for each spatial point in order from high to low. When the spatial point has oversaturated pixels in the current hyperspectral image data, go to step B3; when the spatial point has no oversaturated pixels in the current hyperspectral image data, go to step B4; B3: Determine whether there is an oversaturated pixel at the spatial point in the hyperspectral image data one level lower than the current hyperspectral image data. When the spatial point has an oversaturated pixel in the current hyperspectral image data, proceed to step B3; when the spatial point has no oversaturated pixel in the current hyperspectral image data, proceed to step B4; B4: The hyperspectral data of all spatial points of each light beam is recorded as the ratio of the current hyperspectral image data to the corresponding exposure time to obtain the hyperspectral image data of each light beam.
5. The ultra-high grayscale intelligent hyperspectral imaging method according to claim 1, characterized in that: In step S4, a plurality of hyperspectral image data are fused according to anchor points so that the plurality of hyperspectral image data completely overlap in space. When ultra-high grayscale hyperspectral image fusion imaging is completed, the following steps are adopted: C1: Obtain ultra-high grayscale hyperspectral image data for each light beam; C2: mark the common points of the hyperspectral image data of each light beam, and set the hyperspectral image data of one of the light beams as the reference hyperspectral image data; C3: Traverse all spatial points on the reference hyperspectral image data, and obtain the spectral curve of each spatial point. Calculate the corresponding spatial point on the hyperspectral image data of other light beams through linear interpolation. Calculate the linear interpolation value of each band according to the linear interpolation parameters to obtain the spectral curve of the corresponding spatial point. C4: merge the spectral curve of each spatial point with the spectral curve of the corresponding spatial point to obtain a merged spectral curve; C5: Complete the fusion imaging of ultra-high grayscale hyperspectral images by completely overlapping the data of several hyperspectral images in space.
6. An ultra-high grayscale intelligent hyperspectral imaging device, characterized in that: The invention comprises a beam splitting mechanism (1) for performing light splitting at a preset light intensity distribution ratio, a plurality of hyperspectral modules (2) and a processing module (3) for data processing and overall control, wherein the beam splitting mechanism (1) is provided with at least two light-transmitting parts for exposing the light beam after the light splitting, the imaging parts of the plurality of hyperspectral modules (2) are respectively connected to the light paths of the light-transmitting parts corresponding to each other on the beam splitting mechanism (1), the data output ends of the plurality of hyperspectral modules (2) are all data-connected to the processing module (3), and the processing module (3) receives the hyperspectral image data of ultra-high gray scale of each light beam after the imaging of the plurality of hyperspectral modules (2) is completed to perform hyperspectral image fusion imaging.
7. The ultra-high grayscale intelligent hyperspectral imaging device according to claim 6, characterized in that: The hyperspectral module (2) comprises a slit (21) for beam shaping, a spectroscopic system (22) for collimating a beam, a grating (23) for diffraction spectrometry, and a grayscale camera (24) for imaging. The imaging parts of the slit (21), the spectroscopic system (22), the grating (23), and the grayscale camera (24) are arranged in sequence along the direction of light conduction and the light conduction is conducted. The slit (21) is arranged at the focal position of the light-transmitting part of the beam splitting mechanism (1) and is located at the object-side focal position of the spectroscopic system (22). The imaging part of the grayscale camera (24) is arranged at the image-side focal position of the spectroscopic system (22). The grayscale camera (24) is data-connected to the processing module (3).
8. The ultra-high grayscale intelligent hyperspectral imaging device according to claim 7, characterized in that: The hyperspectral module (2) further comprises a filter (25) for selectively transmitting or blocking light of a specific wavelength, and the filter (25) is arranged in the focusing light path of the spectroscopic system (22).
9. The ultra-high grayscale intelligent hyperspectral imaging device according to claim 7, characterized in that: The grayscale camera (24) synchronously sends control parameters of the grayscale camera (24) when sending hyperspectral image data after completing imaging, and the control parameters of the grayscale camera (24) include at least one of a frame rate, an exposure time, a ROI parameter and a gain.
10. The ultra-high grayscale intelligent hyperspectral imaging device according to claim 6, characterized in that: The processing module (3) comprises a processing board (31) and at least one computing chip (32), wherein the computing chip (32) is configured as at least one of FPGA, DSP and GPU.
Citation Information
Patent Citations
Compact monocular multi-channel configurable multispectral imaging system
CN110017897A
Adjustable light filter type hyperspectral imager and method based on compressed sensing
CN110081977A
Low-cost rapid linear spectral imaging system
CN111504917A
Image processing method, storage medium and electronic device
CN113287291A
Hyperspectral image fusion method and image acquisition system based on checkerboard guidance
CN118537693A