A multispectral demosaicking method based on adaptive spectral correlation iteration

Abstract

The present application relates to the technical field of image data processing, in particular to a multispectral demosaicking method based on adaptive spectral correlation iteration, comprising the following steps: firstly, generating an initial pseudo full-color image from a mosaic image through weighted smoothing filtering, and reconstructing an initial multispectral image by using a guided filtering method; then, quantifying the spectral correlation between different wavebands by using a Pearson correlation coefficient, constructing a high-correlation pseudo full-color image to generate a high-correlation multispectral image; finally, iteratively updating the high-correlation pseudo full-color image by using an adaptive iteration strategy, and outputting a high-quality final multispectral image by adaptively selecting optimal parameters. Therefore, the present application provides a multispectral image demosaicking method considering spectral correlation and dynamically updating a guide image, which is simple to calculate, high in spectral fidelity, and relatively convenient for users to use.

Description

Technical Field

[0001] This invention relates to the field of image data processing technology, and in particular to a multispectral demosaic method based on adaptive spectral correlation iteration, which can be widely applied in fields such as biomedicine, remote sensing monitoring, precision agriculture and industrial inspection. Background Technology

[0002] Compared to traditional RGB imaging, multispectral imaging can capture the reflectance information of a target across multiple discrete spectral bands, enabling more detailed analysis of inherent scene features. However, limited by sensor hardware costs and technology, most multispectral cameras employ multispectral filter arrays for data acquisition. Each pixel records only a single specific band of signal, resulting in a sparsely sampled image, known as a mosaic image. Therefore, recovering the full-resolution image from the mosaic image (de-mosaic) has become a core challenge for multispectral imaging systems.

[0003] The essence of multispectral image demosaic is to accurately estimate unsampled pixels in different spectral bands. To address this issue, several methods have been developed in the field of multispectral demosaic. Brauers et al. proposed weighted bilinear (WB) interpolation, which utilizes inter-channel correlation by considering spectral correlation (SD). Rathi et al. proposed a spectral difference method using convolutional filters to generate a complete multispectral image by calculating the sparsity differences between bands. Miao et al. proposed a binary tree-based edge-aware method that prioritizes the center positions of unsampled pixels through interpolation. Yu et al. proposed WB interpolation based on convolutional filters and optimized it using multi-scale large kernel attention. Antonucci et al. proposed a strategy combining traditional interpolation and non-convex matrix completion, utilizing low-rank structures to improve reconstruction quality. Zhang et al. proposed a method that iteratively updates the inter-channel spectral differences and then reconstructs a full-resolution multispectral image by integrating these differences. However, these methods often ignore the spectral correlation between different bands, easily leading to spectral aliasing when band differences are large. To address this issue, researchers have explored methods utilizing pseudo-panchromatic images. Rathi et al. proposed a general method to calculate the sparse differences between each spectral band and the pseudo-panchromatic image, and then generate a multispectral image through iterative updates of the pseudo-panchromatic image. Jeong et al. proposed an iterative linear regression model to estimate the pseudo-panchromatic image, which generates an iterative guided filter to balance spatial and spectral fidelity. Liao et al. proposed a strategy to adjust the guided filter window by utilizing the correlation between different channels. However, these methods use a fixed guided image and ignore the spectral correlation between different bands. Currently, researchers have studied deep learning-based demosaic methods, but these methods rely on large-scale data to learn the mapping relationship and have poor generalization ability in a few scenarios. Summary of the Invention

[0004] To overcome the shortcomings of existing technologies, this invention provides a multispectral demosaic method that features high spectral fidelity, simple calculation, consideration of spectral correlation, and dynamic updating of the guiding image.

[0005] This invention is achieved through the following technical solution:

[0006] A multispectral demosaic method based on adaptive spectral correlation iteration is characterized by the following steps:

[0007] S1, Generate mosaic image: Use a Gaussian function to simulate the transmittance function of a multispectral filter to construct a reference image, and use a multispectral filter array to downsample the reference image to generate a mosaic image;

[0008] S2, Initial Multispectral Image Reconstruction: Extract the global spatial structure from the mosaic image to generate an initial pseudo-panchromatic image, and reconstruct the initial multispectral image using a guided filtering method;

[0009] S3, Construction of a highly correlated pseudo-panchromatic image: The Pearson correlation coefficient is used to quantify the spectral correlation between different bands of the initial multispectral image. Highly correlated bands are selected by screening thresholds and a highly correlated pseudo-panchromatic image is constructed. The highly correlated multispectral image is reconstructed using a guided filtering method.

[0010] S4, Adaptive Iteration to Determine Parameters: The highly correlated pseudo-panchromatic image is iteratively updated using an adaptive iterative strategy. The optimal number of iterations and the screening threshold are adaptively selected through a comprehensive evaluation index to output a high-quality final multispectral image.

[0011] The multispectral demosaicing method based on adaptive spectral correlation iteration described in this invention also has the following feature: the specific steps for generating the mosaic image are as follows:

[0012] S11, a reference image is constructed by simulating the transmittance function of a multispectral filter using a Gaussian function, and a CIE D65 light source is used. The pixel value of the simulated multispectral camera is calculated from the spectral reflectance at a point. Finally, the pixel value obtained by integration is normalized to ensure that the pixel value of each band is within the range of [0, 255]. The calculation method is as follows:

[0013]

[0014] In the formula For filter Pixel values ​​of the band, It is a point Spectral reflectance of the scene The spectral power distribution of the light source, express The sensitivity function of the filter in the band. These are the normalization coefficients; For wavelength range;

[0015] S12, a mosaic image is generated by downsampling the reference image using a multispectral filtering array. This multispectral filtering array has a 4×4 binary tree arrangement structure, and each spatial pixel records information of only a single band. The final generated single-band mosaic image can be represented as follows:

[0016]

[0017] In the formula for Binary mask for a band, when the pixel is in The value is 1 for bands and 0 for other bands. This indicates element-wise multiplication.

[0018] The multispectral demosaicing method based on adaptive spectral correlation iteration described in this invention also has the following feature: the specific steps of the initial multispectral image reconstruction are as follows:

[0019] S21, a pseudo-panchromatic image is generated by fusing the mosaic image through weighted smoothing filtering and extracting the global spatial structure:

[0020]

[0021] The asterisk (*) indicates a two-dimensional convolution operation, using the "same" mode and the "replicate" padding strategy. This represents the corresponding weighted smoothing filter kernel, which enhances spatial continuity through weighted averaging, enabling the pseudo-panchromatic image to retain the main edges and texture structures of the scene;

[0022] S22, the initial multispectral image is reconstructed using a guided filtering method, because the image to be reconstructed... Band image It satisfies a local linear relationship with the pseudopanchromatic image:

[0023]

[0024] In the formula, Represented in pixels A local window centered at a radius of 4, For any pixel in this window, and It is a set of locally linear coefficients within the window, only related to the center position. related;

[0025] S23, Solve and By minimizing the energy function To preserve the structural information of the guide map, suppress noise and prevent overfitting, and minimize the difference from the output image, since a single pixel i may belong to multiple windows, the final output needs to be a weighted average of the linear coefficients of all windows containing that pixel.

[0026] The calculation method is as follows:

[0027]

[0028] In the formula, It is a regularization parameter to prevent Too large an amount can lead to overfitting. express The mosaic image of the band at location Pixel values; binary mask The constraint-guided filtering is used to calculate linear coefficients using only the effective sampling points of that band.

[0029] S24, the final output, which preserves the spatial structure, can be represented as:

[0030]

[0031] The multispectral demosaicing method based on adaptive spectral correlation iteration described in this invention also has the following feature: the specific steps for constructing the highly correlated pseudo-panchromatic image are as follows:

[0032] S31, taking into full account the inherent spectral correlation between bands in multispectral images, uses the Pearson correlation coefficient to quantify the spectral correlation between different bands for multispectral images. and Band spectral vector and Its Pearson correlation coefficient is defined as:

[0033]

[0034] In the formula For covariance, The standard deviation is denoted as Pearson correlation coefficient, which ranges from [−1, 1]. The closer the value is to 1, the stronger the linear correlation between the two bands.

[0035] S32, Set the filter threshold (Step size 0.01) and determine the set of highly correlated bands. Based on this set, construct Highly correlated pseudo-panchromatic images of the bands:

[0036]

[0037] In the formula, For the first In the next iteration Highly correlated pseudo-panchromatic images of the bands, The number of elements in the set. For the multispectral image after the previous iteration Band image, and its related band set It is dynamically updated as the correlation of different spectral bands changes during the iteration process to adapt to changes in spectral characteristics;

[0038] S33, with As a new guiding image, a highly correlated multispectral image is reconstructed using a guided filtering method:

[0039]

[0040] In the formula, This represents the guided filter operator, with the guided graph as input. With mosaic image The multispectral demosaicing method based on adaptive spectral correlation iteration described in this invention also has the following feature: wherein the specific steps for determining the parameters through adaptive iteration are as follows:

[0041] S41, Excessive iterations may lead to overfitting to noise or local anomalous spectra, and also increase computational costs; therefore, the maximum number of iterations is set to 16. To determine the optimal number of iterations t and the screening threshold... To balance reconstruction quality and computational cost, a comprehensive evaluation index was defined. To quantify reconstruction error:

[0042]

[0043] In the formula, RMSE is the root mean square error, which measures the deviation of pixel values ​​from the true values; SAM is the spectral angle mapping, which measures the angular deviation of the spectral vector; PSNR is the peak signal-to-noise ratio, which evaluates the quality of spatial detail recovery; and SSIM is the structural similarity, which reflects the degree of preservation of image structure and contrast.

[0044] S42, determine the optimal parameter combination by minimizing the comprehensive evaluation index:

[0045]

[0046] S43 outputs high-quality final multispectral images. This completes the mosaic removal process for multispectral images.

[0047] The beneficial effects of this invention are as follows:

[0048] According to the multispectral demosaicing method of this invention, a pseudo-panchromatic image is generated from a mosaic image through weighted smoothing filtering, and the initial multispectral image is recovered using a guided filtering method. Then, the spectral correlation between different bands is quantified using the Pearson correlation coefficient to construct a band-selective pseudo-panchromatic image for multispectral image estimation. Finally, an adaptive iterative strategy for dynamically updating the band-selective pseudo-panchromatic image is adopted to generate a high-quality multispectral image by adaptively selecting the optimal parameters. Therefore, this invention provides a multispectral image demosaicing method that considers spectral correlation and dynamically updates the guided image. It is computationally simple, has high spectral fidelity, and is relatively convenient for users. Attached Figure Description

[0049] Figure 1This is a flowchart of the multispectral demosaicing method based on adaptive spectral correlation iteration of the present invention;

[0050] Figure 2 This is the Pearson correlation coefficient matrix of the 16-band multispectral image of the present invention;

[0051] Figure 3 A schematic diagram of the selected scene for the CAVE dataset of this invention;

[0052] Figure 4 For the present invention Figure 3 A comparison of the spectral curves at Position 1 in the CAVE scene shown;

[0053] Figure 5 For the present invention Figure 3 A comparison of the spectral curves at Position 2 in the CAVE scene shown;

[0054] Figure 6 For the present invention Figure 3 A comparison of the spectral curves at Position 3 in the CAVE scene shown;

[0055] Figure 7 A schematic diagram of the selected scenario for the TT-31 dataset of this invention;

[0056] Figure 8 For the present invention Figure 7 A comparison of the spectral curves at Position 1 in the TT-31 scene shown;

[0057] Figure 9 For the present invention Figure 7 A comparison of the spectral curves at Position 2 in the TT-31 scene shown;

[0058] Figure 10 For the present invention Figure 7 A comparison of the spectral curves at Position 3 in the TT-31 scene shown;

[0059] Figure 11 A schematic diagram of the selected scene for the NTIRE dataset of this invention;

[0060] Figure 12 For the present invention Figure 11 A comparison of the spectral curves at Position 1 in the NTIRE scene shown;

[0061] Figure 13 For the present invention Figure 11 A comparison of the spectral curves at Position 2 in the NTIRE scene shown;

[0062] Figure 14 For the present invention Figure 11 The image shows a comparison of the spectral curves at Position 3 in the NTIRE scene. Detailed Implementation

[0063] To make the technical means, creative features, objectives and effects of this invention easy to understand, the following embodiments are described in detail with reference to the accompanying drawings.

[0064] Figures 1-14 This is a specific embodiment of the present invention, which is...

[0065] A multispectral demosaicing method based on adaptive spectral correlation iteration includes the following steps:

[0066] Step 1, Generate Mosaic Image: A reference image is constructed by simulating the transmittance function of a multispectral filter using a Gaussian function. The reference image is then downsampled using a multispectral filter array to generate a mosaic image. The specific steps are as follows:

[0067] (1) A reference image was constructed by simulating the transmittance function of the multispectral filter using a Gaussian function, and a CIE D65 light source was used. The pixel value of the simulated multispectral camera is calculated from the spectral reflectance at a point. Finally, the pixel value obtained by integration is normalized to ensure that the pixel value of each band is within the range of [0, 255]. The calculation method is as follows:

[0068]

[0069] In the formula For filter Pixel values ​​of the band, It is a point Spectral reflectance of the scene The spectral power distribution of the light source, express The sensitivity function of the filter in the band. These are the normalization coefficients; For wavelength range;

[0070] (2) A mosaic image is generated by downsampling the reference image using a multispectral filtering array. The multispectral filtering array has a 4×4 binary tree arrangement structure, and each spatial pixel records information of only a single band. The final single-band mosaic image can be represented as:

[0071]

[0072] In the formula for Binary mask for a band, when the pixel is in The value is 1 for bands and 0 for other bands. This indicates element-wise multiplication.

[0073] Step 2, Initial Multispectral Image Reconstruction: Extract the global spatial structure from the mosaic image to generate an initial pseudo-panchromatic image, and then reconstruct the initial multispectral image using a guided filtering method. The specific steps are as follows:

[0074] (1) By fusing the mosaic image through weighted smoothing filtering, the global spatial structure is extracted to generate a pseudo-panchromatic image:

[0075]

[0076] The asterisk (*) indicates a two-dimensional convolution operation, using the "same" mode and the "replicate" padding strategy. This represents the corresponding weighted smoothing filter kernel, which enhances spatial continuity through weighted averaging, enabling the pseudo-panchromatic image to retain the main edges and texture structures of the scene;

[0077] (2) Reconstruct the initial multispectral image using the guided filtering method, assuming that the image to be reconstructed is... Band image It satisfies a local linear relationship with the pseudopanchromatic image:

[0078]

[0079] In the formula, Represented in pixels A local window centered at a radius of 4, For any pixel in this window, and It is a set of locally linear coefficients within the window, only related to the center position. related;

[0080] (3) Solve and By minimizing the energy function To preserve the structural information of the guide map, suppress noise and prevent overfitting, and minimize the difference from the output image, since a single pixel i may belong to multiple windows, the final output needs to be a weighted average of the linear coefficients of all windows containing that pixel.

[0081] The calculation method is as follows:

[0082]

[0083] In the formula, It is a regularization parameter to prevent Too large an amount can lead to overfitting. express The mosaic image of the band at location Pixel values; binary mask The constraint-guided filtering is used to calculate linear coefficients using only the effective sampling points of that band.

[0084] (4) The final output, which preserves the spatial structure, can be represented as:

[0085]

[0086] Step 3, Construction of a High-Correlation Pseudo-Palmchromatic Image: The Pearson correlation coefficient is used to quantify the spectral correlation between different bands of the initial multispectral image. High-correlation bands are selected by a threshold and a high-correlation pseudo-panchromatic image is constructed. The highly correlated multispectral image is then reconstructed using a guided filtering method. The specific steps are as follows:

[0087] (1) Taking full account of the inherent spectral correlation between bands in multispectral images, the Pearson correlation coefficient is used to quantify the spectral correlation between different bands for multispectral images. and Band spectral vector and Its Pearson correlation coefficient is defined as:

[0088]

[0089] In the formula For covariance, The standard deviation is denoted as Pearson correlation coefficient, which ranges from [−1, 1]. The closer the value is to 1, the stronger the linear correlation between the two bands.

[0090] (2) Set the filtering threshold (Step size 0.01) and determine the set of highly correlated bands. Based on this set, construct Highly correlated pseudo-panchromatic images of the bands:

[0091]

[0092] In the formula, For the first In the next iteration Highly correlated pseudo-panchromatic images of the bands, The number of elements in the set. For the multispectral image after the previous iteration Band image, and its related band set It is dynamically updated as the correlation of different spectral bands changes during the iteration process to adapt to changes in spectral characteristics;

[0093] (3) with As a new guiding image, a highly correlated multispectral image is reconstructed using a guided filtering method:

[0094]

[0095] In the formula, This represents the guided filter operator, with the guided graph as input. With mosaic image .

[0096] Step 4, Adaptive Iteration to Determine Parameters: The highly correlated pseudo-panchromatic image is iteratively updated using an adaptive iteration strategy. The optimal number of iterations and screening threshold are adaptively selected through a comprehensive evaluation index, outputting a high-quality final multispectral image. The specific operation steps are as follows:

[0097] (1) Too many iterations may lead to overfitting to noise or local anomalous spectra, and will also increase computational costs. The maximum number of iterations is set to 16. In order to determine the optimal number of iterations t and the screening threshold, To balance reconstruction quality and computational cost, a comprehensive evaluation index was defined. To quantify reconstruction error:

[0098]

[0099] In the formula, RMSE is the root mean square error, which measures the deviation of pixel values ​​from the true values; SAM is the spectral angle mapping, which measures the angular deviation of the spectral vector; PSNR is the peak signal-to-noise ratio, which evaluates the quality of spatial detail recovery; and SSIM is the structural similarity, which reflects the degree of preservation of image structure and contrast.

[0100] (2) Determine the optimal parameter combination by minimizing the comprehensive evaluation index:

[0101]

[0102] Output high-quality final multispectral images This completes the mosaic removal process for multispectral images.

[0103] The role and effect of the embodiments

[0104] This embodiment provides a multispectral demosaicing method that considers spectral correlation and dynamically updates the guiding image to improve the accuracy of multispectral image reconstruction. First, a pseudo-panchromatic image is generated from the mosaic image using weighted smoothing filtering, and the initial multispectral image is recovered using a guided filtering method. Then, the spectral correlation between different bands is quantified using the Pearson correlation coefficient to construct a band-selective pseudo-panchromatic image for multispectral image estimation. Finally, an adaptive iterative strategy for dynamically updating the band-selective pseudo-panchromatic image is employed to adaptively select the optimal parameters and generate a high-quality multispectral image.

[0105] In this invention, the Pearson correlation coefficient was selected as the quantitative index of spectral correlation. Compared with other correlation coefficients, the Pearson correlation coefficient has advantages such as high accuracy in quantifying linear correlation, low computational complexity, and high spectral fidelity in capturing spectral features. Figure 2 The Pearson correlation coefficient matrix of the 16-band multispectral image is displayed.

[0106] from Figure 2 As can be seen, the correlation between adjacent bands is significantly higher than that between non-adjacent bands.

[0107] Table 1. Comparison of the average values ​​of PSNR, SSIM, RMSE, and SAM for this invention and other demosaic methods across all datasets.

[0108]

[0109] The table above shows the average PSNR, SSIM, RMSE, and SAM for the proposed method and other demosaic methods across all datasets, with the best results highlighted in bold.

[0110] The results show that the present invention outperforms the comparative methods in all metrics. It performs exceptionally well in spatial detail recovery and spectral fidelity, and maintains strong generalization ability across different scenarios.

[0111] To verify the spectral reconstruction capability of the present invention Figures 3-14 A test scene was selected from the CAVE, TT-31, and NTIRE datasets, and the spectral curves of three texture-rich locations in the reconstructed spectral images obtained by different demosaic methods were compared.

[0112] from Figures 3-14 As can be seen from the data, compared with other methods, the reconstructed spectral data curve of the present invention is closer to the true ground value and has better spectral recovery performance than other methods.

[0113] In the multispectral demosaic method of this embodiment, since spectral correlation and dynamic updating of the guide image are taken into account, the calculation is simple, the spectral fidelity is high, and it is relatively convenient for users to use.

[0114] The above embodiments are preferred embodiments of the present invention and are not intended to limit the scope of protection of the present invention.

Claims

1. A multi-spectral demosaicking method based on adaptive spectral correlation iteration, characterized in that, The method is realized by the following steps: S1, generating a mosaic image: a Gaussian function is used to simulate the transmittance function of a multi-spectral filter to construct a reference image, and a multi-spectral filter array is used to down-sample the reference image to generate a mosaic image; S2, initial multi-spectral image reconstruction: a global spatial structure is extracted from the mosaic image to generate an initial pseudo-panchromatic image, and a guided filtering method is used to reconstruct the initial multi-spectral image; S3, construction of a high-correlation pseudo-panchromatic image: the spectral correlation between different wavebands of the initial multi-spectral image is quantified using a Pearson correlation coefficient, high-correlation wavebands are selected by filtering a threshold, and a high-correlation pseudo-panchromatic image is constructed, and a guided filtering method is used to reconstruct a high-correlation multi-spectral image; the construction of the high-correlation pseudo-panchromatic image in S3 comprises the following steps: S31, fully considering the inherent spectral correlation between the bands of the multispectral image, the spectral correlation between different bands is quantified by using the Pearson correlation coefficient, and the bands of the multispectral image are selected according to the Pearson correlation coefficient and band spectral vector and The Pearson correlation coefficient is defined as: In the formula Covariance, Standard deviation, the Pearson correlation coefficient ranges from [−1, 1], the closer to 1, the stronger the linear correlation between the two bands; the closer to 0, the weaker the linear correlation. S32, set the screening threshold (step 0.01) and determine the high correlation band set , based on the set, construct high correlation pseudo panchromatic image of the band: wherein is the number of iterations, is the number of iterations, a high-correlation pseudo-panchromatic image of the waveband, is the number of set elements, is the number of iterations, a waveband image, whose relevant waveband set is dynamically updated to adapt to the changes in spectral characteristics with the changes in spectral correlation of different wavebands during the iteration process; S33, with As a new guidance image, the high correlation multispectral image is reconstructed by using a guidance filtering method: In the formula, denotes a guided filter operator, the input is a guided image with a mosaic image ; S4, adaptive iteration parameter determination: the high-correlation pseudo-panchromatic image is iteratively updated using an adaptive iteration strategy, the optimal iteration number and filtering threshold are adaptively selected by a comprehensive evaluation index, and a high-quality final multi-spectral image is output.

2. The multi-spectral demosaicing method based on adaptive spectral correlation iteration according to claim 1, characterized in that, The specific steps of generating a mosaic image in S1 are as follows: S11, the transmittance function of the multispectral filter is simulated by a Gaussian function to construct a reference image, and CIE D65 light source and The pixel value of the simulated multispectral camera is calculated by the spectral reflectance at the point, and finally the pixel value obtained by integration is normalized to ensure that the pixel value of each waveband is in the range of [0, 255]; the calculation method is as follows: wherein is a filter pixel value of a waveband, is a point spectral reflectance of a scene at the point, is a spectral power distribution of a light source, denotes filter sensitivity function of a waveband, is a normalization coefficient; is a wavelength range; S12, down-sampling the reference image using a multi-spectral filter array to generate a mosaic image, the multi-spectral filter array has a 4x4 binary tree arrangement structure, each spatial pixel only records single-band information, and the final single-band mosaic image can be represented as: In the formula is a binary mask of the waveband, which is 1 when the pixel point is in the waveband, and 0 otherwise; a binary mask of the waveband, which is 1 when the pixel point is in the waveband, and 0 otherwise; denotes element-wise multiplication.

3. The multi-spectral demosaicking method based on adaptive spectral correlation iteration according to claim 1, characterized in that, The specific steps of initial multi-spectral image reconstruction in S2 are as follows: S21, fuse the mosaic image by weighted smoothing filtering, extract the global spatial structure to generate a pseudo-panchromatic image: Where '*' represents two-dimensional convolution operation, "same" mode and "replicate" filling strategy are used; represents a corresponding weighted smoothing filter kernel, which enhances spatial continuity by weighted averaging, so that the pseudo-panchromatic image preserves the main edge and texture structure of the scene; S22, reconstructing the initial multispectral image using a guided filtering method, since the to-be-reconstructed waveband image satisfies a local linear relationship with the pseudo-panchromatic image: wherein, represents a local window of radius 4 centered at pixel , for any pixel point in this window, and is a set of local linear coefficients within the window, only related to the center position . S23, solving and By minimizing the energy function to preserve the structural information of the guiding image, suppress noise and prevent overfitting, realize the minimization of the difference with the output image, since a single pixel i may belong to multiple windows, the final output needs to weight the linear coefficients of all windows containing this pixel The calculation method is as follows: wherein is a regularization parameter that prevents overfitting due to too large representing a mosaic image of wavebands at the location of the pixel value; a binary mask for constraining the guided filter to only use valid samples of that waveband for computing linear coefficients; S24, the initial multi-spectral image that retains the spatial structure and is finally output can be represented as: 。 4. The multi-spectral demosaicking method based on adaptive spectral correlation iteration of claim 1, wherein, The specific steps of adaptive iteration parameter determination in S4 are as follows: S41, too many iterations can lead to over-fitting to noise or local abnormal spectrum, while also increasing the computational cost, the maximum number of iterations is set to 16; in order to determine the optimal number of iterations t and the screening threshold , while balancing the reconstruction quality and the computational cost, a comprehensive evaluation index is defined to quantify the reconstruction error: In the formula, RMSE is the root mean square error, which measures the deviation of pixel value from the true value, SAM is the spectral angle mapping, which measures the angle deviation of the spectral vector; PSNR is the peak signal-to-noise ratio, which evaluates the spatial detail recovery quality; SSIM is the structural similarity, which reflects the retention degree of image structure and contrast; S42, determine the optimal parameter combination by minimizing the comprehensive evaluation index: S43, output high-quality final multispectral image , complete the multispectral image demosaicing process.

Images