Hyperspectral image sparse unmixing method based on multi-scale super-pixel low-rank representation

By introducing multi-scale superpixel low-rank representation and alternating direction multiplier method in hyperspectral image sparse demix algorithm, the problem of insufficient demix accuracy at a single scale is solved, and higher demix accuracy and performance improvement are achieved .

CN119168864AActive Publication Date: 2024-12-20CHINA UNIV OF GEOSCIENCES (WUHAN)

Patent Information

Application Number
CN202411292080.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-14
Publication Date
2024-12-20
Estimated Expiration
2044-09-14

AI Technical Summary

Technical Problem

The existing hyperspectral image sparse demix algorithm cannot fully capture the spatial information of hyperspectral images under a single segmentation scale, resulting in a reduced accuracy of demix.

Method used

Using a method based on multi-scale superpixel low-rank representation, the objective function is constructed and solved using alternating direction multiplier method to adaptively construct the spectral weighting factor of the abundance matrix by introducing Frobenius norm, L1 norm and weighted kernel norm constraints. and the spatial weighting factor, obtain multi-scale superpixel segmentation graphs, thereby improving the performance of the demix algorithm.

Benefits of technology

Effectively constrain model parameters, promote the sparseness of the abundance matrix, improve the accuracy and performance of the understanding of the mixing algorithm, simplify the solution process and speed up the convergence speed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119168864A_ABST
    Figure CN119168864A_ABST
Patent Text Reader

Abstract

The invention discloses a hyperspectral image sparse unmixing method based on multi-scale super-pixel low-rank representation, and the method comprises the following steps: introducing a Frobenius norm to calculate a difference value between a reconstructed hyperspectral image and an original hyperspectral image, and taking a minimum difference value as a data fidelity term of an objective function; introducing an L1 norm to adaptively construct a spectrum weighting factor and a space weighting factor of the abundance matrix to obtain a sparse regularization item of the target function; obtaining a plurality of segmentation images with different segmentation scales based on a superpixel segmentation algorithm; introducing weighted nuclear norm constraint to the superpixel region of each segmented image to obtain a low-rank representation regularization item of the target function; constructing a target function; and solving the objective function through an alternating direction multiplier method. According to the method, the complementary information from a plurality of segmentation scales is adaptively integrated by constructing the multi-scale super-pixel guided low-rank regularization item, so that the performance of a de-mixing algorithm and the accuracy of a result are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of sparse unmixing of hyperspectral images, and in particular to a sparse unmixing method of hyperspectral images based on multi-scale superpixel low-rank representation. Background Art

[0002] Hyperspectral images consist of three-dimensional data cubes containing a large number of channels. This rich spectral information is crucial for the interpretation of ground targets and has been widely used in agriculture, food safety, geological exploration, and environmental protection. However, in real scenarios, the diversity of target distribution and the spatial resolution limitations of hyperspectral image sensors cause hyperspectral image pixels to appear as a mixture of multiple endmembers. The presence of mixed pixels limits the accurate interpretation of hyperspectral images and further information exploration. To address this problem, a hyperspectral unmixing method is proposed, which decomposes mixed pixels into pure material components and their corresponding proportions.

[0003] Hyperspectral unmixing algorithms can generally be divided into unsupervised and semi-supervised methods. Unsupervised unmixing algorithms may extract endmembers without actual physical meaning from hyperspectral images, resulting in unmixing results that do not meet the requirements. Semi-supervised unmixing methods are also called sparse unmixing, which uses a known spectral library as an endmember matrix and estimates the abundance of each target. However, existing sparse unmixing algorithms only consider the correlation of abundance within homogeneous regions at a single segmentation scale. Although this method is effective in some cases, since the objects in hyperspectral images usually exhibit spatial characteristics at different scales, the homogeneous regions at a single scale cannot fully capture the spatial information of the hyperspectral image, thereby reducing the unmixing accuracy of the sparse unmixing algorithm. Summary of the invention

[0004] In order to solve the above-mentioned technical problems, the present invention provides a sparse unmixing method for hyperspectral images based on multi-scale superpixel low-rank representation.

[0005] The technical solution adopted by the present invention is:

[0006] A hyperspectral image sparse unmixing method based on multi-scale superpixel low-rank representation includes the following specific steps:

[0007] S1. Introduce the Frobenius norm to calculate the difference between the reconstructed hyperspectral image and the original hyperspectral image, and take the minimum difference as the data fidelity term of the objective function;

[0008] S2. Based on the abundance matrix in the original hyperspectral image, the L1 norm is introduced to adaptively construct the spectral weighting factor and the spatial weighting factor of the abundance matrix to obtain the sparse regularization term of the objective function;

[0009] S3, setting the superpixel size of the original hyperspectral image, obtaining multiple segmentation maps of different segmentation scales based on the superpixel segmentation algorithm, and calculating the Calinski-Harabasz index of each segmentation map to obtain the weighting factor of each segmentation map;

[0010] S4, introducing a weighted nuclear norm constraint into the superpixel region of each segmentation map to obtain a low-rank representation regularization term of the objective function;

[0011] S5. constructing an objective function based on the data fidelity term, the sparse regularization term and the low-rank representation regularization term;

[0012] S6. Solve the objective function by the alternating direction multiplication method to obtain the target abundance matrix.

[0013] Furthermore, the step S1 specifically includes the following steps:

[0014] S11, obtaining original hyperspectral images;

[0015] S12, using a linear mixed model to decompose the mixed pixels of the original hyperspectral image to obtain a spectral library of multiple end members and a combination coefficient corresponding to each end member to obtain a reconstructed hyperspectral image;

[0016] The reconstructed hyperspectral image is represented by Y=AX+N; Y=[y1,...,y m ]∈R l×m represents the original hyperspectral image, which contains l spectral bands and m pixels; A = [a1, ..., a p ]∈R l×p represents a spectral library with p end members; X = [x1, ..., x m ]∈R p×m Represents the combination coefficient corresponding to each end member, that is, the abundance matrix of the original hyperspectral image; AX represents the reconstructed hyperspectral image; N∈R m×l represents additional noise and error.

[0017] S13. Based on the original hyperspectral image and the reconstructed hyperspectral image, the Frobenius norm is introduced to calculate the difference between the reconstructed hyperspectral image and the original hyperspectral image, and the minimum difference is taken as the data fidelity term of the objective function; the data fidelity term of the objective function is expressed as

[0018] Wherein, Y represents the original hyperspectral image; AX represents the reconstructed hyperspectral image; Y-AX represents the matrix of the original hyperspectral image and the reconstructed hyperspectral image; is the Frobenius norm of the matrix Y-AX.

[0019] Furthermore, the step S2 specifically includes the following steps:

[0020] S21, obtaining the abundance matrix in the original hyperspectral image;

[0021] S22, adding the L1 norm to the abundance matrix to calculate the sum of the absolute values ​​of the minimum abundance matrix;

[0022] S23, based on the row sparsity of the abundance matrix, adaptively constructing and calculating the spectral weighting factor of the abundance matrix;

[0023] S24, based on the sparsity of the elements of the abundance matrix, adaptively constructing and calculating a spatial weighting factor of the abundance matrix;

[0024] S25, obtaining a sparse regularization term of the objective function based on the spectral weighting factor, the spatial weighting factor and the L1 norm of the abundance matrix;

[0025] Specifically, It is expressed as the L1 norm of the abundance matrix X; the calculation formula of the spectral weighting factor is Where i=1, ..., p, X(i,:) represents the i-th row element of the abundance matrix X; the calculation formula of the spatial weighting factor is in, Represents the mixed pixel x of the original hyperspectral image ij The coverage of the neighborhood; λ||W spe W spa ⊙X|| 1,1 It is represented as the sparse regularization term of the objective function, where λ represents the parameter of the sparse regularization term, which is used to measure the importance of the sparse regularization term of the objective function.

[0026] Furthermore, it is characterized in that the step S3 specifically comprises the following steps:

[0027] S31, obtaining an original hyperspectral image;

[0028] S32, setting the superpixel size of the original hyperspectral image to calculate the segmentation scale and the number of segmentation scales of the original hyperspectral image;

[0029] S33, based on the segmentation scale and the number of segmentation scales, using a superpixel segmentation algorithm to iteratively obtain multiple segmentation maps with different segmentation scales;

[0030] S34, based on multiple segmentation graphs of different segmentation scales, calculating the Calinski-Harabasz index to obtain the weight of each segmentation graph;

[0031] Specifically, for the hth segmentation map, the specific segmentation process is as follows:

[0032] 1) Set the superpixel size of the original hyperspectral image to S;

[0033] 2) The segmentation scale S of the original hyperspectral image is obtained by calculation h , and its calculation formula is:

[0034] S h =S+(-1) h ,h=1,2,...,H

[0035] In the formula, H is the number of segmentation scales, S h Is an integer greater than 0.

[0036] 3) Run the simple linear iterative algorithm H times to obtain H segmentation maps with different segmentation scales;

[0037] 4) Select K h seed points, among which K h is the total number of superpixels in the h-th segmentation map; m is the number of pixels in the h-th segmentation map;

[0038] 5) Calculate the spectral distance and spatial distance between each mixed pixel near each seed point and the seed point; the calculation formulas of the spectral distance and spatial distance are respectively:

[0039]

[0040]

[0041] Where, d spatial and d spectral Represents the spatial distance and spectral distance between mixed pixels; (x i ,y i )、(x j ,y j ) represent the spatial coordinate information of the mixed pixels; y i ,y j Represents the spectral characteristics of mixed pixels i and j.

[0042] 6) Based on the spectral distance and spatial distance, the difference between the mixed pixels is calculated; the specific calculation formula is:

[0043]

[0044] Where Dis is an index used to measure the difference between mixed pixels; r is a weight used to balance the spectral distance and spatial distance.

[0045] 7) Compare the spectral distance and the spatial distance with the preset thresholds respectively, select the mixed pixels whose spectral distance and spatial distance are respectively less than the preset thresholds and assign them to the seed points;

[0046] 8) The average value of all pixels of each superpixel in the segmentation map is taken as the new center point, and the above steps are repeated until the number of iterations is reached or convergence occurs;

[0047] S35, summing the weights of the multiple segmentation graphs to obtain a weight factor of the segmentation graph;

[0048] Specifically, for the hth segmentation map, the corresponding weight is:

[0049]

[0050] In the formula, C h represents the Calinski-Harabasz index of the hth segmentation map; R h is the covariance matrix between pixels of the h-th segmentation map; E h is the covariance matrix between the elements in the superpixel of the hth segmentation map; m and K h are the number of pixels and the total number of superpixels of the h-th segmentation map, respectively.

[0051] Furthermore, the step S4 specifically includes the following steps:

[0052] S41, obtaining multiple segmentation maps of different segmentation scales;

[0053] S42, introducing a weighted nuclear norm constraint into the superpixel region of each segmentation image to obtain similar abundance matrices corresponding to mixed pixels in the same superpixel region;

[0054] S43, introduce the weight of the segmentation map, and adaptively fuse multiple segmentation map features of different segmentation scales;

[0055] S44, obtaining a multi-scale superpixel guided low-rank representation regularization term of the objective function based on the weighted nuclear norm constraint and the weight of the segmentation map;

[0056] Specifically, for the hth segmentation map, a weighted nuclear norm constraint is added, which is specifically expressed as:

[0057]

[0058] In the formula, ω j is a weighting factor that imposes a larger penalty on smaller singular values, thus forcing them to be close to zero in the next iteration; X i represents the abundance matrix of the mixed pixel in the i-th superpixel;

[0059] The low-rank representation regularization term of the objective function is expressed as:

[0060]

[0061] Where β represents the hyperparameter of the low-rank regularization term of the objective function.

[0062] Furthermore, the step S6 specifically includes the following steps:

[0063] S61, introduce variables U, V and Lagrange multiplier D = {D1, D2, D3, D4},

[0064] S62. Construct Lagrangian function:

[0065]

[0066] in,

[0067]

[0068] μ represents the penalty parameter, μ>0;

[0069] G and B are defined as:

[0070] G = [A, I, I, I] T

[0071]

[0072] I represents the identity matrix;

[0073] S63. Lagrangian function The variables U, V and D are solved iteratively as follows:

[0074] S631, fixed variables v and D, the optimization problem about variable U is expressed as:

[0075]

[0076] Where d represents the number of iterations. By taking the partial derivative of the variable U in the above formula and making it equal to zero, the solution of the variable U is:

[0077] U (d+1) ←(A T A+3I) -1 (A T ζ1+ζ2+ζ3+ζ4)

[0078] in,

[0079] S632, variable V contains four sub-problems, namely V1, V2, V3 and V4:

[0080] 1) The optimization problem and solution of variable V1 are expressed as:

[0081]

[0082]

[0083] 2) The optimization problem and solution of variable V2 are expressed as:

[0084]

[0085]

[0086] 3) The optimization problem of variable V3 is expressed as:

[0087]

[0088] For each The solution is:

[0089]

[0090] in, The i-th superpixel region corresponding to the h-th segmentation scale; Γ w,τ (X) = U (Π-τdiag(w)) + T ;UΠV T represents the singular value decomposition of matrix X; (x) + =max(x,0).

[0091] 4) The optimization problem and solution of variable V4 are expressed as:

[0092]

[0093] Each time the variables U, V, and D are updated, the number of iterations d increases by 1; the residual of the variable calculation objective function When it is less than the predefined threshold T h When d = 0.0001 or the maximum number of iterations d = 1000 is reached, the algorithm stops obtaining the target abundance matrix, and then obtains the target abundance map.

[0094] Compared with the prior art, the present invention has the following beneficial effects:

[0095] 1) By adding the Frobenius norm of the abundance matrix as a regularization term in the objective function, the size of the model parameters can be effectively constrained;

[0096] 2) By introducing the L1 norm and adaptively calculating the spectral weighting factor and the spatial weighting factor, the row sparsity and element sparsity of the abundance matrix are effectively improved;

[0097] 3) By using different superpixel segmentation scales, we obtain a multi-scale superpixel segmentation map, and then construct a multi-scale superpixel guided low-rank regularization term to adaptively integrate complementary information from multiple segmentation scales, thereby improving the performance of the demixing algorithm and the accuracy of the results;

[0098] 4) By introducing the alternating direction multiplier method, the objective function is decomposed into multiple simple and easy-to-solve sub-problems, making the algorithm easier to solve and accelerating the convergence speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0099] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments:

[0100] Figure 1 It is a flow chart of a method for sparse unmixing of hyperspectral images based on multi-scale superpixel low-rank representation of the present invention;

[0101] Figure 2 It is a flow chart of solving the objective function of a sparse unmixing method for hyperspectral images based on multi-scale superpixel low-rank representation of the present invention. DETAILED DESCRIPTION

[0102] Example

[0103] like Figure 1 to Figure 2 As shown, a hyperspectral image sparse unmixing method based on multi-scale superpixel low-rank representation includes the following specific steps:

[0104] S1. Introduce the Frobenius norm to calculate the difference between the reconstructed hyperspectral image and the original hyperspectral image, and take the minimum difference as the data fidelity term of the objective function;

[0105] S11, obtaining original hyperspectral images;

[0106] S12, using a linear mixed model to decompose the mixed pixels of the original hyperspectral image to obtain a spectral library of multiple end members and a combination coefficient corresponding to each end member to obtain a reconstructed hyperspectral image;

[0107] The reconstructed hyperspectral image is represented by Y=AX+N; Y=[y1, ..., y m ]∈R l×m represents the original hyperspectral image, which contains spectral bands and m pixels; A = [a1, ..., a p ]∈R l×p represents a spectral library with p end members; X = [x1, ..., x m]∈R p×m Represents the combination coefficient corresponding to each end member, that is, the abundance matrix of the original hyperspectral image; AX represents the reconstructed hyperspectral image; N∈R m×l represents additional noise and error.

[0108] S13. Based on the original hyperspectral image and the reconstructed hyperspectral image, the Frobenius norm is introduced to calculate the difference between the reconstructed hyperspectral image and the original hyperspectral image, and the minimum difference is taken as the data fidelity term of the objective function; the data fidelity term of the objective function is expressed as

[0109] Wherein, Y represents the original hyperspectral image; AX represents the reconstructed hyperspectral image; Y-AX represents the matrix of the original hyperspectral image and the reconstructed hyperspectral image; is the Frobenius norm of the matrix Y-AX.

[0110] S2. Based on the abundance matrix in the original hyperspectral image, the L1 norm is introduced to adaptively construct the spectral weighting factor and the spatial weighting factor of the abundance matrix to obtain the sparse regularization term of the objective function;

[0111] S21, obtaining the abundance matrix in the original hyperspectral image;

[0112] S22, adding the L1 norm to the abundance matrix to calculate the sum of the absolute values ​​of the minimum abundance matrix;

[0113] S23, based on the row sparsity of the abundance matrix, adaptively constructing and calculating the spectral weighting factor of the abundance matrix;

[0114] S24, based on the sparsity of the elements of the abundance matrix, adaptively constructing and calculating a spatial weighting factor of the abundance matrix;

[0115] S25, obtaining a sparse regularization term of the objective function based on the spectral weighting factor, the spatial weighting factor and the L1 norm of the abundance matrix;

[0116] Specifically, It is expressed as the L1 norm of the abundance matrix X; the calculation formula of the spectral weighting factor is Where i=1, ..., p, X(i,:) represents the i-th row element of the abundance matrix X; the calculation formula of the spatial weighting factor is in, Represents the mixed pixel x of the original hyperspectral image ij The coverage of the neighborhood; λ||W spe W spa ⊙X|| 1,1It is represented as the sparse regularization term of the objective function, where λ represents the parameter of the sparse regularization term, which is used to measure the importance of the sparse regularization term of the objective function.

[0117] S3, setting the superpixel size of the original hyperspectral image, obtaining multiple segmentation maps of different segmentation scales based on the superpixel segmentation algorithm, and calculating the Calinski-Harabasz index of each segmentation map to obtain the weight of each segmentation map;

[0118] S31, obtaining an original hyperspectral image;

[0119] S32, setting the superpixel size of the original hyperspectral image to calculate the segmentation scale and the number of segmentation scales of the original hyperspectral image;

[0120] S33, based on the segmentation scale and the number of segmentation scales, using a superpixel segmentation algorithm to iteratively obtain multiple segmentation maps with different segmentation scales;

[0121] S34, based on multiple segmentation graphs of different segmentation scales, calculating the Calinnski-Harabasz index to obtain the weight of each segmentation graph;

[0122] Specifically, for the hth segmentation map, the specific segmentation process is as follows:

[0123] 1) Set the superpixel size of the original hyperspectral image to S;

[0124] 2) The segmentation scale S of the original hyperspectral image is obtained by calculation h , and its calculation formula is:

[0125] S h =S+(-1) h , h=1,2,...,H

[0126] In the formula, H is the number of segmentation scales, S h Is an integer greater than 0.

[0127] 3) Run the simple linear iterative algorithm H times to obtain H segmentation maps with different segmentation scales;

[0128] 4) Select K h seed points, among which K h is the total number of superpixels in the h-th segmentation map; m is the number of pixels in the h-th segmentation map;

[0129] 5) Calculate the spectral distance and spatial distance between each mixed pixel near each seed point and the seed point; the calculation formulas of the spectral distance and spatial distance are respectively:

[0130]

[0131]

[0132] Where, d spatial and d spectral represents the spatial distance and spectral distance between mixed pixels; (x i ,y i )、(x j ,y j ) represent the spatial coordinate information of the mixed pixels; y i ,y j Represents the spectral characteristics of mixed pixels i and j.

[0133] 6) Based on the spectral distance and spatial distance, the difference between the mixed pixels is calculated; the specific calculation formula is:

[0134]

[0135] Where Dis is an index used to measure the difference between mixed pixels; r is a weight used to balance the spectral distance and spatial distance.

[0136] 7) Compare the spectral distance and the spatial distance with the preset thresholds respectively, select the mixed pixels whose spectral distance and spatial distance are respectively less than the preset thresholds and assign them to the seed points;

[0137] 8) The average value of all pixels of each superpixel in the segmentation map is taken as the new center point, and the above steps are repeated until the number of iterations is reached or convergence occurs;

[0138] S35, summing the weights of the multiple segmentation graphs to obtain a weight factor of the segmentation graph;

[0139] Specifically, for the hth segmentation map, the corresponding weight is:

[0140]

[0141] In the formula, C h represents the Calinski-Harabasz index of the hth segmentation map; R h is the covariance matrix between pixels of the h-th segmentation map; E h is the covariance matrix between the elements in the superpixel of the hth segmentation map; m and K h are the number of pixels and the total number of superpixels of the h-th segmentation map, respectively.

[0142] S4, introducing a weighted nuclear norm constraint into the superpixel region of each segmentation map to obtain a low-rank representation regularization term of the objective function;

[0143] S41, obtaining multiple segmentation maps of different segmentation scales;

[0144] S42, introducing a weighted nuclear norm constraint into the superpixel region of each segmentation image to obtain similar abundance matrices corresponding to mixed pixels in the same superpixel region;

[0145] S43, introduce the weight of the segmentation map, and adaptively fuse multiple segmentation map features of different segmentation scales;

[0146] S44, obtaining a multi-scale superpixel guided low-rank representation regularization term of the objective function based on the weighted nuclear norm constraint and the weight of the segmentation map;

[0147] Specifically, for the hth segmentation map, a weighted nuclear norm constraint is added, which is specifically expressed as:

[0148]

[0149] In the formula, ω j is a weighting factor that imposes a larger penalty on smaller singular values, thus forcing them to be close to zero in the next iteration; X i represents the abundance matrix of the mixed pixel in the i-th superpixel;

[0150] The low-rank representation regularization term of the objective function is expressed as:

[0151]

[0152] Where β represents the hyperparameter of the low-rank regularization term of the objective function.

[0153] S5. Construct an objective function based on the data fidelity term, the sparse regularization term and the low-rank representation regularization term of the objective function, which is specifically expressed as follows:

[0154]

[0155] In the formula, lR + (X) indicates the non-negativity of the abundance matrix.

[0156] S6. Solve the objective function by the alternating direction multiplication method to obtain the target abundance matrix. The specific solution process is as follows:

[0157] S61, introduce variables U, V and Lagrange multiplier D = {D1, D2, D3, D4},

[0158] S62. Construct Lagrangian function:

[0159]

[0160] in,

[0161]

[0162] μ represents the penalty parameter, μ>0;

[0163] G and B are defined as:

[0164] G = [A, I, I, I] T

[0165]

[0166] I represents the identity matrix;

[0167] S63. Lagrangian function The variables U, V and D are solved iteratively as follows:

[0168] S631, fixed variables V and D, the optimization problem about variable U is expressed as:

[0169]

[0170] Where d represents the number of iterations. By taking the partial derivative of the variable U in the above formula and making it equal to zero, the solution of the variable U is:

[0171] U (d+1) ←(A T A+3I) -1 (A T ζ1+ζ2+ζ3+ζ4)

[0172] in,

[0173] S632, variable V contains four sub-problems, namely V1, V2, V3 and V4:

[0174] 1) The optimization problem and solution of variable V1 are expressed as:

[0175]

[0176] 2) The optimization problem and solution of variable V2 are expressed as:

[0177]

[0178] 3) The optimization problem of variable V3 is expressed as:

[0179]

[0180] For each The solution is:

[0181]

[0182] in, The i-th superpixel region corresponding to the h-th segmentation scale; Γ w,τ (X) = U (Π-τdiag(w)) + V T ;UΠV T represents the singular value decomposition of matrix X; (x) + =max(x,0).

[0183] 4) The optimization problem and solution of variable V4 are expressed as:

[0184]

[0185]

[0186] Each time the variables U, V, and D are updated, the number of iterations d increases by 1; the residual of the variable calculation objective function When it is less than the predefined threshold T h When d = 0.0001 or the maximum number of iterations d = 1000 is reached, the algorithm stops obtaining the target abundance matrix, and then obtains the target abundance map.

[0187] The present invention can effectively constrain the size of model parameters by adding the Frobenius norm of the abundance matrix as a regularization term in the objective function; effectively promote the row sparsity and element sparsity of the abundance matrix by introducing the L1 norm and adaptively calculating the spectral weighting factor and the spatial weighting factor; obtain the segmentation map of multi-scale superpixels through different superpixel segmentation scales, and then construct a low-rank regularization term guided by multi-scale superpixels, adaptively integrate complementary information from multiple segmentation scales, thereby improving the performance of the demixing algorithm and the accuracy of the results; and introduce the alternating direction multiplier method to decompose the objective function into multiple simple and easy-to-solve sub-problems, so that the algorithm is easier to solve and the convergence speed is accelerated.

[0188] The embodiments described above are merely descriptions of preferred implementation modes of the present invention and are not intended to limit the scope of the present invention. Without departing from the principles and essence of the present invention, various modifications and improvements made to the technical solutions of the present invention by ordinary technicians in this field should all fall within the scope of protection determined by the claims of the present invention.

Claims

1. A sparse unmixing method for hyperspectral images based on multi-scale superpixel low-rank representation, characterized in that: The specific steps include: S1. Introduce the Frobenius norm to calculate the difference between the reconstructed hyperspectral image and the original hyperspectral image, and take the minimum difference as the data fidelity term of the objective function; S2. Based on the abundance matrix in the original hyperspectral image, the L1 norm is introduced to adaptively construct the spectral weighting factor and the spatial weighting factor of the abundance matrix to obtain the sparse regularization term of the objective function; S3, setting the superpixel size of the original hyperspectral image, obtaining multiple segmentation maps of different segmentation scales based on the superpixel segmentation algorithm, and calculating the Calinski-Harabasz index of each segmentation map to obtain the weighting factor of each segmentation map; S4, introducing a weighted nuclear norm constraint into the superpixel region of each segmentation map to obtain a low-rank representation regularization term of the objective function; S5. constructing an objective function based on the data fidelity term, the sparse regularization term and the low-rank representation regularization term; S6. Solve the objective function by the alternating direction multiplication method to obtain the target abundance matrix.

2. The method for sparse unmixing of hyperspectral images based on multi-scale superpixel low-rank representation according to claim 1, characterized in that: The step S1 specifically includes the following steps: S11, obtaining original hyperspectral images; S12, using a linear mixed model to decompose the mixed pixels of the original hyperspectral image to obtain a spectral library of multiple end members and a combination coefficient corresponding to each end member to obtain a reconstructed hyperspectral image; The reconstructed hyperspectral image is represented by Y=AX+N; Y=[y1, ..., y m ]∈R l×m represents the original hyperspectral image, which contains l spectral bands and m pixels; A = [a1, ..., a p ]∈R l×p represents a spectral library with p end members; X = [x1, ..., x m ]∈R p×m Represents the combination coefficient corresponding to each end member, that is, the abundance matrix of the original hyperspectral image; AX represents the reconstructed hyperspectral image; N∈R m×l represents additional noise and error. S13. Based on the original hyperspectral image and the reconstructed hyperspectral image, the Frobenius norm is introduced to calculate the difference between the reconstructed hyperspectral image and the original hyperspectral image, and the minimum difference is taken as the data fidelity term of the objective function; the data fidelity term of the objective function is expressed as Wherein, Y represents the original hyperspectral image; AX represents the reconstructed hyperspectral image; Y-AX represents the matrix of the original hyperspectral image and the reconstructed hyperspectral image; is the Frobenius norm of the matrix Y-AX.

3. The method for sparse unmixing of hyperspectral images based on multi-scale superpixel low-rank representation according to claim 1, characterized in that: The step S2 specifically includes the following steps: S21, obtaining the abundance matrix in the original hyperspectral image; S22, adding the L1 norm to the abundance matrix to calculate the sum of the absolute values ​​of the minimum abundance matrix; S23, based on the row sparsity of the abundance matrix, adaptively constructing and calculating the spectral weighting factor of the abundance matrix; S24, based on the sparsity of the elements of the abundance matrix, adaptively constructing and calculating a spatial weighting factor of the abundance matrix; S25, obtaining a sparse regularization term of the objective function based on the spectral weighting factor, the spatial weighting factor and the L1 norm of the abundance matrix; Specifically, It is expressed as the L1 norm of the abundance matrix X; the calculation formula of the spectral weighting factor is Where i=1, ..., p, X(i,:) represents the i-th row element of the abundance matrix X; the calculation formula of the spatial weighting factor is in, Represents the mixed pixel x of the original hyperspectral image ij The coverage of the neighborhood; λ||W spe W spa ⊙X|| 1,1 It is represented as the sparse regularization term of the objective function, where λ represents the parameter of the sparse regularization term, which is used to measure the importance of the sparse regularization term of the objective function.

4. The method for sparse unmixing of hyperspectral images based on multi-scale superpixel low-rank representation according to claim 1, characterized in that: The step S3 specifically comprises the following steps: S31, obtaining an original hyperspectral image; S32, setting the superpixel size of the original hyperspectral image to calculate the segmentation scale and the number of segmentation scales of the original hyperspectral image; S33, based on the segmentation scale and the number of segmentation scales, using a superpixel segmentation algorithm to iteratively obtain multiple segmentation maps with different segmentation scales; S34, based on multiple segmentation graphs of different segmentation scales, calculating the Calinski-Harabasz index to obtain the weight of each segmentation graph; Specifically, for the hth segmentation map, the specific segmentation process is as follows: 1) Set the superpixel size of the original hyperspectral image to S; 2) The segmentation scale S of the original hyperspectral image is obtained by calculation h , and its calculation formula is: S h =S+(-1) h ,h=1,2,...,H In the formula, H is the number of segmentation scales, S h Is an integer greater than 0. 3) Run the simple linear iterative algorithm H times to obtain H segmentation maps with different segmentation scales; 4) Select K h seed points, among which K h is the total number of superpixels in the h-th segmentation map; m is the number of pixels in the h-th segmentation map; 5) Calculate the spectral distance and spatial distance between each mixed pixel near each seed point and the seed point; the calculation formulas of the spectral distance and spatial distance are respectively: Where, d spatial and d spectral Represents the spatial distance and spectral distance between mixed pixels; (x i ,y i )、(x j ,y j ) represent the spatial coordinate information of the mixed pixels; y i ,y j Represents the spectral characteristics of mixed pixels i and j. 6) Based on the spectral distance and spatial distance, the difference between the mixed pixels is calculated; the specific calculation formula is: Where Dis is an index used to measure the difference between mixed pixels; r is a weight used to balance the spectral distance and spatial distance. 7) Compare the spectral distance and the spatial distance with the preset thresholds respectively, select the mixed pixels whose spectral distance and spatial distance are respectively less than the preset thresholds and assign them to the seed points; 8) The average value of all pixels of each superpixel in the segmentation map is taken as the new center point, and the above steps are repeated until the number of iterations is reached or convergence occurs; S35, summing the weights of the multiple segmentation graphs to obtain a weight factor of the segmentation graph; Specifically, for the hth segmentation map, the corresponding weight is: In the formula, C h represents the Calinski-Harabasz index of the hth segmentation map; R h is the covariance matrix between pixels of the h-th segmentation map; E h is the covariance matrix between the elements in the superpixel of the hth segmentation map; m and K h are the number of pixels and the total number of superpixels of the h-th segmentation map, respectively.

5. The method for sparse unmixing of hyperspectral images based on multi-scale superpixel low-rank representation according to claim 1, characterized in that: The step S4 specifically comprises the following steps: S41, obtaining multiple segmentation maps of different segmentation scales; S42, introducing a weighted nuclear norm constraint into the superpixel region of each segmentation image to obtain similar abundance matrices corresponding to mixed pixels in the same superpixel region; S43, introduce the weight of the segmentation map, and adaptively fuse multiple segmentation map features of different segmentation scales; S44, obtaining a multi-scale superpixel guided low-rank representation regularization term of the objective function based on the weighted nuclear norm constraint and the weight of the segmentation map; Specifically, for the hth segmentation map, a weighted nuclear norm constraint is added, which is specifically expressed as: In the formula, ω j is a weighting factor that imposes a larger penalty on smaller singular values, thus forcing them to be close to zero in the next iteration; X i represents the abundance matrix of the mixed pixel in the i-th superpixel; The low-rank representation regularization term of the objective function is expressed as: Where β represents the hyperparameter of the low-rank regularization term of the objective function.

6. The method for sparse unmixing of hyperspectral images based on multi-scale superpixel low-rank representation according to claim 1, characterized in that: The step S6 specifically comprises the following steps: S61, introduce variables U, V and Lagrange multiplier D = {D1, D2, D3, D4}, S62. Construct Lagrangian function: in, μ represents the penalty parameter, μ>0; G and B are defined as: G=[A,I,I,I] T I represents the identity matrix; S63. Lagrangian function The variables U, V, and D are solved iteratively as follows: S631, fixed variables V and D, the optimization problem about variable U is expressed as: Where d represents the number of iterations. By taking the partial derivative of the variable U in the above formula and making it equal to zero, the solution of the variable U is: U (d+1) ←(A T A+3I) -1 (A T ζ1+ζ2+ζ3+ζ4) among them, S632, variable V contains four sub-problems, namely V1, V2, V3 and V4: 1) The optimization problem and solution of variable V1 are expressed as: 2) The optimization problem and solution of variable V2 are expressed as: 3) The optimization problem of variable V3 is expressed as: For each The solution is: in, The i-th superpixel region corresponding to the h-th segmentation scale; Γ w,τ (X) = U (Π-τdiag(w)) + V T ;UΠV T represents the singular value decomposition of matrix X; (x) + =max(x,0). 4) The optimization problem and solution of variable V4 are expressed as: Each time the variables U, V, and D are updated, the number of iterations d increases by 1; the residual of the variable calculation objective function When it is less than the predefined threshold T h When d = 0.0001 or the maximum number of iterations d = 1000 is reached, the algorithm stops obtaining the target abundance matrix, and then obtains the target abundance map.

Citation Information

Patent Citations

  • Space-spectrum fused hyperspectral image mixed pixel low-rank sparse decomposition method

    CN111161199A

  • Hyperspectral anomaly detection method

    CN115620128A

  • Unmixing image data

    US20240273678A1

Cited By

  • Spectral data fusion method and system based on dictionary learning

    CN119851077A