Satellite solar short wave radiation inversion method based on knowledge distillation

Abstract

The invention provides a satellite solar short-wave radiation inversion method based on knowledge distillation, which relates to the field of solar short-wave radiation inversion, and comprises the following steps: collecting polar orbit satellite data, stationary satellite data, geographic information data and ground observation data; preprocessing the data to obtain input features and labels for training the teacher model and the student model; sorting the importance of the input features by using a random forest model, selecting key features, and removing non-key features; constructing a deep learning model by using the key features, and generating a teacher model of solar short-wave radiation inversion; and taking an output result of the teacher model as a soft label, introducing ground observation data as a hard label, and carrying out knowledge distillation to obtain a student model of solar short-wave radiation inversion. According to the technical scheme of the invention, the problems of data scarcity and high data acquisition cost caused by the fact that a model is constructed only depending on ground observation data in the prior art are solved, and the problem that the inversion precision completely based on satellite data is limited is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of solar shortwave radiation inversion, and in particular to a satellite solar shortwave radiation inversion method based on knowledge distillation. Background Art

[0002] In the context of global climate change and environmental protection, accurate monitoring and assessment of solar shortwave radiation is of great significance to the energy balance and ecosystem of the Earth system. Solar shortwave radiation is the main source of surface radiation energy, affecting many key processes such as atmospheric circulation, temperature distribution and water cycle. In the fields of climate research, agricultural production, solar energy utilization and environmental monitoring, accurately inverting and predicting the distribution and changes of solar shortwave radiation has important scientific and application value.

[0003] The development of satellite observation technology has made it possible to observe solar shortwave radiation with high temporal and spatial resolution on a global scale. However, the accuracy of the inversion of solar shortwave radiation is often limited due to the interference of factors such as atmospheric attenuation, cloud effects and surface reflectivity. In addition, satellite data is indirect and mainly relies on inversion algorithms to extract real ground radiation information. Therefore, the accuracy of the algorithm directly determines the reliability of the inversion results.

[0004] Deep learning methods have made breakthrough progress in the field of remote sensing inversion in recent years. The solar shortwave radiation inversion algorithm based on deep learning can overcome the limitations of traditional physical methods to a certain extent and improve the accuracy of solar shortwave radiation inversion by learning the features in a large amount of historical data. The current mainstream method of deep learning inversion of solar shortwave radiation is to directly use ground observation data as training labels, but the number of ground observation sites is limited, which makes it difficult to meet the needs of high temporal and spatial resolution over a large range, and cannot provide real-time radiation information under rapidly changing weather conditions. Chinese Patent: CN117371316A, discloses a geostationary satellite solar shortwave radiation inversion method and a readable storage medium based on deep learning. The method uses polar-orbiting satellite solar shortwave radiation data with higher accuracy and spatial resolution as training labels to construct a model, combining the advantages of geostationary satellite data and polar-orbiting satellite data, and can perform high-frequency monitoring of solar radiation to meet the needs of dynamic change monitoring. However, due to certain differences in the data distribution of satellite observations and ground observations, the solar shortwave radiation results inverted using only satellite data may not fully reflect the actual situation of ground radiation.

[0005] In summary, building models solely based on ground observation data will face problems of data scarcity and high data acquisition costs, while the inversion accuracy based entirely on satellite data is limited.

[0006] Therefore, there is a need for a satellite solar shortwave radiation inversion method based on knowledge distillation that can organically combine multi-source satellite and ground observation data to improve the inversion accuracy while taking into account wide-area coverage and high-frequency dynamic monitoring. Summary of the invention

[0007] The main purpose of the present invention is to provide a satellite solar shortwave radiation inversion method based on knowledge distillation to solve the problems of data scarcity and high data acquisition cost faced by the existing technology when building a model only relying on ground observation data, while the inversion accuracy based entirely on satellite data is limited.

[0008] To achieve the above object, the present invention provides a satellite solar shortwave radiation inversion method based on knowledge distillation, which specifically includes the following steps: S1, collects polar-orbiting satellite data, geostationary satellite data, geographic information data and ground observation data.

[0009] S2, preprocesses the geostationary satellite data, polar-orbiting satellite data, ground observation data, longitude and latitude data and surface elevation data in geographic information data to obtain input features and labels for training the teacher model and student model.

[0010] S3, using the random forest model to rank the importance of input features, select the key features of satellite solar shortwave radiation inversion, and eliminate non-key features.

[0011] S4, uses key features to build a deep learning model and generate a teacher model for solar shortwave radiation inversion.

[0012] S5, the output results of the teacher model are used as soft labels, and the ground observation data are introduced as hard labels for knowledge distillation to obtain the student model of solar shortwave radiation inversion.

[0013] Furthermore, the geostationary satellite data includes: spectral channel data and geometric feature data; the geometric feature data includes: satellite zenith angle, satellite azimuth angle, solar zenith angle and solar azimuth angle.

[0014] Geographic information data includes: longitude and latitude data, surface elevation data and surface type data.

[0015] Polar-orbiting satellite data include: solar shortwave radiation data.

[0016] Ground observation data include: ground solar shortwave radiation observation data.

[0017] Furthermore, step S2 specifically includes the following steps: S2.1, standardize the spectral channel data in geostationary satellite data, the solar shortwave radiation data in polar-orbiting satellite data, the longitude and latitude data and surface elevation data in geographic information data: (1); in, is the standardized eigenvalue, is the original data, is the mean of the original data, is the standard deviation of the original data.

[0018] S2.2, normalize the data after standardization in S2.1: (2); in, is the normalized eigenvalue, and are the minimum and maximum values ​​of the original data respectively.

[0019] S2.3, perform sine and cosine transforms on the geometric characteristic data of the geostationary satellite.

[0020] S2.4, perform unique hot encoding on the surface type data in the geographic information data and convert the surface type data into a numerical format: (3); in, is the feature vector after one-hot encoding, is the number of surface types, Indicates that if the surface type characteristics belong to The class is , otherwise 0, where .

[0021] Furthermore, step S3 specifically includes the following steps: S3.1, for each decision tree, the input features include preprocessed geostationary satellite data and geographic information data. When an input feature is split at a node, the reduction in the contribution of the node to the prediction error is calculated: (4); in, is the error reduction when the node is split, , , are the errors of the parent node, the left node, and the right node, respectively. and They are respectively the proportion of the number of left and right node samples in the total number of parent node samples.

[0022] S3.2, each feature will have multiple split nodes in each tree, and the sum of all nodes The sum is then averaged across the forest to get the overall importance of the feature: (5); in, is the importance of the feature, is the number of trees in the random forest, Indicates A tree, Represents all nodes in the tree.

[0023] Furthermore, step S4 specifically includes the following steps: S4.1, the neural network includes: an input layer, a fully connected layer and an output layer connected in sequence, and the key features are input into the input layer of the neural network.

[0024] S4.2 is then input into the fully connected layer, and nonlinearity is introduced through the activation function. The calculation formula of the first layer of the fully connected layer is: (6); in, is the output latitude of the first layer, is the activation function for nonlinear mapping. is the weight matrix of the first layer, is the bias vector of the first layer.

[0025] S4.3, the fully connected layer The calculation formula of the layer is: (7); in, It is The output of the layer, It is The weight matrix of the layer, is the bias term, It is The output dimension of the layer.

[0026] S4.4, finally output through the output layer, the calculation formula of the output layer is: (8); in, is the predicted value of the model, which represents the solar shortwave radiation data at the corresponding time. is the weight matrix of the output layer, is the output dimension of the second-to-last layer, is the bias term of the output layer.

[0027] S4.5, set the loss function, the calculation formula is as follows: (9); in, is the loss function of the pre-trained model, It is The predicted value of samples, It is The true value of the samples, is the number of samples.

[0028] Furthermore, step S5 specifically includes the following steps: S5.1, use the bilinear spatial interpolation method to obtain the geostationary satellite data and geographic information data that are consistent with the position of the ground observation station, estimate the value of the target point through four adjacent points, and first perform horizontal interpolation: (10); (11); Then perform vertical interpolation: (12); in, , , , are the values ​​of four known adjacent points, , , , are the coordinates of the known data points, are the estimated coordinates of the target point.

[0029] S5.2, use polar-orbiting satellite data to train the teacher model, use the solar shortwave radiation data predicted by the teacher model as soft labels, and use ground observation data as hard labels to train the student model. Soft target loss and hard target loss are used for optimization during soft label and hard label training respectively. The student model prediction results are denormalized to obtain the optimized results of solar shortwave radiation inversion.

[0030] The hard target loss is used to measure the difference between the student model output and the hard label. The loss value is calculated using the mean square error, and the expression is: (13);

[0031] in, refers to the hard target loss, is the total number of samples in the ground observation data, It is The real solar shortwave radiation data of samples, The student model is The predicted value of solar shortwave radiation on samples.

[0032] The soft target loss is used to measure the difference between the output of the student model and the teacher model. The loss value is also calculated using the mean squared error: (14); in, is the soft objective function, is the number of training samples used in the knowledge distillation process, For the teacher model The predicted value on samples is the soft label or the output of the teacher model. For the student model The predicted value on samples is the value obtained by the student model in the process of imitating the output of the teacher model.

[0033] The total loss function of distillation is defined by combining the soft target loss and the hard target loss, and the expression is as follows: (15); in, is the total loss function during the distillation process, is a hyperparameter.

[0034] Furthermore, step S5 further includes the following steps: S5.3, set the initial learning rate to 10 -5 And gradually reduce the learning rate, using the learning rate decay strategy as exponential decay, the expression is as follows: (16); in, is the current learning rate, is the initial learning rate, is the decay rate, is the number of cycles of current training, is the attenuation step length.

[0035] Furthermore, the generation of the student model includes the following steps: The geostationary satellite data and geographic information data obtained by S5.1 that are consistent with the position of the ground observation station are used as input data, and the ground-observed solar shortwave radiation data are used as labels.

[0036] Perform data cleaning, feature transformation and feature selection on the input data.

[0037] This is then input into the neural network in step S4.1 to generate a student model.

[0038] The present invention has the following beneficial effects: High spatial coverage and regional adaptability: Satellite observation data covers a wide range and contains more spatial features. After further training through knowledge distillation combined with ground observation data, the student model can better adapt to the characteristics of different regions, especially for areas with scarce observation stations, and can provide high-precision solar shortwave radiation estimates.

[0039] High spatiotemporal resolution: The teacher model based on multi-source satellite observation data can obtain solar shortwave radiation data with high spatiotemporal resolution. After fine-tuning with ground observation data, the student model can maintain high resolution while enhancing its response to the actual radiation conditions on the ground, thereby more accurately reflecting the instantaneous radiation change characteristics and supporting high-frequency and dynamically changing monitoring needs.

[0040] Improved accuracy and robustness: Knowledge distillation can make full use of the high-precision characteristics of ground observation data, so that the inversion accuracy of the model in specific regions and meteorological conditions can be improved. In addition, by fine-tuning with ground data, the robustness and generalization ability of the student model will also be enhanced, that is, it can maintain good performance in different seasons and climate conditions.

[0041] Reduce reliance on ground observation data while improving model accuracy: Unlike relying entirely on ground observation data for model training, fine-tuning using satellite data combined with some ground data can achieve higher inversion accuracy with less ground observation data. This method can, to a certain extent, reduce the limitations of insufficient ground observation data on model training, reduce data collection costs, and fully utilize the potential of satellite observations. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the specific implementation of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the specific implementation or the prior art description. Obviously, the drawings described below are some implementations of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings: Figure 1 A flow chart of a satellite solar shortwave radiation inversion method based on knowledge distillation of the present invention is shown.

[0043] Figure 2 A comparison chart of the effects of the knowledge distillation optimization model is shown. DETAILED DESCRIPTION

[0044] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] like Figure 1 A satellite solar shortwave radiation inversion method based on knowledge distillation is shown, which specifically includes the following steps: S1, collects polar-orbiting satellite data, geostationary satellite data, geographic information data and ground observation data.

[0046] S2, preprocesses the geostationary satellite data, polar-orbiting satellite data, ground observation data, longitude and latitude data and surface elevation data in geographic information data to obtain input features and labels for training the teacher model and student model.

[0047] S3, using the random forest model to rank the importance of input features, select the key features of satellite solar shortwave radiation inversion, and eliminate non-key features.

[0048] S4, uses key features to build a deep learning model and generate a teacher model for solar shortwave radiation inversion.

[0049] S5, the output results of the teacher model are used as soft labels, and the ground observation data are introduced as hard labels for knowledge distillation to obtain the student model of solar shortwave radiation inversion.

[0050] The present invention firstly utilizes multi-source satellite data and constructs a teacher model for solar shortwave radiation inversion based on deep learning technology to extract solar shortwave radiation information with high temporal and spatial resolution; on the basis of the teacher model, ground solar radiation data is introduced for knowledge distillation to optimize the parameters of the student model, so that the inversion results of the student model are closer to the actual situation on the ground and the inversion accuracy is improved.

[0051] Specifically, geostationary satellite data include: spectral channel data and geometric feature data; geometric feature data include: satellite zenith angle, satellite azimuth angle, solar zenith angle and solar azimuth angle. Select geostationary satellite data and polar-orbiting satellite data with the same observation time. Since the observation frequencies of the two types of satellites are different, select the closest time range (such as: ±3 minutes); crop the geostationary satellite data after time matching to the observation range of the polar-orbiting satellite to ensure that the data is aligned in space.

[0052] Geographic information data includes: longitude and latitude data, surface elevation data and surface type data. Ensure that all information is consistent with the temporal and spatial scope of satellite data.

[0053] Polar orbit satellite data include: solar shortwave radiation data, which is used as label data for teacher model training. Only the areas scanned simultaneously with the geostationary satellite are extracted to ensure spatial and temporal matching.

[0054] The ground observation data include: ground solar shortwave radiation observation data, which is used as high-precision label data for the subsequent knowledge distillation stage, i.e., the label for student model training.

[0055] Geostationary satellite data and geographic information data are used as input features for subsequent teacher model and student model training, and polar-orbiting satellite data and ground observation data are used as labels.

[0056] Specifically, all data are cleaned, outliers are removed, and missing values ​​are filled.

[0057] Step S2 specifically includes the following steps:

[0058] S2.1, standardize the spectral channel data in geostationary satellite data, the solar shortwave radiation data in polar-orbiting satellite data, the longitude and latitude data and surface elevation data in geographic information data: (1); in, is the standardized eigenvalue, is the original data, is the mean of the original data, is the standard deviation of the original data.

[0059] S2.2, normalize the data after standardization in S2.1: (2); in, is the normalized eigenvalue, and are the minimum and maximum values ​​of the original data respectively.

[0060] S2.3, perform sine and cosine transforms on the geometric characteristic data of the geostationary satellite.

[0061] S2.4, the geometric angles such as the satellite zenith angle are processed by sine and cosine transformation to retain the periodic characteristics of the angle. The surface type is converted into a numerical format through one-hot encoding to improve the adaptability of the model under different surface types.

[0062] Perform unique hot encoding on the surface type data in the geographic information data and convert the surface type data into numerical format: (3); in, is the feature vector after one-hot encoding, is the number of surface types, Indicates that if the surface type characteristics belong to The class is , otherwise 0, where .

[0063] Specifically, step S3 includes the following steps: S3.1, for each decision tree, the input features include preprocessed geostationary satellite data and geographic information data. When an input feature is split at a node, the reduction in the contribution of the node to the prediction error is calculated: (4); in, is the error reduction when the node is split, , , are the errors of the parent node, the left node, and the right node, respectively. and They are respectively the proportion of the number of left and right node samples in the total number of parent node samples.

[0064] S3.2, each feature will have multiple split nodes in each tree, and the sum of all nodes The sum is then averaged across the forest to get the overall importance of the feature: (5); in, is the importance of the feature, is the number of trees in the random forest, Indicates A tree, Represents all nodes in the tree. The importance of features is sorted from high to low, and the contribution of each feature to the target variable is determined, and features with small contributions are removed. For example, if the features ranked in the top n items are key features, the features after the nth feature are removed.

[0065] Specifically, it ensures that each data point in the training data corresponds to a spatiotemporal point scanned simultaneously by a geostationary satellite and a polar-orbiting satellite, uses key features as input, and takes the level-3 shortwave radiation data provided by the polar-orbiting satellite as labels.

[0066] The purpose of the present invention is to utilize the same pixel points, that is, the various spectral channels, geographic information and other characteristics of the geostationary satellite at the same longitude and latitude, to invert the solar shortwave radiation value at a certain moment. The spatial relationship and time series information between adjacent pixels do not need to be explicitly considered, so a multi-layer perceptron is used as the model architecture.

[0067] Step S4 specifically includes the following steps: S4.1, the neural network includes: an input layer, a fully connected layer and an output layer connected in sequence, and the key features are input into the input layer of the neural network.

[0068] S4.2 is then input into the fully connected layer, and nonlinearity is introduced through the activation function. The calculation formula of the first layer of the fully connected layer is: (6); in, is the output latitude of the first layer, is the activation function for nonlinear mapping. is the weight matrix of the first layer, is the bias vector of the first layer.

[0069] The fully connected layer maps the input features to a new space through linear transformation and introduces nonlinearity through activation functions, aiming to introduce higher-level feature expression capabilities to the teacher model while enabling the teacher model to capture complex input data patterns.

[0070] S4.3, each subsequent layer, i.e., the hidden layer, extracts and combines features through similar fully connected calculations. Each layer is nonlinearly transformed through linear transformations (weight matrices and bias terms) and activation functions, gradually increasing the complexity of the model to better capture the underlying patterns in the data. The calculation formula of the layer is: (7); in, It is The output of the layer, It is The weight matrix of the layer, is the bias term, It is The output dimension of the layer.

[0071] S4.4, finally output through the output layer, the calculation formula of the output layer is: (8); in, is the predicted value of the model, which represents the solar shortwave radiation data at the corresponding time. is the weight matrix of the output layer, is the output dimension of the second-to-last layer, is the bias term of the output layer.

[0072] The output layer will generate the predicted value of the teacher model through linear transformation. For each input data point, the output layer calculates a predicted value, which represents the solar shortwave radiation value at the corresponding time.

[0073] S4.5, the loss function is used to measure the gap between the model prediction result and the hard label. The solar shortwave radiation inversion in the present invention is actually a regression problem, so the loss function uses the mean square error. Set the loss function, and the calculation formula is as follows: (9); in, is the loss function of the pre-trained model, It is The predicted value of samples, It is The true value of the samples, is the number of samples. The mean square error calculates the square average of the difference between the predicted value and the true value. The goal is to minimize the loss function so that the predicted value is as close to the true value as possible.

[0074] Specifically, step S5 includes the following steps: S5.1, geostationary satellite data usually covers a wide area, while ground observation stations are relatively sparse, and the longitude and latitude of the two are not necessarily completely consistent. Therefore, in order to ensure that each ground observation point has corresponding satellite data, the bilinear spatial interpolation method is used to obtain the geostationary satellite data and geographic information data that are consistent with the position of the ground observation station, and the value of the target point is estimated through four adjacent points. First, horizontal interpolation is performed: (10); (11); Then perform vertical interpolation: (12); in, , , , are the values ​​of four known adjacent points, , , , are the coordinates of the known data points, are the estimated coordinates of the target point.

[0075] S5.2, knowledge distillation enables a complex large model (teacher model) to guide the training of a simplified small model (student model) through the probability distribution of the output (soft label). In the present invention, the teacher model is a solar shortwave radiation inversion model obtained through previous work and pre-training on large-scale geostationary satellite and polar-orbiting satellite data. The teacher model has learned complex features based on a large amount of geostationary satellite and polar-orbiting satellite data, and is applicable to solar radiation inversion tasks under a wide range of spatiotemporal conditions. The student model learns the output distribution of the teacher model and the hard labels of ground observation data through the distillation loss function.

[0076] Polar-orbiting satellite data are used to train the teacher model. The solar shortwave radiation data predicted by the teacher model is used as soft labels. The ground observation data is used as hard labels to train the student model. Soft target loss and hard target loss are used for optimization during soft label and hard label training respectively. The prediction results of the student model are denormalized to obtain the optimized results of solar shortwave radiation inversion.

[0077] The hard target loss is used to measure the difference between the student model output and the hard label. The hard label is the ground solar shortwave radiation observation data. The loss value is calculated using the mean square error, and the expression is: (13); in, refers to the hard target loss, is the total number of samples in the ground observation data, It is The real solar shortwave radiation data of samples (ground observations), The student model is The predicted value of solar shortwave radiation on samples.

[0078] The soft target loss is used to measure the difference between the output of the student model and the teacher model. The loss value is also calculated using the mean squared error: (14); in, is the soft objective function, is the number of training samples used in the knowledge distillation process, For the teacher model The predicted value on samples is the soft label or the output of the teacher model. For the student model The predicted value on samples is the value obtained by the student model in the process of imitating the output of the teacher model.

[0079] Combining the soft target loss and the hard target loss to define the total loss function of distillation can ensure that the student model can not only learn the knowledge of the teacher model, but also accurately predict the radiation value of the ground observation data. The expression is as follows: (15); in, is the total loss function during the distillation process, is a hyperparameter. It controls the weight between soft target loss and hard target loss. Its value range is between [0, 1], and its initial value is usually set to 0.5. If the teacher model has high accuracy, you can increase If the distribution of ground observation data is significantly different from that of the teacher model, then the value of , allowing the student model to focus more on hard targets.

[0080] Specifically, step S5 also includes the following steps: S5.3, low learning rate is crucial for model stability and generalization ability. Set the initial learning rate to 10 -5 And gradually reduce the learning rate to stabilize the training process and avoid overfitting. The learning rate decay strategy is exponential decay, and the expression is as follows: (16); in, is the current learning rate, is the initial learning rate, is the decay rate, which is usually less than 1. The smaller the value, the faster the learning rate decays. is the number of cycles of current training, is the attenuation step length, which refers to the number of cycles after which attenuation is performed.

[0081] Specifically, the generation of the student model includes the following steps: Step 1: The geostationary satellite data and geographic information data obtained by S5.1 that are consistent with the position of the ground observation station are used as input data, and the ground-observed solar shortwave radiation data are used as labels.

[0082] Step 2: Perform data cleaning, feature conversion and feature selection on the input data. The feature conversion method is as in step S2, and the feature selection method is as in step S3.

[0083] Step 3: Then input into the neural network of step S4.1 to generate the student model.

[0084] Through the above steps, the solar shortwave radiation inversion optimization algorithm based on knowledge distillation proposed in the present invention can effectively combine satellite data with ground observation data, and provide more accurate estimation results in large-scale and high-precision solar shortwave radiation inversion tasks.

[0085] Figure 2 The following figure shows the effect comparison of knowledge distillation optimization model. Figure 2 The pre-trained model result in is the prediction result of the teacher model. Figure 2 The result of knowledge distillation in is the prediction result of the student model. Figure 2 It can be seen that the results after knowledge distillation are close to the ground observations.

[0086] The present invention combines ground observation data with satellite data through a knowledge distillation strategy, achieving a balance between the accuracy and spatial coverage of solar shortwave radiation inversion. The student model is optimized using ground observation data, which significantly improves the accuracy of the student model, reduces dependence on ground observations, and reduces data collection costs. On this basis, the student model has stronger regional adaptability and generalization capabilities. At the same time, the present invention supports dynamic change monitoring with high temporal and spatial resolution, meets the needs of real-time and refined environmental monitoring, and provides more reliable technical support for fields such as climate research and solar energy resource assessment.

[0087] Of course, the above description is not a limitation of the present invention, and the present invention is not limited to the above examples. Changes, modifications, additions or substitutions made by technicians in this technical field within the essential scope of the present invention should also fall within the protection scope of the present invention.

Claims

1. A satellite solar shortwave radiation inversion method based on knowledge distillation, characterized in that: The specific steps include: S1, collects polar-orbiting satellite data, geostationary satellite data, geographic information data and ground observation data; S2, preprocessing the geostationary satellite data, polar-orbiting satellite data, ground observation data, longitude and latitude data and surface elevation data in geographic information data to obtain input features and labels for teacher model and student model training; S3, using the random forest model to rank the importance of input features, select the key features of satellite solar shortwave radiation inversion, and eliminate non-key features; S4, builds a deep learning model using key features to generate a teacher model for solar shortwave radiation inversion; S5, the output results of the teacher model are used as soft labels, and the ground observation data are introduced as hard labels for knowledge distillation to obtain the student model of solar shortwave radiation inversion.

2. According to the method of satellite solar shortwave radiation inversion based on knowledge distillation in claim 1, it is characterized in that: Geostationary satellite data include: spectral channel data and geometric feature data; geometric feature data include: satellite zenith angle, satellite azimuth angle, solar zenith angle and solar azimuth angle; Geographic information data include: longitude and latitude data, surface elevation data and surface type data; Polar-orbiting satellite data include: solar shortwave radiation data; Ground observation data include: ground solar shortwave radiation observation data.

3. According to claim 2, a satellite solar shortwave radiation inversion method based on knowledge distillation is characterized in that: Step S2 specifically includes the following steps: S2.1, standardize the spectral channel data in geostationary satellite data, the solar shortwave radiation data in polar-orbiting satellite data, the longitude and latitude data and surface elevation data in geographic information data: （1）； in, is the standardized eigenvalue, is the original data, is the mean of the original data, is the standard deviation of the original data; S2.2, normalize the data after standardization in S2.1: （2）； in, is the normalized eigenvalue, and are the minimum and maximum values ​​of the original data respectively; S2.3, perform sine and cosine transformation on the geometric characteristic data of the geostationary satellite; S2.4, perform unique hot encoding on the surface type data in the geographic information data and convert the surface type data into a numerical format: （3）； in, is the feature vector after one-hot encoding, is the number of surface types, Indicates that if the surface type characteristics belong to The class is , otherwise 0, where .

4. According to the method of satellite solar shortwave radiation inversion based on knowledge distillation in claim 3, it is characterized in that: Step S3 specifically includes the following steps: S3.1, for each decision tree, the input features include preprocessed geostationary satellite data and geographic information data. When an input feature is split at a node, the reduction in the contribution of the node to the prediction error is calculated: （4）； in, is the error reduction when the node is split, , , are the errors of the parent node, the left node, and the right node, respectively. and They are the proportion of the number of samples of the left and right nodes in the total number of samples of the parent node; S3.2, each feature will have multiple split nodes in each tree, and the sum of all nodes The sum is then averaged across the forest to get the overall importance of the feature: （5）； in, is the importance of the feature, is the number of trees in the random forest, Indicates A tree, Represents all nodes in the tree.

5. According to the method for satellite solar shortwave radiation inversion based on knowledge distillation in claim 4, it is characterized in that: Step S4 specifically includes the following steps: S4.1, the neural network includes: an input layer, a fully connected layer and an output layer connected in sequence, and the key features are input into the input layer of the neural network; S4.2 is then input into the fully connected layer, and nonlinearity is introduced through the activation function. The calculation formula of the first layer of the fully connected layer is: （6）； in, is the output latitude of the first layer, is the activation function for nonlinear mapping. is the weight matrix of the first layer, is the bias vector of the first layer; S4.3, the fully connected layer The calculation formula of the layer is: （7）； in, It is The output of the layer, It is The weight matrix of the layer, is the bias term, It is The output dimension of the layer; S4.4, finally output through the output layer, the calculation formula of the output layer is: （8）； in, is the predicted value of the model, which represents the solar shortwave radiation data at the corresponding time. is the weight matrix of the output layer, is the output dimension of the second-to-last layer, is the bias term of the output layer; S4.5, set the loss function, the calculation formula is as follows: （9）； in, is the loss function of the pre-trained model, It is The predicted value of samples, It is The true value of the samples, is the number of samples.

6. According to claim 5, a satellite solar shortwave radiation inversion method based on knowledge distillation is characterized in that: Step S5 specifically includes the following steps: S5.1, use the bilinear spatial interpolation method to obtain the geostationary satellite data and geographic information data that are consistent with the position of the ground observation station, estimate the value of the target point through four adjacent points, and first perform horizontal interpolation: （10）； （11）； Then perform vertical interpolation: （12）； in, , , , are the values ​​of four known adjacent points, , , , are the coordinates of the known data points, is the estimated target point coordinate; S5.2, using polar-orbiting satellite data to train the teacher model, using the solar shortwave radiation data predicted by the teacher model as soft labels, and using ground observation data as hard labels to train the student model. The soft label and hard label training are optimized using soft target loss and hard target loss respectively. The student model prediction results are denormalized to obtain the optimized results of solar shortwave radiation inversion. The hard target loss is used to measure the difference between the student model output and the hard label. The loss value is calculated using the mean square error, and the expression is: （13）； in, refers to the hard target loss, is the total number of samples in the ground observation data, It is The real solar shortwave radiation data of samples, The student model is The predicted value of solar shortwave radiation on samples; The soft target loss is used to measure the difference between the output of the student model and the teacher model. The loss value is also calculated using the mean squared error: （14）； in, is the soft objective function, is the number of training samples used in the knowledge distillation process, For the teacher model The predicted value on samples is the soft label or the output of the teacher model. For the student model The predicted value on samples, that is, the value obtained by the student model in the process of imitating the output of the teacher model; The total loss function of distillation is defined by combining the soft target loss and the hard target loss, and the expression is as follows: （15）； in, is the total loss function during the distillation process, is a hyperparameter.

7. The satellite solar shortwave radiation inversion method based on knowledge distillation according to claim 6 is characterized in that: Step S5 also includes the following steps: S5.3, set the initial learning rate to 10 -5 And gradually reduce the learning rate, using the learning rate decay strategy as exponential decay, the expression is as follows: （16）； in, is the current learning rate, is the initial learning rate, is the decay rate, is the number of cycles of current training, is the attenuation step length.

8. The satellite solar shortwave radiation inversion method based on knowledge distillation according to claim 7 is characterized in that: The generation of the student model includes the following steps: The geostationary satellite data and geographic information data obtained by S5.1 that are consistent with the position of the ground observation station are used as input data, and the ground-observed solar shortwave radiation data are used as labels; Perform data cleaning, feature conversion and feature selection on input data; This is then input into the neural network described in step S4.1 to generate a student model.

Images