Natural resource investigation monitoring data aggregation and fusion method and system based on unmanned aerial vehicle remote sensing

Abstract

The invention discloses a natural resource investigation monitoring data aggregation and fusion method and system based on unmanned aerial vehicle remote sensing, and relates to the technical field of resource investigation, and the method comprises the steps: inputting satellite image data SAT and video image data VID into a natural resource recognition model NRM, carrying out the independent recognition of the SAT and the VID, and outputting a main recognition layer PRI and an auxiliary recognition layer AUX; according to the method, satellite image data SAT and video image data VID are identified, a main identification layer PRI and an auxiliary identification layer AUX are output respectively, difference analysis is carried out on the two layers through an overlapping degree parameter OVL, a boundary matching degree parameter EDG and an area deviation ratio parameter DIF, and when any parameter exceeds a preset difference tolerance threshold THR, an abnormal region is marked. The multi-source remote sensing data is automatically obtained again and secondary fusion verification is carried out, the identification deviation can be monitored and corrected, the accuracy and integrity of the natural resource monitoring result are effectively improved, and the misjudgment risk is reduced.

Description

Technical Field

[0001] This invention relates to the field of resource survey technology, specifically to a method and system for data aggregation and fusion of natural resource survey and monitoring based on unmanned aerial vehicle (UAV) remote sensing. Background Technology

[0002] Natural resource surveys are a comprehensive undertaking that integrates remote sensing acquisition, ground verification, and spatiotemporal analysis. They combine large-scale observations from satellite remote sensing platforms with high-resolution low-altitude imaging from UAV platforms to acquire multi-source remote sensing data and simultaneously collect ground sample points. The data is then processed in a geographic information system (GIS) for coordinate registration, feature extraction, and attribute correlation analysis. Furthermore, based on temporal change detection algorithms and multi-source data fusion models, quantitative assessments and dynamic monitoring of elements such as forest cover, grassland distribution, water area, land use types, and mineral resources are conducted. Simultaneously, accuracy verification and error correction are performed using field measurement results to ensure the spatial accuracy and statistical reliability of the resource survey results. Existing methods lack difference monitoring, making it difficult to detect and correct biases in a timely manner. This makes it difficult to guarantee the accuracy and completeness of the results, and increases the risk of misjudgment or omission. To address the aforementioned technical shortcomings, a solution is proposed. Summary of the Invention

[0003] To address the shortcomings of existing technologies, this invention provides a method and system for data aggregation and fusion of natural resource survey and monitoring based on unmanned aerial vehicle (UAV) remote sensing.

[0004] To achieve the above objectives, the present invention provides the following technical solution: a method and system for data aggregation and fusion of natural resource survey and monitoring based on unmanned aerial vehicle (UAV) remote sensing, comprising: S1. Acquire multi-source remote sensing data, which includes satellite image data SAT acquired by a satellite remote sensing platform and video image data VID acquired by a low-altitude UAV platform. During the UAV's aerial photography mission, GPS location information and TRJ flight trajectory are collected. After performing an encryption algorithm on the GPS and TRJ data, the data is embedded in the VID file metadata structure. S2. Input satellite image data SAT and video image data VID into the natural resource identification model NRM, perform independent identification on SAT and VID, and output the main identification layer PRI and the auxiliary identification layer AUX. S3. Calculate the overlap parameter OVL, boundary matching parameter EDG, and area deviation ratio parameter DIF for the main recognition layer PRI and the auxiliary recognition layer AUX. When any parameter exceeds the preset difference tolerance threshold THR, trigger the abnormal prompt flag ALM and mark the abnormal area. S4. Using SAT data as the primary confidence source MSR and VID data as the secondary confidence source SSR, perform confidence-weighted fusion and output the fused recognition layer.

[0005] During the drone's aerial photography, location information (GPS) and flight trajectory (TRJ) are collected. The GPS and TRJ use a pre-set symmetric key (KEY) and an initialization vector (IVC) is generated by a true random number generator (TRG). Then, the AES symmetric encryption algorithm is called to generate a ciphertext (CTE). The asymmetric signature algorithm (RSA) uses the private key (SK) to sign the CTE and generate a digital digest (DSG). The DSG and timestamp are then encapsulated into a structured metadata field and inserted into the video image data (VID).

[0006] The configuration and training process of the Natural Resource Recognition (NRM) model includes: S11. Preprocess the satellite image data SAT and video image data VID, and divide them into training set TRN, validation set VAL and test set TST according to the ratio. S12. Construct a convolutional neural network that integrates the U-Net decoder structure and the ResNet-50 encoder. The pre-trained weights of the ResNet-50 encoder are learned from ImageNet and the first NFR residual blocks are frozen. The U-Net decoder uses stepwise upsampling and skip connections to fuse semantic features from the encoder. S13. In the hyperparameter setting stage, the learning rate LRN is set to 1e-4, the batch size BSZ is set to 16, the optimizer OPT adopts the Adam algorithm, and the loss function LOS is a weighted fusion of cross-entropy and Dice coefficients. S14. During the training iteration phase, the model is iterated according to the training cycle EPO=30. Every 30 cycles, the average intersection-union ratio MIO and loss LOS_VAL are calculated on the VAL set. The learning rate LRN is adjusted using the LRN decay strategy and the early stopping mechanism is enabled.

[0007] After the training period ends, the mean intersection-union ratio (MIO), precision (ACC), and recall (REC) on the validation set (VAL) are evaluated, and a comprehensive score is calculated based on preset weighting coefficients α1, α2, and α3. After all cycles are completed, the model weight with the highest PER is selected as the optimal weight parameter and deployed to the Natural Resource Identification (NRM) model.

[0008] Satellite image data (SAT) and video image data (VID) are input into the Natural Resource Identification Model (NRM). The NRM generates pixel-level or object-level high-dimensional semantic codes (ESP) based on the ground feature parameter (FET). The high-dimensional semantic codes (ESP) include category probability distribution (CPD), depth feature vector (DFV), and spatial context relation (SCR). The high-dimensional semantic code ESP is passed to the SAT branch and the VID branch respectively. The SAT branch performs the main recognition task based on CPD and the preset main classification confidence threshold MCT to generate the main recognition layer PRI and calculate the corresponding main boundary confidence PRI while preserving the high coverage and wide-area information. The VID branch uses DFV and SCR to supplement low-altitude high-resolution details and performs detail recognition based on DFV and the preset auxiliary classification confidence threshold ACT to generate the auxiliary recognition layer AUX and calculate the corresponding auxiliary boundary confidence AUX.

[0009] In the SAT branch, class probability mapping is performed on each pixel of the input SAT image based on CPD. Pixels in CPD that exceed the preset class confidence threshold THR_CPD are initially classified and labeled by threshold screening. Then, morphological dilation and erosion operations are used to optimize boundary connectivity and a region growing algorithm is applied to expand adjacent pixels of the same type to output the main recognition layer PRI with smooth boundaries and coherent regions. In the VID branch, mesoscale feature enhancement processing is performed based on DFV, and spatial relationship maps are constructed in the neighborhood in combination with SCR to distinguish between fine textures and small ground features. Then, the boundary deviation is corrected across frames and time using a feature fusion algorithm based on graph convolutional network GCN, generating an auxiliary recognition layer AUX containing high-resolution ground feature outlines and fine structures.

[0010] For the main recognition layer PRI and the auxiliary recognition layer AUX, the number of intersection pixels and the number of union pixels of the two layers are calculated at the pixel level or the segmentation object level, respectively, and the spatial consistency between the layers is quantified by the overlap parameter OVL = number of intersection pixels / number of union pixels. Obtain boundary point sets B_PRI and B_AUX for the boundaries of PRI and AUX. Use the average of the bidirectional minimum distances from each boundary point in B_PRI to the nearest boundary point in B_AUX and from each boundary point in B_AUX to the nearest boundary point in B_PRI as the boundary matching degree parameter EDG to evaluate the degree of boundary alignment.

[0011] The total number of pixels in the areas covered by PRI and AUX are counted to represent the area S_PRI and S_AUX respectively, and the difference in area between the two layers is measured by the area deviation ratio parameter DIF = |S_PRI–S_AUX| / max(S_PRI,S_AUX); When any parameter of OVL, EDG, or DIF exceeds the preset difference tolerance threshold THR, the anomaly warning flag ALM is triggered and the anomaly area is automatically marked in the corresponding spatial location layer by highlighting or marking, and multi-source remote sensing data is reacquired for the anomaly area.

[0012] After synchronously inputting satellite image data (SAT) and video image data (VID) into the Natural Resources Recognition Model (NRM) and obtaining the main recognition layer (PRI) and auxiliary recognition layer (AUX), the system regards SAT data as the main confidence source (MSR) and VID data as the auxiliary confidence source (SSR). Based on the encryption integrity score (ENC), recognition consistency score (ACC), main boundary confidence (PRI), and auxiliary boundary confidence (AUX), a fusion factor is constructed using preset weight coefficients W1 to W6. WGT=W1×MSR+W2×SSR+W3×ENC+W4×ACC+W5×PRI+W6×AUX, Among them, MSR represents the global confidence score for satellite identification, SSR represents the detailed confidence score for UAV identification, ENC represents the encryption integrity verification score for GPS and TRJ data, ACC represents the consistency analysis score of PRI and AUX, and PRI and AUX are the boundary confidence scores of PRI and AUX, respectively.

[0013] A data aggregation and fusion system for natural resource survey and monitoring based on UAV remote sensing, comprising: The data acquisition module uses satellite image data (SAT) acquired by the satellite remote sensing platform and video image data (VID) acquired by the low-altitude unmanned aerial vehicle platform. The data recognition module has a built-in Natural Resource Recognition Model (NRM) that identifies the collected satellite image data (SAT) and video image data (VID) respectively, and outputs the main recognition layer (PRI) and the auxiliary recognition layer (AUX). The anomaly detection module calculates the spatial overlap parameter OVL, boundary matching parameter EDG, and area deviation ratio parameter DIF for the main recognition layer PRI and the auxiliary recognition layer AUX to identify abnormal areas. The confidence fusion output module performs confidence-weighted fusion of the main recognition layer PRI and the auxiliary recognition layer AUX, and outputs the fused recognition layer.

[0014] This invention provides a method and system for data aggregation and fusion in natural resource survey and monitoring based on unmanned aerial vehicle (UAV) remote sensing. Compared with existing technologies, it has the following advantages: This invention performs identification on satellite image data (SAT) and video image data (VID), and outputs a main identification layer (PRI) and an auxiliary identification layer (AUX) respectively. The two layers are analyzed for differences using the overlap parameter (OVL), boundary matching parameter (EDG), and area deviation ratio parameter (DIF). When any parameter exceeds the preset difference tolerance threshold (THR), the abnormal area is marked. The multi-source remote sensing data is automatically reacquired and a secondary fusion verification is performed. This invention can monitor and correct identification deviations, effectively improve the accuracy and completeness of natural resource monitoring results, and reduce the risk of misjudgment.

[0015] This invention embeds GPS and TRJ location information processed by AES symmetric encryption algorithm and RSA asymmetric signature algorithm into the metadata structure of UAV video image data VID, and uses the encryption integrity score ENC as a weight factor in the calculation of the fusion factor WGT. When the ENC score is lower than a preset threshold, the data is marked, which effectively improves the data identification reliability of the monitoring system. Attached Figure Description

[0016] Figure 1 This is a schematic diagram of the principle framework of the present invention. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] Please see Figure 1 This application provides a method and system for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing, including: S1. Acquire multi-source remote sensing data, which includes satellite image data SAT acquired by a satellite remote sensing platform and video image data VID acquired by a low-altitude UAV platform. During the UAV's aerial photography mission, GPS location information and TRJ flight trajectory are collected. After performing an encryption algorithm on the GPS and TRJ data, the data is embedded in the VID file metadata structure. S2. Input satellite image data SAT and video image data VID into the natural resource identification model NRM, perform independent identification on SAT and VID, and output the main identification layer PRI and the auxiliary identification layer AUX. S3. Calculate the overlap parameter OVL, boundary matching parameter EDG, and area deviation ratio parameter DIF for the main recognition layer PRI and the auxiliary recognition layer AUX. When any parameter exceeds the preset difference tolerance threshold THR, trigger the abnormal prompt flag ALM and mark the abnormal area. S4. Using SAT data as the primary confidence source MSR and VID data as the secondary confidence source SSR, perform confidence-weighted fusion and output the fused recognition layer.

[0019] During the drone's aerial photography, location information (GPS) and flight trajectory (TRJ) are collected. The GPS and TRJ use a pre-set symmetric key (KEY) and an initialization vector (IVC) is generated by a true random number generator (TRG). Then, the AES symmetric encryption algorithm is called to generate a ciphertext (CTE). The asymmetric signature algorithm (RSA) uses the private key (SK) to sign the CTE and generate a digital digest (DSG). The DSG and timestamp are then encapsulated into a structured metadata field and inserted into the video image data (VID).

[0020] During the drone's aerial photography mission, this embodiment first collects location information (GPS) and flight trajectory (TRJ) via the built-in GNSS and sends them to the encryption processing unit (ENC). The ENC loads a pre-set symmetric key (KEY, e.g., a 128-bit AES key) to perform preliminary encryption on the GPS and TRJ data, generating intermediate ciphertext. Subsequently, the true random number generator (TRG) generates a 128-bit initialization vector (IVC) based on environmental noise and the system clock. The IVC and the intermediate ciphertext are then used as input to call the AES-256-CBC symmetric encryption algorithm for a second encryption, outputting the final ciphertext (CTE). Following this, the asymmetric signature unit loads the persistently stored RSA private key (SK, e.g., 2048 bits) and performs PKCS#1 on the CTE. v1.5 signature operation generates a digital digest (DSG), and encapsulates the DSG and timestamp (TS) (format YYYYMMDDhhmmssSSS) into a structured metadata field 'EncryptionSignature', where the fields include {"DSG":DSG, "TS":TS}. Finally, the system controller calls the video metadata writing interface to embed the above structured fields into the EXIF ​​metadata segment of the video image data VID. After the writing is completed, a verification loop is executed to verify the CRC check value of the EXIF ​​segment to ensure that the writing is correct and tamper-free. The abort or retry strategy can ensure at least three write attempts or retransmission through the ground station in case of failure, thereby achieving end-to-end encryption protection, signature verification, and traceability management of UAV GPS and TRJ data.

[0021] Beneficial effects: By embedding GPS and TRJ location information processed by AES symmetric encryption algorithm and RSA asymmetric signature algorithm into the metadata structure of UAV video image data VID, and using the encryption integrity score ENC as a weighting factor in the calculation of the fusion factor WGT, the data is marked when the ENC score is lower than a preset threshold, which effectively improves the data recognition credibility of the monitoring system and ensures the accuracy of the fusion recognition layer.

[0022] The configuration and training process of the Natural Resource Recognition (NRM) model includes: S11. Preprocess the satellite image data SAT and video image data VID, and divide them into training set TRN, validation set VAL and test set TST according to the ratio. S12. Construct a convolutional neural network that integrates the U-Net decoder structure and the ResNet-50 encoder. The pre-trained weights of the ResNet-50 encoder are learned from ImageNet and the first NFR residual blocks are frozen. The U-Net decoder uses stepwise upsampling and skip connections to fuse semantic features from the encoder. S13. In the hyperparameter setting stage, the learning rate LRN is set to 1e-4, the batch size BSZ is set to 16, the optimizer OPT adopts the Adam algorithm, and the loss function LOS is a weighted fusion of cross-entropy and Dice coefficients. S14. During the training iteration phase, the model is iterated according to the training cycle EPO=30. Every 30 cycles, the average intersection-union ratio MIO and loss LOS_VAL are calculated on the VAL set. The learning rate LRN is adjusted using the LRN decay strategy and the early stopping mechanism is enabled.

[0023] After the training period ends, the mean intersection-union ratio (MIO), precision (ACC), and recall (REC) on the validation set (VAL) are evaluated, and a comprehensive score is calculated based on preset weighting coefficients α1, α2, and α3. After all cycles are completed, the model weight with the highest PER is selected as the optimal weight parameter and deployed to the Natural Resource Identification (NRM) model.

[0024] It is worth noting that, in order to achieve efficient configuration and training of the Natural Resource Identification Model (NRM), the collected satellite image data (SAT) and video image data (VID) are first preprocessed in step S11, including denoising, geometric correction, film effect restoration and color enhancement. Histogram equalization and Gaussian filtering are then used to enhance the image details. Subsequently, the data is divided into a training set (TRN), a validation set (VAL) and a test set (TST) in a ratio of 7:2:1. Next, in step S12, a convolutional neural network fusion of U-Net decoder and ResNet-50 encoder is constructed based on the PyTorch deep learning framework. The ResNet-50 encoder loads ImageNet pre-trained weights and freezes the first NFR=3 residual blocks to retain low-level general features. Only residual block 4 and subsequent layers are fine-tuned. Batch normalization (BatchNorm) and Dropout (p=0.3) are added after each residual group to prevent overfitting. The U-Net decoder adopts four-level progressive upsampling and fuses semantic features of different scales of the encoder through fusion skip connection to restore the spatial resolution of object detection. Then, in step S13, during the hyperparameter setting phase, the initial learning rate LRN is set to 1×10. -4 The cosine annealing learning rate scheduler was enabled, the batch size BSZ was set to 16, the optimizer OPT adopted the Adam algorithm (β1=0.9, β2=0.999) and weighted L2 regularization (weight decay of 0.0001), and the loss function LOS was defined as a weighted fusion of cross-entropy and Dice coefficients (weight ratio 1:1). At the same time, spatial attention (SAM) was added to each layer of the decoder to enhance the sensitivity to boundaries and small features. Then, in the training iteration phase of step S14, EPO=30 training cycles were executed. After every 10 cycles, the mean intersection-union ratio MIO and the validation loss LOS_VAL were calculated on the VAL set. The early stopping condition was triggered when the MIO did not improve for 5 consecutive cycles. At the same time, the LRN was decayed by a factor of 0.5 after each VAL evaluation. During the training process, the GPU utilization and memory usage were monitored and the BSZ was adjusted as necessary to avoid OOM. Satellite image data (SAT) and video image data (VID) are input into the Natural Resource Identification Model (NRM). The NRM generates pixel-level or object-level high-dimensional semantic codes (ESP) based on the ground feature parameter (FET). The high-dimensional semantic codes (ESP) include category probability distribution (CPD), depth feature vector (DFV), and spatial context relation (SCR). The high-dimensional semantic code ESP is passed to the SAT branch and the VID branch respectively. The SAT branch performs the main recognition task based on CPD and the preset main classification confidence threshold MCT to generate the main recognition layer PRI and calculate the corresponding main boundary confidence PRI while preserving the high coverage and wide-area information. The VID branch uses DFV and SCR to supplement low-altitude high-resolution details and performs detail recognition based on DFV and the preset auxiliary classification confidence threshold ACT to generate the auxiliary recognition layer AUX and calculate the corresponding auxiliary boundary confidence AUX.

[0025] In the SAT branch, class probability mapping is performed on each pixel of the input SAT image based on CPD. Pixels in CPD that exceed the preset class confidence threshold THR_CPD are initially classified and labeled by threshold screening. Then, morphological dilation and erosion operations are used to optimize boundary connectivity and a region growing algorithm is applied to expand adjacent pixels of the same type to output the main recognition layer PRI with smooth boundaries and coherent regions. In the VID branch, mesoscale feature enhancement processing is performed based on DFV, and spatial relationship maps are constructed in the neighborhood in combination with SCR to distinguish between fine textures and small ground features. Then, the boundary deviation is corrected across frames and time using a feature fusion algorithm based on graph convolutional network GCN, generating an auxiliary recognition layer AUX containing high-resolution ground feature outlines and fine structures.

[0026] It is worth noting that NRM generates pixel-level or object-level high-dimensional semantic encoding ESP based on ground feature parameters FET (such as spectral response, texture statistics, and elevation information) through multi-layer convolution and fully connected operations. This ESP includes class probability distribution CPD (confidence probability vector for each class per pixel), depth feature vector DFV (256-dimensional feature representation for each pixel or object), and spatial context relation SCR (pixel / object adjacency matrix constructed based on graph convolution). Then, the ESP is passed to the SAT branch and VID branch for differential processing. In the SAT branch, the model first performs threshold screening on the CPD, selecting pixels in the CPD that are greater than the preset main classification confidence threshold MCT (e.g., 0.8) for preliminary classification and labeling. Then, the boundary connectivity is optimized through 5×5 morphological dilation and 3×3 erosion operations. Then, the connected region expansion method based on the region growing algorithm is called to merge adjacent pixels of the same type. The main recognition layer PRI with smooth boundaries and coherent spatial distribution is output in the fusion layer. At the same time, the main boundary confidence PRI_CONF is calculated in the boundary extraction unit. In the VID branch, the model first uses DFV as a basis to perform multi-scale convolution and attention mechanisms through mesoscale feature enhancement units to highlight texture and small ground features. It then combines SCR to construct a spatial relationship map in the neighborhood to capture the topological association between targets. Subsequently, it performs temporal cross-frame boundary correction through a three-layer graph convolutional network (GCN) and outputs an auxiliary recognition layer AUX containing high-resolution ground feature outlines and calculates the auxiliary boundary confidence AUX_CONF.

[0027] For the main recognition layer PRI and the auxiliary recognition layer AUX, the number of intersection pixels and the number of union pixels of the two layers are calculated at the pixel level or the segmentation object level, respectively, and the spatial consistency between the layers is quantified by the overlap parameter OVL = number of intersection pixels / number of union pixels. Obtain boundary point sets B_PRI and B_AUX for the boundaries of PRI and AUX. Use the average of the bidirectional minimum distances from each boundary point in B_PRI to the nearest boundary point in B_AUX and from each boundary point in B_AUX to the nearest boundary point in B_PRI as the boundary matching degree parameter EDG to evaluate the degree of boundary alignment.

[0028] The total number of pixels in the areas covered by PRI and AUX are counted to represent the area S_PRI and S_AUX respectively, and the difference in area between the two layers is measured by the area deviation ratio parameter DIF = |S_PRI–S_AUX| / max(S_PRI,S_AUX); When any parameter of OVL, EDG, or DIF exceeds the preset difference tolerance threshold THR, the anomaly warning flag ALM is triggered and the anomaly area is automatically marked in the corresponding spatial location layer by highlighting or marking, and multi-source remote sensing data is reacquired for the anomaly area.

[0029] After synchronously inputting satellite image data (SAT) and video image data (VID) into the Natural Resources Recognition Model (NRM) and obtaining the main recognition layer (PRI) and auxiliary recognition layer (AUX), the system regards SAT data as the main confidence source (MSR) and VID data as the auxiliary confidence source (SSR). Based on the encryption integrity score (ENC), recognition consistency score (ACC), main boundary confidence (PRI), and auxiliary boundary confidence (AUX), a fusion factor is constructed using preset weight coefficients W1 to W6. WGT=W1×MSR+W2×SSR+W3×ENC+W4×ACC+W5×PRI+W6×AUX, Among them, MSR represents the global confidence score for satellite identification, SSR represents the detailed confidence score for UAV identification, ENC represents the encryption integrity verification score for GPS and TRJ data, ACC represents the consistency analysis score of PRI and AUX, and PRI and AUX are the boundary confidence scores of PRI and AUX, respectively.

[0030] It is worth noting that PRI and AUX are mapped to two confidence sources. The global confidence score (MSR) for PRI is obtained by averaging the CPD of each pixel in the main recognition layer, while the detail confidence score (SSR) for AUX is calculated by the DFV consistency scoring function for each object in the auxiliary recognition layer. Subsequently, the confidence fusion unit obtains the encryption integrity score (ENC) of GPS and TRJ data. This score is obtained by comparing the consistency of the signature verification results of the DSG output embedded in the VID metadata. Then, the consistency analysis unit calculates the consistency analysis score (ACC) of PRI and AUX. This score is based on a weighted scoring function of three parameters: OVL, EDG, and DIF.

[0031] Beneficial effects: This invention performs recognition on satellite image data (SAT) and video image data (VID) and outputs a main recognition layer (PRI) and an auxiliary recognition layer (AUX) respectively. The two layers are analyzed for differences using the overlap parameter (OVL), boundary matching parameter (EDG), and area deviation ratio parameter (DIF). When any parameter exceeds the preset difference tolerance threshold (THR), the abnormal area is marked. The multi-source remote sensing data is automatically reacquired and a secondary fusion verification is performed. This invention can monitor and correct recognition deviations, effectively improve the accuracy and completeness of natural resource monitoring results, and reduce the risk of misjudgment.

[0032] A data aggregation and fusion system for natural resource survey and monitoring based on UAV remote sensing, comprising: The data acquisition module uses satellite image data (SAT) acquired by the satellite remote sensing platform and video image data (VID) acquired by the low-altitude unmanned aerial vehicle platform. The data recognition module has a built-in Natural Resource Recognition Model (NRM) that identifies the collected satellite image data (SAT) and video image data (VID) respectively, and outputs the main recognition layer (PRI) and the auxiliary recognition layer (AUX). The anomaly detection module calculates the spatial overlap parameter OVL, boundary matching parameter EDG, and area deviation ratio parameter DIF for the main recognition layer PRI and the auxiliary recognition layer AUX to identify abnormal areas. The confidence fusion output module performs confidence-weighted fusion of the main recognition layer PRI and the auxiliary recognition layer AUX, and outputs the fused recognition layer.

[0033] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired or wireless network. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more sets of available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. A semiconductor medium can be a solid-state drive.

[0034] Some of the data in the above formulas are numerical calculations with dimensions removed, and the contents not described in detail in this specification are all prior art known to those skilled in the art.

[0035] The above embodiments are only used to illustrate the technical methods of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical methods of the present invention without departing from the spirit and scope of the technical methods of the present invention.

Claims

1. A method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing, characterized in that, include: S1. Acquire multi-source remote sensing data, which includes satellite image data SAT acquired by a satellite remote sensing platform and video image data VID acquired by a low-altitude UAV platform. During the UAV's aerial photography mission, GPS location information and TRJ flight trajectory are collected. After performing an encryption algorithm on the GPS and TRJ data, the data is embedded in the VID file metadata structure. S2. Input satellite image data SAT and video image data VID into the natural resource identification model NRM, perform independent identification on SAT and VID, and output the main identification layer PRI and the auxiliary identification layer AUX. S3. Calculate the overlap parameter OVL, boundary matching parameter EDG, and area deviation ratio parameter DIF for the main recognition layer PRI and the auxiliary recognition layer AUX. When any parameter exceeds the preset difference tolerance threshold THR, trigger the abnormal prompt flag ALM and mark the abnormal area. S4. Using SAT data as the primary confidence source MSR and VID data as the secondary confidence source SSR, perform confidence-weighted fusion and output the fused recognition layer.

2. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, During the drone's aerial photography, location information (GPS) and flight trajectory (TRJ) are collected. The GPS and TRJ use a pre-set symmetric key (KEY) and an initialization vector (IVC) is generated by a true random number generator (TRG). Then, the AES symmetric encryption algorithm is called to generate a ciphertext (CTE). The asymmetric signature algorithm (RSA) uses the private key (SK) to sign the CTE and generate a digital digest (DSG). The DSG and timestamp are then encapsulated into a structured metadata field and inserted into the video image data (VID).

3. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, The configuration and training process of the Natural Resource Recognition (NRM) model includes: S11. Preprocess the satellite image data SAT and video image data VID, and divide them into training set TRN, validation set VAL and test set TST according to the ratio. S12. Construct a convolutional neural network that integrates the U-Net decoder structure and the ResNet-50 encoder. The pre-trained weights of the ResNet-50 encoder are learned from ImageNet and the first NFR residual blocks are frozen. The U-Net decoder uses stepwise upsampling and skip connections to fuse semantic features from the encoder. S13. In the hyperparameter setting stage, the learning rate LRN is set to 1e-4, the batch size BSZ is set to 16, the optimizer OPT adopts the Adam algorithm, and the loss function LOS is a weighted fusion of cross-entropy and Dice coefficients. S14. During the training iteration phase, the model is iterated according to the training cycle EPO=30. Every 30 cycles, the average intersection-union ratio MIO and loss LOS_VAL are calculated on the VAL set. The learning rate LRN is adjusted using the LRN decay strategy and the early stopping mechanism is enabled.

4. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, After the training period ends, the mean intersection-union ratio (MIO), precision (ACC), and recall (REC) on the validation set (VAL) are evaluated, and a comprehensive score is calculated based on preset weighting coefficients α1, α2, and α3. After all cycles are completed, the model weight with the highest PER is selected as the optimal weight parameter and deployed to the Natural Resource Identification (NRM) model.

5. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, Satellite image data (SAT) and video image data (VID) are input into the Natural Resource Identification Model (NRM). The NRM generates pixel-level or object-level high-dimensional semantic codes (ESP) based on the ground feature parameter (FET). The high-dimensional semantic codes (ESP) include category probability distribution (CPD), depth feature vector (DFV), and spatial context relation (SCR). The high-dimensional semantic code ESP is passed to the SAT branch and the VID branch respectively. The SAT branch performs the main recognition task based on CPD and the preset main classification confidence threshold MCT to generate the main recognition layer PRI and calculate the corresponding main boundary confidence PRI while preserving the high coverage and wide-area information. The VID branch uses DFV and SCR to supplement low-altitude high-resolution details and performs detail recognition based on DFV and the preset auxiliary classification confidence threshold ACT to generate the auxiliary recognition layer AUX and calculate the corresponding auxiliary boundary confidence AUX.

6. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, In the SAT branch, class probability mapping is performed on each pixel of the input SAT image based on CPD. Pixels in CPD that exceed the preset class confidence threshold THR_CPD are initially classified and labeled by threshold screening. Then, morphological dilation and erosion operations are used to optimize boundary connectivity and a region growing algorithm is applied to expand adjacent pixels of the same type to output the main recognition layer PRI with smooth boundaries and coherent regions. In the VID branch, mesoscale feature enhancement processing is performed based on DFV, and spatial relationship maps are constructed in the neighborhood in combination with SCR to distinguish between fine textures and small ground features. Then, the boundary deviation is corrected across frames and time using a feature fusion algorithm based on graph convolutional network GCN, generating an auxiliary recognition layer AUX containing high-resolution ground feature outlines and fine structures.

7. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, For the main recognition layer PRI and the auxiliary recognition layer AUX, the number of intersection pixels and the number of union pixels of the two layers are calculated at the pixel level or the segmentation object level, respectively, and the spatial consistency between the layers is quantified by the overlap parameter OVL = number of intersection pixels / number of union pixels. Obtain boundary point sets B_PRI and B_AUX for the boundaries of PRI and AUX. Use the average of the bidirectional minimum distances from each boundary point in B_PRI to the nearest boundary point in B_AUX and from each boundary point in B_AUX to the nearest boundary point in B_PRI as the boundary matching degree parameter EDG to evaluate the degree of boundary alignment.

8. The method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, The total number of pixels in the areas covered by PRI and AUX are counted to represent the area S_PRI and S_AUX respectively, and the difference in area between the two layers is measured by the area deviation ratio parameter DIF = |S_PRI–S_AUX| / max(S_PRI,S_AUX); When any parameter of OVL, EDG, or DIF exceeds the preset difference tolerance threshold THR, the anomaly warning flag ALM is triggered and the anomaly area is automatically marked in the corresponding spatial location layer by highlighting or marking, and multi-source remote sensing data is reacquired for the anomaly area.

9. A method for data aggregation and fusion of natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, After synchronously inputting satellite image data (SAT) and video image data (VID) into the Natural Resources Recognition Model (NRM) and obtaining the main recognition layer (PRI) and auxiliary recognition layer (AUX), the system regards SAT data as the main confidence source (MSR) and VID data as the auxiliary confidence source (SSR). Based on the encryption integrity score (ENC), recognition consistency score (ACC), main boundary confidence (PRI), and auxiliary boundary confidence (AUX), a fusion factor is constructed using preset weight coefficients W1 to W6. WGT=W1×MSR+W2×SSR+W3×ENC+W4×ACC+W5×PRI+W6×AUX, Among them, MSR represents the global confidence score for satellite identification, SSR represents the detailed confidence score for UAV identification, ENC represents the encryption integrity verification score for GPS and TRJ data, ACC represents the consistency analysis score of PRI and AUX, and PRI and AUX are the boundary confidence scores of PRI and AUX, respectively.

10. A data aggregation and fusion system for natural resource survey and monitoring based on UAV remote sensing according to claim 1, characterized in that, include: The data acquisition module uses satellite image data (SAT) acquired by the satellite remote sensing platform and video image data (VID) acquired by the low-altitude unmanned aerial vehicle platform. The data recognition module has a built-in Natural Resource Recognition Model (NRM) that identifies the collected satellite image data (SAT) and video image data (VID) respectively, and outputs the main recognition layer (PRI) and the auxiliary recognition layer (AUX). The anomaly detection module calculates the spatial overlap parameter OVL, boundary matching parameter EDG, and area deviation ratio parameter DIF for the main recognition layer PRI and the auxiliary recognition layer AUX to identify abnormal areas. The confidence fusion output module performs confidence-weighted fusion of the main recognition layer PRI and the auxiliary recognition layer AUX, and outputs the fused recognition layer.

Images