Landslide area rapid segmentation method based on high-resolution satellite remote sensing data and deep learning algorithm
By combining downsampling and vegetation feature maps with spatial gradient edge enhancement, the computational bottleneck and boundary extraction problems of deep learning models in landslide disaster emergency response were solved, achieving efficient and accurate landslide area segmentation.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SOUTH CHINA UNIV OF TECH
- Filing Date
- 2026-04-03
- Publication Date
- 2026-05-01
AI Technical Summary
In landslide disaster emergency response, existing technologies suffer from cumbersome deep learning model architectures, severe computational bottlenecks when processing large-scale high-resolution images, and insufficient feature extraction capabilities in complex backgrounds, leading to fragmented boundaries and missed or false detections.
Reflectance data from satellite remote sensing images is obtained by downsampling, vegetation feature maps are constructed and input into a convolutional neural network to generate landslide probability maps, edge enhancement is performed by combining spatial gradient magnitude, fine segmentation is performed using a pre-trained semantic segmentation network, and post-processing algorithms are abandoned to repair image edges.
It enables rapid and refined feature extraction and segmentation in large-scale landslide areas, with continuous and smooth boundaries, meeting the timeliness requirements of rapid post-disaster response, reducing computational resource consumption, and improving identification accuracy and recall rate.
Smart Images

Figure CN121962622A_ABST
Abstract
Description
A method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms Technical Field
[0001] This invention relates to the field of ground scene technology, specifically to a method for rapid segmentation of landslide areas based on high-resolution satellite remote sensing data and deep learning algorithms. Background Technology
[0002] As a highly destructive geological hazard, landslides necessitate the rapid and accurate acquisition of affected area information within the critical post-disaster rescue time, which is a core foundation for emergency rescue command. With the rapid development of high-resolution satellite remote sensing technology, massive amounts of remote sensing data have effectively overcome the shortcomings of traditional manual geological surveys, such as low efficiency and high risk. Against this backdrop, computer vision technology is deeply integrated with geological disaster monitoring, and the industry is rapidly transitioning from traditional object-oriented or manual feature extraction to end-to-end fully automated deep learning models.
[0003] In existing technologies, various deep convolutional neural networks have been widely used for landslide information extraction. A typical technique involves directly inputting images into a segmentation model, introducing complex structures such as hollow spatial pyramid pooling and attention mechanisms to extract high-level semantic features. To address the difficulty of annotation, some techniques also introduce weakly supervised frameworks based on category heatmaps and conditional random fields to approximate edge optimization. These techniques primarily rely on continuously deepening the network layers or stacking modules at a single resolution, allowing the network to implicitly learn the texture and spectral features of the landslide to complete the segmentation.
[0004] However, the aforementioned technologies have significant limitations in practical emergency response. The models' overemphasis on improving absolute accuracy leads to bloated architectures, easily creating computational bottlenecks when processing large-scale, high-resolution imagery, resulting in slow inference speeds and failing to meet the extremely high timeliness requirements of post-disaster detection. Existing networks are detached from the optical physics of remote sensing, failing to effectively utilize the significant physical prior of instantaneous destruction of surface vegetation, leading to degraded feature extraction capabilities in complex backgrounds. Furthermore, the lack of decoupling and edge-targeting enhancement for multi-scale features makes them prone to boundary fragmentation and false positives / missed detections when processing irregular edges. In summary, existing technologies fail to resolve the contradiction between fine feature extraction and efficient computational inference, necessitating a rapid segmentation scheme that deeply integrates multispectral physical priors with multi-scale network architectures.
[0005] The information disclosed in the background section is only intended to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention
[0006] The purpose of this invention is to provide a method for rapid segmentation of landslide areas based on high-resolution satellite remote sensing data and deep learning algorithms, so as to solve the problems mentioned in the background art.
[0007] To achieve the above objectives, the present invention provides the following technical solution: a method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms, comprising the following steps: Step 1: acquiring the original satellite remote sensing image of the area to be segmented, downsampling the original satellite remote sensing image to obtain a first image, and extracting the reflectance data of each pixel in the red light channel and near-infrared channel from the first image; Step 2: obtaining the vegetation index of each pixel based on the red light reflectance and near-infrared reflectance of each pixel in the first image, constructing a vegetation layer based on the vegetation index and the position of the corresponding pixel, and performing channel-level stitching of the first image and the vegetation layer to form a vegetation feature map; Step 3: inputting the vegetation feature map into a pre-trained convolutional neural network to generate a landslide probability map, extracting the coordinates of pixels in the landslide probability map whose values are greater than a preset probability threshold, constructing a two-dimensional coordinate set, and mapping the two-dimensional coordinate set to the corresponding coordinates of the original satellite remote sensing image according to the downsampling ratio. Step 4: Based on the reflectance data of each pixel in the red and near-infrared channels of the high-definition test patch, determine the local vegetation index and obtain the spatial gradient magnitude of the local vegetation index. Combine the spatial gradient magnitude with the preset enhancement coefficient to obtain the boundary weight. Use the enhancement weight to enhance the corresponding pixel to obtain the edge enhancement patch. Step 5: Input the edge enhancement patch into the pre-trained semantic segmentation network, extract the spatial features of the edge enhancement patch, determine the landslide state of each pixel in the edge enhancement patch based on the spatial features, summarize the landslide state of all pixels, and obtain the local landslide map of the edge enhancement patch. Step 6: Construct an initialization map with the same spatial size as the original satellite remote sensing image. According to the original satellite remote sensing image mapping coordinates corresponding to each high-definition test patch during cropping, fill all the local landslide maps back into the initialization map. Stitch together the adjacent local landslide maps to obtain the landslide area segmentation map.
[0008] Further, the original satellite remote sensing image of the region to be segmented is acquired; the mapping coordinates are determined according to the preset downsampling ratio; in each spectral channel of the original satellite remote sensing image, the four nearest neighboring pixels to the mapping coordinates are extracted respectively; the spatial distance between the mapping coordinates and the four neighboring pixels in the horizontal and vertical directions is calculated; a distance weight is generated based on the spatial distance; the pixel values of the four neighboring pixels are weighted and averaged using the distance weight to obtain the first image; for the first image, the reflectance data corresponding to the red light channel and the near-infrared channel are extracted pixel by pixel.
[0009] Furthermore, the difference between the reflectance data of each pixel in the red light channel and the near-infrared channel is calculated as the reflectance difference value, and the sum of the reflectance data of each pixel in the red light channel and the near-infrared channel is calculated as the total reflectance value. The ratio of the reflectance difference value to the total reflectance value is calculated to obtain the vegetation difference value of each pixel. The vegetation difference values of all pixels in the first image are traversed and normalized to obtain the vegetation index of each pixel. The vegetation index of each pixel is reorganized according to the position of all pixels in the first image to obtain a vegetation layer. The pixel features of each spectral channel at the corresponding position in the first image are enhanced by the pixel values of each pixel in the vegetation layer to obtain a vegetation feature map.
[0010] Furthermore, the vegetation feature map is input into a pre-trained convolutional neural network to obtain a landslide probability map; the pixels in the landslide probability map are traversed, and pixels with probability values exceeding a preset probability threshold are marked as potential landslide points, and the coordinates of the potential landslide points are recorded to generate a two-dimensional coordinate set; the coordinate values in the two-dimensional coordinate set are mapped to the original satellite remote sensing image based on the reciprocal of the downsampling ratio as a scaling factor to obtain the original two-dimensional coordinates in the original satellite remote sensing image; the corresponding local image is cropped according to a preset size with the original two-dimensional coordinates as the center to obtain a high-resolution image patch to be tested.
[0011] Furthermore, the pre-trained convolutional neural network is obtained by training and converging using a sample set containing historical downsampled first images, corresponding constructed vegetation layers, and real landslide annotation data, by minimizing the classification cross-entropy loss between the predicted probability and the real landslide annotation data.
[0012] Furthermore, for each high-definition image patch to be tested, the reflectance data of each pixel in the red light channel and near-infrared channel are extracted, the vegetation difference value of each pixel is calculated, and normalization is performed to obtain the local vegetation index of the corresponding pixel location; the spatial change rate of the local vegetation index in the horizontal and vertical directions is calculated using the discrete central difference operator, and vector magnitude is synthesized to obtain the spatial gradient magnitude of each pixel; the spatial gradient magnitude is multiplied by the preset enhancement coefficient to obtain the boundary weight; the boundary weight is used to weight the original pixel features of the high-definition image patch pixel by pixel to obtain the edge-enhanced image patch.
[0013] Furthermore, the local vegetation indices within the current high-definition map patch are traversed, and the local maximum and minimum values are extracted respectively. The local vegetation range between the local maximum and minimum values is calculated. The regional mean of the spatial gradient magnitude is statistically analyzed to extract the local average gradient value of the high-definition map patch. The relative proportion between the local vegetation range and the local average gradient value is evaluated to obtain the enhancement coefficient.
[0014] Furthermore, each edge enhancement patch is input into a pre-trained semantic segmentation network. Convolution is performed on the edge enhancement patches to obtain global semantic information. The global semantic information is then upsampled to obtain the spatial features of the edge enhancement patches. Convolution is performed on the spatial features to obtain the classification score of each pixel. The classification score is normalized to obtain the probability value of each pixel. The probability value is compared with a preset classification threshold to obtain the landslide state of each pixel. The landslide states are spatially arranged according to the coordinate position of each pixel in the edge enhancement patch to obtain a local landslide map.
[0015] Furthermore, an all-zero matrix with the same spatial size as the original satellite remote sensing image is constructed as the initialization map. Based on the original satellite remote sensing image mapping coordinates corresponding to each high-resolution landslide patch during cropping, the corresponding local landslide map is backfilled in situ into the initialization map. During the process of backfilling the corresponding local landslide map into the initialization map, the overlapping areas of adjacent local landslide maps are extracted. Multiple landslide states of pixels in different local landslide maps are extracted. If at least one of the multiple landslide states is determined to be a landslide category, the pixel is determined to be a landslide pixel. If no landslide category exists in the multiple landslide states, the pixel is determined to be a background pixel. The determined pixels are updated to the corresponding positions in the initialization map, and the updated initialization map is used as the landslide area segmentation map.
[0016] Compared with existing technologies, the beneficial effects of this invention are as follows: Based on the original satellite remote sensing image of the area to be segmented, this invention downsamples to obtain a first image and extracts its reflectance data. It calculates the reflectance difference value and the sum of reflectance values, performs normalization mapping to obtain a vegetation index, and constructs a vegetation layer. The first image and the vegetation layer are then stitched together to obtain a vegetation feature map, which is input into a pre-trained convolutional neural network to output a landslide probability map. Pixel coordinates greater than a preset probability threshold are extracted to construct a two-dimensional coordinate set, which is then mapped onto the original satellite remote sensing image to crop out high-resolution patches to be measured. This invention integrates the underlying physical mechanisms of remote sensing with multi-scale spatial structures, highlighting the physical characteristics of vegetation damage during landslides through the vegetation layer. This guides the model to generate a strong targeted response in the early stages of feature extraction, overcoming spectral confusion of ground features in complex backgrounds. Simultaneously, by utilizing downsampling features for coarse screening of the entire image region, high-resolution cropping is only applied to potential areas that meet the probability criteria. This completely avoids redundant calculations on massive non-disaster background areas, significantly reduces memory usage, breaks through the computational bottleneck when processing large-scale high-resolution data, and significantly improves the overall inference speed, meeting the timeliness requirements of rapid post-disaster response. Furthermore, this invention obtains the local vegetation index of each high-resolution test patch and calculates its spatial gradient magnitude. The spatial gradient magnitude, combined with a preset enhancement coefficient, is used as a weight to perform weighted calculations on the original pixels of the high-resolution test patch to generate edge-enhanced patches. These edge-enhanced patches are then input into a pre-trained semantic segmentation network to output local landslide maps. Finally, based on the positional information of the two-dimensional coordinate set, all local landslide maps are backfilled into an initialization map of the same size as the original satellite remote sensing image, ultimately outputting a landslide area segmentation map. This design abandons the conventional approach of relying on time-consuming post-processing algorithms to repair image edges, innovatively prioritizing edge optimization. By using spatial gradient magnitude for weighting, irregular boundaries such as landslide mudflows are sharpened at the bottom layer before features enter the semantic segmentation network. This weighting mechanism significantly reduces the feature convergence burden of the semantic segmentation network, resulting in more continuous, smoother boundaries in the final landslide area segmentation map that closely resemble the real terrain. This achieves refined extraction and accurate segmentation of features from large-scale landslide areas while maintaining extremely high computational efficiency. Attached Figure Description
[0017] Figure 1 is a schematic diagram of the overall method flow of the present invention. Detailed Implementation
[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to specific embodiments.
[0019] It should be noted that, unless otherwise defined, the technical or scientific terms used in this invention should have the ordinary meaning understood by one of ordinary skill in the art to which this invention pertains. The terms "first," "second," and similar terms used in this invention do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as "comprising" or "including" mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as "connected" or "linked" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as "upper," "lower," "left," and "right" are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0020] Example: Please refer to Figure 1. The present invention provides a technical solution: a method for rapid segmentation of landslide areas based on high-resolution satellite remote sensing data and deep learning algorithms. The specific steps include: Step 1: Obtain the original satellite remote sensing image of the area to be segmented, downsample the original satellite remote sensing image to obtain a first image, and extract the reflectance data of each pixel in the red light channel and near-infrared channel from the first image.
[0021] In this embodiment, the original satellite remote sensing image of the region to be segmented is acquired; the mapping coordinates are determined according to a preset downsampling ratio; in each spectral channel of the original satellite remote sensing image, the four nearest neighboring pixels to the mapping coordinates are extracted respectively; the spatial distance between the mapping coordinates and the four neighboring pixels in the horizontal and vertical directions is calculated; a distance weight is generated based on the spatial distance; the pixel values of the four neighboring pixels are weighted and averaged using the distance weight to obtain the first image; for the first image, the reflectance data corresponding to the red light channel and the near-infrared channel are extracted pixel by pixel.
[0022] Downsampling of raw satellite remote sensing images addresses the computational bottleneck caused by the massive data volume of high-resolution imagery. High-resolution satellite remote sensing data contains rich spatial details; directly inputting raw satellite remote sensing images into deep learning networks results in extremely high memory consumption and computational overhead. Downsampling compression significantly reduces the amount of feature data while better preserving the spatial geometric relative positions of ground features. A foundational data layer for macroscopic coarse screening is constructed, enabling subsequent networks to quickly locate potential disaster areas across the entire map with minimal computational cost, avoiding ineffective convolutional calculations over massive normal background areas.
[0023] In remote sensing optical physics, healthy vegetation exhibits a strong absorption band in the red light band due to chlorophyll absorption, and a very strong reflection peak in the near-infrared band due to the scattering effect of the internal cell structure of the leaves. In contrast, the reflectance characteristics of exposed landslide soil or rock in these two bands are drastically different from those of vegetation. The extracted reflectance data from the red and near-infrared channels refer to the average spectral value of a pixel within its corresponding spectral band. True physical reflectance manifests as a continuous spectral curve within a fixed band, accurately capturing the sensitive spectral characteristics of abrupt changes in vegetation cover. This alleviates the problem of spectral confusion of ground features against complex surface backgrounds and improves the model's sensitivity in distinguishing between landslide and non-landslide areas.
[0024] Extracting reflectivity data eliminates external environmental interference and preserves characteristic data. Raw pixel values acquired by satellite sensors are easily affected by factors such as the solar altitude angle, atmospheric scattering and absorption conditions, and terrain shadows at the time of capture, leading to drastic fluctuations in values for the same ground feature. Reflectivity data characterizes the true reflectivity of a ground surface to electromagnetic waves, eliminating the influence of external environment and lighting. Extracting reflectivity data ensures that the subsequently calculated vegetation index has strict numerical stability, improving the model's generalization ability when faced with different regions, weather conditions, and satellite data sources.
[0025] Step 2: Obtain the vegetation index of each pixel based on the red light reflectance and near-infrared reflectance of each pixel in the first image. Construct a vegetation layer based on the vegetation index and the position of the corresponding pixel. Then, perform channel-level stitching of the first image and the vegetation layer to form a vegetation feature map.
[0026] In this embodiment, the difference between the reflectance data of each pixel in the red light channel and the near-infrared channel is calculated as the reflectance difference value, and the sum of the reflectance data of each pixel in the red light channel and the near-infrared channel is calculated as the total reflectance value. The ratio of the reflectance difference value to the total reflectance value is calculated to obtain the vegetation difference value of each pixel. The vegetation difference values of all pixels in the first image are traversed and normalized to obtain the vegetation index of each pixel. The vegetation index of each pixel is reorganized according to the position of all pixels in the first image to obtain a vegetation layer. The pixel features of each spectral channel at the corresponding position in the first image are enhanced by the pixel values of each pixel in the vegetation layer to obtain a vegetation feature map.
[0027] The ratio of reflectance difference to total reflectance is calculated to eliminate noise from topographical undulations, uneven illumination, and sensor calibration errors. Since the absolute reflectance in the red and near-infrared bands scales proportionally with external lighting conditions, a simple difference cannot provide a consistent evaluation standard across different lighting areas. By introducing the total reflectance as the denominator in the ratio calculation, the results are normalized to a fixed interval, highlighting the unique spectral characteristics of vegetation. This makes the vegetation difference value more resistant to interference from topographical shadows and changes in solar altitude angle. This improves the stability of vegetation cover extraction and ensures the reliability of the data source under different environments.
[0028] Isolated vegetation difference values represent only the spectral attributes of a single pixel and lack spatial context. By rigorously arranging vegetation according to the spatial physical coordinates of the first image, the spatial geometric topology of the features in the real physical world is preserved.
[0029] The relative difference levels of each pixel are stretched and mapped, converting the extreme value-scaled floating-point numerical values into data representations conforming to standard image channel formats. This stretching and mapping process enhances the visual contrast and data variance of the image, making the boundary gradient between the landslide-damaged vegetation area and the normal background steeper and more significant. It also reduces the convergence difficulty of deep learning networks in shallow feature extraction and highlights high-frequency edge signals.
[0030] The pixel values in the vegetation layer serve as spatial weight coefficients for physical priors. Utilizing these values to target and enhance all spectral channels of the first image forces the deep learning network to break free from the limitation of treating all regions equally. This guides the model to generate a strong targeted response early in feature extraction, focusing on areas of vegetation cover anomalies while significantly suppressing useless signals from large areas of non-hazardous background. This not only avoids redundant computation caused by massive amounts of invalid background but also overcomes the problem of spectral obfuscation of ground features against complex backgrounds.
[0031] Step 3: Input the vegetation feature map into a pre-trained convolutional neural network to generate a landslide probability map. Extract the coordinates of pixels in the landslide probability map whose values are greater than a preset probability threshold, construct a two-dimensional coordinate set, map the two-dimensional coordinate set to the corresponding position in the original satellite remote sensing image according to the downsampling ratio, and crop out a high-resolution image patch to be tested around the corresponding position.
[0032] In this embodiment, the vegetation feature map is input into a pre-trained convolutional neural network to obtain a landslide probability map; the pixels in the landslide probability map are traversed, and pixels with probability values exceeding a preset probability threshold are marked as potential landslide points, and the coordinates of the potential landslide points are recorded to generate a two-dimensional coordinate set; the coordinate values in the two-dimensional coordinate set are mapped to the original satellite remote sensing image according to the reciprocal of the downsampling ratio as a scaling factor to obtain the original two-dimensional coordinates in the original satellite remote sensing image; the corresponding local image is cropped according to a preset size with the original two-dimensional coordinates as the center to obtain a high-definition image patch to be tested.
[0033] The vegetation feature map, as input, not only contains multispectral optical reflectance information but also directly incorporates characteristics of vegetation damage. The network extracts deep features through multiple convolutional kernels and maps the multidimensional feature tensor to floating-point values in the [0,1] interval using an activation function in the output layer. This value quantifies the statistical confidence that each pixel belongs to a landslide terrain, generating a landslide probability map. This transforms abstract multidimensional image features into concrete, quantifiable predictive indicators, providing a reliable mathematical basis for subsequent spatial location selection.
[0034] Potential landslide points are marked for rapid coarse screening, quickly eliminating massive amounts of absolutely safe background areas. A preset probability threshold is the key decision boundary determining the rigor of this coarse screening. This probability threshold is typically set based on a comprehensive analysis of statistical evaluation results from a large historical sample set during the validation phase, as well as the actual operational needs of disaster emergency response. Threshold filtering can instantly narrow the focus from the complex full-map data to highly suspicious areas of anomaly, reducing the data throughput of fine-tuning.
[0035] Feature extraction and probability prediction are performed on the downsampled first image, where the recorded two-dimensional coordinate set consists only of logical coordinates on a low-resolution feature map. To accurately obtain the high-precision edge morphology of the landslide, refined analysis must be performed on the high-resolution original image containing extremely high spatial details. By using the reciprocal of the downsampling ratio as a scaling factor for inverse coordinate mapping, the coordinates of suspected points in the first image can be accurately restored to their true geographic or physical spatial locations in the original high-resolution satellite remote sensing image.
[0036] In this embodiment, the pre-trained convolutional neural network is obtained by training and converging using a sample set containing historical downsampled first images, corresponding constructed vegetation layers, and real landslide annotation data, by minimizing the classification cross-entropy loss between the predicted probability and the real landslide annotation data.
[0037] Real landslide annotation data refers to manually annotated pixel-level labels that completely correspond to the input image in terms of spatial resolution. Pixels in the landslide area are assigned positive sample labels, while pixels in the background area where no landslide has occurred are assigned negative sample labels.
[0038] A sample set of real landslide labeled data is used for model training to ensure that the feature distribution extracted by the convolutional neural network during the training phase remains consistent with that in the actual application inference phase, and to deeply integrate remote sensing physical mechanisms. Using historical downsampled first images enables the network to learn the macroscopic morphology of landslides in a low-resolution feature space; introducing vegetation layers as training input injects optical physical priors into the deep learning model. This allows the network to focus on the essential physical characteristics of abrupt changes in vegetation cover rather than blindly searching for patterns in complex visible light textures during parameter optimization. Real landslide labeled data provides supervisory signals for the mapping between these physical characteristics and actual disasters, guiding the network gradient in the correct descent direction, reducing the risk of overfitting in complex backgrounds, and improving the network's recognition accuracy when facing different geological landforms.
[0039] Minimizing the classification cross-entropy loss drives network training convergence, reflecting the underlying task attributes of probability evaluation and macroscopic coarse screening. The core task of convolutional neural networks is to perform pixel-level binary classification, i.e., determining whether the current region belongs to a potential landslide or a safe background. The classification cross-entropy loss function can accurately measure the difference between the probability distribution predicted by the network and the true label distribution, and penalizes high-confidence false predictions.
[0040] By continuously minimizing this loss value during training, the network can be forced to produce highly discriminative probability values at the output, generating a landslide probability map with strong contrast and clear boundaries. Optimizing the network's classification decision boundary provides a solid and reliable data basis for efficient and accurate filtering of potential landslide points using preset probability thresholds, reducing the probability of missed and false detections in the macro-screening stage.
[0041] Step 4: Determine the local vegetation index based on the reflectance data of each pixel in the red light channel and near-infrared channel within the high-definition test patch, and obtain the spatial gradient magnitude of the local vegetation index. Combine the spatial gradient magnitude with the preset enhancement coefficient to obtain the boundary weight. Use the enhancement weight to enhance the corresponding pixel to obtain the edge-enhanced patch.
[0042] In this embodiment, for each high-definition image patch to be tested, the reflectance data of each pixel in the red light channel and near-infrared channel are extracted, the vegetation difference value of each pixel is calculated, and normalization is performed to obtain the local vegetation index of the corresponding pixel position; the spatial change rate of the local vegetation index in the horizontal and vertical directions is calculated using the discrete central difference operator, and vector magnitude is synthesized to obtain the spatial gradient magnitude of each pixel; the spatial gradient magnitude is multiplied by a preset enhancement coefficient to obtain the boundary weight; the original pixel features of the high-definition image patch to be tested are weighted pixel by pixel using the boundary weight to obtain the edge-enhanced image patch.
[0043] High-resolution local vegetation indices are extracted from corresponding pixel locations and introduced to characterize the vegetation damage caused by landslides. While low-resolution macroscopic vegetation indices can only determine approximate location, high-resolution local vegetation indices can depict the microscopic surface anomalies within and around the landslide body, providing the physical data basis for pixel-level edge sharpening and enhancement.
[0044] The essential manifestation of landslide boundaries in optical remote sensing imagery is the dramatic alternation between normal vegetation and exposed soil, reflected as a step-like abrupt change in vegetation index values. The discrete central difference operator (CDD) is a classic numerical differentiation method that approximates the derivative by calculating the difference between the current pixel and its adjacent pixels. The CDD operator offers better symmetry, effectively smoothing local isolated noise while accurately and sensitively capturing the spatial rate of change of the vegetation index in both horizontal and vertical directions. It explicitly transforms the implicit numerical abrupt changes between pixels into a rate of change index.
[0045] Spatial rate of change is a directional vector in both the horizontal and vertical directions, while landslide boundaries in real terrain are irregular and vary in orientation. To objectively evaluate whether a pixel is on a landslide edge without being influenced by the specific orientation of the boundary, vector magnitude synthesis is required. The synthesized spatial gradient magnitude is a scalar, stripped of its directional attribute, purely and intuitively quantifying the severity of vegetation mutation at the pixel's location. Pixels with larger gradient magnitudes are more likely to be located at the actual physical boundary of a landslide.
[0046] By combining the spatial gradient magnitude with a preset enhancement coefficient to generate boundary weights, a spatial edge attention mask is constructed. Using these weights, multiplicative or additive weighting operations are performed on the original pixels of the high-resolution test patch, which can target and amplify the pixel features of the landslide boundary while relatively suppressing the feature responses of the internal flat or background areas.
[0047] The weighted edge enhancement patches significantly increase the contrast of the landslide boundaries, reducing the feature convergence burden on the subsequent semantic segmentation network. This allows the network to quickly output segmentation patches with smooth, continuous boundaries that closely resemble the real mudslide morphology, perfectly balancing computational efficiency and refined extraction accuracy.
[0048] In this embodiment, the local vegetation index within the current high-definition image patch to be tested is traversed, and the local maximum and local minimum values are extracted respectively. The local vegetation range between the local maximum and local minimum values is calculated. The regional mean of the spatial gradient magnitude is statistically analyzed to extract the local average gradient value of the high-definition image patch to be tested. The relative proportional relationship between the local vegetation range and the local average gradient value is evaluated to obtain the enhancement coefficient.
[0049] Calculating local vegetation range quantifies the absolute contrast of vegetation cover within a current high-resolution map tile. Local maximum values typically represent undisturbed, healthy forest within the tile, while local minimum values represent complete exposure of soil or rock due to landslides. Local vegetation range reflects the most severe span of physical and ecological environmental damage within a local area. Establishing a macroscopic contrast benchmark can intuitively characterize the severity of landslide hazards and potential feature stretching space within the current map tile, providing reliable basic data support for adaptive weight adjustment.
[0050] Regional mean statistics are performed on spatial gradient magnitudes to assess the overall boundary complexity and high-frequency texture density of local patches. The gradient magnitude of a single pixel is affected by isolated noise points or minor surface debris in the remote sensing image. The local average gradient value, through smoothed statistical analysis in the spatial domain, reflects the overall basis strength of the edge signal within the patch. This filters out the accidental influence of local high-frequency noise, providing a stable and representative evaluation standard for regional texture features.
[0051] High-resolution image tiles with different geographical backgrounds and varying degrees of damage exhibit significant inherent differences in contrast and noise levels. Using a fixed enhancement factor can easily lead to over-sharpening of originally clear areas, resulting in false edges, or insufficient enhancement of blurred landslide boundaries.
[0052] The local vegetation range represents the contrast potential of the current image patch, while the average gradient value represents the existing edge strength. By calculating the relative ratio between the two, a customized enhancement coefficient can be tailored for each high-resolution image patch. Regions with high contrast but blurred boundaries receive a strong boost, while regions with already extremely dense textures are moderately suppressed. This improves the environmental adaptability of edge enhancement in the face of varied and complex terrain, ensuring that the feature maps fed into the semantic segmentation network always maintain optimal boundary resolution.
[0053] Step 5: Input the edge enhancement patch into the pre-trained semantic segmentation network, extract the spatial features of the edge enhancement patch, determine the landslide state of each pixel of the edge enhancement patch based on the spatial features, summarize the landslide states of all pixels, and obtain the local landslide map of the edge enhancement patch.
[0054] In this embodiment, each edge enhancement patch is input into a pre-trained semantic segmentation network. The edge enhancement patches are convolved to obtain global semantic information. The global semantic information is upsampled to obtain the spatial features of the edge enhancement patches. The spatial features are convolved to obtain the classification score of each pixel. The classification score is normalized to obtain the probability value of each pixel. The probability value is compared with a preset classification threshold to obtain the landslide state of each pixel. The landslide states are spatially arranged according to the coordinate position of each pixel in the edge enhancement patch to obtain a local landslide map.
[0055] Upon receiving edge-enhanced patches, the encoder extracts global semantic features from the patches layer by layer using multi-layer convolution and downsampling operations, such as the macroscopic texture and shape of landslides. Subsequently, the decoder performs upsampling to restore spatial resolution, introducing skip connections in this process to fuse low-level features from the encoder that retain rich physical boundary details with high-level semantic features. Finally, the network outputs a feature matrix rich in spatial detail information, i.e., high-dimensional spatial features.
[0056] Each physical pixel within the edge enhancement patch is scored independently, outputting a continuous classification score. The scores, ranging from 0 to 1, are then forcibly normalized to obtain the probability value of each pixel belonging to the landslide category. The probability values of all pixels are then compared one by one with a preset classification threshold, which is set to 0.5.
[0057] Semantic segmentation networks can fully perceive the global contextual semantic relationships between different features within a map tile through downsampling, and restore lost spatial resolution layer by layer through upsampling. Since the input edge-enhanced map tiles have already undergone boundary sharpening by the underlying physical gradient, the semantic segmentation network can easily overcome the feature convergence difficulties of complex boundaries such as muddy water flow under guidance, and then make high-precision binary classification judgments for each physical pixel, outputting a local prediction map with smooth boundaries and a high degree of fit to the real terrain.
[0058] Step 6: Construct an initial map with the same spatial dimensions as the original satellite remote sensing image. Based on the original satellite remote sensing image mapping coordinates corresponding to each high-resolution landslide patch during cropping, backfill all local landslide maps into the initial map. Then, stitch together adjacent local landslide maps to obtain a landslide area segmentation map.
[0059] In this embodiment, an all-zero matrix with the same spatial size as the original satellite remote sensing image is constructed as the initialization map. Based on the original satellite remote sensing image mapping coordinates corresponding to each high-definition map patch during cropping, the corresponding local landslide map is backfilled in situ into the initialization map. During the process of backfilling the corresponding local landslide map into the initialization map, the overlapping area of adjacent local landslide maps is extracted. Multiple landslide states of pixels in different local landslide maps are extracted. If at least one of the multiple landslide states is determined to be a landslide category, the pixel is determined to be a landslide pixel. If no landslide category exists in the multiple landslide states, the pixel is determined to be a background pixel. The determined pixels are updated to the corresponding positions in the initialization map, and the updated initialization map is used as the landslide area segmentation map.
[0060] A zero-matrix with the same spatial dimensions as the original satellite remote sensing image was constructed to create a panoramic physical canvas covering the complete macroscopic geographic coordinates of the disaster area. During the downsampling and coarse screening stage, the vast majority of absolutely safe, non-disaster background areas were actively stripped away. The zero values in the zero-matrix represent the initial pixel background color, which in binary classification logic represents non-landslide areas. Areas that previously underwent massive invalid calculations were directly assigned as safe backgrounds by default, perfectly reconstructing the spatial dimensions of the original image while avoiding redundant feature reconstruction calculations for non-disaster areas.
[0061] When cropping and extracting suspected landslide points, in order to preserve sufficient local boundary context, physical overlap inevitably occurs between adjacent high-resolution map patches to be measured. At the overlapping boundaries, obvious splicing gaps or spatial faults are easily generated due to conflicts in the results of different local prediction maps.
[0062] Extracting overlapping areas and performing logical fusion of pixel states can effectively resolve prediction discrepancies at the boundary intersections of adjacent tiles. This smooths prediction differences from local perspectives, eliminates stitching seams, and ensures that large landslides spanning multiple tiles appear as a continuous, complete geological entity with coherent physical boundaries in the final landslide area segmentation map, thus improving the overall visual quality and interpretation accuracy of the final segmentation results.
[0063] Table 1: Accuracy evaluation results of different segmentation methods As shown in Table 1, landslide detection in high-resolution remote sensing images is a typical task with extremely imbalanced sample distribution, making conventional detection methods highly susceptible to interference when faced with massive and complex backgrounds. Regarding conventional methods, while existing methods such as Deeplabv3+ have a certain precision, their recall is low due to the difficulty in overcoming the loss of microscopic edge features and interference from complex terrain shadows, indicating that a large number of landslides with blurred or occluded edges are not effectively identified. In terms of recall, the method proposed in this application, through targeted enhancement of vegetation layers and spatial gradient edge sharpening, can more sensitively capture and identify more complex landslides compared to other methods, demonstrating that the model in this application improves the detection rate of landslides. In the field of landslide disaster emergency response and detection, to avoid serious hidden dangers caused by missed reports, more emphasis is often placed on the recall rate of landslide detection rather than just the precision rate. The F1 score, the harmonic value of precision and recall, is the most important parameter for evaluating the overall accuracy of the model, and the method in this application achieves the highest F1 score. Furthermore, the overall precision and mean intersection-union ratio (OCR) also significantly exceed those of other methods. Therefore, the landslide area rapid segmentation method proposed in this application based on high-resolution satellite remote sensing data and deep learning algorithms can significantly improve the accuracy of landslide area identification and segmentation.
[0064] The above formulas are all dimensionless calculations. The formulas are derived from software simulations based on a large amount of collected data to obtain the most recent real-world results. The preset parameters in the formulas are set by those skilled in the art according to the actual situation.
[0065] The above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any other combination thereof. When implemented in software, the above embodiments can be implemented, in whole or in part, as a computer program product. Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution.
[0066] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.
[0067] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.
Claims
1. A method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms, characterized in that, The specific steps include: Step 1: Acquire the original satellite remote sensing image of the area to be segmented, downsample the original satellite remote sensing image to obtain the first image, and extract the reflectance data of each pixel in the red light channel and near-infrared channel from the first image; Step 2: Obtain the vegetation index of each pixel based on the red light reflectance and near-infrared reflectance of each pixel in the first image, construct a vegetation layer based on the vegetation index and the position of the corresponding pixel, and perform channel-level stitching of the first image and the vegetation layer to form a vegetation feature map; Step 3: Input the vegetation feature map into a pre-trained convolutional neural network to generate a landslide probability map, extract the coordinates of pixels in the landslide probability map whose values are greater than a preset probability threshold, construct a two-dimensional coordinate set, map the two-dimensional coordinate set to the corresponding position in the original satellite remote sensing image according to the downsampling ratio, and crop out a high-resolution image patch to be tested around the corresponding position; Step 4: Based on the high Step 5: Determine the local vegetation index by analyzing the reflectance data of each pixel in the red and near-infrared channels within the image patch to be tested, and obtain the spatial gradient magnitude of the local vegetation index. Combine the spatial gradient magnitude with a preset enhancement coefficient to obtain the boundary weight. Use the enhancement weight to enhance the corresponding pixel to obtain the edge enhancement patch. Step 6: Input the edge enhancement patch into a pre-trained semantic segmentation network to extract the spatial features of the edge enhancement patch. Determine the landslide state of each pixel in the edge enhancement patch based on the spatial features. Summarize the landslide states of all pixels to obtain the local landslide map of the edge enhancement patch. Step 7: Construct an initialization map with the same spatial size as the original satellite remote sensing image. According to the original satellite remote sensing image mapping coordinates corresponding to each high-definition image patch to be tested during cropping, fill all the local landslide maps back into the initialization map. Stitch together adjacent local landslide maps to obtain the landslide area segmentation map.
2. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 1, characterized in that: Acquire the original satellite remote sensing image of the region to be segmented; determine the mapping coordinates according to the preset downsampling ratio; extract the four nearest neighboring pixels to the mapping coordinates in each spectral channel of the original satellite remote sensing image; calculate the spatial distance between the mapping coordinates and the four neighboring pixels in the horizontal and vertical directions; generate distance weights based on the spatial distances; perform a weighted average of the pixel values of the four neighboring pixels using the distance weights to obtain the first image; for the first image, extract the reflectance data corresponding to the red light channel and near-infrared channel pixel by pixel.
3. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 2, characterized in that: The difference between the reflectance data of each pixel in the red light channel and the near-infrared channel is calculated as the reflectance difference value, and the sum of the reflectance data of each pixel in the red light channel and the near-infrared channel is calculated as the total reflectance value. Calculate the ratio of the reflectance difference value to the sum of reflectance values to obtain the vegetation difference value of each pixel; traverse the vegetation difference values of all pixels in the first image and normalize them to obtain the vegetation index of each pixel; reorganize the vegetation index of each pixel according to the positions of all pixels in the first image to obtain the vegetation layer. By using the pixel values of each pixel in the vegetation layer, feature enhancement is performed on the pixel features of each spectral channel at the corresponding position in the first image to obtain a vegetation feature map.
4. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 2, characterized in that: The vegetation feature map is input into a pre-trained convolutional neural network to obtain a landslide probability map. Pixels in the landslide probability map are traversed, and those with probability values exceeding a preset probability threshold are marked as potential landslide points. The coordinates of the potential landslide points are recorded to generate a two-dimensional coordinate set. The coordinate values in the two-dimensional coordinate set are mapped to the original satellite remote sensing image using the reciprocal of the downsampling ratio as a scaling factor to obtain the original two-dimensional coordinates in the original satellite remote sensing image. The corresponding local image is cropped according to a preset size using the original two-dimensional coordinates as the center to obtain a high-resolution image patch to be tested.
5. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 4, characterized in that: The pre-trained convolutional neural network is obtained by training and converging using a sample set containing historical downsampled first images, corresponding constructed vegetation layers, and real landslide annotation data, by minimizing the classification cross-entropy loss between the predicted probability and the real landslide annotation data.
6. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 1, characterized in that: For each high-definition image patch to be tested, the reflectance data of each pixel in the red light channel and near-infrared channel are extracted, the vegetation difference value of each pixel is calculated, and normalization is performed to obtain the local vegetation index of the corresponding pixel location; the spatial change rate of the local vegetation index in the horizontal and vertical directions is calculated using the discrete central difference operator, and the vector magnitude is synthesized to obtain the spatial gradient magnitude of each pixel; the spatial gradient magnitude is multiplied by the preset enhancement coefficient to obtain the boundary weight; the original pixel features of the high-definition image patch to be tested are weighted pixel by pixel using the boundary weight to obtain the edge-enhanced image patch.
7. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 6, characterized in that: Traverse the local vegetation indices within the current high-definition map patch to be tested, extract the local maximum and local minimum values respectively, and calculate the local vegetation range between the local maximum and local minimum values; perform regional mean statistics on the spatial gradient amplitude, and extract the local average gradient value of the high-definition map patch to be tested; evaluate the relative proportional relationship between the local vegetation range and the local average gradient value to obtain the enhancement coefficient.
8. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 1, characterized in that: Each edge enhancement patch is input into a pre-trained semantic segmentation network. Convolution is performed on the edge enhancement patches to obtain global semantic information. The global semantic information is then upsampled to obtain the spatial features of the edge enhancement patches. Convolution is performed on the spatial features to obtain the classification score of each pixel. The classification score is normalized to obtain the probability value of each pixel. The probability value is compared with a preset classification threshold to obtain the landslide state of each pixel. The landslide states are spatially arranged according to the coordinate position of each pixel in the edge enhancement patch to obtain a local landslide map.
9. The method for rapid landslide area segmentation based on high-resolution satellite remote sensing data and deep learning algorithms according to claim 8, characterized in that: An all-zero matrix with the same spatial dimensions as the original satellite remote sensing image is constructed as the initialization map. Based on the original satellite remote sensing image mapping coordinates corresponding to each high-resolution landslide patch during cropping, the corresponding local landslide map is backfilled in situ into the initialization map. During the process of backfilling the corresponding local landslide map into the initialization map, the overlapping areas of adjacent local landslide maps are extracted. Multiple landslide states of pixels in different local landslide maps are extracted. If at least one of the multiple landslide states is determined to be a landslide category, the pixel is determined to be a landslide pixel. If no landslide category exists among the multiple landslide states, the pixel is determined to be a background pixel. The determined pixels are updated to the corresponding positions in the initialization map, and the updated initialization map is used as the landslide area segmentation map.
Citation Information
Patent Citations
Fabric defect real-time identification method and device based on deep learning
CN120783127A
High-precision image processing method and system based on illumination adaptive compensation
CN121032846A
Lightweight satellite landslide image intelligent detection method, apparatus and device, and medium
CN121438136A