Automatic fusion method and system for suspended sediment concentration of multi-source ocean color satellite

Abstract

The application discloses a kind of multi-source ocean color satellite suspended silt concentration automatic fusion method and system, belong to marine remote sensing and geographic information processing technical field, comprising: S1, original satellite data file is automatically identified and read;S2, quality mark data is handled, and integrated quality mask is generated once, and concentration data is marked with invalid value;S3, all effective pixels are resampled to pre-defined regular geographic grid, and the concentration accumulation sum and pixel count of each grid unit are calculated, and then grid mean is obtained;S4, the multiple grid data in same area, same time window are stacked along time axis, and median robust average method or minimum value synthesis method is used to carry out space-time fusion;S5, based on the data after fusion, standard raster file and thematic map containing geographic elements and decoration information are automatically generated.The application can solve the problems of fragmentation of processing flow, low efficiency and insufficient accuracy in the prior art.

Description

Technical Field

[0001] This invention belongs to the field of marine remote sensing and geographic information processing technology, and in particular relates to an automated fusion method and system for the concentration of suspended sediment from multi-source ocean color satellites. Background Technology

[0002] Suspended sediment concentration is an important indicator for assessing coastal erosion, estuarine deposition, water transparency, and the ecological environment. Satellite remote sensing technology, especially ocean color satellites such as Haiyang-1 and Sentinel-3, provides a core data source for large-scale, periodic monitoring of suspended sediment.

[0003] However, existing technologies have significant limitations when processing this data: Data formats are heterogeneous (HDF5, NetCDF, etc.), requiring manual writing of different scripts for reading; Quality control relies on pixel-by-pixel looping, which is inefficient and inconsistent in standards; Data from different satellites and at different times is difficult to automatically align to a unified spatial grid; Multi-temporal fusion methods are simple (such as direct averaging) but are easily affected by residual clouds and flare noise. The fragmented process from data to the final thematic map makes it difficult to meet the requirements of business systems for high timeliness, high accuracy, and unattended operation. Summary of the Invention

[0004] This invention provides an automated fusion method and system for the concentration of suspended sediment from multi-source ocean color satellites, which solves the problems of fragmented processing, insufficient accuracy, and low efficiency in existing technologies.

[0005] To achieve the above-mentioned objectives, the first objective of this invention is to provide an automated fusion method for the concentration of suspended sediment from multi-source ocean color satellites, comprising: S1. Automatically identify and read raw satellite data files of different formats, and extract suspended sediment concentration data, geographic coordinate data and quality label data; S2. Process the quality identification data based on vectorized bit operations to generate a comprehensive quality mask in one go, and mark the concentration data as invalid values ​​according to the mask; S3. Resample all valid pixels onto a predefined regular geographic grid, and use a vectorized accumulation method to calculate the concentration accumulation and pixel count of each grid cell in parallel to obtain the grid mean. S4. Stack multiple grid data from the same region and the same time window along the time axis, and perform spatiotemporal fusion using the median robust averaging method or the minimum value synthesis method to obtain the fused concentration data. S5, automatically generating a standard raster file and a thematic map containing geographic elements and finishing information based on the fused concentration data.

[0006] Preferably, S1 comprises: For HDF5 files of Haiyang-1 C / D satellites, reading the TSM layer, longitude and latitude layers, and the l2_flags layer; For NetCDF data packages of Sentinel-3 satellites, reading the TSM_NN variable, latitude / longitude variables and WQSF variable, and converting the stored value to a scientific value V_science according to the following formula: V_science=scale_factor×V_storage+add_offset, wherein, scale_factor is a scaling factor, add_offset is an offset; V_storage is an unknown quantity directly read from the file; then obtaining the actual concentration value through exponentiation: TSM=10^{V_science}.

[0007] Preferably, S2 comprises: verifying that the shape of the quality identification array is consistent with that of the concentration data array; according to a preset invalid bit list RemoveBits, performing the following processing on the quality identification array: Mask_i=(Flag&(1<<bit_i))!=0, and reducing to obtain a total mask: Mask_total=np.bitwise_or.reduce([Mask_1,...,Mask_n]); marking pixels where Mask_total is true, the original concentration is a fixed invalid value or the concentration is negative as NaN.

[0008] Preferably, S3 comprises: setting the boundary and step size of a target grid; extracting non-NaN valid pixels, as well as their longitude and latitude (lon,lat) and concentration value val; calculating grid row and column indexes for each valid pixel: col_idx=floor((lon-left_lon) / StepSize), row_idx=floor((top_lat-lat) / StepSize); flattening the row and column indexes into a one-dimensional index: flat_idx=row_idx×N_cols+col_idx; The bincount function is used to calculate the cumulative sum SumMatrix for each grid cell in parallel, with flat_idx as the index and val as the weight, while simultaneously calculating the count matrix. Calculate the grid mean GridMean: GridMean = SumMatrix / CountMatrix, assign NaN to the position where the count is 0.

[0009] Preferred median robust averaging methods include: For a time series V_series, calculate the median and root mean square deviation (RMS): RMS = sqrt(mean((V_series-Median)^2)); Set a coefficient k and filter values ​​that satisfy |V_series_i-Median|≤k×RMS; The average value of the filtered values ​​is used as the fusion result.

[0010] A second objective of this invention is to provide an automated fusion system for the concentration of suspended sediment from multi-source ocean color satellites, comprising: The data reading module automatically identifies and reads raw satellite data files in different formats, extracting suspended sediment concentration data, geographic coordinate data, and quality label data; The quality control module processes the quality identification data based on vectorized bit operations, generates a comprehensive quality mask in one go, and marks the concentration data as invalid values ​​according to the mask; The gridding module resamples all valid pixels onto a predefined regular geographic grid, and uses a vectorized accumulation method to calculate the concentration sum and pixel count of each grid cell in parallel, thereby obtaining the grid mean. The spatiotemporal fusion module stacks multiple grid data from the same region and the same time window along the time axis and performs spatiotemporal fusion using the median robust averaging method or the minimum value synthesis method to obtain fused concentration data. The product output module automatically generates standard raster files and thematic maps containing geographic features and finishing information based on the fused concentration data.

[0011] Preferably, the data reading module includes: The first analysis unit reads the GeophysicalData / TSM layer as suspended sediment concentration data, the NavigationData / Latitude and Longitude layers as geographic coordinate data, and the GeophysicalData / l2_flags layer as mass label data from the HDF5 file of Haiyang-1 C / D satellite. A second parsing unit, configured to read the TSM_NN variable from the tsm_nn.nc file, read the latitude and longitude variables from the geo_coordinates.nc file, and read the WQSF variable as quality identification data from the wqsf.nc file of the NetCDF data packet of Sentinel-3 satellite; The second parsing unit converts the stored value to a scientific value V_science according to the following formula based on the scaling factor scale_factor and the offset add_offset in the metadata of the TSM_NN variable: V_science=scale_factor×V_storage+add_offset, and further obtains the actual suspended sediment concentration value TSM through exponential operation TSM=10^{V_science}.

[0012] Preferably, the quality control module comprises: Checking the shape consistency between the quality identification array and the suspended sediment concentration data array; Performing vectorized bitwise operation on the quality identification array according to a preset invalid quality identification bit list RemoveBits: generating a boolean mask Mask_i=(Flag&(1<<bit_i))!=0 for each bit bit_i in the list, and generating a comprehensive quality mask Mask_total=np.bitwise_or.reduce([Mask_1,Mask_2,…,Mask_n]) through bitwise OR reduction operation; Marking pixel values where the comprehensive quality mask is true, preset fixed invalid values in the suspended sediment concentration data, and pixels with negative concentration as NaN.

[0013] Preferably, the gridding module comprises: Receiving a target grid boundary Bound and a grid step size StepSize set by a user; Extracting non-NaN valid pixels from the suspended sediment concentration data, and acquiring the longitude lon_j, latitude lat_j and concentration value val_j corresponding to each valid pixel; Calculating the row index and column index of each valid pixel in the target grid according to the following formula: col_idx_j=floor((lon_j-Bound.left_lon) / StepSize), row_idx_j=floor((Bound.top_lat-lat_j) / StepSize); Convert the row index and column index into a flattened one-dimensional index flat_idx_j = row_idx_j × N_cols + col_idx_j, where N_cols is the number of grid columns; Using the bincount function of the NumPy library, with the one-dimensional index flat_idx_j as the index and the concentration value val_j as the weight, the concentration accumulation SumMatrix of each grid cell is calculated in parallel, and the pixel count CountMatrix of each grid cell is calculated at the same time. Calculate the mean value GridMean for each grid cell: GridMean = SumMatrix / CountMatrix, and assign NaN to the grid cells with a count of zero.

[0014] A third objective of this invention is to provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the aforementioned automated fusion method for the concentration of suspended sediment from multi-source ocean color satellites.

[0015] The advantages and positive effects of this application are: This invention enables end-to-end unattended processing from raw data to thematic maps. In particular, through vectorized quality control and bincount-based gridding, it avoids pixel-by-pixel looping, improving processing speed by more than an order of magnitude compared to traditional point-by-point methods, thus meeting the needs of high-frequency production in business applications.

[0016] This invention achieves high compatibility and consistency of multi-source data, unifies the parsing of two mainstream ocean color satellite data, Haiyang-1 C / D and Sentinel-3, and aligns them to the same spatial reference through standard gridding, enabling multi-source and multi-temporal data to be processed collaboratively, and the product has good spatiotemporal consistency.

[0017] This invention employs a dual approach: hierarchical quality labeling vectorization removal and median robust averaging fusion. The former accurately filters out interference from clouds, flares, land, and other sources; the latter effectively suppresses occasional outliers in the time series, resulting in a fusion result that is more physically robust than direct averaging or median averaging.

[0018] The scalability established by this invention allows users to configure core parameters such as grid step size, fusion algorithm type (robust average / minimum synthesis), quality control bit list, and synthesis cycle. It can adapt to business needs of different resolutions and regions without modifying the underlying code, and has extremely high reusability and platform potential. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a flowchart of a preferred embodiment of the present invention. Detailed Implementation

[0021] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0022] Please see Figure 1 An automated fusion method for the concentration of suspended sediment from multiple ocean color satellites mainly includes: S1. Automatically identify and read raw satellite data files of different formats, and extract suspended sediment concentration data, geographic coordinate data and quality label data; in the computer system, the quality label data is stored in the form of an array, named the quality label array; S2. Process the quality identification data based on vectorized bit operations to generate a comprehensive quality mask in one go, and mark the concentration data as invalid values ​​according to the mask; S3. Resample all valid pixels onto a predefined regular geographic grid, and use a vectorized accumulation method to calculate the concentration accumulation and pixel count of each grid cell in parallel to obtain the grid mean. S4. Stack multiple grid data from the same region and the same time window along the time axis, and perform spatiotemporal fusion using the median robust averaging method or the minimum value synthesis method to obtain the fused concentration data. S5. Based on the fused concentration data, automatically generate standard raster files and thematic maps containing geographic features and embellishment information.

[0023] To better understand the technical solution of the present invention, the above steps are described in detail below without limitation: S1 includes: automatically scanning the user-specified input directory to identify and extract raw data files in two main formats: HDF5 format (.h5) files from Ocean-1 C / D satellites and NetCDF data packets (.sen3 directory) from Sentinel-3.

[0024] S1 specifically includes: First, the system automatically scans the user-specified input directory to identify and extract raw data files in two main formats: HDF5 format (.h5) files from Ocean-1 C / D satellites and NetCDF data packets (.sen3 directory) from Sentinel-3 satellites. Then, based on the satellite type, the suspended sediment concentration data, latitude and longitude navigation data, and quality label data (Flag) are extracted respectively. Finally, for the Sentinel-3 data, based on the scale_factor and add_offset in its metadata, the conversion V_science = scale_factor × V_storage + add_offset was performed, and the actual concentration value was obtained through exponential calculation.

[0025] In one specific embodiment, the system acts as the execution entity, uniformly parsing data of different formats: For data from Haiyang-1C / D satellites: read the three core datasets in the HDF5 file: GeophysicalData / TSM (suspended sediment concentration data layer), NavigationData / Latitude and NavigationData / Longitude (latitude and longitude navigation layers), and GeophysicalData / l2_flags (mass labeling layer).

[0026] For Sentinel-3 data: Key data from multiple NetCDF files in the .sen3 directory were read, including the TSM_NN variable (logarithmic suspended sediment concentration) in the tsm_nn.nc file, the latitude and longitude variables (latitude and longitude) in the geo_coordinates.nc file, and the WQSF variable (mass identifier) ​​in the wqsf.nc file. The metadata (scale_factor and add_offset) of the TSM_NN variable was automatically identified, and data decompression and unit conversion were performed. The stored value V_storage was converted to the actual scientific value V_science using the following formula: V_science=scale_factor×V_storage+add_offset Here, `scale_factor` and `add_offset` are known quantities stored in the file attributes; `V_storage` is the unknown quantity (raw stored value) read directly from the file; and `V_science` is the scientific value to be calculated (i.e., log10(TSM)). Subsequently, the system uses the exponential operation `TSM_concentration = 10 × V_science` to restore the log10 concentration to the actual suspended sediment concentration value (unit: g / m³).

[0027] S2 specifically comprises: Automated quality control is performed on the original suspended sediment concentration data read in S1 and the corresponding quality identification data. The core function of this step is to efficiently and accurately eliminate invalid pixels contaminated by factors such as clouds, sun glint, ice, land, and high solar zenith angle, so as to ensure the reliability of data for subsequent analysis. It specifically includes: 1) Data verification: Verify whether the shapes of the quality identification array Flag and the suspended sediment concentration data array Data are consistent.

[0028] 2) Quality identification mask generation: According to the preset list of invalid quality identification bits RemoveBits, which indicates that when which identification bits are set to 1, it represents that the pixel data is unreliable (for example, the setting for data from HY-1C / D satellites is [1,3,5,7,8,9,12,14,15,21,25]), vectorized bitwise operation is performed on the Flag array. For each bit bit_i in the list, calculate the boolean mask Mask_i=(Flag&(1<<bit_i))!=0. Then, through bitwise OR reduction operation, the final comprehensive quality mask Mask_total=np.bitwise_or.reduce([Mask_1,Mask_2,...,Mask_n]) is generated. This process operates on the entire array at one time, completely replacing the traditional pixel-by-pixel loop judgment.

[0029] 3) Invalid value marking: Mark the pixel values with the comprehensive quality mask Mask_total being 1, invalid values of suspended sediment concentration data (-999 for HY-1C / D satellite data, FillValue for Sentinel-3 data), and suspended sediment concentration data meeting the physical invalid condition (Data<0) as NaN.

[0030] S3 specifically comprises: Resample the quality-controlled pixel data with irregular geographic coordinates (defined by Longitude and Latitude arrays) onto a standard regular geographic grid with a unified geographic range and fixed step size predefined by the user. This step realizes the spatial alignment and standardization of multi-source, multi-scene heterogeneous observation data, and lays a foundation for subsequent data fusion. It specifically includes: 1) Parameter definition: The user sets the boundary of the target grid, that is, the unified geographic range and the grid step size StepSize; 2) Spatial range interception and valid data extraction: Extract non-NaN valid pixels from the suspended sediment concentration data Data, and obtain their corresponding longitude and latitude (lon, lat) and suspended sediment concentration values val.

[0031] 3) Grid Index Calculation: For each retained valid pixel (lon_j, lat_j), the system calculates its row index row_idx_j and column index col_idx_j in the target grid. The calculation formula is as follows: col_idx_j=floor((lon_j-Bound['left_lon']) / StepSize) row_idx_j=floor((Bound['top_lat']-lat_j) / StepSize) Floor() is the floor function.

[0032] 4) Vectorized Accumulation and Counting: The system converts the two-dimensional row and column index into a one-dimensional flat index: flat_idx_j = row_idx_j × N_cols + col_idx_j, where N_cols is the number of grid columns. The system uses the bincount function from the NumPy library to perform two vectorization operations: Using flat_idx as the index and val as the weight, calculate the cumulative sum of data in each grid cell, SumMatrix.

[0033] Using flat_idx as the index, calculate the pixel count CountMatrix for each grid cell.

[0034] 5) Grid mean calculation: The system calculates the mean of each grid cell based on the cumulative sum and the counting matrix: GridMean = SumMatrix / CountMatrix. For grid cells with a count of 0, the mean is assigned the value NaN.

[0035] S4 specifically includes: For multiple standard grid data points generated after S3 gridding within the same region and time period (e.g., one month), the system stacks them along the time dimension. The purpose of this step is to synthesize a suspended sediment concentration product that better represents the water condition within that time period, has more complete data coverage, and less noise. The fusion methods include the median robust averaging method and the minimum value synthesis method.

[0036] 1) Median Robust Averaging Method: The system first calculates the median of V_series, then calculates the root mean square (RMS) of the deviation of each value from the median: RMS = sqrt(mean((V_series-Median)^2)). Subsequently, the system selects all values ​​that satisfy |V_series_i-Median| ≤ ​​k × RMS (where k is a preset coefficient, such as 1.5), and finally calculates the average of these "robust" values ​​as the fusion value for that grid location. This method effectively removes the interference of random outliers in the time series.

[0037] 2) Minimum value synthesis method: The system directly takes the minimum value in V_series as the fusion value, aiming to minimize the impact of residual pollution such as clouds.

[0038] S5 specifically includes: Based on the fused mesh data generated by S4, two standardized products are automatically generated.

[0039] 1) Standard Georeferenced Raster File: The system generates a standard GeoTIFF format file by combining the data matrix, along with its precise geographic transformation parameters (affine transformations calculated from Bound and StepSize) and coordinate system information.

[0040] 2) Thematic Maps: Based on the dynamic range of the data, color scales and classifications are set, basic geographic elements such as coastlines and administrative divisions are overlaid, and finishing elements such as map titles, legends, scales, data sources, cartographic units, and dates are added. The final output is a high-resolution image file (such as PNG format). This step achieves unattended output of "data to map".

[0041] An automated fusion system for measuring suspended sediment concentration from multiple ocean color satellites includes: The data reading module is used to execute S1; The quality control module is used to execute S2; The mesh module is used to execute authority S3; The spatiotemporal fusion module is used to execute S4; The product output module is used to execute S5.

[0042] The data reading module includes: The first parsing unit is used to read the GeophysicalData / TSM layer as suspended sediment concentration data, the NavigationData / Latitude and Longitude layers as geographic coordinate data, and the GeophysicalData / l2_flags layer as mass label data from the HDF5 file of Haiyang-1 C / D satellite. The second parsing unit is used to read the TSM_NN variable from the tsm_nn.nc file, the latitude and longitude variables from the geo_coordinates.nc file, and the WQSF variable from the wqsf.nc file as quality identification data for the NetCDF data packets of the Sentinel-3 satellite; The second analysis unit is further configured to convert a stored value into a scientific value according to scale_factor and add_offset in the metadata of the TSM_NN variable by the following formula: V_science=scale_factor×V_storage+add_offset, and further obtain the actual total suspended sediment concentration value (unit: g / m³) through an exponential operation TSM=10^{V_science}.

[0043] The quality control module is specifically configured to: verify the shape consistency between the quality identifier array and the total suspended sediment concentration data array; perform vectorized bitwise operation on the quality identifier array according to a preset invalid quality identification bit list RemoveBits: generating a boolean mask Mask_i=(Flag&(1<<bit_i))!=0 for each bit bit_i in the list, and generating a comprehensive quality mask Mask_total=np.bitwise_or.reduce([Mask_1,Mask_2,…,Mask_n]) through bitwise OR reduction operation; mark pixel values for which the comprehensive quality mask is true, the preset fixed invalid values in the total suspended sediment concentration data, and negative concentrations as NaN.

[0044] the preset invalid quality identification bit list in the quality control module is set to 1,3,5,7,8,9,12,14,15,21,25 for HY-1C / D satellite data, and is used for eliminating cloud, land, flare, high solar zenith angle and ice pixels.

[0045] The gridding module is specifically configured to: receive a target grid boundary Bound and a grid step size StepSize set by a user; extract valid pixels that are not NaN from the total suspended sediment concentration data, and obtain the longitude lon_j, latitude lat_j and concentration value val_j corresponding to each valid pixel; calculate the row index and column index of each valid pixel in the target grid according to the following formulas: col_idx_j=floor((lon_j-Bound.left_lon) / StepSize), row_idx_j=floor((Bound.top_lat-lat_j) / StepSize); convert the row index and column index into a flattened one-dimensional index flat_idx_j=row_idx_j×N_cols+col_idx_j, where N_cols is the number of grid columns; Using the bincount function of the NumPy library, with the one-dimensional index flat_idx_j as the index and the concentration value val_j as the weight, the concentration accumulation SumMatrix of each grid cell is calculated in parallel, and the pixel count CountMatrix of each grid cell is calculated at the same time. Calculate the mean value of each grid cell: GridMean = SumMatrix / CountMatrix, and assign the value of the grid cell with a count of zero to NaN.

[0046] The spatiotemporal fusion module includes: The median robust averaging unit stacks multiple grid data points within the same grid region and time window along the time axis into a sequence V_series. It calculates the median and root mean square (RMS) of this sequence: sqrt(mean((V_series-Median)²)). Values ​​satisfying |V_series_i-Median| ≤ ​​k × RMS, where k is a preset coefficient, are selected, and their average is used as the fusion result. The minimum value synthesis unit directly takes the minimum value in the sequence V_series as the fusion result; The spatiotemporal fusion module selectively enables the median robust average unit or the minimum value synthesis unit according to the fusion mode specified by the user.

[0047] The preset coefficient k in the median robust average unit is 1.5.

[0048] The product output module includes: The raster file generation unit is used to generate a standard GeoTIFF format file based on the fused mesh data, combined with the affine transformation parameters calculated from the target mesh boundary and step size, and the preset coordinate system information. The thematic map generation unit is used to automatically classify and color the data according to the dynamic range of the fused grid data, overlay preset coastlines and basic geographic elements of administrative divisions, and add map title, legend, scale, data source, cartographic unit and date finishing elements to finally generate a high-resolution image file.

[0049] The system also includes a parameter configuration module, which allows users to set at least one of the following parameters: target grid step size, spatiotemporal fusion method type, quality control invalid bit list, and synthesis cycle; the data reading module, quality control module, meshing module, and spatiotemporal fusion module adapt to the processing requirements of different regions, different resolutions, and different synthesis cycles according to the settings of the parameter configuration module.

[0050] The above description is only a preferred embodiment of the present invention. It should be noted that, for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. An automated fusion method of multi-source ocean color satellite suspended sediment concentration, characterized in that, Comprising: S1, automatically identifying and reading original satellite data files in different formats, and extracting suspended sediment concentration data, geographic coordinate data and quality identification data; S2, processing the quality identification data based on vectorized bit operation, generating a comprehensive quality mask at one time, and marking invalid values for the concentration data according to the mask; S3, resampling all valid pixels onto a predefined regular geographic grid, adopting a vectorized accumulation method to parallelly calculate the concentration accumulation sum and pixel count of each grid cell, and then obtain the grid average value; S4, stacking a plurality of pieces of grid data in the same region and the same time window along the time axis, and adopting a median robust average method or a minimum value synthesis method to perform spatio-temporal fusion, so as to obtain fused concentration data; said median robust average method comprises: calculating a median Median and a root mean square of deviation RMS for a time series V_series, where RMS=sqrt(mean((V_series-Median)^2)); setting a coefficient k, and screening values satisfying |V_series_i-Median|≤k×RMS; calculating an average value of the screened values as a fusion result; S5, automatically generating a standard raster file and a thematic map containing geographic elements and finishing information based on the fused concentration data.

2. The automated fusion method of multi-source ocean color satellite suspended sediment concentration according to claim 1, characterized in that, S1 comprises: for HDF5 files of HY-1C / D satellites, reading a TSM layer, a longitude and latitude layer and an l2_flags layer; for NetCDF data packets of Sentinel-3 satellites, reading a TSM_NN variable, latitude / longitude variables and a WQSF variable, and converting stored values into scientific values V_science according to the following formula: V_science=scale_factor×V_storage+add_offset, wherein, scale_factor is a scaling factor, add_offset is an offset; V_storage is a variable directly read from a file; then obtaining an actual concentration value through exponential operation: TSM=10^{V_science}.

3. The automated fusion method of multi-source ocean color satellite suspended sediment concentration according to claim 1, wherein S2 comprising: checking whether the shape of the quality identification array is consistent with that of the concentration data array; executing the following operation on the quality identification array according to a preset invalid bit list RemoveBits: Mask_i=(Flag&(1<<bit_i))!=0, and reducing to a total mask: Mask_total=np.bitwise_or.reduce([Mask_1,...,Mask_n]); marking pixels with true Mask_total, original concentration being a fixed invalid value or negative concentration as NaN.

4. The automated fusion method of multi-source ocean color satellite suspended sediment concentration according to claim 1, wherein S3 comprising: receiving a target grid boundary Bound and a grid step size StepSize set by a user; extracting non-NaN valid pixels from the suspended sediment concentration data, and acquiring a longitude lon_j, a latitude lat_j and a concentration value val_j corresponding to each valid pixel; calculating a row index and a column index of each valid pixel in a target grid according to the following formula: col_idx_j=floor((lon_j-Bound.left_lon) / StepSize), row_idx_j=floor((Bound.top_lat-lat_j) / StepSize); Convert the row index and column index into a flattened one-dimensional index flat_idx_j = row_idx_j × N_cols + col_idx_j, where N_cols is the number of grid columns; Using the bincount function of the NumPy library, with the one-dimensional index flat_idx_j as the index and the concentration value val_j as the weight, the concentration accumulation SumMatrix of each grid cell is calculated in parallel, and the pixel count CountMatrix of each grid cell is calculated at the same time. Calculate the mean value GridMean for each grid cell: GridMean = SumMatrix / CountMatrix, and assign NaN to the grid cells with a count of zero.

5. An automated fusion system for multi-source ocean color satellite suspended sediment concentration, characterized in that, include: The data reading module automatically identifies and reads raw satellite data files in different formats, extracting suspended sediment concentration data, geographic coordinate data, and quality label data; The quality control module processes the quality identification data based on vectorized bit operations, generates a comprehensive quality mask in one go, and marks the concentration data as invalid values ​​according to the mask; The gridding module resamples all valid pixels onto a predefined regular geographic grid, and uses a vectorized accumulation method to calculate the concentration sum and pixel count of each grid cell in parallel, thereby obtaining the grid mean. The spatiotemporal fusion module stacks multiple grid data from the same region and the same time window along the time axis and performs spatiotemporal fusion using the median robust averaging method or the minimum value synthesis method to obtain fused concentration data. The median robust averaging method includes: For a time series V_series, calculate the median and root mean square deviation (RMS): RMS = sqrt(mean((V_series-Median)^2)); Set a coefficient k and filter values ​​that satisfy |V_series_i-Median|≤k×RMS; The average value after filtering is used as the fusion result; The product output module automatically generates standard raster files and thematic maps containing geographic features and finishing information based on the fused concentration data.

6. The automated fusion system for multi-source ocean color satellite suspended sediment concentration according to claim 5, characterized in that, The data reading module includes: The first analysis unit reads the GeophysicalData / TSM layer as suspended sediment concentration data, the NavigationData / Latitude and Longitude layers as geographic coordinate data, and the GeophysicalData / l2_flags layer as mass label data from the HDF5 file of Haiyang-1 C / D satellite. A second parsing unit, configured to read the TSM_NN variable from the tsm_nn.nc file, read the latitude and longitude variables from the geo_coordinates.nc file, and read the WQSF variable as quality identification data from the wqsf.nc file for the NetCDF data packet of Sentinel-3 satellite; The second parsing unit converts the stored value to a scientific value V_science according to the following formula based on the scaling factor scale_factor and the offset add_offset in the metadata of the TSM_NN variable: V_science=scale_factor×V_storage+add_offset, and further obtains the actual total suspended matter concentration value TSM through exponential operation TSM=10^{V_science}.

7. The automated fusion system for multi-source ocean color satellite suspended sediment concentration according to claim 5, characterized in that, The quality control module comprises: checking the shape consistency between the quality identification array and the total suspended matter concentration data array; performing vectorized bitwise operation on the quality identification array according to a preset invalid quality identification bit list RemoveBits: generating a Boolean mask Mask_i=(Flag&(1<<bit_i))!=0 for each bit bit_i in the list, and generating a comprehensive quality mask Mask_total=np.bitwise_or.reduce([Mask_1,Mask_2,…,Mask_n]) through bitwise OR reduction operation; marking pixel values for which the comprehensive quality mask is true, the preset fixed invalid values in the total suspended matter concentration data, and negative concentration values as NaN.

8. The automated fusion system for multi-source ocean color satellite suspended sediment concentration according to claim 5, characterized in that, The gridding module comprises: receiving a target grid boundary Bound and a grid step size StepSize set by a user; extracting valid non-NaN pixels from the total suspended matter concentration data, and acquiring the longitude lon_j, latitude lat_j and concentration value val_j corresponding to each valid pixel; calculating the row index and column index of each valid pixel in the target grid according to the following formula: col_idx_j=floor((lon_j-Bound.left_lon) / StepSize), row_idx_j=floor((Bound.top_lat-lat_j) / StepSize); converting the row index and column index into a flattened one-dimensional index flat_idx_j=row_idx_j×N_cols+col_idx_j, wherein N_cols is the number of grid columns; using the bincount function of the NumPy library, with the one-dimensional index flat_idx_j as the index and the concentration value val_j as the weight, calculating the concentration accumulation sum SumMatrix of each grid cell in parallel, and simultaneously calculating the pixel count CountMatrix of each grid cell; Calculate the mean value GridMean for each grid cell: GridMean = SumMatrix / CountMatrix, and assign NaN to the grid cells with a count of zero.

9. A computer-readable storage medium storing a computer program, characterized in that, When executed by the processor, the program implements the automated fusion method for the concentration of suspended sediment from multi-source ocean color satellites as described in any one of claims 1-4.

Images