Method, device and equipment for comprehensive evaluation of ocean optical satellite data quality and medium

By conducting multi-dimensional inspections and analyses of ocean optical satellite data, the problem of neglecting multi-dimensional assessment in existing technologies has been solved, achieving a comprehensive improvement in data quality and ensuring reliability.

CN120408063BActive Publication Date: 2025-10-24NATIONAL SATELLITE OCEAN APPLICATION SERVICE
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510330016.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-03-20
Publication Date
2025-10-24
Estimated Expiration
2045-03-20

AI Technical Summary

Technical Problem

Existing technologies for quality control of marine optical satellite data only focus on image quality, neglecting multi-dimensional comprehensive evaluation, resulting in insufficient improvement in data quality.

Method used

By conducting multi-dimensional checks on marine optical satellite data, including date rationality, dataset completeness, validity, dimensionality correctness, spatiotemporal continuity, file integrity, and stability, and combining spatiotemporal matching and stability analysis, a comprehensive evaluation of marine optical satellite data can be achieved.

Benefits of technology

This enables a multi-dimensional comprehensive evaluation of ocean optical satellite data, improving data quality and reliability, and ensuring data integrity and availability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120408063B_ABST
    Figure CN120408063B_ABST
Patent Text Reader

Abstract

The application discloses a kind of marine optical satellite data quality comprehensive evaluation method, device, equipment and medium, to carry out multidimensional comprehensive evaluation to marine optical satellite data, improve the quality of marine optical satellite data, the present application relates to data processing field, the marine optical satellite data quality comprehensive evaluation method, by carrying out data collection date rationality, data set integrity, validity, dimension correctness, spatio-temporal continuity, file integrity, stability check to marine optical satellite data, complete marine optical satellite data quality comprehensive evaluation, it is beneficial to real-time, comprehensive monitoring marine optical satellite data quality under various business scenarios.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of data processing, and in particular to a marine optical satellite data quality comprehensive evaluation method, device, equipment and medium. BACKGROUND

[0002] At present, the quality control of marine optical satellite data mostly focuses on the image quality level, for example: optimization and adjustment of parameters such as spatial resolution, radiation correction accuracy, signal-to-noise ratio, etc. Although this kind of method can effectively improve the visual effect and basic data quality of the image, it usually only focuses on the surface characteristics of the data (such as sharpness, color fidelity, etc.), and ignores other important quality dimensions, lacking a multi-dimensional comprehensive evaluation of marine optical satellite data.

[0003] Therefore, how to comprehensively evaluate marine optical satellite data from multiple dimensions to improve the quality of marine optical satellite data has become a technical problem that technicians in the field need to solve. SUMMARY

[0004] The purpose of the present application is to provide a marine optical satellite data quality comprehensive evaluation method, device, equipment and medium to comprehensively evaluate marine optical satellite data from multiple dimensions and improve the quality of marine optical satellite data.

[0005] In order to achieve the above purpose, the present application provides the following technical scheme:

[0006] A marine optical satellite data quality comprehensive evaluation method, comprising:

[0007] According to the acquisition date of the marine optical satellite data and the file date of the marine optical satellite data, date rationality checking is performed on the marine optical satellite data to obtain a date rationality checking result of the marine optical satellite data;

[0008] According to a preset number of data sets, a data set number of the marine optical satellite data is subjected to integrity checking to obtain a data set integrity checking result;

[0009] According to a preset effective data information, each marine optical satellite data in the data set is subjected to validity checking to obtain a validity checking result of the marine optical satellite data; wherein the effective data information includes at least one of a pixel unique value, a pixel filling value and a data effective value of the marine optical satellite data;

[0010] According to a preset data dimension information, each marine optical satellite data is subjected to dimension correctness checking to obtain a dimension correctness checking result of the marine optical satellite data; wherein the data dimension information includes a number of scanning lines and a number of sampling points of the marine optical satellite data;

[0011] According to time code information of the marine optical satellite data, a time difference between adjacent scan lines, and longitude and latitude information between adjacent pixels, performing a space-time continuity check and a file integrity check on the marine optical satellite data to obtain a space-time continuity check result and a file integrity check result of the marine optical satellite data;

[0012] Performing matching on marine optical secondary product data corresponding to the data set in a space-time matching manner to determine same-type load data and historical secondary product data corresponding to the marine optical secondary product data;

[0013] Performing stability analysis on the same-type load data, the marine optical secondary product data, and the historical secondary product data to determine a stability check result of the data set;

[0014] Based at least on the date reasonableness check result, the data set integrity check result, the validity check result, the dimension correctness check result, the space-time continuity check result, the file integrity check result, and the stability check result, determining a quality comprehensive evaluation result of the marine optical satellite data.

[0015] In an optional embodiment of the present application, further comprising:

[0016] According to a preset file naming rule, performing a check on file naming of the marine optical satellite data to obtain a naming specification check result of the marine optical satellite data;

[0017] The file naming rule includes naming specification of at least one field of a satellite identifier, a collection date, and a sensor type.

[0018] In an optional embodiment of the present application, further comprising:

[0019] According to preset file format information, performing a check on a file format of the marine optical satellite data to obtain a file format check result of the marine optical satellite data.

[0020] In an optional embodiment of the present application, further comprising:

[0021] According to a preset file size range, performing a check on a file size of the marine optical satellite data to obtain a file size check result of the marine optical satellite data.

[0022] In an optional embodiment of the present application, the data validity value is determined according to a sensor parameter type used for collecting the marine optical satellite data; and the sensor parameter type includes at least one of radiance, water temperature, and reflectivity.

[0023] In an optional embodiment of the present application, the time-space continuity check and file integrity check of the ocean optical satellite data according to the time code information of the ocean optical satellite data, the time difference between adjacent scan lines and the longitude and latitude information between adjacent pixels, obtaining the time-space continuity check result and file integrity check result of the ocean optical satellite data, comprises:

[0024] According to the time code information of the ocean optical satellite data, it is judged whether the time difference between adjacent scan lines of the ocean optical satellite data is greater than a preset time threshold, and according to the longitude and latitude information between adjacent pixels in the ocean optical satellite data, it is determined whether the distance between the adjacent pixels is greater than a preset distance threshold;

[0025] If the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold, and the distance between adjacent pixels in the ocean optical satellite data is less than or equal to the preset distance threshold, it is determined that the time-space continuity check result of the ocean optical satellite data is time-space continuous;

[0026] If the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold, or the distance between adjacent pixels in the ocean optical satellite data is greater than the preset distance threshold, it is determined that the time-space continuity check result of the ocean optical satellite data is time-space discontinuous;

[0027] The start time and end time of scanning in the time code information of the ocean optical satellite data are determined;

[0028] According to the start time and end time of scanning, it is judged whether the scan line of the ocean optical satellite data covers the whole day data recording time range;

[0029] If the scan line of the ocean optical satellite data covers the whole day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold, it is determined that the file integrity check result of the ocean optical satellite data is file complete;

[0030] If the scan line of the ocean optical satellite data does not cover the whole day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold, it is determined that the file integrity check result of the ocean optical satellite data is file incomplete.

[0031] Compared with the prior art, the marine optical satellite data quality comprehensive evaluation method provided by the application carries out data collection date rationality, data set integrity, validity, dimension correctness, space-time continuity, file integrity, stability checking on marine optical satellite data, completes the quality comprehensive evaluation of marine optical satellite data, and is beneficial to real-time and comprehensive monitoring of marine optical satellite data quality in various business scenarios.

[0032] The application also provides a marine optical satellite data quality comprehensive evaluation device, which comprises:

[0033] A date rationality checking unit is configured to perform date rationality checking on the marine optical satellite data according to the collection date of the marine optical satellite data and the file date of the marine optical satellite data, and obtain a date rationality checking result of the marine optical satellite data.

[0034] A data set integrity checking unit is configured to perform integrity checking on the number of data sets of the marine optical satellite data according to a preset data set number, and obtain a data set integrity checking result.

[0035] An effectiveness checking unit is configured to perform effectiveness checking on each marine optical satellite data in the data set according to preset effective data information, and obtain an effectiveness checking result of the marine optical satellite data, wherein the effective data information comprises at least one of a pixel unique value, a pixel filling value and a data effective value of the marine optical satellite data.

[0036] A dimension correctness checking unit is configured to perform dimension correctness checking on each marine optical satellite data according to preset data dimension information, and obtain a dimension correctness checking result of the marine optical satellite data, wherein the data dimension information comprises a number of scanning lines and a number of sampling points of the marine optical satellite data.

[0037] A data integrity checking unit is configured to perform space-time continuity checking and file integrity checking on the marine optical satellite data according to time code information of the marine optical satellite data, a time difference between adjacent scanning lines and longitude and latitude information between adjacent pixels, and obtain a space-time continuity checking result and a file integrity checking result of the marine optical satellite data.

[0038] A data stability checking unit is configured to match marine optical secondary product data corresponding to the data set in a space-time matching manner, determine same-type load data and historical secondary product data corresponding to the marine optical secondary product data, and perform stability analysis on the same-type load data, the marine optical secondary product data and the historical secondary product data to determine a stability checking result of the data set.

[0039] a quality comprehensive evaluation unit configured to determine a quality comprehensive evaluation result of the ocean optical satellite data based on at least the date reasonableness checking result, the data set integrity checking result, the validity checking result, the dimension correctness checking result, the spatio-temporal continuity checking result, the file integrity checking result and the stability checking result.

[0040] Compared with the prior art, the ocean optical satellite data quality comprehensive evaluation device provided by the present application has the same beneficial effects as the ocean optical satellite data quality comprehensive evaluation method described in the above technical solution, and details are not repeated here.

[0041] The present application also provides an electronic device comprising:

[0042] a processor;

[0043] a memory for storing instructions executable by the processor;

[0044] the processor is configured to execute the above-mentioned ocean optical satellite data quality comprehensive evaluation device by running the instructions in the memory.

[0045] Compared with the prior art, the electronic device provided by the present application has the same beneficial effects as the ocean optical satellite data quality comprehensive evaluation method described in the above technical solution, and details are not repeated here.

[0046] The present application also provides a computer storage medium, wherein the computer storage medium stores instructions, and the instructions, when executed, implement the above-mentioned ocean optical satellite data quality comprehensive evaluation device.

[0047] Compared with the prior art, the computer storage medium provided by the present application has the same beneficial effects as the ocean optical satellite data quality comprehensive evaluation method described in the above technical solution, and details are not repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0048] The drawings described herein are used to provide further understanding of the present application, and form a part of the present application. The illustrative embodiments of the present application and their descriptions serve to explain the present application, and do not constitute an improper limitation on the present application. In the drawings:

[0049] Figure 1 The ocean optical satellite data quality comprehensive evaluation method flowchart provided by the present application is shown in the figure.

[0050] Figure 2 The ocean optical satellite data quality comprehensive evaluation device structure diagram provided by the present application is shown in the figure.

[0051] Figure 3A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] To facilitate a clear description of the technical solutions of the embodiments of the present invention, the words "first" and "second" are used in the embodiments of the present invention to distinguish between identical or similar items with substantially the same functions and effects. For example, the first threshold and the second threshold are merely used to distinguish between different thresholds and do not limit their order. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity or execution order, and the words "first" and "second" do not necessarily mean different.

[0053] It should be noted that, in the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present invention should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0054] In the present invention, "at least one" means one or more, and "more" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, the combination of a and b, the combination of a and c, the combination of b and c, or the combination of a, b and c, where a, b, c can be single or plural.

[0055] Currently, the quality control work of ocean optical satellite data mostly focuses on the image quality level, such as the optimization and adjustment of parameters such as spatial resolution, radiation correction accuracy, and signal-to-noise ratio. Although this type of method can effectively improve the visual effect and basic data quality of the image, this method usually only focuses on the surface characteristics of the data (such as clarity, color fidelity, etc.), while ignoring other important quality dimensions, and lacks a multi-dimensional comprehensive evaluation of ocean optical satellite data.

[0056] Therefore, how to conduct a multi-dimensional comprehensive evaluation of ocean optical satellite data to improve the quality of ocean optical satellite data has become a technical problem that technicians in this field urgently need to solve.

[0057] To solve the above technical problems, the embodiment of the present application provides a marine optical satellite data quality comprehensive evaluation method, device, equipment and medium, which are described one by one in the following embodiments.

[0058] Please refer to Figure 1 , Figure 1 The marine optical satellite data quality comprehensive evaluation method flowchart provided by the embodiment of the present application is shown in the following.

[0059] As Figure 1 shown, the marine optical satellite data quality comprehensive evaluation method includes the following S101 to S108.

[0060] S101, according to the collection date of the marine optical satellite data and the file date of the marine optical satellite data, performing date rationality check on the marine optical satellite data to obtain the date rationality check result of the marine optical satellite data.

[0061] The main purpose of the date rationality check is to ensure that the collection date and the file date of the marine optical satellite data are logically reasonable, and to avoid data quality problems caused by date errors. For example, the collection date is in the future, the file date corresponding to the marine optical satellite data does not match the collection date, the date format is wrong, etc. These errors will affect the usability and reliability of the data. Through the above S101, these errors can be found and corrected in time to ensure the accuracy and timeliness of the data.

[0062] In an optional embodiment of the present application, the date rationality check can include logical verification of the collection date (such as checking whether the collection date is in the future or conflicts with the operation cycle of the satellite), logical verification of the file date (such as checking whether the file date is consistent with the collection date or the difference between the two is within a reasonable time range), and specification check of the date format (such as checking whether the formats of the collection date and the file date meet the preset standards).

[0063] For the date rationality check, the collection date and the file date of the marine optical satellite data can be extracted from the data file name and the file attribute, respectively. For example, the data file name may contain "20241001" indicating that the collection date of the marine optical satellite data is October 1, 2024, and the same date information may also be recorded in the file attribute.

[0064] After obtaining the collection date and the file date of the marine optical satellite data, the formats of the collection date and the file date can be further logically verified.

[0065] Specifically, the extracted collection date and file date can be checked according to a preset date format (for example, NNNNYYRR, where NNNN represents the year, YY represents the month, and RR represents the date) to check whether the extracted collection date and file date are standard, for example, whether the collection date and file date are 8 digits, whether the month is between 01 and 12, and whether the date is between 01 and 31.

[0066] Further, it is checked whether the collection date is a future time, for example, if the current time is October 1, 2024, and the extracted collection date is October 20, 2024, it is determined that the collection date is a future time, and at this time, it can be determined that the date rationality check result is that the collection date of the ocean optical satellite data is abnormal.

[0067] Further, it is checked whether the collection date conflicts with the operation cycle of the satellite, for example, if the operation cycle of a satellite is once every 3 days, and the collection date does not match the operation cycle of the satellite, it is determined that the date rationality check result is that the collection date of the ocean optical satellite data is abnormal.

[0068] Further, it is checked whether the file date is consistent with the collection date or whether the time difference between the file date and the collection date exceeds a preset time range, and if the two are inconsistent or the difference between the two exceeds the preset time range, it is determined that the date rationality check result is that the collection date and the file date are abnormal.

[0069] S102, according to a preset number of data sets, the number of data sets of the ocean optical satellite data is checked for integrity, and a data set integrity check result is obtained.

[0070] The purpose of the integrity check is to ensure that the number of data sets of the ocean optical satellite data is consistent with the preset number, and to avoid incomplete or redundant data caused by missing or redundant data sets. Through the integrity check, missing, duplication or naming errors in the data set can be found in time, thereby ensuring the integrity and availability of the data set.

[0071] In the embodiments of the present application, the integrity check includes: comparison of the number of files (for example, whether the preset number of data sets is consistent with the actual number of data sets), identification of missing or redundant data sets (for example, identifying whether there is a missing or redundant data set in the data set, and recording the missing or redundant file information), and integrity check of the data structure (for example, checking whether the files in the data set are organized according to the preset structure, for example, whether necessary subdirectories or hierarchical structures are included).

[0072] Specifically, the integrity check specifically includes:

[0073] Firstly, according to the business requirements or data production specifications, the number of preset data sets is determined, for example, 10 data sets should be generated in a single data file of a marine optical satellite on a single day.

[0074] Then, the marine optical satellite data in the actually collected data set is traversed to determine the number of data sets of the marine optical satellite data, and the number of data sets is compared with the number of preset data sets to determine whether they are consistent. If they are not consistent, further analysis is performed to determine whether the inconsistency is caused by missing files or redundant files.

[0075] If the number of preset data sets is greater than the number of data sets of the marine optical satellite data, it is determined that the marine optical satellite data is missing data sets.

[0076] If the number of preset data sets is less than the number of data sets of the marine optical satellite data, it is determined that the marine optical satellite data is redundant data sets.

[0077] Further, it is checked whether the structure and organization of the marine optical satellite data in the data set conform to the preset structure and organization, for example, the data set should contain raw data, processed data, and metadata sub-targets, and each sub-target should contain a specific type and a specific number of marine optical satellite data.

[0078] S103, according to the preset valid data information, the validity of each marine optical satellite data in the data set is checked, and the validity checking result of the marine optical satellite data is obtained; wherein the valid data information includes at least one of the pixel unique value, the pixel filling value and the data valid value of the marine optical satellite data.

[0079] The main purpose of data validity checking is to ensure that the scientific data set (such as reflectivity, radiance, water temperature, etc.) in the marine optical satellite data conforms to the preset valid data range, and to avoid data quality problems caused by data abnormalities (such as all invalid values, unique values or filling values). Through validity checking, errors in the data production process can be found in time to ensure the scientificity and usability of the data.

[0080] In the embodiments of the present application, the validity checking includes: pixel unique value checking (checking whether all pixel values in the data set are the same, which may be an abnormality caused by incorrect assignment in the data production process), pixel filling value checking (checking whether there are a large number of filling values in the data set, wherein the filling value usually represents invalid data or missing data), data valid value checking (checking whether the value of each pixel in the data set is within the preset valid range, such as reflectivity range 0~1, water temperature range -2°C~40°C), data distribution rationality checking (checking whether the distribution of pixel values in the data set conforms to the expectation, such as whether there are abnormal high or low values).

[0081] Specifically, the validity check includes:

[0082] According to the sensor parameters and scientific data characteristics of the ocean optical satellite data, preset valid data information is set, including setting a determination condition of a unique value of a pixel (such as: all pixel values are the same), defining a pixel filling value (such as: using a filling value to fill fixed pixels, and the filling value is 32767), and setting a range of valid data values (such as: the reflectivity range is 0-1, and the water temperature range is -2°C-40°C).

[0083] Each pixel in the data set is traversed, the number of unique values of the pixel value is calculated, and if the number of unique values is less than the data of the ocean optical satellite data in the data set, it is determined that the validity check result is a unique value anomaly.

[0084] The number and proportion of the filling value in the data set are counted, and if the proportion of the filling value exceeds a preset filling value proportion threshold (such as 10%), it is determined that the validity check result is a filling value anomaly.

[0085] Each pixel in the data set is traversed, and it is judged whether the pixel value is within a preset valid range. If the pixel value is out of range, the position and value of the abnormal pixel are recorded, and it is determined that the validity check result is a pixel value anomaly.

[0086] The statistical characteristics (such as mean, standard deviation, maximum value, and minimum value) of the pixel values in the data set are calculated, and it is judged whether it meets the expectation. For example, if the maximum value of the reflectivity is 2, which exceeds the valid range 0-1, it is determined to be abnormal, and the check result is output.

[0087] In S104, according to preset data dimension information, dimension correctness of each of the ocean optical satellite data is checked, and a dimension correctness check result of the ocean optical satellite data is obtained; wherein the data dimension information includes a number of scanning lines and a number of sampling points of the ocean optical satellite data.

[0088] The main purpose of the data dimension correctness check is to ensure that the dimension information (such as the number of scanning lines and the number of sampling points) of the ocean optical satellite data is consistent with the preset dimension information, and to avoid data structure anomalies or subsequent processing failures caused by dimension errors. Through the dimension correctness check, the inconsistency of the dimension that may occur in the data production or transmission process can be found in time, and the structural integrity and usability of the data are ensured.

[0089] In the embodiments of the present application, the data dimension correctness check includes: scanning line number check (checking whether the number of scanning lines in the data set is consistent with the preset number of scanning lines), and sampling point number check (checking whether the number of sampling points in the data set is consistent with the preset number of sampling points).

[0090] Specifically, the data dimension correctness check includes:

[0091] According to the satellite payload parameters and data processing specifications, the dimension information of the preset data set is determined, including the number of scan lines and the number of sampling points. For example, the preset number of scan lines of certain ocean optical satellite data is 2000, and the number of sampling points is 1000.

[0092] The actual number of scan lines and the number of sampling points are extracted from the data attributes of the ocean optical satellite data. For example, the HDF5 library or the NetCDF library is used to read the dimension information of the ocean optical satellite data.

[0093] The actual extracted number of scan lines and the number of sampling points are compared with the preset dimension information to determine whether they are consistent. If they are not consistent, the specific dimension difference is recorded.

[0094] If they are not consistent, it is determined that the data dimension correctness check result is data dimension abnormality.

[0095] S105, according to the time code information of the ocean optical satellite data, the time difference between adjacent scan lines and the longitude and latitude information between adjacent pixels, the ocean optical satellite data is checked for spatial and temporal continuity and file integrity, and the spatial and temporal continuity check result and file integrity check result of the ocean optical satellite data are obtained.

[0096] The main purpose of the spatial and temporal continuity check and the file integrity check is to ensure the continuity of the ocean optical satellite data in time and space and the integrity of the file, and to avoid data quality problems caused by data loss, time jump or spatial discontinuity. Through these two checks, possible abnormalities in the data acquisition, transmission or processing process can be found in time to ensure the integrity and usability of the data.

[0097] The spatial and temporal continuity check includes: time continuity check (such as: based on time code information, checking whether the time difference between adjacent scan lines is within a reasonable range to ensure that the data is continuous in time), spatial continuity check (such as: based on longitude and latitude information, checking whether the spatial distance difference between adjacent pixels is within a reasonable range to ensure that the data is continuous in space).

[0098] The file integrity check includes: time coverage integrity check (such as: based on data files within a day, checking whether the time code information covers a complete time period to ensure that there is no data loss in time), scan line integrity check (such as: checking whether there is a time jump or loss between adjacent scan lines to ensure that the data is continuous in time).

[0099] Specifically, the above S105 includes:

[0100] According to the time code information of the ocean optical satellite data, it is determined whether the time difference between adjacent scan lines of the ocean optical satellite data is greater than a preset time threshold value, and according to the longitude and latitude information between adjacent pixels in the ocean optical satellite data, it is determined whether the distance between the adjacent pixels is greater than a preset distance threshold value.

[0101] If the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold value, and the distance between adjacent pixels in the ocean optical satellite data is less than or equal to the preset distance threshold value, it is determined that the spatio-temporal continuity check result of the ocean optical satellite data is spatio-temporal continuity.

[0102] If the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold value, or the distance between adjacent pixels in the ocean optical satellite data is greater than the preset distance threshold value, it is determined that the spatio-temporal continuity check result of the ocean optical satellite data is spatio-temporal discontinuity.

[0103] The start time and end time of scanning in the time code information of the ocean optical satellite data are determined.

[0104] According to the start time and end time of scanning, it is determined whether the scan line of the ocean optical satellite data covers the full-day data recording time range (such as 24 hours).

[0105] If the scan line of the ocean optical satellite data covers the full-day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold value, it is determined that the file integrity check result of the ocean optical satellite data is file integrity.

[0106] If the scan line of the ocean optical satellite data does not cover the full-day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold value, it is determined that the file integrity check result of the ocean optical satellite data is file integrity.

[0107] S106, in a spatio-temporal matching manner, the ocean optical secondary product data corresponding to the data set is matched to determine the same type of load data and historical secondary product data corresponding to the ocean optical secondary product data.

[0108] S107, stability analysis is performed on the same type of load data, the ocean optical secondary product data and the historical secondary product data to determine the stability check result of the data set.

[0109] The main purpose of the stability analysis is to evaluate the stability and variation trend of the marine optical secondary product data based on the marine optical satellite data, to determine the stability check result of the data set by spatiotemporal matching and comparison with similar load data and historical secondary product data. Through the stability analysis, abnormal changes in the data production process can be found in time, and the long-term stability and reliability of the data can be ensured.

[0110] In the embodiments of the present application, the main content of the stability analysis includes: stability index calculation (calculating the average deviation and standard deviation of the current marine optical secondary product data and similar load data and historical secondary product data), variation trend analysis (based on historical data, analyzing the variation trend of the current data, and judging whether there is abnormal fluctuation or systematic deviation).

[0111] In order to realize the stability analysis, first, the above S106 is performed to obtain the similar load data and historical secondary product data corresponding to the marine optical secondary product data through spatiotemporal matching.

[0112] Specifically, the spatiotemporal matching includes time matching and space matching.

[0113] The time matching includes:

[0114] The acquisition time of the marine optical secondary product data (the acquisition time of the marine optical satellite data used to generate the marine optical secondary product data) is extracted, and then similar load data and historical secondary product data close to the acquisition time are screened out from similar sensors and historical secondary product data of the sensor used to acquire the marine optical secondary product data.

[0115] The space matching includes:

[0116] The latitude and longitude information of the marine optical secondary product data is extracted, and then similar load data and historical secondary product data close to the latitude and longitude information are screened out from similar sensors and historical secondary product data of the sensor used to acquire the marine optical secondary product data.

[0117] Further, the stability index calculation specifically refers to comparing the marine optical secondary product data with the similar load data and historical secondary product data pixel by pixel, and calculating the average deviation and standard deviation between the current data and the comparison data.

[0118] The average deviation can be obtained by the following formula (1):

[0119] (1) ;

[0120] The standard deviation can be obtained by the following formula (2):

[0121] (2);

[0122] wherein M represents the average deviation; S represents the standard deviation; the pixel value of the i-th pixel of the marine optical secondary product data; represents the pixel value of the i-th pixel of the same type of load data or historical secondary product data; N is the total number of pixels of the marine optical secondary product data / same type of load data / historical secondary product data.

[0123] In practical application, the greater the average deviation and the standard deviation, the lower the consistency of the marine optical secondary product data with the same type of load data / historical secondary product data, and the worse the stability of the marine optical secondary product data.

[0124] The trend analysis refers to analyzing the difference between the marine optical secondary product data and the historical secondary product data, specifically analyzing the trend of the average deviation and the standard deviation between the two, if the average deviation and / or the standard deviation between the two gradually decreases with the change of the collection time of the historical secondary product data, it indicates that the stability of the marine optical secondary product data is higher; if the average deviation and / or the standard deviation between the two gradually increases with the change of the collection time of the historical secondary product data, it indicates that the stability of the marine optical secondary product data is lower.

[0125] S108, at least based on the date reasonableness check result, the data set integrity check result, the validity check result, the dimension correctness check result, the spatio-temporal continuity check result, the file integrity check result and the stability check result, determine the quality comprehensive evaluation result of the marine optical satellite data.

[0126] The main purpose of the quality comprehensive evaluation is to comprehensively evaluate the quality of the marine optical satellite data based on at least the results of the date reasonableness check, the data set integrity check, the validity check, the dimension correctness check, the spatio-temporal continuity check, the file integrity check and the stability check. Through comprehensive evaluation, the quality status of the data can be comprehensively understood, potential problems in the data can be identified, and reliable basis can be provided for subsequent data processing and application.

[0127] In an optional embodiment of the present application, quality comprehensive evaluation rules can be formulated based on the importance of the above-mentioned check results, for example: if the date reasonableness, data set integrity, validity, dimension correctness, spatio-temporal continuity, file integrity and stability checks are all passed, it is determined that the data quality is excellent. If a check is not passed, but the problem is minor (such as the file size slightly exceeds the range), it is determined that the data quality is good. If a check is not passed, and the problem is serious (such as there are many data validity abnormalities), it is determined that the data quality is poor. If multiple checks are not passed, it is determined that the data quality is unqualified.

[0128] It can be understood that, in addition to the above-mentioned check results given by S101 to S107 and the quality comprehensive evaluation of the marine optical satellite data, the marine optical satellite data can also be comprehensively evaluated in other aspects.

[0129] In an optional embodiment of the present application, the method further comprises:

[0130] According to a preset file naming rule, the file naming of the marine optical satellite data is checked to obtain a naming specification check result of the marine optical satellite data; wherein the file naming rule comprises the naming specification of at least one field of a satellite identifier, a collection date, and a sensor type.

[0131] The purpose of the naming specification check of the marine optical satellite data is to clarify and standardize the source and characteristics of the marine optical satellite data.

[0132] In actual application, for marine optical satellite data, the satellite identifier, collection date, sensor type and other fields in the file naming rule are of great significance. The satellite identifier is used to clarify the source of the data, for example, "LT5" in the Landsat series of satellites can represent Landsat 5 satellite; the collection date is used to clarify the shooting time of the data, so as to facilitate the staff to study the timeliness of the marine environment change (such as temperature, biological activity, etc.) based on the collection date. The sensor type indicates the tool type of obtaining data, for example, a multi-spectral sensor can obtain data of multiple wave bands at the same time, while a sensor of a specific spectral range can be more effective in detecting specific substances in the ocean (such as chlorophyll, etc.).

[0133] In the process of practical application, first, check if there is a satellite identifier in the file name. This part may be an abbreviation of the satellite name or a specific alphanumeric combination. For example, if it is referred to some known satellite naming rules, find the corresponding satellite code and check if it is accurate. For example, for MODIS satellite, the prefix "MOD" part can be regarded as a kind of representation related to the satellite, and the specific "18" is the identification associated with the marine product type. If there are different values, it needs to be checked whether it conforms to new or special rules.

[0134] Then, check the acquisition date part. Confirm whether the acquisition date is in the internationally recognized date format (such as the acquisition date representation form of NNNNYYRR mentioned in S101), and whether the format is correct. If the format is not standardized (such as 20 - 231015) or the date number is not logical (such as 20251315), it can be determined that the file naming in the acquisition date field does not conform to the naming specification.

[0135] Next, check the sensor type part. If there is a related identifier, confirm whether the sensor name or code is consistent with the known sensor name and use criteria corresponding to the satellite. If a satellite has only three types of sensors A, B, and C, but the file identifies type D, the naming of this file has a problem in the sensor type.

[0136] In an optional embodiment of the present application, the method further comprises:

[0137] According to the preset file format information, the file format of the marine optical satellite data is checked, and a file format checking result of the marine optical satellite data is obtained.

[0138] In the process of practical application, the file format of the marine optical satellite data can be checked based on the inherent file format of the data file. For example, if the inherent file format of the data file is HDF5, it can be determined whether the marine optical satellite data is in HDF5 format by analyzing the content and file header information of the file.

[0139] In an optional embodiment of the present application, the method further comprises:

[0140] According to the preset file size range, the file size of the marine optical satellite data is checked, and a file size checking result of the marine optical satellite data is obtained.

[0141] In practical applications, many factors influence the file size of ocean optical satellite data. From a resolution perspective, higher resolutions contain more pixels, resulting in larger data volumes and larger file sizes. For example, if an ocean optical observation satellite uses ultra-high resolution to image a localized coral reef area, the precise display of each coral structure and the reflection and refraction of the surrounding water requires detailed pixel counts to construct the image. Therefore, the data volume will increase significantly compared to low-resolution, large-scale ocean observations.

[0142] The extent of the coverage area also plays an important role in file size; if the data is optical data for an entire ocean basin, the file size will be much larger than if it is just for a small offshore area.

[0143] The number of bands also affects file size. More bands means more ocean optical information needs to be stored across different frequency bands. For example, if both visible light and infrared ocean imagery are required, the file size will naturally be much larger than a single-band file. Furthermore, if this data undergoes special processing (such as complex algorithmic fusion of multiple band images), the file size may also increase.

[0144] In actual applications, to check the file size of ocean optical satellite data, first, a preset file size range is determined. This preset file size range can be based on data provided by the satellite data service provider. For example, a file size standard can be established based on the technical parameters of the satellite imaging system itself (such as the upper limit of the sensor imaging capability and data volume) and the actual limitations of data processing and transmission (such as the maximum file size allowed by the transmission bandwidth). For example, it is stipulated that ocean optical data files for a satellite in a specific area and mode should be between 500MB and 2GB.

[0145] Next, the actual size of the ocean optical satellite data file is obtained. In practical applications, the actual size of the ocean optical satellite data file can be directly obtained by viewing the file properties in the operating system environment. In Windows, you can right-click the file icon to view the file size in the properties. In Linux or Unix systems, you can use the ls - lh command to view the file size.

[0146] Finally, the actual size is compared with the preset range. If the file size is less than the lower limit, there may be incomplete data or the file may have been incorrectly compressed to an unreasonable range. If the file size exceeds the upper limit, it may be due to additional data being appended (for example, log information attached to an error report mixed with the data file) or metadata management errors causing some data to be stored repeatedly.

[0147] After the above file format checking result, file size checking result and naming standard checking result are obtained, at least one of the above checking results can be brought into S108 to perform quality comprehensive evaluation on the ocean optical satellite data.

[0148] To sum up, the method for quality comprehensive evaluation of ocean optical satellite data provided in the application performs data collection date rationality checking, data set integrity checking, effectiveness checking, dimension correctness checking, spatial and temporal continuity checking, file integrity checking and stability checking on the ocean optical satellite data, and then completes the quality comprehensive evaluation of the ocean optical satellite data, which is conducive to real-time and comprehensive monitoring of the quality of the ocean optical satellite data in various business scenarios.

[0149] The embodiment of the application also provides a device for quality comprehensive evaluation of ocean optical satellite data, which is described below with reference to Figure 2 , Figure 2 The device for quality comprehensive evaluation of ocean optical satellite data provided in the embodiment of the application is shown in the structure diagram.

[0150] As shown in Figure 2 , the device for quality comprehensive evaluation of ocean optical satellite data comprises:

[0151] a date rationality checking unit 201 configured to perform date rationality checking on the ocean optical satellite data according to the collection date of the ocean optical satellite data and the file date of the ocean optical satellite data, and obtain a date rationality checking result of the ocean optical satellite data.

[0152] a data set integrity checking unit 202 configured to perform integrity checking on the number of data sets of the ocean optical satellite data according to a preset data set number, and obtain a data set integrity checking result.

[0153] an effectiveness checking unit 203 configured to perform effectiveness checking on each ocean optical satellite data in the data set according to preset effective data information, and obtain an effectiveness checking result of the ocean optical satellite data; wherein the effective data information comprises at least one of a pixel unique value, a pixel filling value and a data effective value of the ocean optical satellite data.

[0154] a dimension correctness checking unit 204 configured to perform dimension correctness checking on each ocean optical satellite data according to preset data dimension information, and obtain a dimension correctness checking result of the ocean optical satellite data; wherein the data dimension information comprises a number of scanning lines and a number of sampling points of the ocean optical satellite data.

[0155] The data integrity check unit 205 is configured to perform a spatiotemporal continuity check and a file integrity check on the ocean optical satellite data based on the time code information of the ocean optical satellite data, the time difference between adjacent scan lines, and the longitude and latitude information between adjacent pixels, and obtain a spatiotemporal continuity check result and a file integrity check result of the ocean optical satellite data.

[0156] The data stability check unit 206 is used to match the Ocean Optics secondary product data corresponding to the data set in a spatiotemporal matching manner, determine similar load data and historical secondary product data corresponding to the Ocean Optics secondary product data; perform stability analysis on the similar load data, the Ocean Optics secondary product data, and the historical secondary product data, and determine the stability check result of the data set.

[0157] The comprehensive quality evaluation unit 207 is used to determine a comprehensive quality evaluation result of the ocean optical satellite data based on at least the date rationality check result, the data set integrity check result, the validity check result, the dimensional correctness check result, the spatiotemporal continuity check result, the file integrity check result, and the stability check result.

[0158] In an optional embodiment of the present application, the device is further used to: check the file naming of the ocean optical satellite data according to a preset file naming rule to obtain a naming standardization check result of the ocean optical satellite data; wherein the file naming rule includes a naming standard for at least one field of the satellite identifier, acquisition date, and sensor type.

[0159] In an optional implementation manner of the present application, the device is further configured to: check the file format of the ocean optical satellite data according to preset file format information to obtain a file format check result of the ocean optical satellite data.

[0160] In an optional implementation manner of the present application, the apparatus is further configured to: check the file size of the ocean optical satellite data according to a preset file size range, and obtain a file size check result of the ocean optical satellite data.

[0161] In an optional implementation of the present application, the data valid value is determined according to the sensor parameter type used to collect the ocean optical satellite data; the sensor parameter type includes: at least one of: radiation brightness, water temperature, and reflectivity.

[0162] In an optional embodiment of the present application, the time-space continuity check and file integrity check on the ocean optical satellite data according to the time code information of the ocean optical satellite data, the time difference between adjacent scan lines and the longitude and latitude information between adjacent pixels, obtain the time-space continuity check result and the file integrity check result of the ocean optical satellite data, comprising:

[0163] According to the time code information of the ocean optical satellite data, it is determined whether the time difference between adjacent scan lines of the ocean optical satellite data is greater than a preset time threshold, and according to the longitude and latitude information between adjacent pixels in the ocean optical satellite data, it is determined whether the distance between the adjacent pixels is greater than a preset distance threshold.

[0164] If the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold, and the distance between adjacent pixels in the ocean optical satellite data is less than or equal to the preset distance threshold, it is determined that the time-space continuity check result of the ocean optical satellite data is time-space continuous.

[0165] If the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold, or the distance between adjacent pixels in the ocean optical satellite data is greater than the preset distance threshold, it is determined that the time-space continuity check result of the ocean optical satellite data is time-space discontinuous.

[0166] The start time and end time of scanning in the time code information of the ocean optical satellite data are determined.

[0167] According to the start time and end time of scanning, it is determined whether the scan line of the ocean optical satellite data covers the whole day data recording time range.

[0168] If the scan line of the ocean optical satellite data covers the whole day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold, it is determined that the file integrity check result of the ocean optical satellite data is file complete.

[0169] If the scan line of the ocean optical satellite data does not cover the whole day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold, it is determined that the file integrity check result of the ocean optical satellite data is file incomplete.

[0170] The above method embodiments provided by the present embodiment belong to the same application concept as the device embodiments of the present application, and the technical details not described in detail in the present embodiment can be referred to the specific processing content of the ocean optical satellite data quality comprehensive evaluation method provided by the above embodiments of the present application, which will not be described here.

[0171] The embodiments of the present application also provide an electronic device, as shown in Figure 3 Figure 3 An electronic device structure schematic diagram is provided in the embodiments of the present application.

[0172] As shown in Figure 3 The electronic device comprises:

[0173] a processor 210;

[0174] a memory 200 for storing instructions executable by the processor 210;

[0175] The processor 210 is configured to execute the method for comprehensive evaluation of ocean optical satellite data quality disclosed in any of the above embodiments by running the instructions in the memory 200.

[0176] The processor 210, the memory 200, the communication interface 220, the input device 230 and the output device 240 are connected to each other through a bus. Wherein:

[0177] The bus can include a path for transmitting information between various components of the computer system.

[0178] The processor 210 can be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or can be an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs of the present application. It can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a ready-to-use programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.

[0179] The processor 210 can include a main processor, and can also include a baseband chip, a modem, etc.

[0180] The memory 200 stores programs for executing the technical solutions of the present application, and can also store operating systems and other key services. Specifically, the program can include program code, and the program code includes computer operation instructions. More specifically, the memory 200 can include read-only memory (ROM), other types of static storage devices that can store static information and instructions, random access memory (RAM), other types of dynamic storage devices that can store information and instructions, disk storage, flash, etc.

[0181] ​The input device 230 can include a device that receives data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a touch screen, etc.

[0182] The output device 240 can include a device that allows output of information to a user, such as a display screen, a printer, a speaker, etc.

[0183] The communication interface 220 can include a device using any transceiver to communicate with other devices or communication networks, such as an Ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), etc.

[0184] The processor 210 executes programs stored in the memory 200 and calls other devices, which can be used to implement each step of any of the ocean optical satellite data quality comprehensive evaluation methods provided by the above-described embodiments.

[0185] In addition to the above-described methods and devices, the embodiments of the present application can also be computer program products including computer program instructions that, when executed by a processor, cause the processor to perform the steps in the ocean optical satellite data quality comprehensive evaluation methods of various embodiments of the present application.

[0186] The computer program product can be written in any combination of one or more programming languages to perform the operations of the embodiments of the present application, including an object-oriented programming language, such as Java, C++, etc., and a conventional procedural programming language, such as "C" language or similar programming languages. The program code can be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0187] In addition, the embodiments of the present application can also be a storage medium having a computer program stored thereon, which is executed by a processor to perform the steps in the ocean optical satellite data quality comprehensive evaluation methods of various embodiments of the present application.

[0188] For each of the above-described method embodiments, in order to simply describe, they are all expressed as a combination of a series of actions, but those skilled in the art should know that the present application is not limited by the order of the described actions, because according to the present application, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0189] It should be noted that each of the embodiments in the specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between embodiments can be mutually referred to.

[0190] The steps in the method of each embodiment of the application can be adjusted, combined and deleted in sequence according to actual needs. The technical features described in each embodiment can be replaced or combined.

[0191] The modules and sub-modules in the device and terminal in each embodiment of the application can be combined, divided and deleted according to actual needs.

[0192] In several embodiments provided by the application, it should be understood that the disclosed terminal, device and method can be implemented by other ways. For example, the terminal embodiments described above are only schematic, for example, the division of modules or sub-modules is only a logical function division, and other division manners can be adopted in actual implementation, for example, a plurality of sub-modules or modules can be combined or integrated into another module, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed mutual elements can be indirect coupling or communication connection through some interfaces, devices or modules, and can be electrical, mechanical or other forms.

[0193] The modules or sub-modules described as separate components can or can not be physically separated, and the components of the modules or sub-modules can or can not be physical modules or sub-modules, that is, they can be located in one place, or can be distributed on a plurality of network modules or sub-modules. According to actual needs, some or all of the modules or sub-modules can be selected to achieve the purpose of the embodiment.

[0194] In addition, each functional module or sub-module in each embodiment of the application can be integrated in one processing module, or each module or sub-module can exist physically, or two or more modules or sub-modules can be integrated in one module. The integrated module or sub-module can be realized in the form of hardware or in the form of software functional module or sub-module.

[0195] Those skilled in the art will further appreciate that the units and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various examples have been described herein in terms of their functionality, their composition, and their manner of operation. Whether such functionality is implemented in hardware or software depends on the particular application and design constraints imposed on the overall system. Skilled persons can implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

[0196] The steps of a method or algorithm described in connection with the embodiments disclosed herein can be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module can reside in random access memory (RAM), flash memory, read-only memory (ROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0197] Finally, it should be noted that the terms "first", "second", and the like, herein do not denote any order, quantity, combination, or importance, but rather are used to distinguish one element from another, and are more especially used for the purpose of identification in claims. Moreover, the terms "comprise", "include" or "contain" or any other variant thereof, are intended to cover non-exclusive inclusions, such that processes, methods, articles, or apparatuses that comprise, include, or contain a list of elements, not only include those elements, but also other elements not expressly listed or otherwise inherent to such processes, methods, articles, or apparatuses. Without further limitation, an element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0198] The above description of disclosed embodiments provides enabling disclosure for those skilled in the art to carry out or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and generic principles defined herein can be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for comprehensive evaluation of ocean optical satellite data quality, characterized in that, The method comprises the following steps: checking the date rationality of the ocean optical satellite data according to the collection date of the ocean optical satellite data and the file date of the ocean optical satellite data, and obtaining the date rationality checking result of the ocean optical satellite data; checking the data set completeness of the ocean optical satellite data according to the preset data set number, and obtaining the data set completeness checking result; checking the validity of each ocean optical satellite data in the data set according to the preset valid data information, and obtaining the validity checking result of the ocean optical satellite data; wherein the valid data information comprises at least one of the pixel unique value, the pixel filling value and the data valid value of the ocean optical satellite data; checking the dimension correctness of each ocean optical satellite data according to the preset data dimension information, and obtaining the dimension correctness checking result of the ocean optical satellite data; wherein the data dimension information comprises the scan line number and the sampling point number of the ocean optical satellite data; checking the space-time continuity and the file integrity of the ocean optical satellite data according to the time code information of the ocean optical satellite data, the time difference between adjacent scan lines and the longitude and latitude information between adjacent pixels, and obtaining the space-time continuity checking result and the file integrity checking result of the ocean optical satellite data; matching the ocean optical secondary product data corresponding to the data set in a space-time matching manner, and determining the same type load data and the historical secondary product data corresponding to the ocean optical secondary product data; performing stability analysis on the same type load data, the ocean optical secondary product data and the historical secondary product data, and determining the stability checking result of the data set; determining the quality comprehensive evaluation result of the ocean optical satellite data based on at least the date rationality checking result, the data set completeness checking result, the validity checking result, the dimension correctness checking result, the space-time continuity checking result, the file integrity checking result and the stability checking result.

2. The method according to claim 1, wherein, The method further comprises the following steps: checking the file naming of the ocean optical satellite data according to the preset file naming rule, and obtaining the naming specification checking result of the ocean optical satellite data; wherein the file naming rule comprises the naming specification of at least one field of satellite identifier, collection date and sensor type.

3. The method according to claim 1, wherein, The method further comprises the following steps: checking the file format of the ocean optical satellite data according to the preset file format information, and obtaining the file format checking result of the ocean optical satellite data.

4. The method according to claim 1, wherein, The method further comprises the following steps: checking the file size of the ocean optical satellite data according to the preset file size range, and obtaining the file size checking result of the ocean optical satellite data.

5. The method according to claim 1, wherein, The data valid value is determined according to the sensor parameter type used for collecting the ocean optical satellite data; and the sensor parameter type comprises at least one of radiation brightness, water temperature and reflectivity.

6. The method according to claim 1, wherein, The time code information of the ocean optical satellite data, the time difference between adjacent scan lines, and the longitude and latitude information between adjacent pixels are used to perform a space-time continuity check and a file integrity check on the ocean optical satellite data, to obtain a space-time continuity check result and a file integrity check result of the ocean optical satellite data, including: According to the time code information of the ocean optical satellite data, it is judged whether the time difference between adjacent scan lines of the ocean optical satellite data is greater than a preset time threshold, and according to the longitude and latitude information between adjacent pixels in the ocean optical satellite data, it is determined whether the distance between the adjacent pixels is greater than a preset distance threshold; If the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold, and the distance between adjacent pixels in the ocean optical satellite data is less than or equal to the preset distance threshold, it is determined that the space-time continuity check result of the ocean optical satellite data is space-time continuous; If the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold, or the distance between adjacent pixels in the ocean optical satellite data is greater than the preset distance threshold, it is determined that the space-time continuity check result of the ocean optical satellite data is space-time discontinuous; The start time and end time of scanning in the time code information of the ocean optical satellite data are determined; According to the start time and end time of scanning, it is judged whether the scan line of the ocean optical satellite data covers the full-day data recording time range; If the scan line of the ocean optical satellite data covers the full-day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is less than or equal to the preset time threshold, it is determined that the file integrity check result of the ocean optical satellite data is file complete; If the scan line of the ocean optical satellite data does not cover the full-day data recording time range, and the difference between adjacent scan lines of the ocean optical satellite data is greater than the preset time threshold, it is determined that the file integrity check result of the ocean optical satellite data is file incomplete.

7. A device for comprehensive evaluation of ocean optical satellite data quality, characterized in that Including: A date rationality checking unit is configured to perform a date rationality check on the ocean optical satellite data according to the collection date of the ocean optical satellite data and the file date of the ocean optical satellite data, to obtain a date rationality check result of the ocean optical satellite data; A data set integrity checking unit is configured to perform a completeness check on the number of data sets of the ocean optical satellite data according to a preset number of data sets, to obtain a data set integrity check result; An effectiveness checking unit is configured to perform an effectiveness check on each ocean optical satellite data in the data set according to preset effective data information, to obtain an effectiveness check result of the ocean optical satellite data; wherein the effective data information includes at least one of a pixel unique value, a pixel filling value, and a data effective value of the ocean optical satellite data. A dimension correctness checking unit is configured to perform dimension correctness checking on each of the ocean optical satellite data according to preset data dimension information, and obtain a dimension correctness checking result of the ocean optical satellite data; wherein the data dimension information includes a number of scanning lines and a number of sampling points of the ocean optical satellite data; A data integrity checking unit is configured to perform spatio-temporal continuity checking and file integrity checking on the ocean optical satellite data according to time code information of the ocean optical satellite data, a time difference between adjacent scanning lines, and longitude and latitude information between adjacent pixels, and obtain a spatio-temporal continuity checking result and a file integrity checking result of the ocean optical satellite data; A data stability checking unit is configured to match the ocean optical secondary product data corresponding to the data set in a spatio-temporal matching manner, determine same-type load data and historical secondary product data corresponding to the ocean optical secondary product data, and perform stability analysis on the same-type load data, the ocean optical secondary product data, and the historical secondary product data to determine a stability checking result of the data set; A quality comprehensive evaluation unit is configured to determine a quality comprehensive evaluation result of the ocean optical satellite data based on at least the date rationality checking result, the data set integrity checking result, the effectiveness checking result, the dimension correctness checking result, the spatio-temporal continuity checking result, the file integrity checking result, and the stability checking result.

8. An electronic device, comprising: Comprise: a processor; a memory for storing instructions executable by the processor; the processor is configured to execute the method of any one of claims 1 to 6 by running the instructions in the memory.

9. A computer storage medium, characterized in that The computer storage medium stores instructions, and when the instructions are executed, the method of any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Satellite infrared load calibration method based on ocean region reanalysis data

    CN113970376A

  • Multi-satellite radiation reference correction and consistency evaluation method for optical satellites

    CN117034028A