Ocean sediment mineral data integration method and system

Abstract

The invention discloses a marine sediment mineral data integration method and system, and the method comprises the steps: configuring header field information of a marine sediment mineral standard data table, receiving to-be-integrated sediment mineral data, and carrying out the matching query of the header field information of the to-be-integrated sediment mineral data; performing standardized naming on mineral names of the to-be-integrated sediment mineral data by utilizing the mineral name configuration library table, storing the updated to-be-integrated sediment mineral data and updating the marine sediment mineral standard data table; performing duplicate removal operation on data in the marine sediment mineral standard data table based on the header field information combination; and performing error checking operation on the data in the sea sediment mineral standard data table after the duplicate removal, wherein the data after the error checking operation is completed is used for exporting to obtain a sea sediment mineral integrated data set. According to the method, the integration efficiency and quality are improved, and standard and reliable basic data are provided for mineral resource exploration, marine scientific research, big data application and the like.

Description

Technical Field

[0001] The present invention relates to the technical field of data integration, and particularly relates to a method and system for integrating marine sediment mineral data. Background Art

[0002] Marine sediment mineral data is an important basic material in the field of marine geology, recording rich information on provenance, climate, sedimentation, environment, and tectonics, etc. It can provide qualitative and quantitative bases for understanding modern geological processes, surface processes, marine environmental processes, climate evolution, and tectonic uplift and denudation processes. It is the "golden key" for studying mineralization processes and has outstanding significance in the research of marine sedimentation, environmental evolution, and the exploration and development of seabed mineral resources.

[0003] With the implementation and rapid development of human marine survey projects, a large amount of marine sediment mineral data has been obtained and accumulated. Since these basic data come from different periods and different survey institutions, the adopted standard specifications are not completely consistent. Therefore, there are certain differences in data processing methods, data structures, and the identification of mineral names and classifications, etc., which hinder the integration and sharing of data, making it impossible to fully utilize the value of data achievement materials. In the context of the "big data" era, carrying out data integration is of great significance for exploring the potential value of data. The difficulties in integrating marine sediment mineral data are mainly reflected in the following aspects:

[0004] 1. The problem of inconsistent mineral names. There is a phenomenon that one mineral has two or more names for a long time. For example, pyrite has aliases such as iron pyrite and fool's gold, and there is a situation of mixed use of the names garnet and garnet stone.

[0005] 2. There are a very large number of types of marine sediment minerals with complex sources, including both terrigenous clasts and a large number of marine authigenic minerals and biogenic clasts. It is difficult to integrate the multi-source data due to the non-standard use of the names of identified minerals or components.

[0006] 3. The problem of data deduplication. It is often difficult to identify situations such as repeated mineral types in a single data, repeated data caused by multiple submissions or submissions from different units.

[0007] Currently, due to the above-mentioned many problems in marine sediment mineral data, the integration and application of marine sediment mineral data mostly rely on manual processing, and there is still a lack of relevant intelligent data integration processing solutions.

[0008] Therefore, how to provide a method and system for integrating marine sediment mineral data that can achieve refined and platform-based integration capabilities for marine sediment mineral data is a technical problem that needs to be solved urgently by those skilled in the art. Summary of the Invention

[0009] In view of the above research status and existing problems, the present invention provides a method and system for integrating marine sediment mineral data, which reduces the manual workload and operation errors, improves the integration efficiency and quality, and provides standardized and reliable basic data for aspects such as mineral resource exploration, marine scientific research, and big data applications.

[0010] A method for integrating marine sediment mineral data provided by the present invention includes the following steps:

[0011] S1: Configure the header field information of the marine sediment mineral standard data table, receive the sediment mineral data to be integrated, perform a matching query of the header field information on the sediment mineral data to be integrated, and import the matching data into a temporary table;

[0012] S2: Use the mineral name configuration library table to standardize the naming of the mineral names of the sediment mineral data to be integrated in the temporary table, update the mineral names with the corresponding standard mineral names in the mineral name configuration library table, and store and update the sediment mineral data to be integrated in the marine sediment mineral standard data table;

[0013] S3: Combine the header field information, and perform a duplicate elimination operation on the data in the marine sediment mineral standard data table based on the combination of the header field information;

[0014] S4: Perform an error checking operation on the data in the marine sediment mineral standard data table after duplicate elimination, and the data after the error checking operation is used to export and obtain a marine sediment mineral integration data set.

[0015] Preferably, the header field information at least includes the name, type, length, and measurement unit of each field.

[0016] Preferably, the header field information further includes the value range of the field.

[0017] Preferably, the name of the field corresponding to each data record includes: station number, longitude and latitude, sample top and bottom depth, identification date, identification method, mineral name, and mineral content.

[0018] Preferably, the step of performing a matching query of the header field information on the sediment mineral data to be integrated in S1 includes:

[0019] S11: Use the header field names of the sediment mineral data to be integrated as the fields to be matched, and generate a query statement that matches the header fields of the marine sediment mineral standard data table;

[0020] S12: Execute a query statement in the current marine sediment mineral standard data table to match the header field names. When all the to-be-matched field names corresponding to a single data record are exactly the same, automatically match them to the header field configuration information of the marine sediment mineral standard data table;

[0021] S13: After all the header field names of the sediment mineral data to be integrated are matched, import the successfully matched data into the corresponding temporary table.

[0022] Preferably, the mineral name configuration fields of the mineral name configuration library table include mineral code, mineral name, and mineral alias.

[0023] Preferably, the steps of standardizing the mineral names of the sediment mineral data to be integrated in S2 include:

[0024] S21: Generate a query statement using the mineral names in the sediment mineral data to be integrated, and perform a search query in the mineral name configuration library table. If the standard mineral information is found, go to S23; if the standard mineral information is not found, go to S22;

[0025] S22: Receive the judgment result on whether the mineral name in the sediment mineral data to be integrated is a mineral alias. If the judgment result is a mineral alias, update it to the mineral alias in the mineral name configuration library table, and go to S23;

[0026] S23: Store the corresponding standard mineral name as the updated mineral name in the marine sediment mineral standard data table.

[0027] Preferably, the combination of header field information in S3 includes at least one or more of the following:

[0028] Station number, longitude and latitude, identification date, and sample top-bottom depth are used as the combination of header field information to judge whether they are exactly the same, and determine whether to perform the operation of removing duplicate data according to the judgment result;

[0029] Longitude and latitude information and sample top-bottom depth are used as the combination of header field information to judge whether they are exactly the same, and determine whether to notify the execution of the duplicate removal operation according to the judgment result.

[0030] Preferably, the error checking operations in S4 include at least one or more of the following:

[0031] Whether the sample top-bottom depth of the i-th data record and / or the sample top-bottom depth of the i-th data record compared with the sample top-bottom depth of the (i - 1)-th data record is within the allowable range. If not, an exception is prompted, where i > 1;

[0032] Determine whether the threshold range of the judgment field is within the allowed range. If not, mark the data outside the range.

[0033] Sum up all the mineral contents of the i-th data record, and determine whether it is within the preset percentage content test error range. If not, prompt an anomaly for the data outside the range.

[0034] Check whether the data type of the field conforms to the preset type requirements. If not, prompt an anomaly.

[0035] The present invention also provides an integration system for marine sediment mineral data according to the integration method of marine sediment mineral data described above, including:

[0036] A data input module for configuring the header field information of the marine sediment mineral standard data table, receiving the sediment mineral data to be integrated, performing a matching query of the header field information on the sediment mineral data to be integrated, and importing the matching data into a temporary table.

[0037] A normalization processing module for using the mineral name configuration library table to normalize the mineral names of the sediment mineral data to be integrated in the temporary table, updating the mineral names with the corresponding standard mineral names in the mineral name configuration library table, and storing and updating the sediment mineral data to be integrated after the update into the marine sediment mineral standard data table.

[0038] An intelligent duplicate elimination module for combining the header field information and performing duplicate elimination operations on the data in the marine sediment mineral standard data table based on the combination of the header field information.

[0039] A quality control module for performing error checking operations on the data in the marine sediment mineral standard data table after duplicate elimination.

[0040] A data output module for exporting the data after the error checking operation is completed to obtain a marine sediment mineral integration data set.

[0041] It has the following beneficial effects compared with the prior art:

[0042] The present invention greatly improves the data integration efficiency and automation level through dynamic library table structure adaptation, intelligent duplicate elimination rules, and automatic normalization of mineral names.

[0043] The present invention uses intelligent matching of mineral aliases to improve the semantic consistency of multi-source data and supports the deep integration of multi-source heterogeneous data.

[0044] The present invention strengthens the data quality and standardization degree through multi-dimensional quality control.

[0045] The present invention solves key problems such as "same name but different substances", "data redundancy", and "format differences" in the integration of marine sediment mineral data, significantly improving the data integration efficiency and application value, and providing a reliable data foundation for marine scientific research, mineral resource exploration, and big data analysis. The systematic integration process reduces the need for manual intervention, forms a reusable data integration platform, promotes cross-domain sharing and collaboration of marine sediment mineral data, and enhances the comprehensive application potential of marine sediment mineral data. Brief Description of the Drawings

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.

[0047] Figure 1 It is a flowchart of the integration method for marine sediment mineral data provided by an embodiment of the present invention;

[0048] Figure 2 It is an organizational structure diagram of the integration system for marine sediment mineral data provided by an embodiment of the present invention;

[0049] Figure 3 It is a schematic diagram of the configuration of the standard mineral name code in the MongoDB database provided by an embodiment of the present invention. Detailed Embodiments

[0050] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0051] In the first aspect of the embodiment of the present invention, an integration method for marine sediment mineral data is disclosed. Based on the characteristics of the dynamic table structure and dynamic addition of fields in the MongoDB (Marine Sediment Mineral Standard Data Table) non-relational database, the goal is to reduce the amount of manual work, reduce operation errors, and improve integration efficiency and quality. As Figure 1 shown, the method includes the following steps:

[0052] S1: First, configure the header field information of the marine sediment mineral standard data table, and set each header field information in the configuration table; then, receive the sediment mineral data to be integrated, insert it into the temporary table of the Mongo database, perform a matching query of the header field information on the sediment mineral data to be integrated in the Mongo database temporary table, and retain the matching data;

[0053] S2: Due to the different standard specifications adopted for marine sediment mineral data from different sources in different periods, and at the same time, some mineral names have different aliases, it is often difficult to directly integrate data from different sources. Therefore, the normalization of mineral names is a key step in data integration. Use the mineral name configuration library table to standardize the mineral names of the sediment mineral data to be integrated in the temporary table, update the mineral names with the corresponding standard mineral names in the mineral name configuration library table, and store and update the updated sediment mineral data to be integrated in the marine sediment mineral standard data table;

[0054] S3: Combine the header field information, and perform a duplicate elimination operation on the data in the marine sediment mineral standard data table based on the combined header field information;

[0055] S4: Perform an error checking operation on the data in the marine sediment mineral standard data table after duplicate elimination, and the data after the error checking operation is used to export and obtain the integrated dataset of marine sediment minerals.

[0056] In one embodiment, the header field information includes at least the name, type, length, and measurement unit of each field.

[0057] In this embodiment, for the header field information where the corresponding content of the field name is a numerical value, the value range of the field is also included.

[0058] In this embodiment, the field names corresponding to each data record include: station number, longitude and latitude, sample top and bottom depth, identification date, identification method, mineral name, and mineral content. The specific configuration table information is shown in Table 1.

[0059] Table 1 Configuration Information of Marine Sediment Mineral Standard Data Table

[0060]

[0061]

[0062] In one embodiment, the steps of performing a matching query of the header field information on the sediment mineral data to be integrated in S1 include:

[0063] S11: Use the header field names of the sediment mineral data to be integrated as the fields to be matched, and generate a query statement that matches the header fields of the marine sediment mineral standard data table;

[0064] S12: Execute a query statement in the current marine sediment mineral standard data table to match the header field names. When all the to-be-matched field names corresponding to a single data record are exactly the same, automatically match them to the header field configuration information of the marine sediment mineral standard data table; when no header field configuration information of the marine sediment mineral standard data table that is exactly the same as all the to-be-matched fields corresponding to the single data record is found, perform manual judgment and matching.

[0065] S13: Perform header field name matching on the header fields of the sediment mineral data to be integrated according to the header information, and pop up a matching processing interface; when all the header field names of the sediment mineral data to be integrated are successfully matched, import the successfully matched data into the corresponding temporary table. When the header field matching fails, the matching processing interface prompts a failure message.

[0066] Among them, the prompt content of the failure message includes a prompt to perform manual matching.

[0067] In one embodiment, in S2, a mineral name configuration library table file is set in the marine sediment mineral standard data table. The mineral name configuration fields of the mineral name configuration library table include mineral code, mineral name, and mineral alias. In this embodiment, the mineral name configuration library table can be configured in the data format of "Crystallography and Mineralogical Terminology Classification Code" to check and standardize the naming of mineral names in the data, realize the standardization of mineral names, and provide a basis for the next step of mineral data integration.

[0068] In this embodiment, in the step of setting the mineral name configuration library table, corresponding database statements for addition, modification, and deletion can be generated as needed, and the corresponding statements are executed to perform addition, modification, and deletion operations on the mineral name configuration information.

[0069] In one embodiment, the steps of standardizing the naming of the mineral names of the sediment mineral data to be integrated in S2 include:

[0070] S21: Generate a query statement using the mineral name in the sediment mineral data to be integrated, and perform a search query in the mineral name configuration library table. If the standardized mineral information is found, go to S23; if the standardized mineral information is not found, go to S22;

[0071] S22: Receive the judgment result on whether the mineral name in the sediment mineral data to be integrated is a mineral alias. If the judgment result is a mineral alias, update it to the mineral alias in the mineral name configuration library table, and go to S23;

[0072] S23: Store the updated mineral name with the corresponding standard mineral name into the marine sediment mineral standard data table. After normalization, the mineral names in the original data file will be matched and stored in the database with the standard names and codes, realizing the integration of mineral data.

[0073] It should be noted that the judgment result on whether the mineral name in the received sediment mineral data to be integrated is a mineral alias can come from the manual matching result or other machine automation matching results.

[0074] In one embodiment, the combination of header field information in S3 includes at least one or more of the following:

[0075] The station number, longitude and latitude, identification date, and sample top and bottom depth are used as the combination of header field information to judge whether they are exactly the same, and determine whether to perform the operation of removing duplicate data according to the judgment result;

[0076] The longitude and latitude information and the sample top and bottom depth are used as the combination of header field information to judge whether they are exactly the same, and determine whether to notify the execution of the duplicate data removal operation according to the judgment result.

[0077] The specific implementation process of this embodiment is as follows:

[0078] When the station number, longitude and latitude, date, and sample top and bottom depth are all exactly the same, it is automatically judged as duplicate data and directly removed.

[0079] When the longitude and latitude information is the same, but the sample top and bottom depth is different, it is automatically judged as suspected duplicate data, and a prompt message is generated to prompt further manual duplicate data removal in combination with information such as the investigation date, investigation unit, and data source;

[0080] When the sample top and bottom depth is the same, but the longitude and latitude information is different, it is judged as suspected duplicate data, and a prompt message is generated to prompt further manual duplicate data removal in combination with information such as the investigation date, investigation unit, and data source;

[0081] Generate a data duplicate data removal processing statement according to the duplicate data removal rule, execute the statement to obtain the data duplicate data removal result, and export the duplicate data removal result.

[0082] In one embodiment, set a check box window for the header data items of the marine sediment mineral standard data table, and perform multi-information combination duplicate data removal based on the duplicate data removal rule. An appropriate error is allowed to be set in the consistency judgment process of duplicate data. When the duplicate values of two data records are within the error range, they are regarded as exactly the same.

[0083] In one embodiment, the error checking operation in S4 includes at least one or more of the following:

[0084] Logical consistency checking operation:

[0085] Sampling interval inspection: The sample top depth of the i-th data record minus the sample top depth of the (i - 1)-th data record is used as the sampling interval. Determine whether the sampling interval is within the allowed range. If not, an abnormality is prompted, where i > 1;

[0086] Top depth and bottom depth inspection: Determine whether the sample bottom depth of the i-th data record is greater than its top depth, and determine whether the sample top depth of the i-th data record is greater than or equal to the sample bottom depth of the (i - 1)-th data record. If not, an abnormality is prompted.

[0087] It can be understood that the sampling point of the i-th data is located below the position of the (i - 1)-th data in the geographical vertical direction.

[0088] Numerical range inspection operation:

[0089] Determine whether the threshold range of the field is within the allowed range. If not, mark the data outside the range; for example, check whether the identified mineral content is between 0 and 100%.

[0090] Percentage content inspection operation:

[0091] Sum up all the mineral contents of the i-th data record, and determine whether it is within the preset percentage content inspection error range. If not, an abnormality is prompted for the data outside the range;

[0092] Illegal code inspection operation:

[0093] Check whether the data type of the field meets the preset type requirements. If not, an abnormality is prompted; for example, if a character appears in a numerical data item, it is prompted as an illegal code.

[0094] In one embodiment, according to the actual application requirements, it further includes the step of screening and exporting the integrated dataset of marine sediment minerals according to the time - space range:

[0095] S51: Input the queried time - space range or the set sea area range, generate a time - space range query statement according to the query retrieval conditions, and execute this statement in the standard data table of marine sediment minerals for query and retrieval;

[0096] S52: Main mineral marking, generate a database query statement for the percentage of the number of single mineral particles in the total number of identified particles, execute this statement, and screen and mark the main mineral data;

[0097] S53: Integrated data export, export the required integrated data file of marine sediment minerals according to the standardized integrated data format.

[0098] The second aspect of the embodiments of the present invention also discloses an integration system for marine sediment mineral data according to the integration method of marine sediment mineral data disclosed in the first aspect of the embodiments, as Figure 2 shown, including: a data input module, a normalization processing module, an intelligent duplicate elimination module, a quality control module, and a data output module; where:

[0099] The data input module is used to configure the header field information of the marine sediment mineral standard data table, receive the sediment mineral data to be integrated, perform a matching query on the header field information of the sediment mineral data to be integrated, and import the matching data into a temporary table;

[0100] The normalization processing module is used to use the mineral name configuration library table to normalize the mineral names of the sediment mineral data to be integrated in the temporary table, update the mineral names with the corresponding standard mineral names in the mineral name configuration library table, and store and update the updated sediment mineral data to be integrated in the marine sediment mineral standard data table;

[0101] The intelligent duplicate elimination module is used to combine the header field information and perform duplicate elimination operations on the data in the marine sediment mineral standard data table based on the combined header field information;

[0102] The quality control module is used to perform error checking operations on the data in the marine sediment mineral standard data table after duplicate elimination;

[0103] The data output module is used to export the data after the error checking operation is completed to obtain a marine sediment mineral integration data set.

[0104] The second aspect of the embodiments of the present invention is used to execute all the steps of the method provided in the first aspect of the embodiments.

[0105] The above has introduced in detail an integration method and system for marine sediment mineral data provided by the present invention. Specific examples are used in this article to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present invention.

[0106] In this document, relational terms such as first and second are used solely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Also, the terms "comprises," "comprising," or any other variation thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements that are inherent to such process, method, article, or apparatus. Without further limitation, an element qualified by the statement "comprising a..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.

Claims

1. An integration method for marine sediment mineral data, characterized in that It includes the following steps: S1: Configure the header field information of the marine sediment mineral standard data table, receive the sediment mineral data to be integrated, perform a matching query of the header field information on the sediment mineral data to be integrated, and import the matched data into a temporary table; S2: Use the mineral name configuration library table to standardize the mineral names of the sediment mineral data to be integrated in the temporary table, update the mineral names with the corresponding standard mineral names in the mineral name configuration library table, and store and update the sediment mineral data to be integrated in the marine sediment mineral standard data table; S3: Combine the header field information and perform a duplicate data removal operation on the data in the marine sediment mineral standard data table based on the combined header field information; S4: Perform an error checking operation on the data in the marine sediment mineral standard data table after duplicate data removal, and the data after the error checking operation is used to export and obtain a marine sediment mineral integration dataset.

2. The integration method of marine sediment mineral data according to claim 1, characterized in that The header field information at least includes the name, type, length, and measurement unit of each field.

3. The integration method of marine sediment mineral data according to claim 2, characterized in that The header field information also includes the value range of the field.

4. The integration method of marine sediment mineral data according to claim 2 or 3, characterized in that The name of the field corresponding to each data record includes: station number, longitude and latitude, sample top and bottom depth, identification date, identification method, mineral name, and mineral content.

5. The integration method of marine sediment mineral data according to claim 2, characterized in that The step of performing a matching query of the header field information on the sediment mineral data to be integrated in S1 includes: S11: Use the header field names of the sediment mineral data to be integrated as the fields to be matched, and generate a query statement that matches the header fields of the marine sediment mineral standard data table; S12: Execute the query statement in the current marine sediment mineral standard data table to match the header field names. When all the fields to be matched corresponding to a single data record are exactly the same, automatically match to the header field configuration information of the marine sediment mineral standard data table; S13: After all the header field names of the sediment mineral data to be integrated are matched, import the successfully matched data into the corresponding temporary table.

6. The integration method of marine sediment mineral data according to claim 1, characterized in that The mineral name configuration fields of the mineral name configuration library table include mineral code, mineral name, and mineral alias.

7. The integration method of marine sediment mineral data according to claim 6, characterized in that The step of standardizing the mineral names of the sediment mineral data to be integrated in the temporary table in S2 includes: S21: Use the mineral names in the sediment mineral data to be integrated to generate a query statement and perform a search query in the mineral name configuration library table. If the standard mineral information is found, enter S23; if the standard mineral information is not found, enter S22; S22: Receive the judgment result on whether the mineral name in the sediment mineral data to be integrated is a mineral alias. If the judgment result is a mineral alias, update it to the mineral alias in the mineral name configuration library table and enter S23; S23: Store the updated mineral name with the corresponding standard mineral name in the marine sediment mineral standard data table.

8. The integration method of marine sediment mineral data according to claim 4, characterized in that The combination of the header field information in S3 at least includes one or more of the following: The station number, longitude and latitude, identification date, and top and bottom depths of the sample are used as a combination of header field information to determine whether they are exactly the same. Based on the determination result, it is determined whether to perform the operation of eliminating duplicate data. The longitude and latitude information and the top and bottom depths of the sample are used as a combination of header field information to determine whether they are exactly the same. Based on the determination result, it is determined whether to notify the execution of the duplicate data elimination operation.

9. The integration method of marine sediment mineral data according to claim 1, characterized in that The error checking operation in S4 includes at least one or more of the following: Whether the top and bottom depths of the sample in the i-th data record, and / or the top and bottom depths of the sample in the i-th data record compared to the top and bottom depths of the sample in the (i - 1)-th data record are within the allowable range. If not, an abnormality is prompted, where i > 1. Determine whether the threshold range of the field is within the allowable range. If not, mark the data outside the range. Sum up all the mineral contents of the i-th data record and determine whether it is within the preset percentage content test error range. If not, an abnormality is prompted for the data outside the range. Check whether the data type of the field conforms to the preset type requirements. If not, an abnormality is prompted.

10. An integration system for marine sediment mineral data of an integration method for marine sediment mineral data according to any one of claims 1-9, characterized in that, Includes: A data input module for configuring the header field information of the marine sediment mineral standard data table, receiving the sediment mineral data to be integrated, performing a matching query of the header field information on the sediment mineral data to be integrated, and importing the matching data into a temporary table. A normalization processing module for normalizing the mineral names of the sediment mineral data to be integrated in the temporary table using the mineral name configuration library table, updating the mineral names with the corresponding standard mineral names in the mineral name configuration library table, and storing and updating the sediment mineral data to be integrated in the marine sediment mineral standard data table. An intelligent duplicate elimination module for combining the header field information and performing the duplicate elimination operation on the data in the marine sediment mineral standard data table based on the combination of the header field information. A quality control module for performing an error checking operation on the data in the marine sediment mineral standard data table after duplicate elimination. A data output module for exporting the data after the error checking operation is completed to obtain a marine sediment mineral integration dataset.

Images