Meteorological data processing method and system, electronic equipment and storage medium

By receiving parameter input instructions in the user operation interface, downloading and processing CMIP6 data, performing data calculation and visualization processing, the problems of low efficiency and high threshold of CMIP6 data processing are solved, and efficient meteorological data processing and simplified processes are realized.

CN118965480APending Publication Date: 2024-11-15UNIV OF MACAU
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411041872.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

There are problems of inefficiency and high thresholds in the download and processing of CMIP6 data, making it difficult for users to obtain highly customized data from numerous mode data.

Method used

A meteorological data processing method and system are proposed to receive parameter input instructions through the user operation interface, download CMIP6 data, perform consistent pre-processing, and perform data calculation and visualization to generate a meteorological spatial distribution map.

Benefits of technology

The CMIP6 data processing process is simplified, the efficiency of data acquisition is improved, the threshold for use is reduced, and efficient meteorological data processing is achieved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118965480A_ABST
    Figure CN118965480A_ABST
Patent Text Reader

Abstract

The invention discloses a meteorological data processing method and system, electronic equipment and a storage medium, and the method comprises the steps: receiving a parameter input instruction of a target object at a user operation interface, and determining a meteorological parameter according to the parameter input instruction; the meteorological parameters comprise downloading parameters and processing parameters; downloading initial meteorological data from a specified data source according to the downloading parameters; performing unification preprocessing on the initial meteorological data based on the processing parameters to obtain target meteorological data; performing data operation on the target meteorological data to obtain a set average value and a set standard deviation of each space region; and carrying out visualization processing on the set average value and the set standard deviation to obtain a meteorological spatial distribution diagram of all spatial regions. According to the invention, meteorological data processing is efficiently realized by integrating data downloading, data processing and integration and mode data operation functions, and the method can be widely applied to the technical field of data processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a meteorological data processing method, system, electronic equipment and storage medium. Background Art

[0002] In the past 20 years, the International Coupled Model Intercomparison Project Phase (CMIP) organized by the World Climate Research Program has promoted the international academic community to attach great importance to the simulation and projection of climate change. Among them, the latest Sixth Global International Coupled Model Intercomparison Project Phase (CMIP6) is the one with the largest number of participating models, the most complete scientific experiments, and the largest amount of simulation data in all CMIP programs implemented over the past 20 years.

[0003] CMIP6 model data is of great significance to the research in the field of global climate change. However, for CMIP6 data users, it is challenging to obtain highly customized data from a large number of model data according to their own research needs. Specifically, there are many difficulties in downloading, processing and computing CMIP6 data. Summary of the invention

[0004] The main purpose of the embodiments of the present invention is to provide a meteorological data processing method, system, electronic device and storage medium, in order to solve at least one problem of the prior art. The present invention can efficiently process meteorological data.

[0005] To achieve the above object, an embodiment of the present invention provides a meteorological data processing method, the method comprising:

[0006] Receive parameter input instructions of the target object on the user operation interface, and determine meteorological parameters according to the parameter input instructions; the meteorological parameters include download parameters and processing parameters;

[0007] Download and obtain initial meteorological data from a specified data source according to download parameters;

[0008] Performing consistent preprocessing on the initial meteorological data based on the processing parameters to obtain the target meteorological data;

[0009] Perform data operations on the target meteorological data to obtain the ensemble mean and ensemble standard deviation of each spatial area;

[0010] The ensemble mean and ensemble standard deviation are visualized to obtain the meteorological spatial distribution map of all spatial areas.

[0011] In some embodiments, the parameter input instruction includes a range setting instruction, a resolution setting instruction, and a name setting instruction; determining the meteorological parameter according to the parameter input instruction includes the following steps:

[0012] Determine the set standard parameters of CMIP6 data as meteorological parameters according to the range setting command, the resolution setting command and the name setting command;

[0013] The download parameters include the model name and variable name; the processing parameters include the time range, spatial range, time resolution and spatial resolution.

[0014] In some embodiments, the specified data source includes a CMIP6 database; and the method further includes the following steps:

[0015] A dynamic interactive link with the CMIP6 database is established based on regular expression URL parsing.

[0016] In some embodiments, the download parameters include a mode name and a variable name; downloading and obtaining initial meteorological data from a specified data source according to the download parameters includes the following steps:

[0017] Based on the dynamic interactive link, data search requests are sent to the CMIP6 database according to the model name and variable name;

[0018] Initial meteorological data are obtained by batch downloading from the CMIP6 database based on data search requests.

[0019] In some embodiments, the processing parameters include a time range, a spatial range, a time resolution, and a spatial resolution; and performing consistency preprocessing on the initial meteorological data based on the processing parameters includes at least one of the following steps:

[0020] Unify the file storage format of all data in the initial meteorological data into the specified file format;

[0021] Based on the reprojection method, the projection coordinate system of all data in the initial meteorological data is unified into the specified spatial coordinate system;

[0022] Interpolate or resample all data in the initial meteorological data to a specified data resolution based on a bilinear interpolation method; the specified data resolution includes a spatial resolution and a temporal resolution;

[0023] Clip all data in the initial meteorological data to the specified time and space range; the time and space range includes the time range and space range.

[0024] In some embodiments, the target meteorological data includes a multi-mode set; performing data operations on the target meteorological data includes the following steps:

[0025] Perform an average operation on the multi-modal set corresponding to the target spatial region;

[0026] The expression of the average operation is:

[0027]

[0028] In the formula, represents the ensemble average of the target space area; X i represents the i-th mode data in the multi-mode set; n represents the number of modes in the multi-mode set;

[0029] Perform standard deviation calculation on the multi-mode set corresponding to the target spatial area;

[0030] The expression for standard deviation operation is:

[0031]

[0032] In the formula, X σ Represents the collective standard deviation of the target spatial region.

[0033] In some embodiments, visualizing the ensemble mean and the ensemble standard deviation comprises the following steps:

[0034] Based on the preset visualization numerical gradient range mapping table, the corresponding spatial area in the preset spatial distribution map is converted into corresponding gradient colors according to the gradient range of the ensemble mean and the ensemble standard deviation.

[0035] To achieve the above object, another aspect of an embodiment of the present invention provides a meteorological data processing system, the system comprising:

[0036] A user operation interface module, used to receive parameter input instructions of a target object on a user operation interface, and determine meteorological parameters according to the parameter input instructions; the meteorological parameters include download parameters and processing parameters;

[0037] A data download module is used to download and obtain initial meteorological data from a specified data source according to download parameters;

[0038] A data processing module is used to perform consistent preprocessing on the initial meteorological data based on processing parameters to obtain target meteorological data;

[0039] The data operation module is used to perform data operation on the target meteorological data to obtain the ensemble mean value and ensemble standard deviation of each spatial area;

[0040] The automatic visualization section is used to visualize the ensemble mean and ensemble standard deviation to obtain the meteorological spatial distribution map of all spatial areas.

[0041] In some embodiments, the designated data source includes a CMIP6 database; and the system further includes:

[0042] The interactive module is used to establish a dynamic interactive link with the CMIP6 database based on regular expression URL parsing.

[0043] To achieve the above objective, another aspect of an embodiment of the present invention provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the above method when executing the computer program.

[0044] To achieve the above objective, another aspect of an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above method is implemented.

[0045] The embodiments of the present invention include at least the following beneficial effects: The present invention provides a meteorological data processing method, system, electronic device and storage medium, which receives parameter input instructions of a target object on a user operation interface and determines meteorological parameters according to the parameter input instructions; the meteorological parameters include download parameters and processing parameters; initial meteorological data are downloaded from a specified data source according to the download parameters; the initial meteorological data are preprocessed in a consistent manner based on the processing parameters to obtain target meteorological data; data operations are performed on the target meteorological data to obtain the ensemble mean and ensemble standard deviation of each spatial region; the ensemble mean and ensemble standard deviation are visualized to obtain meteorological spatial distribution maps of all spatial regions. The embodiments of the present invention simplify and optimize the CMIP6 data processing flow in the field of climate change research, and solve the problems of low efficiency and high threshold in the current CMIP6 data acquisition technology. Meteorological data processing is efficiently achieved by integrating data download, data processing and integration, and model data operation functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 is a flow chart of a meteorological data processing method provided by an embodiment of the present invention;

[0047] Figure 2 It is a schematic diagram of the architecture composition of the meteorological data processing system provided by an embodiment of the present invention;

[0048] Figure 3 is a schematic diagram of an example of a user operation interface provided by an embodiment of the present invention;

[0049] Figure 4 is a schematic diagram of an example of file directory selection provided by an embodiment of the present invention;

[0050] Figure 5 is a schematic diagram of an example of a system prompt when there is insufficient data to participate in a calculation provided by an embodiment of the present invention;

[0051] Figure 6 is a schematic diagram of an example of a system prompt when a task is completed according to an embodiment of the present invention;

[0052] Figure 7 is a schematic diagram of an example of an automatic visualization result of a collection of multi-mode average results provided by an embodiment of the present invention;

[0053] Figure 8 is a schematic diagram of an example of an automatic visualization result of a set of multi-mode standard deviation results provided by an embodiment of the present invention;

[0054] Fig. 9 It is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the embodiments of the present invention. They are only examples of systems and methods consistent with some aspects of the embodiments of the present invention as detailed in the attached claims.

[0056] It is understood that the terms "first", "second", etc. used in the present invention may be used herein to describe various concepts, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of the embodiments of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" and "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0057] The terms "at least one", "multiple", "each", "any", etc. used in the present invention, at least one includes one, two or more, multiple includes two or more, each refers to each of the corresponding multiple, and any refers to any one of the multiple.

[0058] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present invention belongs. The terms used herein are only for the purpose of describing the embodiments of the present invention and are not intended to limit the present invention.

[0059] The meteorological data processing method provided by the embodiment of the present invention relates to the field of data processing technology. The meteorological data processing method provided by the embodiment of the present invention can be applied to a terminal, can be applied to a server, and can also be software running in a terminal or a server. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and a car terminal, etc., but is not limited to this; the server side can be configured as an independent physical server, or a server cluster or distributed system composed of multiple physical servers, and can also be configured to provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms and other basic cloud computing services. The server can also be a node server in a blockchain network; the software can be an application that implements the meteorological data processing method, etc., but is not limited to the above forms.

[0060] The present invention can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present invention can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present invention can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0061] Figure 1 is an optional flow chart of the meteorological data processing method provided by an embodiment of the present invention. Figure 1 The method may include but is not limited to steps S100 to S500.

[0062] S100, receiving a parameter input instruction of a target object on a user operation interface, and determining a meteorological parameter according to the parameter input instruction;

[0063] Among them, meteorological parameters include download parameters and processing parameters;

[0064] It should be noted that, in some embodiments, the parameter input instruction includes a range setting instruction, a resolution setting instruction and a name setting instruction; determining the meteorological parameters according to the parameter input instruction may include the following steps: determining the standard parameters of the set CMIP6 data as meteorological parameters according to the range setting instruction, the resolution setting instruction and the name setting instruction; wherein the download parameters include a model name and a variable name; and the processing parameters include a time range, a spatial range, a time resolution and a spatial resolution.

[0065] For example, in some specific implementations, the user operation interface provides a graphical interface and supports custom parameter settings (for example, receiving user settings for different parameters through a preset input command box), so that the operation can be performed without programming knowledge. The parameters specifically include time range, spatial range, time resolution, spatial resolution, mode name, variable name, etc. The parameters are standard parameters of CMIP6 data.

[0066] S200, downloading and obtaining initial meteorological data from a designated data source according to download parameters;

[0067] In some embodiments, the designated data source includes a CMIP6 database; the method may further include the following steps: establishing a dynamic interactive link with the CMIP6 database based on regular expression URL parsing.

[0068] It should be noted that the download parameters include the model name and the variable name; in some embodiments, step S200 may include the following steps: based on the dynamic interactive link, sending a data search request to the CMIP6 database according to the model name and the variable name; based on the data search request, batch downloading from the CMIP6 database to obtain initial meteorological data.

[0069] Exemplarily, in some specific implementations, CMIP6 parameters can be dynamically interacted with the CMIP6 database based on regular expression URL parsing, so that users can search for data and send data requests to the CMIP6 database in a convenient way, and can be used to batch download CMIP6 data of specified mode names with one click, avoiding cumbersome manual download operations, and saving the original data to a specified file directory. Specifically, multi-threaded downloading can also be supported. In the event of a network interruption, the following process steps can also be performed: save some of the downloaded files, and clean up the incompletely downloaded data. The user can re-run the download module to continue the previously interrupted download process without restarting. Among them, the CMIP6 data returned by the download can be named using the standard "variable name-frequency-experiment name" for single-mode data.

[0070] S300, performing consistency preprocessing on the initial meteorological data based on the processing parameters to obtain target meteorological data;

[0071] It should be noted that, in some embodiments, the processing parameters include time range, spatial range, time resolution and spatial resolution; the initial meteorological data is pre-processed for consistency based on the processing parameters, which may include at least one of the following steps: unifying the file storage format of all data in the initial meteorological data to a specified file format; unifying the projection coordinate system of all data in the initial meteorological data to a specified spatial coordinate system based on a reprojection method; interpolating or resampling all data in the initial meteorological data to a specified data resolution based on a bilinear interpolation method; the specified data resolution includes spatial resolution and time resolution; cropping all data in the initial meteorological data to a specified time and space range; the time and space range includes a time range and a spatial range.

[0072] For example, in some specific implementations, consistency preprocessing can be achieved by identifying and processing the inconsistencies of CMIP6 data from different data sources, including data combination methods, data formats, projection coordinates, data shapes and structures, etc. Specifically, it can include: unifying all file storage formats of all CMIP6 single-mode data to a specified file format; unifying the projection coordinate system of all CMIP6 data to a specified spatial coordinate system based on a reprojection method; interpolating / resampling all CMIP6 data to a specified spatial resolution based on bilinear interpolation; and clipping all CMIP6 data to a specified spatiotemporal range. The above steps ensure the consistency of subsequent data file formats, resolutions, and spatial reference coordinate systems.

[0073] Among them, the processing specification examples of consistent preprocessing are as follows: the data format is netCDF format, the default projection coordinate system is WGS1984 coordinate system, the default data range is global, the default data spatial resolution is 1°, and the default data time resolution is day.

[0074] S400, performing data calculation on the target meteorological data to obtain the ensemble mean value and ensemble standard deviation of each spatial region;

[0075] It should be noted that, in some embodiments, the target meteorological data includes a multi-mode set; performing data operations on the target meteorological data may include the following steps:

[0076] Perform an average operation on the multi-modal set corresponding to the target spatial region;

[0077] The expression of the average operation is:

[0078]

[0079] In the formula, represents the ensemble average of the target space area; X irepresents the i-th mode data in the multi-mode set; n represents the number of modes in the multi-mode set;

[0080] Perform standard deviation calculation on the multi-mode set corresponding to the target spatial area;

[0081] The expression for standard deviation operation is:

[0082]

[0083] In the formula, X σ Represents the collective standard deviation of the target space area

[0084] For example, in some specific implementations, the ensemble mean and ensemble standard deviation of multi-modal data are calculated, and the calculation formulas of the multi-ensemble mean and standard deviation are as follows:

[0085]

[0086] in, and X σ are the multi-model ensemble mean and standard deviation respectively. i Represents the i-th mode data, and n is the number of modes.

[0087] S500: Visualize the ensemble mean and the ensemble standard deviation to obtain a meteorological spatial distribution map of all spatial regions.

[0088] It should be noted that, in some embodiments, the visualization of the set mean and the set standard deviation may include the following steps: based on a preset visualization numerical gradient range mapping table, the corresponding spatial area in the preset spatial distribution map is converted into corresponding gradient colors according to the gradient range where the set mean and the set standard deviation are located.

[0089] For example, in some specific implementations, based on the result files of the above-obtained set average and set standard deviation, the gradient range of the specific values ​​in the result file can be automatically converted into the corresponding gradient color visualization expression, so that the user can intuitively understand the final product of the present application. The visualization function is mainly based on the matplotlib library of the python language, so the user can also adjust the numerical gradient range used for visualization and change the gradient color category to obtain a customized visualization effect.

[0090] See also Figure 2 The embodiment of the present invention further provides a meteorological data processing system 200, which can implement the above-mentioned meteorological data processing method. The system may include:

[0091] The user operation interface module 210 is used to receive parameter input instructions of the target object in the user operation interface, and determine the meteorological parameters according to the parameter input instructions; the meteorological parameters include download parameters and processing parameters;

[0092] The data download module 220 is used to download and obtain initial meteorological data from a specified data source according to download parameters;

[0093] The data processing module 230 is used to perform consistency preprocessing on the initial meteorological data based on the processing parameters to obtain the target meteorological data;

[0094] The data operation module 240 is used to perform data operation on the target meteorological data to obtain the ensemble mean value and ensemble standard deviation of each spatial region;

[0095] The automatic visualization module 250 is used to visualize the ensemble mean and the ensemble standard deviation to obtain the meteorological spatial distribution map of all spatial regions.

[0096] In some embodiments, the specified data source includes a CMIP6 database; the system may further include:

[0097] The interactive module is used to establish a dynamic interactive link with the CMIP6 database based on regular expression URL parsing.

[0098] It can be understood that the contents of the above method embodiments are all applicable to the present system embodiments, the functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0099] In order to explain the principle of the technical solution of the present invention in detail, the overall process of the present invention is described below in combination with some specific embodiments. It is easy to understand that the following is an explanation of the technical principle of the present invention and cannot be regarded as a limitation of the present invention.

[0100] First of all, it should be noted that CMIP data of different modes come from various sources and in different formats, and their temporal and spatial resolutions, spatial references, and file formats are also inconsistent. There are currently two ways to obtain CMIP6 data. One is for users to manually download data through the web page, and the other is to obtain it through some third-party libraries of computer programming languages. For the first method, users need to invest a lot of time to manually download, manually process and integrate these data, which is a time-consuming and complicated process; for the second method, users need to invest a lot of time to learn specialized programming languages, which have certain technical barriers. At present, there is still a lack of a simple, fast, and efficient method or system for processing CMIP6 data. Therefore, it is necessary to solve the problem of low efficiency and high threshold in the acquisition and preliminary processing of CMIP6 data.

[0101] CMIP6 data is of great significance to the research in the field of global climate change. However, these data have many challenges in downloading and processing. Specifically, the data variable names are cumbersome, the data sources are diverse and the formats are different, and a lot of time needs to be invested to learn, download, process and integrate. This process is time-consuming and complicated. In summary, there are problems of low efficiency and high threshold. Based on the deficiencies in the prior art, the present invention implements a CMIP6 meteorological model data fast download, processing, calculation method and visual operation interface system with a simple user operation interface, which allows CMIP6 users to download data manually from the CMIP6 data webpage without spending a lot of time, and do not need to use code to pre-process and calculate data, which greatly improves the efficiency of CMIP6 users in obtaining data and reduces the cost and threshold of using CMIP6 data in actual scientific research and production.

[0102] like Figure 3 As shown, the present invention shows a method for quickly processing CMIP6 meteorological model data and a specific user operation interface of the system, which includes an original file storage path, an output file storage path, and parameters related to all required CMIP6 data.

[0103] When the present invention starts running, first you need to click the 'Select' button on the interface shown, such as Figure 4 As shown, select "Original file storage path" and "Output file storage path". In particular, these two paths can be the same file directory, which is convenient for managing data files; in addition, this application adds a function of recording the preference record of the selected folder, which is convenient for quickly and accurately finding the required folder directory when frequently using the software of this application.

[0104] After selecting the path, you should also enter the time range of the required data in "Start Time" and "End Time" according to the actual data required, including the specific year, month, and day. Figure 3 The start time is "2015-01-01" and the end time is "2100-01-01", which means that the time range of the required data is from January 1, 2015 to December 30, 2100. It should also be pointed out that if the data required is monthly, it is recommended to fill in "30" in the "day" column.

[0105] After filling in the time range, you should also fill in the "Variable Name" column according to the type of data actually required. In particular, the standard CMIP6 variable name should be filled in here. Figure 3 The filled "pr" means precipitation data. In particular, the variable names used in the specific implementation cases of this application are only for demonstration and explanation. If other variable names are filled in, they should also be within the scope of protection.

[0106] After filling in the "Variable Name", you should also fill in the "Experiment Name" according to the type of forced experiment for which you actually need the data. In particular, you need to fill in the standard CMIP6 experiment name. Figure 3 The "hist-nat" filled in means that only historical experiments with natural forcing are considered. In particular, the experimental names used in the specific implementation cases of this application are only for demonstration and explanation. If other experimental names are filled in, they should also be within the scope of protection.

[0107] After filling in the "Experiment Name", you should also fill in the "Frequency" according to the actual data required. In particular, the frequency here refers to the time resolution of the required data. Figure 3 The "day" filled in means the daily frequency data. In particular, the frequency names used in the specific implementation cases of this application are only for demonstration and explanation. If other frequencies are filled in, they should also be within the scope of protection.

[0108] After filling in "Frequency", you should also fill in "Resolution" according to the required data spatial resolution. In particular, the resolution here refers specifically to the spatial resolution. It should also be noted that since the data produced by this application uses equal longitude and latitude projection by default, the spatial resolution here represents the resolution in both longitude and latitude directions. Figure 3 The "1" filled in indicates that the spatial resolution is 1°. In particular, the spatial resolution used in the specific implementation examples of this application is only for illustration purposes. If other resolutions are filled in, they should also be within the scope of protection of the rights.

[0109] After filling in the "resolution", you should also fill in the "starting latitude" and "starting longitude" according to the required data space range. In particular, the description of longitude and latitude in this application uses positive and negative numbers to distinguish between north and south, such as west longitude and south latitude are represented by negative numbers, and east longitude and north latitude are represented by positive numbers. Figure 3 The starting latitude "-90" and the starting longitude "-180" filled in mean that the starting latitude is 90° south latitude and the starting longitude is 180° west longitude. In particular, the spatial range used in the specific implementation case of this application is only for demonstration and explanation. If other spatial ranges are filled in, they should also be within the scope of protection of the rights.

[0110] After filling in the spatial range, if you need to download data, you should also fill in the "Model Name" according to the model name of the required data. In particular, you need to fill in the standard model name, separated by commas. And click "Required" to confirm that you need to download the CMIP6 raw data through this application. Optionally, this application supports preparing raw data by yourself, and you should select "Not Required" to not download the CMIP6 raw data through this application. In particular, if the above parameters are filled in incorrectly, the data download will fail, and there will be no raw data to participate in the subsequent model ensemble average calculation and model standard deviation calculation. An error alarm will automatically be issued, such as Figure 5 shown.

[0111] When all parameters are filled in, click "Start Run" and the program will automatically run the relevant workflow according to the selected parameters, including sending model data download requests to the CMIP6 database, processing of raw data, and multi-model data operations according to the parameters filled in by the user. In the process of downloading data to the CMIP6 database, the data will be automatically saved to the folder specified by the user. As above, all single-model data will be automatically saved in the folder according to the standard naming;

[0112] When the data download step is completed, it will automatically enter the data processing module. All single-mode data will be formed into single-mode data that is consistent in time and space according to user requirements, including time and space range, time and space resolution, required variables, frequency, etc.;

[0113] After the data processing step is completed, the data operation module is automatically entered. The data operation module of the present application will perform multi-mode ensemble average calculation and multi-mode ensemble standard deviation calculation on all single-mode data that are consistent in time and space, and generate two final result files.

[0114] When the workflow is complete, Figure 6 As shown, it indicates that all steps have been completed. In particular, this application provides a result visualization function, such as Figure 7 and Figure 8 As shown, the final results of the present invention, namely the multi-mode ensemble mean and the multi-mode ensemble standard deviation, are automatically visualized.

[0115] It can be seen that the present invention implements a fast processing method for CMIP6 data, which can be quickly used without programming knowledge, greatly improving the efficiency of scientific researchers in processing and using CMIP6 data, and is expected to promote work efficiency and business performance in the field of climate change research.

[0116] The embodiment of the present invention further provides an electronic device, the electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the above-mentioned meteorological data processing method when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.

[0117] It can be understood that the contents of the above method embodiments are all applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0118] See also Fig. 9 , Fig. 9 The hardware structure of an electronic device 1000 of another embodiment is illustrated. The electronic device includes:

[0119] The processor 1001 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present invention;

[0120] The memory 1002 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 1002 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 1002, and the processor 1001 calls and executes the meteorological data processing method of the embodiment of the present invention;

[0121] Input / output interface 1003, used to implement information input and output;

[0122] The communication interface 1004 is used to realize the communication interaction between the device and other devices. The communication can be realized through a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.);

[0123] A bus 1005 , which transmits information between various components of the device (e.g., the processor 1001 , the memory 1002 , the input / output interface 1003 , and the communication interface 1004 );

[0124] The processor 1001 , the memory 1002 , the input / output interface 1003 and the communication interface 1004 are connected to each other in communication within the device via the bus 1005 .

[0125] An embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned meteorological data processing method is implemented.

[0126] It can be understood that the contents of the above method embodiments are all applicable to the present storage medium embodiments, the functions specifically implemented by the present storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0127] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0128] The meteorological data processing method, meteorological data processing system, electronic device and storage medium provided by the embodiment of the present invention obtain rock images and preprocess each channel of the rock images; stack the channels of the preprocessed rock images and input them into a preset feature extractor for feature extraction, and output a feature vector; the feature extractor includes an encoder, and the encoder is trained based on a cascaded decoder; the feature vectors of different rock images are clustered by self-organizing mapping to obtain the background category of each rock image; the corresponding rock images are pseudo-labeled based on the background category; the pre-configured deep learning network is classified and trained based on the rock images marked with background categories or crack labels; the trained deep learning network is used to perform crack detection on the target rock images to be detected to obtain the detection results. The embodiment of the present invention adds background classification, and by increasing the number of background classifications about non-crack categories, the convolutional neural network is driven to learn non-crack features and improve crack detection performance. The embodiment of the present invention can accurately process meteorological data.

[0129] The embodiments described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. Those skilled in the art can appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0130] Those skilled in the art will appreciate that the technical solutions shown in the figures do not limit the embodiments of the present invention and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0131] The system embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0132] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0133] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0134] It should be understood that in the present invention, "at least one (item)" refers to one or more, and "plurality" refers to two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can represent: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0135] In the several embodiments provided by the present invention, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of systems or units, which can be electrical, mechanical or other forms.

[0136] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0137] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0138] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including multiple instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0139] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the embodiments of the present invention is not limited thereby. Any modification, equivalent substitution and improvement made by those skilled in the art without departing from the scope and essence of the embodiments of the present invention shall be within the scope of the rights of the embodiments of the present invention.

Claims

1. A meteorological data processing method, characterized in that: The method comprises the following steps: Receiving a parameter input instruction of a target object on a user operation interface, and determining meteorological parameters according to the parameter input instruction; the meteorological parameters include download parameters and processing parameters; Downloading and obtaining initial meteorological data from a designated data source according to the download parameters; Performing consistency preprocessing on the initial meteorological data based on the processing parameters to obtain target meteorological data; Performing data operations on the target meteorological data to obtain an ensemble mean value and an ensemble standard deviation for each spatial region; The ensemble mean value and the ensemble standard deviation are visualized to obtain a meteorological spatial distribution map of all the spatial regions.

2. The method according to claim 1, characterized in that The parameter input instruction includes a range setting instruction, a resolution setting instruction and a name setting instruction; and determining the meteorological parameters according to the parameter input instruction includes the following steps: Determine the set standard parameters of CMIP6 data as the meteorological parameters according to the range setting instruction, the resolution setting instruction and the name setting instruction; The download parameters include a mode name and a variable name; the processing parameters include a time range, a space range, a time resolution and a space resolution.

3. The method according to claim 1, characterized in that The designated data source includes a CMIP6 database; the method further includes the following steps: A dynamic interactive link with the CMIP6 database is established based on regular expression URL parsing.

4. The method according to claim 3, characterized in that The download parameters include a mode name and a variable name; the initial meteorological data is downloaded from a specified data source according to the download parameters, including the following steps: Based on the dynamic interactive link, sending a data search request to the CMIP6 database according to the mode name and the variable name; The initial meteorological data is obtained by batch downloading from the CMIP6 database based on the data search request.

5. The method according to claim 1, characterized in that The processing parameters include time range, space range, time resolution and space resolution; the pre-processing of the initial meteorological data based on the processing parameters includes at least one of the following steps: Unifying the file storage format of all data in the initial meteorological data into a specified file format; Based on the reprojection method, the projection coordinate system of all data in the initial meteorological data is converted to a specified spatial coordinate system; Interpolating or resampling all data in the initial meteorological data to a specified data resolution based on a bilinear interpolation method; the specified data resolution includes the spatial resolution and the temporal resolution; All data in the initial meteorological data are clipped to a specified spatiotemporal range; the spatiotemporal range includes the time range and the space range.

6. The method according to claim 1, characterized in that The target meteorological data includes a multi-mode set; the data operation on the target meteorological data includes the following steps: Performing an average operation on the multi-mode set corresponding to the target spatial region; The expression of the average operation is: In the formula, represents the ensemble average of the target space area; X i represents the i-th mode data in the multi-mode set; n represents the number of modes in the multi-mode set; Performing a standard deviation operation on the multi-mode set corresponding to the target spatial area; Wherein, the expression of the standard deviation operation is: In the formula, X σ Represents the collective standard deviation of the target spatial region.

7. The method according to claim 1, characterized in that The visualizing of the set mean value and the set standard deviation comprises the following steps: Based on a preset visualization numerical gradient range mapping table, the corresponding spatial area in the preset spatial distribution map is converted into a corresponding gradient color according to the gradient range where the set mean value and the set standard deviation are located.

8. A meteorological data processing system, characterized in that: The system comprises: A user operation interface module, used to receive parameter input instructions of a target object on a user operation interface, and determine meteorological parameters according to the parameter input instructions; the meteorological parameters include download parameters and processing parameters; A data download module, used for downloading and obtaining initial meteorological data from a specified data source according to the download parameters; A data processing module, used for performing consistency preprocessing on the initial meteorological data based on the processing parameters to obtain target meteorological data; A data operation module is used to perform data operation on the target meteorological data to obtain the ensemble mean value and ensemble standard deviation of each spatial area; The automatic visualization section is used to visualize the ensemble mean and the ensemble standard deviation to obtain the meteorological spatial distribution map of all the spatial areas.

9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.