Meteorological data format conversion method and system based on configuration file

Abstract

The embodiment of the invention provides a meteorological data format conversion method and system based on a configuration file, and is applied to the technical field of computers. The method comprises the following steps: acquiring original data of different types of meteorological stations; reading configuration files corresponding to the original data of the meteorological stations of different models; wherein the configuration file comprises meteorological element identifiers arranged in sequence, and the sequence is the sequence of the meteorological elements in the original data; reading meteorological elements in the original data of the meteorological stations of different models according to the order determined by the configuration file; searching and acquiring meteorological element identifiers corresponding to the meteorological elements in a standard meteorological dictionary, and converting the extracted data of the meteorological elements into data in a meteorological dictionary format; and according to a dictionary protocol format, generating overall meteorological dictionary format data from the data in the meteorological dictionary format. In this way, different configuration files can be read, so that the conversion process of data diversification is simplified, and the data integration and collection efficiency is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method and system for converting meteorological data formats based on a configuration file. Background Art

[0002] There are many types of automatic weather stations, and the types and quantities of their observation elements vary, as do the data formats. The differences in data formats among different automatic weather stations are mainly reflected in the number of meteorological elements and the order of arrangement between elements. However, a unified format is required when connecting to the server.

[0003] In the original meteorological data analysis work, each meteorological data format requires a corresponding specific parsing program. Due to the wide variety of weather station types, this makes the program maintenance cost high. Summary of the Invention

[0004] The present disclosure provides a configuration file-based meteorological data format conversion method and system, which solves the technical problem of high program maintenance costs caused by the variety of weather station data formats.

[0005] According to a first aspect of the present disclosure, a method for converting meteorological data format based on a configuration file is provided. The method comprises:

[0006] Obtain raw data from weather stations of different models;

[0007] Reading configuration files corresponding to the raw data of the different models of weather stations; wherein the configuration files include meteorological element identifiers arranged in sequence, wherein the sequence is the order of the meteorological elements in the raw data;

[0008] Reading meteorological elements from raw data of the different models of weather stations according to an order determined by the configuration file;

[0009] Searching and obtaining meteorological element identifiers corresponding to the meteorological elements in a standard meteorological dictionary, and converting the extracted meteorological element data into data in a meteorological dictionary format;

[0010] According to the dictionary protocol format, the data in the weather dictionary format is converted into complete weather dictionary format data.

[0011] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the configuration file is generated in sequence according to meteorological elements determined in the original data of the corresponding model weather station.

[0012] As described above and any possible implementation method, an implementation method is further provided, wherein the standard meteorological dictionary assigns a unique identifier and corresponding format to each meteorological element based on the professional classification of meteorological elements, wherein the format includes unit, length and scale factor.

[0013] According to the above aspects and any possible implementation manner, an implementation manner is further provided, wherein the method further includes:

[0014] Verify the generated configuration file and adjust the configuration file if errors are found during verification.

[0015] According to a second aspect of the present disclosure, a configuration file-based meteorological data format conversion system is provided. The system includes: a reading module configured to read configuration files corresponding to raw data from different models of meteorological stations; wherein the configuration files include meteorological element identifiers arranged in sequence, where the sequence corresponds to the order of the meteorological elements in the raw data;

[0016] A reading module, configured to read meteorological elements from raw data of the different models of weather stations according to an order determined by the configuration file;

[0017] A search module searches for and obtains a meteorological element identifier corresponding to the meteorological element in a standard meteorological dictionary, and converts the extracted meteorological element data into data in a meteorological dictionary format;

[0018] The generating module is used for generating complete meteorological dictionary format data from the meteorological dictionary format data according to the dictionary protocol format.

[0019] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the above method when executing the program.

[0020] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method according to the first aspect and / or the second aspect of the present disclosure is implemented.

[0021] The present disclosure unifies the raw data formats of weather stations of different models into a standard meteorological dictionary format and stores them by reading different configuration files, which greatly simplifies the conversion process and realizes the unified processing and analysis of subsequent data.

[0022] It should be understood that the contents described in the Summary of the Invention section are not intended to limit the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. The accompanying drawings are provided for a better understanding of the present disclosure and do not constitute a limitation of the present disclosure. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, among which:

[0024] Figure 1 A flowchart of a method for converting meteorological data format based on a configuration file according to an embodiment of the present disclosure is shown;

[0025] Figure 2 A framework diagram of a method for converting meteorological data format based on a configuration file according to an embodiment of the present disclosure is shown;

[0026] Figure 3 shows a configuration file effect diagram according to an embodiment of the present disclosure;

[0027] Figure 4 A diagram showing a standard weather dictionary format according to an embodiment of the present disclosure is shown;

[0028] Figure 5 A block diagram of a meteorological data format conversion system based on a configuration file according to an embodiment of the present disclosure is shown;

[0029] Figure 6 A block diagram of an exemplary electronic device capable of implementing embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0030] To make the purpose, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of the present disclosure.

[0031] In this document, the term "and / or" simply describes a relationship between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates that the related objects are in an "or" relationship.

[0032] In the present disclosure, first, the meteorological element identification and order of the weather station are obtained by reading different configuration files, then the meteorological elements in the original data of different types of weather stations are read according to this order, the meteorological element identification is searched and matched in the standard meteorological dictionary, and then the meteorological dictionary format data is generated in sequence, and finally the complete data body is generated and stored according to the dictionary protocol format.

[0033] Figure 1 FIG. 1 shows a flow chart of a method for converting meteorological data format based on a configuration file according to an embodiment of the present disclosure. Figure 1 As shown, a method for converting meteorological data format based on a configuration file includes:

[0034] S101, obtaining raw data from weather stations of different models.

[0035] In some embodiments, in the application scenario of meteorological monitoring, the collection of meteorological data is crucial for many fields such as meteorological research, weather forecasting, agricultural production, etc. Meteorological stations of different models are distributed in different regions of various places, and meteorological data are collected according to their respective collection rules and formats. These data may contain various meteorological elements such as temperature, humidity, and air pressure. The data collected by meteorological stations of different models differ in the types of meteorological elements, arrangement order and data format.

[0036] In some embodiments, the server establishes a connection with different models of weather stations distributed in various places through a network communication interface. When the server receives a data request response sent by the weather station, it will receive and cache the original data collected by the different models of weather stations to prepare for subsequent data processing.

[0037] S102, reading configuration files corresponding to the raw data of the different models of weather stations; wherein the configuration files include meteorological element identifiers arranged in sequence, wherein the sequence is the order of the meteorological elements in the raw data.

[0038] In some embodiments, the server reads the corresponding configuration file based on the weather station unique identifier, where the weather station unique identifier can be obtained from the file header of the original data, a specific data field, or the accompanying information of the transmission protocol. Specifically, the original data is transmitted in a specific format, and the file header clearly marks the weather station ID, so the server can accurately identify it.

[0039] In some embodiments, the configuration file is pre-generated, and the generation process is as follows: before the weather station is put into use, technicians can analyze the structure of the raw data collected by the weather station based on the model, sensor configuration and data acquisition protocol of the weather station, determine the types and arrangement order of the meteorological elements, and then assign corresponding identifiers to each meteorological element, and record these identifiers in the configuration file according to the order of the meteorological elements in the raw data.

[0040] Specifically, the raw data collected by a certain model of weather station are temperature, humidity, and air pressure in order. Technicians can write the identifiers representing temperature, humidity, and air pressure into the configuration file in this order. After that, when the server receives the raw data from the weather station, it can accurately read the corresponding configuration file from the designated storage location based on the extracted unique identifier of the weather station.

[0041] In some embodiments, the configuration file may be manually written using a text editor, or may be generated using a configuration file generation tool.

[0042] In some embodiments, the generated configuration file is verified, and if errors are found during the verification, the configuration file is adjusted.

[0043] Specifically, the generated configuration file is verified. If errors are found during the verification, the configuration file is adjusted. The verification process may include checking the accuracy of the meteorological element identification in the configuration file, the rationality of the order, and the matching degree with the original data. If it is found that the identification of a meteorological element in the configuration file does not correspond to the actual data, or the order is inconsistent with the arrangement of the original data, the configuration file needs to be adjusted accordingly to ensure the accuracy of subsequent data conversion.

[0044] S103 , reading meteorological elements from the raw data of the weather stations of different models according to the order determined by the configuration file.

[0045] In some embodiments, data of each meteorological element is accurately extracted from the original data according to the arrangement order of the meteorological elements in the configuration file.

[0046] S104: Search and obtain the meteorological element identifier corresponding to the meteorological element in the standard meteorological dictionary, and convert the extracted meteorological element data into data in the meteorological dictionary format.

[0047] In some embodiments, the corresponding meteorological element identifier is searched and obtained in the standard meteorological dictionary to generate meteorological dictionary format data, wherein the standard meteorological dictionary assigns a unique identifier and corresponding format to each meteorological element based on the professional classification of meteorological elements, wherein the format includes unit, length and scale factor.

[0048] Specifically, the meteorological elements read from the original data are searched in a standard meteorological dictionary to obtain their corresponding meteorological element identifiers, and then data in a meteorological dictionary format is generated according to the dictionary format.

[0049] S105 , generating complete meteorological dictionary format data from the meteorological dictionary format data according to the dictionary protocol format.

[0050] In some embodiments, necessary protocol information is added according to the dictionary protocol format, such as data source, collection time, etc., to generate complete meteorological dictionary format data. For the generated complete meteorological dictionary format data, the server has a variety of processing methods.

[0051] Specifically, the server can store data in a local database, such as a MySQL database, a distributed file system, etc. The server can also forward the data to other platforms that require meteorological data through a network communication protocol. The server can also directly transmit the data to an internal data analysis module for subsequent processing.

[0052] The following describes in detail a configuration file-based meteorological data format conversion 100 provided by the embodiment of the present disclosure in conjunction with a specific embodiment. Figure 2 A framework diagram of a method for converting meteorological data format based on a configuration file according to an embodiment of the present disclosure is shown as follows:

[0053] Get the raw data of weather stations of different models. Taking weather station C as an example, the server establishes a connection with weather station C through the network communication interface, receives and caches the raw data collected by weather station C, and the received raw data is: 20241219053000 236 0 236 0 236 0 236 0 05:01 236 0 236 0 05:01 0 ... 05:0610051 10056 05:07 10051 05:32 / / / / / 130 284.

[0054] Before the weather station is put into use, the technicians determine the types and order of meteorological elements in the weather station C according to the model of the weather station C, such as "wind speed", "wind direction", "precipitation", etc., and then assign corresponding identifiers to each meteorological element. These identifiers are recorded in the configuration file according to the order of meteorological elements in the original data, such as AZX=XXX. Figure 3 A configuration file effect diagram according to an embodiment of the present disclosure is shown.

[0055] The server accurately reads the corresponding configuration file based on the ID of weather station C extracted from the raw data.

[0056] The server reads the configuration file corresponding to the weather station C, determines the order of the meteorological elements in the configuration file, and reads the meteorological elements determined in the raw data of the weather station C according to the order determined by the configuration file.

[0057] Search and obtain the corresponding meteorological element identifier in the standard meteorological dictionary, and generate meteorological dictionary format data, wherein the standard meteorological dictionary assigns a unique identifier and a corresponding format to each meteorological element based on the professional classification of meteorological elements, wherein the format includes a unit, a length, and a scale factor. Figure 4 A diagram of a standard weather dictionary format according to an embodiment of the present disclosure is shown.

[0058] According to the dictionary protocol format, add information such as data source and collection time to generate complete meteorological dictionary format data and store it in the database. The complete meteorological dictionary format data is as follows:

[0059] BG,001,P0001,3956,11620,55,03,YSRP,001,20250211101001,001,030,02,AEC,293,AFC,000,AED,293,AFD,000,AEGa,294,AFDa,000,AFDb,12:07,AE A,295,AFA,000,AEEb,298,AFAa,000,AFAf,12:07,AEB,293,AFB,000,AHA,000,AAA,0272,AAAa,0274,AAAb,12:07,AAAc,0272,AAAd,12:18,ADA,063,AD Ac,063,ADAd,12:12,AGA,10000,AGAa,10000,AGAb,12:12,AGAc,10000,AG Ad,12:12,AHB,0000,AHL,00000000000000000000000000000000000000000000000000000000000000000 000000000000000000000000000000000000000000000,0000000000000000000000000000000,z,1,rL,1,7020,ED.

[0060] According to the embodiments of the present disclosure, through configuration files and standard meteorological dictionaries, the raw data of weather stations of different models can be quickly and accurately converted into a unified meteorological dictionary format, avoiding the tedious process of individual programming and processing for each weather station, greatly improving the efficiency of data processing. When the model or collection rules of the weather station change, only the configuration file needs to be modified accordingly, without the need for large-scale modifications to the entire data processing system, reducing the maintenance cost and complexity of the system.

[0061] It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present disclosure is not limited by the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0062] The above is an introduction to the method embodiment. The following is a further explanation of the solution disclosed in the present disclosure through an apparatus embodiment.

[0063] Figure 5 FIG. 5 shows a block diagram of a meteorological data format conversion system 500 based on a configuration file according to an embodiment of the present disclosure. Figure 5 As shown, the apparatus 500 includes:

[0064] The acquisition module S501 is used to obtain raw data from weather stations of different models;

[0065] The reading module S502 is configured to read configuration files corresponding to the raw data of the different models of weather stations; wherein the configuration files include meteorological element identifiers arranged in sequence, wherein the sequence is the order of the meteorological elements in the raw data;

[0066] A reading module S502 is configured to read meteorological elements from raw data of the different models of weather stations according to an order determined by the configuration file;

[0067] A search module S503 is used to search and obtain the meteorological element identifier corresponding to the meteorological element in a standard meteorological dictionary, and convert the extracted meteorological element data into data in a meteorological dictionary format;

[0068] The generating module S504 is configured to generate complete meteorological dictionary format data from the meteorological dictionary format data according to the dictionary protocol format.

[0069] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0070] In the technical solutions disclosed herein, the acquisition, storage, and application of user personal information involved comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0071] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0072] Figure 6 A schematic block diagram of an electronic device 600 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0073] The electronic device 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a ROM 602 or a computer program loaded from a storage unit 608 into a RAM 603. The RAM 603 may also store various programs and data required for the operation of the electronic device 600. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An I / O interface 605 is also connected to the bus 604.

[0074] Multiple components in the electronic device 600 are connected to the I / O interface 605, including an input unit 606, such as a keyboard, a mouse, etc.; an output unit 607, such as various types of displays, speakers, etc.; a storage unit 608, such as a magnetic disk, an optical disk, etc.; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 609 allows the electronic device 600 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0075] The computing unit 601 can be a variety of general-purpose and / or specialized processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 601 performs the various methods and processes described above, such as method 100. For example, in some embodiments, method 100 can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as a storage unit 608. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 600 via ROM 602 and / or communication unit 609. When the computer program is loaded into RAM 603 and executed by the computing unit 601, one or more steps of the method 100 described above can be performed. Alternatively, in other embodiments, the computing unit 601 can be configured to perform method 100 in any other appropriate manner (e.g., by means of firmware).

[0076] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0077] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0078] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0079] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0080] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0081] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0082] It should be understood that the various forms of processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions of this disclosure can be achieved, and this document is not limited here.

[0083] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. A method for converting meteorological data format based on a configuration file, comprising: Obtain raw data from weather stations of different models; Reading configuration files corresponding to the raw data of the different models of weather stations; wherein the configuration files include meteorological element identifiers arranged in sequence, wherein the sequence is the order of the meteorological elements in the raw data; Reading meteorological elements from raw data of the different models of weather stations according to an order determined by the configuration file; Searching and obtaining meteorological element identifiers corresponding to the meteorological elements in a standard meteorological dictionary, and converting the extracted meteorological element data into data in a meteorological dictionary format; According to the dictionary protocol format, the data in the weather dictionary format is converted into complete weather dictionary format data.

2. The method according to claim 1, characterized in that The configuration file is generated in sequence according to the meteorological elements determined in the original data of the weather station of the corresponding model.

3. The method according to claim 1, characterized in that The standard meteorological dictionary assigns a unique identifier and a corresponding format to each meteorological element based on the professional classification of meteorological elements, wherein the format includes a unit, a length, and a scale factor.

4. The method according to claim 1, wherein The method further comprises: Verify the generated configuration file and adjust the configuration file if errors are found during verification.

5. A meteorological data format conversion system based on a configuration file, comprising: Acquisition module, used to obtain raw data from weather stations of different models; A reading module, configured to read configuration files corresponding to the raw data of the different models of weather stations; wherein the configuration files include meteorological element identifiers arranged in sequence, wherein the sequence is the order of the meteorological elements in the raw data; A reading module, configured to read meteorological elements from raw data of the different models of weather stations according to an order determined by the configuration file; A search module searches for and obtains a meteorological element identifier corresponding to the meteorological element in a standard meteorological dictionary, and converts the extracted meteorological element data into data in a meteorological dictionary format; The generating module generates complete meteorological dictionary format data from the meteorological dictionary format data according to the dictionary protocol format.

6. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 4.

7. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-4.

Images