Data reading method and device, electronic equipment and storage medium

By matching and transforming the original dimensional information to read NetCDF data, the problems of long database transfer time and large storage space consumption are solved, achieving low-cost and fast data reading.

CN114925022BActive Publication Date: 2026-01-23BEIJING BOE ENERGY TECH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202210567331.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-23
Publication Date
2026-01-23
Estimated Expiration
2042-05-23

AI Technical Summary

Technical Problem

In existing technologies, transferring NetCDF data files to a database is time-consuming and consumes a large amount of storage space, especially when the data is used infrequently or when timeliness is not a major concern, resulting in high costs for reading the data.

Method used

By acquiring raw dimensional and attribute information and matching it with preset file features of common network data format files, the data location method is determined, and the raw dimensional information is converted into coordinate information to read the target data. This includes preprocessing and classification steps to adapt to different file formats.

Benefits of technology

It enables fast data location and retrieval with low storage space usage, reducing infrequent and unnecessary database space usage and storage costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114925022B_ABST
    Figure CN114925022B_ABST
Patent Text Reader

Abstract

The application discloses a data reading method, a data reading device, an electronic device and a storage medium. The data reading method comprises the following steps: acquiring a network universal data format file, original dimension information and attribute information to be read, and matching the original dimension information and the attribute information with preset file features corresponding to the network universal data format file to obtain a data positioning method; converting the original dimension information into coordinate information according to the data positioning method; and reading target data in the network universal data format file according to the coordinate information. The data reading method can quickly locate and read the target data in the network universal data format file, and reduce the low-frequency unnecessary database space occupation and storage cost.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of data processing, and in particular to a data reading method, a data reading device, an electronic device, and a storage medium. BACKGROUND

[0002] Network Common Data Form (NetCDF) is a description and coding standard for array-oriented and network-shared data developed for the characteristics of scientific data. NetCDF data files can highly compress data files, and can efficiently store, manage, obtain, and distribute grid data, and are widely used in atmospheric science, hydrology, oceanography, environmental simulation, geophysics, and many other fields.

[0003] If the NetCDF data file is converted to a database, not only is the conversion process time-consuming, but also a large amount of database storage space is occupied. In the case of low data usage frequency or low time efficiency requirement, the cost of reading data after conversion to a database is high. SUMMARY

[0004] The present application aims to at least solve one of the technical problems existing in the prior art. To this end, the present application provides a data reading method, a data reading device, an electronic device, and a storage medium.

[0005] The data reading method provided by the present application embodiment comprises:

[0006] obtaining a network common data format file, and original dimension information and attribute information to be read;

[0007] matching the original dimension information and the attribute information with a preset file feature corresponding to the network common data format file to obtain a data positioning method;

[0008] converting the original dimension information into coordinate information according to the data positioning method;

[0009] reading target data in the network common data format file according to the coordinate information.

[0010] In some embodiments, the matching the original dimension information and the attribute information with a preset file feature corresponding to the network common data format file to obtain a data positioning method comprises:

[0011] In the case where the original dimension information and the attribute information do not match the preset file feature, the network common data format file is preprocessed to determine the corresponding preset file feature and data positioning method.

[0012] In some embodiments, the network universal data format file is preprocessed to determine the corresponding preset file feature and data positioning method, comprising:

[0013] determining preset attribute information of the network universal data format;

[0014] acquiring preset dimensions in the network universal data format file and structure and rules of the preset dimensions;

[0015] determining a mathematical function adapted to the preset dimensions and the structure and rules of the preset dimensions to obtain a data positioning method;

[0016] storing the preset dimensions, the data positioning method and the preset attribute information to determine the file feature corresponding to the network universal data format file.

[0017] In some embodiments, the determining a mathematical function adapted to the preset dimensions and the structure and rules of the preset dimensions to obtain a data positioning method comprises:

[0018] in the case that the preset dimensions and the structure and rules of the preset dimensions are not adapted to the mathematical function, storing the preset dimensions and the location of the corresponding data in the network universal data format file in the form of a dictionary to obtain the data positioning method.

[0019] In some embodiments, in the case that the number of the network universal data format files is multiple, the data reading method comprises, before the step of converting the original dimension information into coordinate information according to the data positioning method:

[0020] classifying the network universal data format files according to the data positioning method.

[0021] In some embodiments, the converting the original dimension information into coordinate information according to the data positioning method comprises:

[0022] respectively converting the original dimension information into coordinate information of the classified corresponding type of the network universal data format file according to the data positioning method.

[0023] In some embodiments, the reading target data in the network universal data format file according to the coordinate information comprises:

[0024] in the case that the number of the network universal data format files is multiple, creating multiple threads to respectively read the target data in each of the network universal data format files according to the corresponding coordinate information.

[0025] The data reading device provided by the embodiment of the application comprises:

[0026] The acquisition module is configured to acquire a network universal data format file and original dimension information and attribute information to be read.

[0027] The matching module is configured to match the original dimension information and the attribute information with preset file features corresponding to the network universal data format file to obtain a data positioning method.

[0028] The conversion module is configured to convert the original dimension information into coordinate information according to the data positioning method.

[0029] The reading module is configured to read target data in the network universal data format file according to the coordinate information.

[0030] The electronic device provided by the embodiment of the application comprises a processor and a memory, wherein the memory stores a computer program, and the computer program is executed by the processor to enable the processor to execute the data reading method.

[0031] The nonvolatile computer readable storage medium of the embodiment of the application contains a computer program, and when the computer program is executed by a processor, the processor executes the data reading method.

[0032] In the data reading method, the data reading device, the electronic device and the computer storage medium of the embodiment of the application, the original dimension information and the attribute information read are matched with preset file features corresponding to the network universal data format file to obtain a data positioning method of a target data position, and then the original dimension information is directly converted into coordinate information by the data positioning method, so that the target data is read in the network universal data format file according to the coordinate information. In this way, low-cost and fast positioning reading can be realized under the condition of relatively low storage space occupation, and the low-frequency unnecessary database space occupation and storage cost are reduced.

[0033] Additional aspects and advantages of the application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0034] The above and / or additional aspects and advantages of the application will become apparent and be readily appreciated from the following description, including the drawings.

[0035] Figure 1 is a flowchart of the data reading method of some embodiments of the application;

[0036] Figure 2is a module schematic diagram of a data reading device according to some embodiments of the present application;

[0037] Figures 3-8 is a flowchart of a data reading method according to some embodiments of the present application. DETAILED DESCRIPTION

[0038] Embodiments of the present application are described in detail below with reference to examples illustrated in the accompanying drawings, in which the same or like reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present application, and should not be understood as limiting the present application.

[0039] Referring to Figure 1 The present application provides a data reading method, the data reading method comprising the steps of:

[0040] 01, obtaining a network universal data format file, and original dimension information and attribute information to be read;

[0041] 02, matching the original dimension information and attribute information with preset file features corresponding to the network universal data format file to obtain a data positioning method;

[0042] 03, converting the original dimension information into coordinate information according to the data positioning method;

[0043] 04, reading target data in the network universal data format file according to the coordinate information.

[0044] Referring to Figure 2 The embodiment of the present application provides a data reading device 10. The data reading device 10 comprises an obtaining module 110, a matching module 120, a converting module 130 and a reading module 140. Step 01 can be realized by the obtaining module 110, step 02 can be realized by the matching module 120, and step 03 can be realized by the converting module 130. Step 04 can be realized by the reading module 140.

[0045] Alternatively, the obtaining module 110 can be used to obtain a network universal data format file, and original dimension information and attribute information to be read. The matching module 120 can be used to match the original dimension information and attribute information with preset file features corresponding to the network universal data format file to obtain a data positioning method. The converting module 130 can be used to convert the original dimension information into coordinate information according to the data positioning method. The reading module 140 can be used to read target data in the network universal data format file according to the coordinate information.

[0046] The embodiment of the present application further provides an electronic device, which comprises a processor and a memory. The memory stores a computer program, and the processor executes the computer program, so that the processor can be used to acquire a network universal data format file, original dimension information and attribute information to be read, and match the original dimension information and the attribute information with preset file features corresponding to the network universal data format file to obtain a data positioning method, and then convert the original dimension information into coordinate information according to the data positioning method, and read target data in the network universal data format file according to the coordinate information.

[0047] In the data reading method, the data reading device 10 and the electronic device of the embodiment of the present application, the original dimension information and the attribute information read are matched with preset file features corresponding to the network universal data format file to obtain a data positioning method of the target data position, and then the original dimension information is directly converted into coordinate information by the data positioning method, so that the target data is read in the network universal data format file according to the coordinate information. In this way, low-cost and fast positioning reading can be realized under the condition of relatively low storage space occupation, and the low-frequency unnecessary database space occupation and storage cost are reduced.

[0048] The electronic device can include but is not limited to a mobile phone, a tablet, a computer, a network server and the like. The embodiment of the present application can be described by taking the computer as an example, that is, the data reading method and the data reading device 10 are applied to but not limited to the computer. The data reading device 10 can be hardware or software pre-installed on the computer, and can execute the data reading method when the computer is started and runs. For example, the data reading method can be a part of the underlying software code of the computer or the operating system. In this way, the target data can be directly read in the network universal data format file when the computer runs.

[0049] In some embodiments, the data reading device 10 can be a part of the electronic device. In other words, the electronic device comprises the data reading device 10.

[0050] In some embodiments, as hardware, the data reading device 10 can be independent or additionally added to the computer or the computer system as a peripheral element. The data reading device 10 can also be integrated into the computer or the computer system, for example, when the data reading device 10 is a part of the electronic device, the data reading device 10 can be integrated into the processor.

[0051] In some embodiments in which the data reading device 10 is a part of the electronic device, as software, the code segment corresponding to the data reading device 10 can be stored on the memory and executed by the processor to realize the foregoing functions. In other words, the data reading device 10 comprises the foregoing computer program, or the foregoing computer program comprises the data reading device 10.

[0052] It should be noted that the network common data format (NetCDF) file refers to a data file of a data description and coding standard for array type and suitable for network sharing of scientific data. The network common data format file can be highly compressed and can be used for efficient storage, management, acquisition and distribution of grid data, and is widely used in atmospheric science, hydrology, oceanography, environmental simulation, geophysics and many other fields.

[0053] The original dimension information refers to the dimension information of the file data before the network common data format file is generated. The dimension of the file data is the same as that of the corresponding network common data format file. The original dimension information can be one-dimensional or multi-dimensional. The attribute information refers to the attribute of the file data. In step 01, the original dimension information and the attribute information to be read can be determined according to user input.

[0054] For example, a global climate data file, due to the wide coverage of the data, usually needs to store global climate data files in a period of time (for example, one day or one week, etc.) as a file, then the longitude, latitude and date can be used as the dimensions of the network common data file for storage, and the rainfall, sunshine, cloud layer stored under the three dimensions are attribute information. The original dimension information can be longitude, latitude and date, and the attribute information can be one or more of rainfall, sunshine or cloud layer.

[0055] The data positioning method is used to find the position of the target data of the network communication data format file, so as to determine the position of the target data. The data positioning method includes multiple. The data positioning method is defined by the user in advance, and is directly used by the user when reading the target data subsequently. The positioning method is a process of positioning conversion according to the parameters by recursion, loop and the like, according to some file information mentioned above

[0056] The preset file feature refers to the feature involved in the data positioning method, and the preset file feature can include but is not limited to the name, adaptation method, number, attribute and the like of all dimension information. That is, in step 02, the original dimension information and the attribute information read are matched with the features involved in the data positioning method, so as to determine whether there is a matched data positioning method. When the data positioning method has the same features as the original dimension information and the attribute information, it means that the matching is successful.

[0057] For example, in some examples, taking a global weather dataset as an example, the network communication data format file stores one day of global rainfall data. If the historical average daily rainfall (target data) of a certain city center in the network communication data format file is to be read, the original dimension information to be read is longitude, latitude, and date, and the attribute information is rainfall. Then the longitude, latitude, date, and rainfall are matched with the features designed in the data positioning method to obtain the latitude adaptation method, the longitude adaptation method, the date adaptation method, and the rainfall adaptation method.

[0058] In step 03, the coordinate information refers to the coordinate information in the network communication data format file. For example, the original dimension information is longitude and latitude information. If the coordinate information (3000, 12000) is obtained by the longitude and latitude adaptation method from the longitude and latitude (30, 120), the coordinate information refers to the coordinate of the longitude and latitude in the network communication data format file. In this way, the target data corresponding to the coordinate can be obtained from the network communication data format file according to the coordinate information.

[0059] Please refer to Figure 3 In some embodiments, step 02 includes a sub-step:

[0060] 021, in the case that the original dimension information and the attribute information do not match the preset file features, the network general data format file is preprocessed to determine the corresponding preset file features and data positioning method.

[0061] In some embodiments, the sub-step 021 can be implemented by the matching module 120, or in other words, the matching module 120 can be used to preprocess the network general data format file to determine the corresponding preset file features and data positioning method in the case that the original dimension information and the attribute information do not match the preset file features.

[0062] In some embodiments, the processor is configured to preprocess the network general data format file to determine the corresponding preset file features and data positioning method in the case that the original dimension information and the attribute information do not match the preset file features.

[0063] It can be understood that if the original dimension information and the attribute information do not match the preset file features, it means that the current data positioning method is not suitable for this type of network general data format file, that is, in the current data positioning method, the coordinate information in the network general data format file cannot be converted from the original dimension information, and a new data positioning method suitable for this type of network general data format file needs to be constructed. Therefore, the network general data format file is preprocessed to obtain all the dimension information of the network general data format file, so as to construct the corresponding data positioning method according to all the dimension information. In this way, the original dimension information can be converted to generate coordinate information through the data positioning method subsequently.

[0064] Please combine Figure 4 In some embodiments, sub-step 021 comprises sub-steps of:

[0065] 0211, determining preset attribute information of the network universal data format file;

[0066] 0212, obtaining preset dimensions in the network universal data format file and structure and rules of the preset dimensions;

[0067] 0213, determining a mathematical function adapted to the preset dimensions and the structure and rules of the preset dimensions to obtain a data positioning method;

[0068] 0214, storing the preset dimensions, the data positioning method and the preset attribute information to determine file features corresponding to the network universal data format file.

[0069] In some embodiments, sub-steps 0211-0214 can be implemented by the matching module 120, or in other words, the matching module 120 can be used to determine preset attribute information of the network universal data format file; obtain preset dimensions in the network universal data format file and structure and rules of the preset dimensions; determine a mathematical function adapted to the preset dimensions and the structure and rules of the preset dimensions to obtain a data positioning method; and store the preset dimensions, the data positioning method and the preset attribute information to determine file features corresponding to the network universal data format file.

[0070] In some embodiments, the processor can be used to determine preset attribute information of the network universal data format file; obtain preset dimensions in the network universal data format file and structure and rules of the preset dimensions; determine a mathematical function adapted to the preset dimensions and the structure and rules of the preset dimensions to obtain a data positioning method; and store the preset dimensions, the data positioning method and the preset attribute information to determine file features corresponding to the network universal data format file.

[0071] It should be noted that the mathematical function can be a linear function, i.e. f(x) = y, where x represents the preset dimension and y represents the coordinate of the preset latitude in the network universal data format file. That is, in this embodiment, the data positioning method can be a linear function corresponding to the preset latitude.

[0072] For example, in some examples, in a global climate NetCDF data file, the preset attribute information can be rainfall, sunshine, cloud layer, etc., the preset dimension can be longitude, latitude and time, and the preset dimension structure and rule can be a three-dimensional array composed of longitude, latitude and time. Among them, the latitude and longitude can be incremented by 0.1 increments (for example, 30° north latitude, 30.1° north latitude, 30.2° north latitude, etc.), and the time is incremented in day dimension (for example, February 1, February 2, February 3, etc.) or hour latitude. The file characteristics corresponding to the network universal data format file can be longitude, latitude and date, rainfall, sunshine, cloud layer, longitude and latitude, and time corresponding mathematical functions, etc.

[0073] Please refer to Figure 5 In some embodiments, 0213 comprises:

[0074] 02131, in the case where the preset dimension and the structure and rule of the preset dimension are not adapted to the mathematical function, storing the preset dimension and the position of the corresponding data in the network universal data format file in the form of a dictionary to obtain a data positioning method.

[0075] In some embodiments, the sub-step 02131 can be implemented by the matching module 120, or in other words, the matching module 120 can be used to store the preset dimension and the position of the corresponding data in the network universal data format file in the form of a dictionary to obtain a data positioning method in the case where the preset dimension and the structure and rule of the preset dimension are not adapted to the mathematical function.

[0076] In some embodiments, the processor can be used to store the preset dimension and the position of the corresponding data in the network universal data format file in the form of a dictionary to obtain a data positioning method in the case where the preset dimension and the structure and rule of the preset dimension are not adapted to the mathematical function.

[0077] For example, in the network universal data format file generated by longitude and latitude as dimension, the longitude and latitude can be directly stored with the actual position of the longitude and latitude in the network universal data format file to obtain {‘longitude and latitude’: ‘actual position in the file’}, and {‘longitude and latitude’: ‘actual position in the file’} is the data positioning method of the network universal data format file.

[0078] Please refer to Figure 6 In some embodiments, before step 03, the data reading method further comprises:

[0079] 05, classifying the network universal data format file according to the data positioning method.

[0080] Please further refer to Figure 2In some embodiments, the data reading device 10 further comprises a classification module 150, and the step 05 can be implemented by the classification module 150, or in other words, the classification module 150 can be used to classify the network universal data format files according to the data positioning method.

[0081] In some embodiments, the processor can be used to classify the network universal data format files according to the data positioning method.

[0082] It should be noted that the classification of the network universal data format files means that the network universal data format files that can use the same data positioning method are classified into a category, so as to obtain a file classification list. It can be understood that if a network universal data format file can use multiple data positioning methods, the network universal data format file can be classified into a file list corresponding to each data positioning method, respectively.

[0083] In this way, the corresponding multiple network universal data format files can be read according to the same data positioning method subsequently, so as to improve the positioning efficiency of the data positioning method.

[0084] Please refer to Figure 7 In some embodiments, the step 03 comprises a sub-step:

[0085] 031, converting the original dimension information into coordinate information of the classified corresponding type of network universal data format files according to the data positioning method, respectively.

[0086] In some embodiments, the sub-step 031 can be implemented by the conversion module 130, or in other words, the conversion module 130 can be used to convert the original dimension information into coordinate information of the classified corresponding type of network universal data format files according to the data positioning method, respectively.

[0087] In some embodiments, the processor is used to convert the original dimension information into coordinate information of the classified corresponding type of network universal data format files according to the data positioning method, respectively.

[0088] In this way, the final coordinate information in the network universal data network format file can be obtained according to the specific original dimension information to be positioned by the data positioning method, and the coordinate information can be stored in the memory.

[0089] Please refer to Figure 8 In some embodiments, the step 04 comprises a sub-step:

[0090] 041, in the case where the number of network universal data format files is multiple, multiple threads are created to read target data in each network universal data format file according to the corresponding coordinate information, respectively.

[0091] In some embodiments, the sub-step 041 can be implemented by the reading module 140, or in other words, the reading module 140 can be configured to create multiple threads to read the target data from the respective network universal data format files according to the corresponding coordinate information in the case that the number of network universal data format files is multiple.

[0092] In some embodiments, the processor can be configured to create multiple threads to read the target data from the respective network universal data format files according to the corresponding coordinate information in the case that the number of network universal data format files is multiple.

[0093] In this way, batch reading of multiple files can be implemented, and the reading speed and efficiency of the electronic device are improved.

[0094] The embodiments of the present application also provide a non-volatile computer readable storage medium, which stores a computer program. When the computer program is executed by one or more processors, the processors perform the data reading method described above.

[0095] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable devices. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be magnetic media (such as floppy disk, hard disk, magnetic tape), optical media (such as digital video disc (DVD)) or semiconductor media (such as solid state disk (SSD)) and the like.

[0096] Those skilled in the art can understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or in a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0097] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0098] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically, or two or more units can be integrated into one unit.

[0099] The above is merely a specific implementation of the present application, but the protection scope of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A data reading method, characterized in that, include: Obtain a common network data format file, as well as the raw dimension and attribute information to be read; A data location method is obtained by matching the original dimensional information and the attribute information with the preset file features corresponding to the network general data format file. The original dimension information is converted into coordinate information according to the data positioning method described above; Read the target data from the network general data format file based on the coordinate information; The method for obtaining data location by matching the original dimensional information and the attribute information with preset file features corresponding to the network general data format file includes: If the original dimension information and the attribute information do not match the preset file features, the network general data format file is preprocessed to determine the corresponding preset file features and data location method; The method for preprocessing the network general data format file to determine the corresponding preset file characteristics and data location includes: Determine the preset attribute information of the network general data format file; Obtain the preset dimensions, as well as the structure and rules of the preset dimensions, from the network general data format file; A mathematical function is determined that is compatible with the preset dimension and the structure and rules of the preset dimension to obtain a data positioning method; The preset dimension, the data positioning method, and the preset attribute information are stored to determine the file characteristics corresponding to the network general data format file; The method for determining a mathematical function that adapts to the preset dimension and the structure and rules of the preset dimension to obtain a data location method includes: When the preset dimension and its structure and rules are not compatible with mathematical functions, the preset dimension and the position of the corresponding data in the network general data format file are stored in dictionary form to obtain the data positioning method.

2. The data reading method according to claim 1, characterized in that, When there are multiple network common data format files, before the step of converting the original dimension information into coordinate information according to the data positioning method, the data reading method includes: The network general data format files are classified according to the data location method.

3. The data reading method according to claim 2, characterized in that, The step of converting the original dimension information into coordinate information according to the data positioning method includes: According to the data positioning method, the original dimensional information is converted into coordinate information of the corresponding type of network general data format file.

4. The data reading method according to claim 1, characterized in that, The step of reading target data from the network common data format file based on the coordinate information includes: When there are multiple network common data format files, multiple threads are created to read the target data from each of the network common data format files according to the corresponding coordinate information.

5. A data reading device, characterized in that, include: The acquisition module is used to acquire network common data format files, as well as the raw dimension and attribute information to be read; The matching module is used to obtain a data location method by matching the original dimension information and the attribute information with the preset file features corresponding to the network general data format file. The conversion module is used to convert the original dimension information into coordinate information according to the data positioning method; The reading module is used to read target data from the network general data format file based on the coordinate information. The matching module is further configured to obtain a data location method by matching the original dimension information and the attribute information with the preset file features corresponding to the network general data format file, including: when the original dimension information and the attribute information do not match the preset file features, preprocessing the network general data format file to determine the corresponding preset file features and data location method; preprocessing the network general data format file to determine the corresponding preset file features and data location method includes: determining the preset attribute information of the network general data format file; obtaining the preset dimension and the structure and rules of the preset dimension in the network general data format file; determining a mathematical function that is compatible with the preset dimension and the structure and rules of the preset dimension to obtain a data location method; storing the preset dimension, the data location method, and the preset attribute information to determine the file features corresponding to the network general data format file; determining a mathematical function that is compatible with the preset dimension and the structure and rules of the preset dimension to obtain a data location method includes: when the preset dimension and the structure and rules of the preset dimension do not match the mathematical function, storing the preset dimension and the position of the corresponding data in the network general data format file in dictionary form to obtain the data location method.

6. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a computer program and being executed by the processor, causing the processor to perform the data reading method according to any one of claims 1-4.

7. A non-volatile computer-readable storage medium containing a computer program, characterized in that, When the computer program is executed by a processor, the processor performs the data reading method according to any one of claims 1-4.

Citation Information

Patent Citations

  • Meteorological data preprocessing method and device, computer equipment and storage medium

    CN110928849A

  • Method and device for analyzing and translating multi-format data file

    CN112364206A

  • Meteorological data query method and device

    CN114385932A

  • Latitude and longitude data conversion method and device, computer equipment and storage medium

    CN114510660A

  • Analyzing method of satellite data based on the web

    KR1020110089749A