A method and system for organizing and storing national regional geological mapping data

Abstract

The application discloses a kind of national regional geological mapping data organization storage method and system, the method includes: selecting the project of regional geological survey data belonging to;Data type judgment;Data type selection;The file uploading of the geological mapping data is carried out;PostgreSQL business database and MinIO original file database in management system, update the associated information table of PostgreSQL business database, extract the attribute information, spatial position information and business associated information of the geological mapping data, and store in the attribute information table and associated information table of PostgreSQL business database.The advantages of the present application are: simple to realize, using the hierarchical organization mode of regional geological mapping data of "project number-sheet number-data type-data file" for mixed database unified storage, and using storage address for data correlation, improve the organization management efficiency of regional geological mapping data.

Description

Technical Field

[0001] This invention belongs to the field of geological technology and relates to a method and system for organizing and storing national and regional geological mapping data. Background Technology

[0002] Digital geological survey technology is a technology that uses geographic information systems, global positioning systems, remote sensing technology, etc., to digitally collect, store, organize, analyze, map, and build databases of various geological information obtained from field geological surveys in regional geological survey work. Over the years, digital geological survey technology has been widely used in the 1:50,000 and 1:250,000 regional geological mapping processes in my country, leading to an explosive growth in geological mapping data, with the data volume increasing from GB to TB, and now to the PB level. According to statistics, since 2002, nearly 4,300 1:50,000 regional geological mapping databases, including original data databases and result map databases, have been established using digital geological survey technology, accounting for 19.55% of the more than 22,000 1:50,000 map sheets nationwide. Moreover, the number of map sheets is increasing every year. These data can play a role in the following applications: (1) Data retrieval service. After organizing and processing geological information, it provides users with comprehensive, detailed, accurate and effective attribute data query and retrieval results. (2) User interactive customization service. It generates customized maps with different themes according to user needs. It can generate custom map styles such as vector graphics and static maps containing different geological elements, which are interactive, editable, and freely marked. (3) Comprehensive analysis function. Break down data silos and perform general data analysis on map information and attribute data. Perform statistical analysis, correlation analysis, cluster analysis, etc. on the distribution status, numerical characteristics and random variables of chronology, geophysical and remote sensing data, and generate visualization charts. (4) Decision support function. Provide intelligent evaluation and decision support functions. Extract expert experience, knowledge or effective structured evaluation processes in relevant fields, construct decision models and evaluation models, and output short reports for reference. (5) Production of a series of thematic maps. Display and analyze basic geological information around supporting the new round of mineral exploration breakthrough strategic action and the implementation of major national strategies. In addition, considering the diversified needs of different users in different fields and multiple scenarios, it is necessary to form a series of thematic map libraries (strata, structures, igneous rocks, volcanoes, fossils, gemstones, geological relics, etc.).

[0003] Currently, this data is fragmented and scattered across various production units. Furthermore, the specific data content of each map sheet generated from geological mapping includes field maps, map sheet PRB libraries, actual material map data, original manuscript maps, geological map spatial databases, and unstructured geological report data, all stored separately in different types of lightweight databases and files. The traditional method of storing and managing data according to data type results in dispersed storage locations, insufficient data correlation, inconvenient data management, and weak comprehensive application capabilities. When there are further business application needs, such as the comprehensive application of geological mapping data, it is necessary to classify, integrate, and manage data such as field route geological survey data, measured geological profile data, rock geochemical sample analysis results, and thin section identification results in an orderly manner, and strengthen the direct or indirect spatial and temporal correlations of various data types. This involves a very large amount of computation and low data retrieval and extraction efficiency. Summary of the Invention

[0004] The purpose of this invention is to overcome the above-mentioned shortcomings and provide a method and system for organizing and storing national and regional geological mapping data, which can solve various problems existing in the prior art.

[0005] To achieve the above objectives, the technical solution adopted by this invention is: a method for organizing and storing national regional geological mapping data, characterized in that it includes:

[0006] Step 1: Select the project to which the regional geological survey data belongs;

[0007] Step 2: Data type determination. If the uploaded data is geological mapping data, select the map sheet number corresponding to the data. If it is other geological survey data, you do not need to select the map sheet number.

[0008] Step 3: Data type selection, determining the classification of the geological mapping data and / or other geological survey data;

[0009] Step 4: Upload the geological mapping data to PC, Web, and mobile devices, and cache the uploaded data file archive locally.

[0010] Step 5: Manage the PostgreSQL business database and MinIO raw file database in the system, store the entity files of the regional geological mapping data, update the storage path and file directory structure information to the association information table of the PostgreSQL business database, extract the attribute information, spatial location information and business association information of the geological mapping data, and store them in the attribute information table and association information table of the PostgreSQL business database.

[0011] Furthermore, if the geological mapping data is uploaded via PC or Web, step five further includes:

[0012] Original data storage: Step a1. Determine whether the current data already exists under the project, map sheet, and corresponding data type; if it exists, first delete the relevant attribute information table in the business database and the historical data already entered in the object storage database; then execute step b1. Step b1. If the data does not exist, write the project number and map sheet number information into the association information table of the business database, decompress the file package to obtain the regional geological survey data file, and read the directory structure information of the data file;

[0013] Data format conversion: Perform data format conversion, parse the data directory structure, convert and parse the data into geojson format, extract spatial feature data, extract vector data and save it to the PostGIS spatial database;

[0014] Multimedia file processing: Determine if a multimedia file exists in the cached regional geological mapping data file; Step a2. If a multimedia file exists, and the multimedia file is a photo, generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then proceed to step b2; Step b2. If no multimedia file exists, simultaneously upload the cached regional geological mapping data file compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database;

[0015] Attribute and spatial location information extraction: Read the regional geological mapping data file cached locally, call the data format conversion service through the message queue to convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

[0016] Furthermore, if the geological survey data for a field route is uploaded via a mobile device, step five further includes:

[0017] Determine the data type of the data uploaded from the mobile device. If the data is field route geological survey data that has been uploaded to the PC, then only replace and update the original data in the "Collection Day Backup" folder stored in the MinIO original file library. Otherwise, if the data has not been uploaded to the PC, then upload the user-uploaded data in the form of a compressed package to the "Collection Day Backup" folder under the corresponding project and map sheet in the MinIO original file library.

[0018] Data format conversion: Perform data format conversion, parse the data directory structure, convert and parse the data into geojson format, extract spatial feature data, extract vector data and save it to the PostGIS spatial database;

[0019] Multimedia file processing: Determine if a multimedia file exists in the cached regional geological mapping data file; Step a2. If a multimedia file exists, and the multimedia file is a photo, generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then proceed to step b2; Step b2. If no multimedia file exists, simultaneously upload the cached regional geological mapping data file compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database;

[0020] Attribute and spatial location information extraction: Read the regional geological mapping data file cached locally, call the data format conversion service through the message queue to convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

[0021] Furthermore, if the uploaded data is of other types, step five further includes:

[0022] Multimedia file processing: Determine if a multimedia file exists in the cached regional geological mapping data file; Step a2. If a multimedia file exists, and the multimedia file is a photo, generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then proceed to step b2; Step b2. If no multimedia file exists, simultaneously upload the cached regional geological mapping data file compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database.

[0023] Furthermore, the geological mapping data is categorized as follows: daily backups of data collection, field hand-drawn maps, exploration engineering databases, map sheet PRB databases, actual material maps, original manuscript maps, and spatial databases; the other geological survey data is categorized as follows: previous geological data and results reports.

[0024] Another object of the present invention is to provide a national regional geological mapping data organization and storage system, characterized in that it includes:

[0025] The first selection unit is used to select the project to which the regional geological survey data belongs;

[0026] The second selection unit is used to determine the data type. If the uploaded data is geological mapping data, select the map sheet number corresponding to the data. If it is other geological survey data, you do not need to select the map sheet number.

[0027] The third selection unit is used for data type selection, determining the classification of the geological mapping data and / or other geological survey data.

[0028] The processing unit is used to upload the geological mapping data to PC, Web and mobile devices, and cache the uploaded data file compressed package locally;

[0029] The execution unit manages the PostgreSQL business database and the MinIO raw file database in the system, stores the entity files of regional geological mapping data, updates the storage path and file directory structure information to the association information table of the PostgreSQL business database, extracts the attribute information, spatial location information and business association information of the geological mapping data, and stores them in the attribute information table and association information table of the PostgreSQL business database.

[0030] Compared with the prior art, the present invention has the following advantages:

[0031] The implementation is simple, employing a hierarchical organization of regional geological mapping data in the format of "project number-map sheet number-data type-data file" for unified storage in a hybrid database. Data association is achieved using storage addresses, improving the efficiency of organizing and managing regional geological mapping data. On one hand, for the massive amounts of unstructured data in regional geological mapping, a native object storage model is used, perfectly matching the organization of discrete files, maintaining file integrity, and avoiding the management complexity caused by block storage. On the other hand, for structured business data such as project information and personnel information, native JSON format is supported, meeting the dynamic rendering needs of field route data. Moreover, spatial data management uses a PostGIS extension solution, maintaining strong consistency with business data. Attached Figure Description

[0032] The features of the invention will be more readily understood and recognized when reading the following detailed description in conjunction with the accompanying drawings of preferred embodiments of the invention, wherein:

[0033] Figure 1A flowchart illustrating an embodiment of the present invention for organizing and storing national and regional geological mapping data is shown.

[0034] Figure 2 A schematic diagram illustrating an embodiment of the organization of national and regional geological mapping data according to the present invention is shown;

[0035] Figure 3 This is a schematic diagram of the structure of a national regional geological mapping data organization and storage system according to the present invention. Detailed Implementation

[0036] Specific embodiments of the present invention are disclosed herein as requested. However, it should be understood that the disclosed embodiments are merely examples of the invention, which may be implemented in many different forms. Therefore, the specific structural and functional details disclosed herein should not be construed as limiting, but rather serve as the basis for the claims. It should be understood that the drawings and their detailed description are not intended to limit the invention to the specific forms disclosed herein; rather, the invention covers all modifications, equivalents, and alternatives falling within the scope defined by the claims. As used throughout this application, the word “may” indicates optional (i.e., possible) rather than mandatory (i.e., required). Similarly, the words “comprising” and “including” mean including but not limited to. Furthermore, unless otherwise mentioned, the word “a” means “at least one” and the word “a plurality” means one or more. When using abbreviations or technical terms, these refer to their generally accepted meanings known in the art.

[0037] like Figure 1 As shown, this invention discloses a method for organizing and storing national regional geological mapping data, including: Step 1, selecting the project to which the regional geological survey data belongs; Step 2, data type determination: if the uploaded data is geological mapping data, select the map sheet number corresponding to the data; if it is other geological survey data, it is not necessary to select the map sheet number; Step 3, data type selection: determine the classification of the geological mapping data and / or the classification of other geological survey data; Step 4, upload the geological mapping data files on PC, Web, and mobile terminals, and cache the uploaded data file compressed package locally; Step 5, manage the PostgreSQL business database and MinIO raw file database in the system, store the entity files of the regional geological mapping data, update the storage path and file directory structure information to the association information table of the PostgreSQL business database, extract the attribute information, spatial location information, and business association information of the geological mapping data, and store them in the attribute information table and association information table of the PostgreSQL business database.

[0038] Please refer to Figure 1The national regional geological mapping data storage method of the present invention can realize the storage of national regional geological mapping data by project-map sheet-data type-data file, and realize the mixed storage of national regional geological survey business data and raw data files based on PostgreSQL, PostGIS and MinIO, specifically including:

[0039] (1) Select Project: Select the project to which the regional geological survey data belongs;

[0040] (2) Data type judgment: If the uploaded data is geological mapping data, select the map sheet number where the corresponding data is located; if it is other geological survey data such as previous geological data and results reports, then it is not necessary to select the map sheet number.

[0041] (3) Data type selection: Geological mapping data is classified into daily backups of data collection, field hand-drawn maps, exploration engineering databases, map sheet PRB databases, actual material maps, original manuscript maps, spatial databases, etc.; other data include previous geological data, results reports, etc.

[0042] (4) Data upload: Upload the regional geological mapping data file compressed package. Geological mapping data files can be uploaded on PC, Web and mobile devices, and the uploaded data file compressed package is cached locally.

[0043] (5) If the geological mapping data is uploaded from PC or Web, then proceed with steps (6) to (9) in sequence; if the geological survey data of the field route is uploaded from mobile device, then proceed with step (10); if the uploaded data is other types of geological survey data, then proceed with step (8).

[0044] (6) Original data storage: a. Determine whether the current data already exists under the project, map sheet and corresponding data type; if it exists, first delete the relevant attribute information table in the business database and the historical data already stored in the object storage database; then execute step b. b. If the data does not exist, write the project number and map sheet number information into the association information table of the business database, decompress the file package to obtain the regional geological survey data file, and read the directory structure information of the data file.

[0045] (7) Data format conversion: Perform data format conversion, parse the data directory structure, convert and parse the data into geojson, extract spatial feature data, extract vector data and save it to the PostGIS spatial database;

[0046] (8) Multimedia file processing: Determine whether there are multimedia files such as photos in the regional geological mapping data files cached locally; ① If there are multimedia files, and the multimedia files are photos, generate photo thumbnails first, upload them to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia files are video, audio, etc., no processing is done; then execute step ②; ② If there are no multimedia files, upload the regional geological mapping data file compressed package and the regional geological mapping data files cached locally to the MinIO raw file library simultaneously, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database;

[0047] (9) Extraction of attribute and spatial location information: Read the regional geological mapping data file cached locally, call the data format conversion service through the message queue to convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

[0048] (10) Determine the data type of the data uploaded by the mobile terminal. If the data is field route geological survey data that has been uploaded to the PC terminal, then only replace and update the original data in the "Collection Day Backup" folder stored in the MinIO original file library. Otherwise, if the data has not been uploaded to the PC terminal, upload the user-uploaded data in the form of a compressed package to the "Collection Day Backup" folder under the corresponding project and map sheet in the MinIO original file library, and then execute steps (7) to (9).

[0049] The national regional geological mapping data organization and storage system includes a data acquisition module, a database management module, a raw file storage module, and a business data storage module. The data acquisition module uploads compressed packages of regional geological mapping data to be stored and caches and decompresses them locally. The database management module manages the PostgreSQL business database and the MinIO raw file database within the system. The raw file storage module stores the physical files of the regional geological mapping data and updates the storage path and file directory structure information to the association information table in the PostgreSQL business database. The business data storage module extracts attribute information, spatial location information, and business association information from the geological mapping data and stores them in the attribute information table and association information table of the PostgreSQL business database.

[0050] As a specific implementation, select the project to which the geological mapping data belongs; if it is regional geological mapping data organized by map sheet, select the map sheet number where the data is located; select the type of geological mapping data; upload the geological mapping data file compressed package and cache it locally; adopt different storage strategies for geological mapping data and other types of geological survey data.

[0051] As a specific implementation, if the geological mapping data is uploaded from a PC or Web client, the association information table of the business database is read to check whether there are any relevant data records in the current project and map area. (1) If there are no relevant data records, the directory structure information of the data file is decompressed and read, the local geological mapping data is uploaded to the original file library, and the file storage path and file directory structure information are recorded in the association information table of the business database; it is determined whether there are multimedia files such as photos in the local geological mapping data file: if there are photos, a photo thumbnail is generated and uploaded to the original file library, and the thumbnail storage location information is recorded in the association information table of the business database; the local geological mapping data file is read, and the data format conversion service is called through the message queue to convert and extract the attribute information and spatial location information of the geological mapping data, and store it in the attribute information table of the business database. (2) If there are existing relevant data records, the historical data that has been entered into the database is deleted first, and then the operation is performed according to step (1).

[0052] As a specific implementation, if the field route geological survey data is uploaded by a mobile terminal, the association information table in the business database is read to check whether there are any relevant data records in the current project and map area. (1) If there are no relevant data records, the field route geological survey data cached locally is first stored in the "Collection Day Backup" folder in the original file library in the form of a compressed package, and the file storage path and file directory structure information are recorded in the association information table of the business database; then, the directory structure information of the field route geological survey data in the "Collection Day Backup" is decompressed and read to determine whether there are multimedia files such as photos. If there are photos, a photo thumbnail is generated and uploaded to the thumbnail file directory in the original file library, and the thumbnail storage location information is recorded in the association information table of the business database; finally, the field route geological survey data file in the "Collection Day Backup" is read, and the data format conversion service is called through the message queue to convert and extract the attribute information and spatial location information of the route data, and store it in the attribute information table of the business database. (2) If there are existing data records and no PC or WEB database entry operation has been performed, delete the historical data that has been entered into the database first, and then perform the operation according to step (1); (3) If there are existing data records and the status is that they have been entered into the database on PC or WEB, when the mobile terminal tries to upload data for the same route again, the system will only update the corresponding original file in the "Collection Daily Backup" folder in the original file library and replace it with the latest uploaded data.

[0053] As a specific implementation, if other types of geological survey data are uploaded, it is determined whether there are multimedia files such as photos in the geological survey data files cached locally: if photos exist, photo thumbnails are generated and uploaded to the original file library, and the thumbnail storage location information is recorded in the association information table of the business database; if no multimedia files exist, the geological survey data cached locally is uploaded to the original file library, and the file storage path and file directory structure information are recorded in the association information table of the business database.

[0054] like Figure 2 As shown, national regional geological mapping data is organized using project-map sheet-data type as the link, establishing the relationship between various types of data throughout the entire life cycle of regional geological mapping work, including previous geological data, field hand-drawn maps, measured profiles, field general map library, actual material maps, original manuscript maps, spatial databases, and regional geological survey reports, to support the comprehensive storage and rapid retrieval of national regional geological survey data.

[0055] For nationwide regional geological mapping data (1:50,000 and 1:25,000), and in accordance with the actual operational needs of geological surveys, the mapping data is hierarchically organized according to "project number-map sheet number-data type-data file". Based on different data types, a hybrid database is used to store operational data and raw files separately. Regional geological mapping data files from different stages of surveys conducted by map sheet method for each project (within a certain work area), including field hand-drawn map libraries, daily backup libraries, map sheet PRB libraries, actual material maps, original manuscript maps, and geological map spatial databases, are stored in the MinIO raw file library. The extracted attribute information and operational association information of the above data are stored in a PostgreSQL operational database, while spatial element data is stored in a PostGIS spatial database. Data association is achieved by recording the storage address of single-map sheet geological mapping data files in the association information table of the operational database. This enables unified storage and management of multi-source heterogeneous geological mapping data across PCs, web platforms, and mobile devices, improving the efficiency of organizing and managing geological mapping data over large areas.

[0056] Please refer to Figure 3 This invention discloses a national regional geological mapping data organization and storage system, comprising: a first selection unit 101 for selecting the project to which the regional geological survey data belongs; a second selection unit 102 for data type determination, selecting the map sheet number corresponding to the data if the uploaded data is geological mapping data, and not selecting the map sheet number if it is other geological survey data; a third selection unit 103 for data type selection, determining the classification of the geological mapping data and / or other geological survey data; a processing unit 104 for uploading the geological mapping data to a PC, Web, or mobile device, and caching the uploaded data file compressed package locally; and an execution unit 105 for managing the PostgreSQL business database and the MinIO raw file database in the system, storing the entity files of the regional geological mapping data, updating the storage path and file directory structure information to the association information table of the PostgreSQL business database, extracting the attribute information, spatial location information, and business association information of the geological mapping data, and storing them in the attribute information table and association information table of the PostgreSQL business database.

[0057] This invention provides a solution for performance optimization, enhanced scalability, and comprehensive functionality by combining specialized storage systems. It primarily comprises three core components: MinIO object storage, a PostgreSQL relational database, and a PostGIS spatial database extension. Each component specifically addresses the storage and management needs of specific data types.

[0058] First, for the massive amounts of unstructured data in regional geological mapping (including regional geological mapping data files, images, audio and video, etc.), the MinIO distributed object storage system is adopted. Its advantages are: 1) Storage characteristic adaptation: It adopts a native object storage model, perfectly matching the organization of discrete files, maintaining file integrity, and avoiding the management complexity brought by block storage. 2) System architecture advantages: Lightweight cloud-native architecture, supporting multi-cloud deployment and cross-platform operation, distributed design ensures high data availability, its own erasure coding technology can realize data preservation in the event of hardware failure, effectively preventing data loss, and supports transmission encryption to meet the sensitive security requirements of geological mapping data; 3) Performance: Linear scalability can support petabyte-level data scale, and high-throughput parallel read and write characteristics are suitable for optimizing the performance of large file access; 4) Cost-effectiveness: The system is open source and has low integration costs.

[0059] Secondly, for structured business data such as project information and personnel information, the PostgreSQL relational database is selected. Its core advantages are: 1) Data model support: complete relational data management capabilities, support for queries and transactions, native JSON format support, and meeting the dynamic rendering needs of field route data; 2) Performance guarantee: high concurrency processing capabilities, support for synchronous data upload across mobile, PC, and WEB terminals, and a powerful SQL engine to support complex query optimization; 3) Cost-effectiveness: open-source model reduces usage costs; 4) Spatial expansion: seamless integration with PostGIS to achieve the association management of business data and spatial data.

[0060] Third, spatial data management adopts the PostGIS extended solution, which has the following advantages: 1) Spatial analysis capabilities: It provides more than 400 professional spatial functions, has professional analysis capabilities, and supports spatial relationship operations such as containment, intersection, and buffer analysis; 2) Performance optimization: Efficient spatial indexes greatly improve query efficiency and maintain a strong consistency with business data.

[0061] The above explanation of the present invention is not limited to the foregoing embodiments and drawings, and it will be apparent to those skilled in the art that various substitutions, modifications and alterations can be made without departing from the scope of the present invention.

Claims

1. A method for organizing and storing national and regional geological mapping data, characterized in that, include: Step 1: Select the project to which the regional geological survey data belongs; Step 2: Data type determination. If the uploaded data is geological mapping data, select the map sheet number corresponding to the data. If it is other geological survey data, there is no need to select a map sheet number; Step 3: Data type selection, determining the classification of the geological mapping data and / or other geological survey data; Step 4: Upload the geological mapping data to PC, Web, and mobile devices, and cache the uploaded data file archive locally. Step 5: Manage the PostgreSQL business database and MinIO raw file database in the system, store the entity files of the regional geological mapping data, update the storage path and file directory structure information to the association information table of the PostgreSQL business database, extract the attribute information, spatial location information and business association information of the geological mapping data, and store them in the attribute information table and association information table of the PostgreSQL business database.

2. The method for organizing and storing national and regional geological mapping data according to claim 1, characterized in that, If the geological mapping data is uploaded via PC or Web, step five further includes: Original data storage: Step a1. Determine if the current data already exists under the project, map sheet, and corresponding data type; if it exists, first delete the relevant attribute information table in the business database and the historical data already entered into the object storage database; then execute step b1. Step b1. If the data does not exist, write the project number and map sheet number information into the association information table of the business database, decompress the file package to obtain the regional geological survey data file, and read the directory structure information of the data file; Data format conversion: Perform data format conversion, parse the data directory structure, convert and parse the data into geojson format, extract spatial feature data, extract vector data and save it to the PostGIS spatial database; Multimedia file processing: Determine if a multimedia file exists in the cached regional geological mapping data file; Step a2. If a multimedia file exists, and the multimedia file is a photo, generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then proceed to step b2; Step b2. If no multimedia file exists, simultaneously upload the cached regional geological mapping data file compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database; Attribute and spatial location information extraction: Read the regional geological mapping data file cached locally, call the data format conversion service through the message queue to convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

3. The method for organizing and storing national and regional geological mapping data according to claim 1, characterized in that, If the data is from a field route geological survey uploaded via a mobile device, step five further includes: Determine the data type of the data uploaded from the mobile device. If the data is field route geological survey data that has been uploaded to the PC, then only replace and update the original data in the data collection day backup folder stored in the MinIO original file library. Otherwise, if the data has not been uploaded to the PC, then upload the user-uploaded data in the form of a compressed package to the data collection day backup folder under the corresponding project and map sheet in the MinIO original file library. Data format conversion: Perform data format conversion, parse the data directory structure, convert and parse the data into geojson format, extract spatial feature data, extract vector data and save it to the PostGIS spatial database; Multimedia file processing: Determine if a multimedia file exists in the cached regional geological mapping data file; Step a2. If a multimedia file exists, and the multimedia file is a photo, generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then proceed to step b2; Step b2. If no multimedia file exists, simultaneously upload the cached regional geological mapping data file compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database; Attribute and spatial location information extraction: Read the regional geological mapping data file cached locally, call the data format conversion service through the message queue to convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

4. The method for organizing and storing national and regional geological mapping data according to claim 1, characterized in that, If the uploaded data is of other types, step five further includes: Multimedia file processing: Determine whether multimedia files exist in the regional geological mapping data files cached locally; Step a2. If a multimedia file exists, and the multimedia file is a photo, then first generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then proceed to step b2; Step b2. If no multimedia file exists, simultaneously upload the cached regional geological mapping data file compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information in the association information table of the PostgreSQL business database.

5. The method for organizing and storing national and regional geological mapping data according to claim 1, characterized in that, The geological mapping data is categorized as follows: daily backups of data collection, field hand-drawn maps, exploration engineering database, map sheet PRB database, actual material maps, original manuscript maps, and spatial databases; other geological survey data is categorized as follows: previous geological data and results reports.

6. A national regional geological mapping data organization and storage system, characterized in that, include: The first selection unit is used to select the project to which the regional geological survey data belongs; The second selection unit is used to determine the data type. If the uploaded data is geological mapping data, then select the map sheet number where the corresponding data is located. If it is other geological survey data, there is no need to select a map sheet number; The third selection unit is used for data type selection, determining the classification of the geological mapping data and / or other geological survey data. The processing unit is used to upload the geological mapping data to PC, Web and mobile devices, and cache the uploaded data file compressed package locally; The execution unit manages the PostgreSQL business database and the MinIO raw file database in the system, stores the entity files of regional geological mapping data, updates the storage path and file directory structure information to the association information table of the PostgreSQL business database, extracts the attribute information, spatial location information and business association information of the geological mapping data, and stores them in the attribute information table and association information table of the PostgreSQL business database.

Images