National regional geological mapping data organization and storage method and system

By using a hierarchical organization method of 'project number-map sheet number-data type-data file', combined with PostgreSQL, MinIO and PostGIS, the problem of scattered storage of geological mapping data is solved, and efficient data management and integrated application are achieved.

CN121070933AActive Publication Date: 2025-12-05CHINA GEOLOGICAL SURVEY NATURAL RESOURCES COMPREHENSIVE SURVEY COMMAND CENT
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202511254662.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-09-04
Publication Date
2025-12-05
Estimated Expiration
2045-09-04

AI Technical Summary

Technical Problem

In existing technologies, geological mapping data is scattered and stored in different types of lightweight databases, resulting in inconvenient data management and weak comprehensive application capabilities, making it difficult to achieve efficient data classification, integration, and correlation management.

Method used

It adopts a hierarchical organization method of 'project number-map sheet number-data type-data file', uses PostgreSQL and MinIO databases for hybrid storage, and realizes spatial association management of data through PostGIS extension solution, supporting multi-terminal data upload and format conversion.

Benefits of technology

It enables efficient organization and management of geological mapping data, enhances data retrieval and comprehensive application capabilities, and meets the diverse needs of users in multiple scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121070933A_ABST
    Figure CN121070933A_ABST
Patent Text Reader

Abstract

The invention discloses a national regional geological mapping data organization and storage method and system. The method comprises the following steps: selecting a project to which regional geological survey data belongs; judging a data type; data type selection; uploading a file of the geological mapping data; and managing a PostgreSQL business database and a MinIO original file database in the system, updating an associated information table of the PostgreSQL business database, extracting attribute information, spatial position information and business associated information of the geological mapping data, and storing the attribute information, spatial position information and business associated information in the attribute information table and the associated information table of the PostgreSQL business database. The method has the advantages that the method is easy to implement, unified storage of the mixed database is carried out by adopting a regional geological mapping data hierarchical organization mode of project number-sheet number-data type-data file, data association is carried out by utilizing the storage address, and the organization and management efficiency of the regional geological mapping data is improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of geology and relates to a national regional geological mapping data organization and storage method and system. BACKGROUND

[0002] Digital geological survey technology is a technology of digital collection, storage, arrangement, analysis, mapping and database construction of various geological information obtained by field geological survey in regional geological survey by using geographic information system, global satellite positioning system and remote sensing technology. In the past years, digital geological survey technology has been widely applied to the regional geological mapping process of 1:50,000 and 1:250,000 in China, which has caused the explosive growth of geological mapping data and the data volume has developed from GB to TB and now to PB order of magnitude. According to statistics, since 2002, nearly 4300 pieces of 1:50,000 regional geological mapping databases including original data databases and result map databases have been established by using digital geological survey technology, accounting for 19.55% of more than 22,000 1:50,000 map ranges in China. And the number of map pieces is increasing every year. These data can play a role in the following applications: (1) data retrieval service. After the geological information is organized and processed, the attribute data query and retrieval results are provided for users in a comprehensive, detailed, accurate and effective manner. (2) user interactive self-defined service. Different theme customized maps are generated according to user needs. The self-defined map styles can be formed, including vector maps, static maps and other customized map styles with different geological elements, online interaction, editing and free marking. (3) comprehensive analysis function. The data islands are broken, and the general data analysis of map information and attribute data can be performed. The statistical analysis, correlation analysis and cluster analysis of the relationship between the distribution state, digital characteristics and random variables of chronology, geophysical and remote sensing data are performed to form visual charts. (4) auxiliary decision-making function. The intelligent evaluation and auxiliary decision-making function is provided. The experience, knowledge or effective structured evaluation process of experts in related fields are extracted to construct decision-making models and evaluation models, and a short report for reference is output. (5) production of series of special maps. The basic geological information display and analysis are carried out to support the new round of prospecting breakthrough strategic action and the implementation of national major strategies. In addition, considering the diversified needs of cross-field, multi-scenario and different users, a series of special map libraries (strata, structures, magmatic rocks, volcanoes, fossils, precious stones and geological relics) are formed.

[0003] At present, these data are in a "fragmented" state and scattered in various production units. Moreover, the specific data content of each map produced by geological mapping includes field hand maps, map PRB libraries, actual material map data, original map compilation, geological map spatial databases, and unstructured geological report data, which are respectively stored in different types of lightweight databases and files. The traditional storage management method of building a database according to the type of data leads to scattered storage locations, insufficient data correlation, and problems such as inconvenient data management and weak comprehensive application capabilities. When there are further business application requirements such as comprehensive application of geological mapping data, the data of field route geological survey, measured geological profile data, rock geochemical sample analysis results, and thin section identification results need to be classified, integrated, and managed in an orderly manner, and the spatial and temporal correlation of various data directly or indirectly needs to be strengthened, which will result in a large amount of calculation and low data retrieval and extraction efficiency. SUMMARY

[0004] The purpose of the present application is to overcome the above-mentioned deficiencies and provide a national regional geological mapping data organization and storage method and system which can solve various problems existing in the prior art.

[0005] In order to achieve the above-mentioned purpose, the technical scheme adopted by the present application is as follows: a national regional geological mapping data organization and storage method, characterized in that it comprises:

[0006] Step one, selecting the project to which the regional geological survey data belongs;

[0007] Step two, data type judgment. If the uploaded data is geological mapping data, select the map number where the data is located. If it is other geological survey data, no map number needs to be selected;

[0008] Step three, data type selection, determine the classification of the geological mapping data and / or the classification of other geological survey data;

[0009] Step four, upload the file of the geological mapping data on the PC end, Web end, and mobile end, and cache the uploaded data file compression package to the local;

[0010] Step five, manage the PostgreSQL business database and MinIO original file database in the system, store the entity file of the regional geological mapping data, update the storage path and file directory structure information to the associated information table of the PostgreSQL business database, extract the attribute information, spatial location information, and business associated information of the geological mapping data, and store them in the attribute information table and the associated information table of the PostgreSQL business database.

[0011] Further, if the geological mapping data uploaded by the PC end and the Web end, the step five further comprises:

[0012] Original data storage: step a1. Determine whether the current data exists under the project, map, and corresponding data type; if it exists, first delete the relevant attribute information table in the business database and the historical data already stored in the object storage database; then execute step b1, step b1. If there is no data, write the project number and map information into the association information table of the business database, decompress the file compression package, obtain the regional geological survey data file, and read the directory structure information of the data file;

[0013] Data format conversion: perform data format conversion, parse the data directory structure, and convert and parse the data into geojson format, extract spatial feature data, and save the vector data to the PostGIS spatial database;

[0014] Multimedia file processing: determine whether there are multimedia files in the regional geological mapping data file cached locally; step a2. If there are multimedia files, and the multimedia files are photos, first generate a photo thumbnail, upload it to the object storage database original file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then execute step b2; step b2. If there are no multimedia files, synchronize the regional geological mapping data file compression package and regional geological mapping data file cached locally to the MinIO original file library, and record the file storage path and file directory structure information to the association information table of the PostgreSQL business database;

[0015] Attribute and spatial location information extraction: read the regional geological mapping data file cached locally, call the data format conversion service through the message queue, convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

[0016] Further, if the field route geological survey data uploaded by the mobile terminal, the step five further comprises:

[0017] Determine the data type of the mobile terminal uploaded data, if the data is field route geological survey data that has been uploaded on the PC end, only replace and update the original data stored in the "collection day backup" folder in the MinIO original file library, otherwise, if the data has not been uploaded on the PC end, upload the user uploaded data in the form of a compression package to the "collection day backup" folder under the corresponding project and map in the MinIO original file library;

[0018] Data format conversion: data format conversion is performed, data directory structure is parsed, and data conversion is parsed into geojson format, spatial feature data is extracted, and vector data is extracted and saved into a PostGIS spatial database;

[0019] Multimedia file processing: it is judged whether there is a multimedia file in the regional geological mapping data file cached locally; step a2. if there is a multimedia file, and the multimedia file is a photo, first generate a photo thumbnail, upload to the object storage database original file library, and record the thumbnail storage location information in the associated information table of the business database; if the multimedia file is a video or audio file, no processing is performed; step b2 is executed again; step b2. if there is no multimedia file, the regional geological mapping data file compressed package cached locally and the regional geological mapping data file are synchronously uploaded to the MinIO original file library, and the file storage path and file directory structure information are recorded to the associated information table of the PostgreSQL business database;

[0020] Attribute and spatial position information extraction: read the regional geological mapping data file cached locally, call the data format conversion service through the message queue, convert the attribute file of the regional geological survey data into geojson format; extract the attribute information and spatial position information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial position information in the PostGIS spatial database.

[0021] Further, if other types of geological survey data are uploaded, the step five further comprises:

[0022] Multimedia file processing: it is judged whether there is a multimedia file in the regional geological mapping data file cached locally; step a2. if there is a multimedia file, and the multimedia file is a photo, first generate a photo thumbnail, upload to the object storage database original file library, and record the thumbnail storage location information in the associated information table of the business database; if the multimedia file is a video or audio file, no processing is performed; step b2 is executed again; step b2. if there is no multimedia file, the regional geological mapping data file compressed package cached locally and the regional geological mapping data file are synchronously uploaded to the MinIO original file library, and the file storage path and file directory structure information are recorded to the associated information table of the PostgreSQL business database.

[0023] Further, the classification of the geological mapping data includes daily backup, field hand drawing, exploration engineering library, sheet prb library, actual material drawing, original drawing for editing, and spatial database; the classification of the other geological survey data includes past geological data and achievement report.

[0024] Another object of the present application is to provide a national regional geological mapping data organization and storage system, characterized in that it comprises:

[0025] A first selection unit is configured to select a project to which regional geological survey data belongs;

[0026] A second selection unit is configured to determine the data type, and if the uploaded data is geological mapping data, select the corresponding map number where the data is located; if it is other geological survey data, no map number needs to be selected;

[0027] A third selection unit is configured to select the data type, determine the classification of the geological mapping data and / or the classification of other geological survey data;

[0028] A processing unit is configured to upload the geological mapping data file on the PC side, the Web side and the mobile side, and cache the uploaded data file compression package locally;

[0029] An execution unit is configured to manage the PostgreSQL business database and the MinIO original file database in the system, store the entity file of the regional geological mapping data, update the storage path and file directory structure information to the association information table of the PostgreSQL business database, extract the attribute information, spatial position information and business association information of the geological mapping data, and store them in the attribute information table and the association information table of the PostgreSQL business database.

[0030] Compared with the prior art, the present application has the following advantages:

[0031] It is simple to implement, uses a regional geological mapping data hierarchical organization method of "project number-map number-data type-data file" for mixed database unified storage, and uses storage addresses for data association, which improves the organization and management efficiency of regional geological mapping data. On the one hand, for the massive unstructured data in regional geological mapping data, a native object storage model is adopted, which perfectly matches the organization form of discrete files, maintains file integrity, and avoids the management complexity caused by block storage. On the other hand, for structured business data such as project information and personnel information, the native JSON format can be supported to meet the dynamic rendering requirements of field route data, and the spatial data management uses a PostGIS extension scheme to maintain strong consistency with business data. BRIEF DESCRIPTION OF DRAWINGS

[0032] The features of the present application will be easier to understand and realize when reading the following detailed description in combination with the drawings of the preferred embodiments of the present application, in which:

[0033] Figure 1An embodiment flow chart of a national regional geological mapping data organization and storage method of the present application is shown.

[0034] Figure 2 An embodiment schematic diagram of national regional geological mapping data organization of the present application is shown.

[0035] Figure 3 A structural schematic diagram of a national regional geological mapping data organization and storage system of the present application is shown. DETAILED DESCRIPTION

[0036] In accordance with the requirements, specific embodiments of the present application are disclosed herein. However, it should be understood that the disclosed embodiments are merely examples of the present application, which can be implemented in various different forms. Therefore, the specific structural and functional details disclosed herein should not be interpreted as limiting, but merely as the basis for the claims. It should be understood that the drawings and detailed description are not intended to limit the present application to the specific form disclosed herein, but rather, the present application covers all modifications, equivalents, and alternatives falling within the scope of the claims. As used throughout this application, the word "may" means optional (i.e., having the possibility of) rather than mandatory (i.e., must). Similarly, the words "include" and "comprise" mean including, but not limited to. Furthermore, unless otherwise noted, the word "a" means "at least one" and the word "multiple" means one or more. In using abbreviations or technical terms, these refer to the generally accepted meanings known in the art.

[0037] As shown in the drawings, Figure 1 The present application discloses a national regional geological mapping data organization and storage method, comprising: step one, selecting a project to which regional geological survey data belongs; step two, data type judgment, if the uploaded data is geological mapping data, selecting the corresponding map number where the data is located; if it is other geological survey data, no map number needs to be selected; step three, data type selection, determining the classification of the geological mapping data and / or the classification of other geological survey data; step four, uploading the file of the geological mapping data on the PC end, Web end and mobile end, and caching the uploaded data file compression package to the local; step five, managing the PostgreSQL business database and MinIO original file database in the system, storing the entity file of the regional geological mapping data, and updating the storage path and file directory structure information to the association information table of the PostgreSQL business database, extracting the attribute information, spatial position information and business association information of the geological mapping data, and storing them in the attribute information table and association information table of the PostgreSQL business database.

[0038] Please refer to Figure 1The national regional geological mapping data storage method can realize the storage of national regional geological mapping data according to projects, sheets, data types and data files, and realizes the mixed storage of national regional geological survey business data and original data files based on PostgreSQL, PostGIS and MinIO, and specifically includes:

[0039] (1) Select the project: select the project to which the regional geological survey data belongs;

[0040] (2) Data type judgment: if the uploaded data is geological mapping data, select the corresponding sheet number where the data is located; if it is other geological survey data such as previous geological data and achievement report, no sheet number needs to be selected;

[0041] (3) Data type selection: the classification of geological mapping data includes collection day backup, field hand drawing, exploration engineering library, sheet prb library, actual material drawing, original drawing for editing, spatial database, etc.; other data includes previous geological data, achievement report, etc.;

[0042] (4) Data upload: upload the regional geological mapping data file compression package, and upload the geological mapping data file on the PC, Web and mobile end, and cache the uploaded data file compression package locally;

[0043] (5) If the geological mapping data uploaded by PC and Web is uploaded, steps (6)-(9) are sequentially executed; if the field route geological survey data uploaded by the mobile terminal is uploaded, step (10) is executed; if other types of geological survey data are uploaded, step (8) is executed;

[0044] (6) Original data storage: a. Determine whether the current data exists in the project, sheet and corresponding data type; if it exists, delete the related attribute information table in the business database and the historical data already stored in the object storage database; then execute step b, b. If there is no data, write the project number and sheet number information into the association information table of the business database, decompress the file compression package to obtain the regional geological survey data file, and read the directory structure information of the data file.

[0045] (7) Data format conversion: perform data format conversion, parse the data directory structure, and convert the data into geojson, extract spatial feature data, extract vector data and save it to the PostGIS spatial database;

[0046] (8) Multimedia file processing: Determine whether there are multimedia files such as photos in the regional geological mapping data file cached locally; ① If there are multimedia files, and the multimedia files are photos, first generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the associated information table of the business database; if the multimedia files are video, audio, or other files, no processing is performed; then perform step ②; ② If there are no multimedia files, compress the regional geological mapping data file package cached locally, upload the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information to the associated information table of the PostgreSQL business database;

[0047] (9) Attribute and spatial location information extraction: Read the regional geological mapping data file cached locally, call the data format conversion service through the message queue, convert the attribute file of the regional geological survey data to geojson format; extract the attribute information and spatial location information of the regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial location information in the PostGIS spatial database.

[0048] (10) Determine the data type of the data uploaded by the mobile terminal. If the data is field route geological survey data that has been uploaded on the PC side, only the original data under the "collection day backup" folder in the MinIO raw file library is replaced and updated. Otherwise, if the data has not been uploaded on the PC side, the user uploaded data is uploaded to the "collection day backup" folder under the corresponding project and map in the MinIO raw file library in the form of a compressed package, and then steps (7)-(9) are performed.

[0049] The national regional geological mapping data organization and storage system includes a data acquisition module, a database management module, an original file storage module, and a business data storage module. The data acquisition module is used to upload regional geological mapping data compressed packages to be stored in the warehouse, and to cache and decompress them locally; the database management module is used to manage the PostgreSQL business database and the MinIO raw file database in the system; the original file storage module is used to store the entity files of regional geological mapping data, and update the storage path and file directory structure information to the associated information table of the PostgreSQL business database; the business data storage module is used to extract attribute information, spatial location information, and business associated information of geological mapping data, and store them in the attribute information table and the associated information table of the PostgreSQL business database.

[0050] As a specific example, select the project to which the geological mapping data belongs; if the data is organized by sheet, select the sheet number where the data is located; select the type of geological mapping data; upload the geological mapping data file compression package and cache it locally; and take different storage strategies for geological mapping data and other types of geological survey data.

[0051] As a specific example, if the geological mapping data is uploaded by PC or Web, read the associated information table of the business database, and check whether there is a related data record in the current project and sheet range.(1) If there is no existing related data record, decompress and read the directory structure information of the data file, cache the local geological mapping data uploaded to the original file library, and record the file storage path and file directory structure information to the associated information table of the business database; determine whether there are multimedia files such as photos in the geological mapping data file cached locally: if there are photos, generate a photo thumbnail and upload it to the original file library, and record the thumbnail storage location information in the associated information table of the business database; read the geological mapping data file cached locally, call the data format conversion service through the message queue, convert and extract the attribute information and spatial location information of the geological mapping data, and store them in the attribute information table of the business database.(2) If there is an existing related data record, delete the historical data that has been stored in the library first, and then follow step (1).

[0052] As a specific example, if the mobile terminal uploaded the field route geological survey data, the associated information table in the business database was read to check whether there was a related data record in the current project and the map range.(1) If there was no related data record, the field route geological survey data cached in the local was first stored in the "collection day backup" folder in the original file library in the form of a compressed package, and the file storage path and file directory structure information was recorded in the associated information table of the business database; then the directory structure information of the field route geological survey data in the "collection day backup" was decompressed and read to determine whether there were multimedia files such as photos, if there were photos, photo thumbnails were generated and uploaded to the thumbnail file directory under the original file library, and the thumbnail storage location information was recorded in the associated information table of the business database; finally, the field route geological survey data file in the "collection day backup" was read, the data format conversion service was called through the message queue, the attribute information and spatial position information of the route data were converted and extracted, and were stored in the attribute information table of the business database.(2) If there was a related data record and no PC or WEB end storage operation was performed, the historical data stored in the library was first deleted, and then step (1) was performed; (3) if there was a related data record and the state was PC or WEB storage, when the mobile terminal tried to upload the data of the same route again, the system would only update the corresponding original file under the "collection day backup" folder in the original file library, and replace it with the latest uploaded data.

[0053] As a specific example, if the uploaded was other types of geological survey data, it was determined whether there were multimedia files such as photos in the geological survey data file cached in the local: if there were photos, photo thumbnails were generated and uploaded to the original file library, and the thumbnail storage location information was recorded in the associated information table of the business database, if there were no multimedia files, the geological survey data cached in the local was uploaded to the original file library, and the file storage path and file directory structure information was recorded in the associated information table of the business database.

[0054] As shown in Figure 2 , the project-map-data type was used as a link to organize the national regional geological mapping data, the correlation between the multi-type data throughout the whole life cycle of the regional geological mapping work, such as the past geological data, the field map, the measured profile, the field general map library, the actual material map, the original map for editing, the spatial database, and the regional geological survey report, was established, and the comprehensive storage and rapid retrieval of the national regional geological survey data was supported.

[0055] The national regional geological mapping data (1:50,000, 1:25,000) is hierarchically organized according to the project number, sheet number, data type and data file in combination with the actual business needs of geological survey, and the business data and original files are stored separately according to different data types by using a hybrid database. The regional geological mapping data files in different stages such as field hand drawing library, collection day backup library, sheet PRB library, actual material drawing, original drawing for editing, geological map spatial database and the like generated by the survey work in the form of sheet in each project (a certain range of work area) are stored in the MinIO original file library, the attribute information and business association information of the extracted data are stored in the PostgreSQL business database, and the spatial feature data is stored in the PostGIS spatial database, and the data is associated by recording the storage address of the geological mapping data file of a single sheet in the association information table of the business database, so that the unified storage management of multi-source heterogeneous geological mapping data is realized on the PC end, the Web end and the mobile end, and the organization and management efficiency of the geological mapping data in a large area is improved.

[0056] Please refer to Figure 3 The national regional geological mapping data organization storage system of the application comprises: a first selection unit 101 for selecting a project to which regional geological survey data belongs; a second selection unit 102 for data type judgment, if the uploaded data is geological mapping data, the corresponding sheet number of the data is selected; if it is other geological survey data, the sheet number does not need to be selected; a third selection unit 103 for data type selection, which determines the classification of the geological mapping data and / or the classification of other geological survey data; a processing unit 104 for uploading the file of the geological mapping data on the PC end, the Web end and the mobile end, and buffering the compressed package of the uploaded data file to the local; an execution unit 105 for managing the PostgreSQL business database and the MinIO original file database in the system, storing the entity file of the regional geological mapping data, updating the storage path and file directory structure information to the association information table of the PostgreSQL business database, extracting the attribute information, spatial position information and business association information of the geological mapping data, and storing them in the attribute information table and the association information table of the PostgreSQL business database.

[0057] The application realizes a solution of performance optimization, expansion enhancement and function perfection by combining professional storage systems. It mainly comprises three core components: MinIO object storage, PostgreSQL relational database and PostGIS spatial database extension, and each component solves the storage and management needs of specific types of data.

[0058] First, for the massive unstructured data in regional geological mapping data (including regional geological mapping data files, pictures, audio and video, etc.), the MinIO distributed object storage system is adopted. Its advantages are as follows: 1) storage characteristics adaptation: the native object storage model is adopted, which perfectly matches the organization form of discrete files, maintains file integrity, and avoids the management complexity caused by block storage. 2) System architecture advantage: lightweight cloud native architecture, supporting multi-cloud deployment and cross-platform operation, distributed design ensures high availability of data, its own erasure coding technology can realize data preservation when hardware fails, effectively prevent data loss, support transmission encryption, meet the sensitive security needs of geological mapping data; 3) Performance: linear expansion capability can support PB-level data size, high-throughput parallel read-write characteristics are suitable for optimizing large file access performance; 4) Cost-effectiveness: open source system, low integration cost.

[0059] Second, for structured business data such as project information and personnel information, PostgreSQL relational database is selected. Its core advantages are as follows: 1) Data model support: complete relational data management capability, support query and transaction, native JSON format support, meet the dynamic rendering requirements of field route data; 2) Performance guarantee: high concurrency processing capability, support mobile, PC and WEB three-end data synchronization upload, powerful SQL engine support complex query optimization; 3) Cost-effectiveness: open source mode reduces the use cost; 4) Spatial expansion: seamless integration with PostGIS, realize the associated management of business data and spatial data.

[0060] Third, the spatial data management adopts the PostGIS expansion scheme, and its advantages are as follows: 1) Spatial analysis capability: provides more than 400 professional spatial functions, has professional analysis capability, supports spatial relationship operations such as inclusion, intersection and buffer analysis; 2) Performance optimization: high-efficiency spatial index greatly improves the query efficiency, and maintains strong consistency association with business data.

[0061] The above explanation of the present application is not limited to the foregoing embodiments and drawings, and it is obvious to those skilled in the art of the present application that various substitutions, modifications and changes can be made without departing from the scope of the present application.

Claims

1. A method for organizing and storing national regional geological mapping data, characterized in that, The application relates to a regional geological survey data uploading method and system. Step one, selecting a project to which regional geological survey data belongs; Step two, judging the data type, if the uploaded data is geological mapping data, selecting the corresponding data sheet number; If it is other geological survey data, no sheet number needs to be selected; Step three, selecting the data type, determining the classification of the geological mapping data and / or the classification of other geological survey data; Step four, uploading the geological mapping data file on the PC, Web and mobile terminals, and caching the uploaded data file compression package locally; Step five, managing the PostgreSQL business database and MinIO original file database in the system, storing the entity file of the regional geological mapping data, updating the storage path and file directory structure information to the association information table of the PostgreSQL business database, extracting the attribute information, spatial position information and business association information of the geological mapping data, and storing them in the attribute information table and the association information table of the PostgreSQL business database.

2. The method of claim 1, wherein, If the geological mapping data is uploaded on the PC and Web, the step five further comprises: Original data storage: step a1. judging whether the current data exists in the project, sheet and corresponding data type; if it exists, deleting the related attribute information table in the business database and the historical data stored in the object storage database; then executing step b1, step b1. if the data does not exist, writing the project number and sheet number information into the association information table of the business database, decompressing the file compression package to obtain the regional geological survey data file, and reading the directory structure information of the data file; Data format conversion: converting the data format, analyzing the data directory structure, converting and analyzing the data into geojson format, extracting spatial element data, extracting vector data and saving them into the PostGIS spatial database; Multimedia file processing: judging whether there are multimedia files in the regional geological mapping data file cached locally; step a2. if there are multimedia files, and the multimedia files are photos, first generating photo thumbnails, uploading them to the object storage database original file library, and recording the thumbnail storage location information in the association information table of the business database; if the multimedia files are video and audio files, no processing is performed; then executing step b2; step b2. if there are no multimedia files, synchronously uploading the regional geological mapping data file compression package and regional geological mapping data file cached locally to the MinIO original file library, and recording the file storage path and file directory structure information to the association information table of the PostgreSQL business database. Attribute and spatial position information extraction: read the regional geological mapping data file cached locally, call the data format conversion service through the message queue, convert the attribute file of regional geological survey data into geojson format; extract the attribute information and spatial position information of regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial position information in the PostGIS spatial database.

3. The method of claim 1, wherein, If the mobile terminal uploads the field route geological survey data, the step five further comprises: Judging the data type of the mobile terminal uploaded data, if the data is the field route geological survey data that has been uploaded on the PC terminal, only the original data under the "collection day backup" folder in the MinIO original file library is replaced and updated, otherwise, if the data has not been uploaded on the PC terminal, the data uploaded by the user is uploaded to the "collection day backup" folder under the corresponding project and map in the MinIO original file library in the form of a compressed package; Data format conversion: perform data format conversion, parse the data directory structure, and convert and parse the data into geojson format, extract spatial element data, extract vector data and save it to the PostGIS spatial database; Multimedia file processing: judge whether there is a multimedia file in the regional geological mapping data file cached locally; step a2. If there is a multimedia file, and the multimedia file is a photo, first generate a photo thumbnail, upload it to the object storage database original file library, and record the thumbnail storage location information in the association information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then execute step b2; step b2. If there is no multimedia file, compress the regional geological mapping data file cached locally, upload the regional geological mapping data file to the MinIO original file library, and record the file storage path and file directory structure information to the association information table of the PostgreSQL business database. Attribute and spatial position information extraction: read the regional geological mapping data file cached locally, call the data format conversion service through the message queue, convert the attribute file of regional geological survey data into geojson format; extract the attribute information and spatial position information of regional geological mapping data from the geojson file, store the attribute information in the attribute information table of the business database, and store the spatial position information in the PostGIS spatial database.

4. The method of claim 1, wherein, If the uploaded is other types of geological survey data, the step five further comprises: Multimedia file processing: determine whether there is a multimedia file in the regional geological mapping data file cached locally; step a2. If there is a multimedia file, and the multimedia file is a photo, first generate a photo thumbnail, upload it to the object storage database raw file library, and record the thumbnail storage location information in the associated information table of the business database; if the multimedia file is a video or audio file, no processing is performed; then execute step b2; step b2. If there is no multimedia file, compress the regional geological mapping data file cached locally, upload the compressed package and the regional geological mapping data file to the MinIO raw file library, and record the file storage path and file directory structure information to the associated information table of the PostgreSQL business database.

5. The method of claim 1, wherein, The classification of the geological mapping data includes: daily backup, field hand-drawing, exploration engineering library, sheet prb library, actual material drawing, original drawing for editing, and spatial database; the classification of the other geological survey data includes: previous geological data and achievement report.

6. A national regional geological mapping data organization storage system characterized by, It includes: A first selection unit for selecting a project to which regional geological survey data belongs; A second selection unit for data type judgment, if the uploaded data is geological mapping data, selecting the sheet number where the corresponding data is located; If it is other geological survey data, no sheet number needs to be selected; A third selection unit for data type selection, determining the classification of the geological mapping data and / or the classification of the other geological survey data; A processing unit for uploading the geological mapping data file on the PC side, Web side and mobile side, and caching the uploaded data file compression package locally; An execution unit for managing the PostgreSQL business database and the MinIO raw file database in the system, storing the entity file of the regional geological mapping data, updating the storage path and file directory structure information to the associated information table of the PostgreSQL business database, extracting the attribute information, spatial position information and business association information of the geological mapping data, and storing them in the attribute information table and the associated information table of the PostgreSQL business database.

Citation Information

Patent Citations

  • Digital processing method for field investigation of geological disasters

    CN111414448A

  • Geographic file data storage and read-write method

    CN113868202A

  • Data pool construction method and system suitable for artificial intelligence geological map modeling

    CN118170856A

  • Distributed architecture for tracking content indexing

    US20190087281A1