A method and system for organizing and retrieving national regional geological mapping data

Abstract

The application discloses a kind of national regional geological mapping data organization retrieval method and system, the method includes: user initiates data query request from client;Parsing data query request, obtains search constraint condition;According to the search constraint condition, carry out first-level search in the associated information table of business database, determine all relevant project number, sheet number;According to the search constraint condition, carry out secondary search in the attribute information table of business database, retrieve all the attribute records of relevant sheet under the search condition;According to regional geological mapping data type, the search results are grouped, and the search results of the same type regional geological mapping data are merged into a search result set;Search result is returned to client, and visualized display is carried out in the form of space figure.The application has the advantages that: simple to realize, not only meet the efficiency requirement of data retrieval, but also provide the whole-process tracing ability from project planning to data application.

Description

Technical Field

[0001] This invention belongs to the field of geological technology and relates to a method and system for organizing and retrieving national and regional geological mapping data. Background Technology

[0002] When geological mapping data is used in a comprehensive manner, it is required to classify, integrate and manage data such as field route geological survey data, measured geological profile data, rock geochemical sample analysis results, and thin section identification results, and strengthen the direct or indirect spatial and temporal correlations of various types of data.

[0003] Currently, geological mapping data is fragmented and scattered across various production units. Furthermore, the specific data content of each map sheet generated from geological mapping includes field maps, map sheet PRB libraries, actual material map data, original draft maps, geological map spatial databases, and unstructured geological report data, all stored separately in different types of lightweight databases and files. The traditional method of storing and managing data according to data type results in dispersed storage locations, insufficient data correlation, inconvenient data management, and weak comprehensive application capabilities. When further business applications require data, such as computationally intensive data, data retrieval and extraction efficiency remains low. Summary of the Invention

[0004] The purpose of this invention is to overcome the above-mentioned shortcomings and provide a method and system for organizing and retrieving national and regional geological mapping data, which can solve various problems existing in the prior art.

[0005] To achieve the above objectives, the technical solution adopted by this invention is: a method for organizing and retrieving national and regional geological mapping data, characterized in that it includes:

[0006] The user initiates a data query request from the client;

[0007] Parse the data query request and obtain the search constraints;

[0008] Based on the search constraints, a first-level search is performed in the related information table of the business database to determine all relevant project numbers and map sheet numbers;

[0009] Based on the search constraints, a secondary search is performed in the attribute information table of the business database to retrieve all attribute records that meet the search conditions under the relevant map sheet;

[0010] The search results are grouped according to the type of regional geological mapping data, and the search results of the same type of regional geological mapping data are merged into a single search result set.

[0011] The search results are returned to the client and displayed in a spatial graphic format.

[0012] Further, the association information table comprises a project information table, a sheet table, a DGSS data table, a file directory hierarchy table, a thumbnail table and various main tables, forming an association network of project-sheet-data-attribute.

[0013] Further, first-level retrieval is performed in the association information table of the business database according to the retrieval constraint condition, to determine all relevant project numbers and sheet numbers, including:

[0014] Taking the project ID as an entry, the associated sheet numbers are matched in the sheet table, to determine the spatial data range covered by the project;

[0015] According to the sheet number and the data type parameter, the records meeting the condition are filtered in the DGSS data table, to extract the data ID;

[0016] According to the data type, the main table corresponding thereto is located, the main table record is obtained through the data ID association, and the association relationship of the attribute information table and the data storage path are determined.

[0017] Further, the attribute information table is designed according to seven categories of geological mapping data, each category of data corresponds to an independent attribute information table system, including an association identifier field, a management attribute field, a spatial attribute field and a standard attribute field.

[0018] Further, second-level retrieval is performed in the attribute information table of the business database according to the retrieval constraint condition, to retrieve all attribute records meeting the retrieval condition under the relevant sheet, including: based on the association field in the main table, second-level retrieval is performed in the corresponding attribute information table, and attribute data and spatial information are cooperatively extracted through the PostGIS spatial query capability.

[0019] Another object of the present application is to provide a national regional geological mapping data organization and retrieval system, characterized in that it comprises:

[0020] A query request analysis module is configured to analyze a data query request and obtain a retrieval constraint condition;

[0021] A first retrieval module is configured to perform first-level retrieval in the association information table of the business database according to the retrieval constraint condition, to determine all relevant project numbers and sheet numbers;

[0022] A second retrieval module is configured to perform second-level retrieval in the attribute information table of the business database according to the retrieval constraint condition, to retrieve all attribute records meeting the retrieval condition under the relevant sheet;

[0023] A result arrangement module is configured to group the retrieval results, and combine the retrieval results of the same type of geological mapping data into one retrieval result set.

[0024] A result visualization module is configured to visualize the search results in a spatial graph.

[0025] Compared with the prior art, the present application has the following advantages:

[0026] First, the "business logic-storage logic-retrieval logic" of data management is highly unified. Through the structured field design, various types of information tables not only maintain independent management functions, but also form an organic whole through key fields, avoiding the problem of data islands. For geological mapping business, this technical architecture not only meets the efficiency requirement of data retrieval, but also provides geological workers with full-process traceability from project planning to data application through multi-dimensional association of projects, sheets and data types, laying a good foundation for effective management of regional geological mapping data.

[0027] Second, the efficiency of regional geological mapping data query and retrieval is improved. In view of the problems of large amount of regional geological mapping data, large amount of calculation and low data retrieval efficiency during retrieval, through the first-level retrieval in the business database associated information table, all related projects and sheets can be determined, which greatly reduces the search range of regional geological mapping data meeting the search constraint conditions; according to the search constraint conditions, the second-level retrieval is carried out in the attribute information table of the business database, so that the records of regional geological mapping data meeting the search constraint conditions can be obtained efficiently and quickly, the data calculation amount is small, and the query and retrieval efficiency is high. BRIEF DESCRIPTION OF DRAWINGS

[0028] The features of the present application will become more fully understood and appreciated when considered in connection with the following detailed description, in conjunction with the accompanying drawings, in which:

[0029] Figure 1 An embodiment flowchart of a national regional geological mapping data organization and retrieval method of the present application is shown;

[0030] Figure 2 A structural schematic diagram of a national regional geological mapping data organization and retrieval system of the present application is shown. DETAILED DESCRIPTION

[0031] In accordance with the requirements, specific embodiments of the present application are disclosed herein. It should be understood, however, that the disclosed embodiments are merely examples of the present application, which can be embodied in various and alternative forms. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims. It is to be understood that the figures and detailed descriptions thereof are not intended to limit the present application to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the scope of the claims. As used throughout this application, the word "may" is used in the permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must). Similarly, the words "include," "including," and "includes" mean including, but not limited to. Furthermore, the term "a" is understood to mean "at least one" and the term "multiple" is understood to mean one or more, unless otherwise indicated. In using abbreviations or technical terms, these refer to the generally accepted meanings known in the art.

[0032] Referring to Figure 1 The national regional geological mapping data retrieval method of the present application comprises: (1) a user initiates a data query request from a client; (2) parsing the data query request to obtain retrieval constraint conditions; generally, the retrieval constraint conditions mainly include spatial range constraints, attribute constraints, etc., and the retrieval constraint conditions can be customized and extended; (3) performing first-level retrieval in the associated information table of the PostgreSQL business database according to the retrieval constraint conditions to determine all related project numbers and sheet numbers; (4) performing second-level retrieval in the attribute information table of the business database according to the retrieval constraint conditions to retrieve all attribute records that meet the retrieval conditions under the related sheets; (5) grouping the retrieval results (such as field hand-drawn maps, exploration engineering libraries, sheet prb libraries, actual material maps, etc.) according to the types of geological mapping data, and merging the retrieval results of the same type of geological mapping data into one retrieval result set; (6) returning the retrieval results to the client and visually displaying them in the form of spatial graphics.

[0033] As a specific embodiment, the present application realizes the retrieval and result display of an interactive sharing service with a data storage system, organizes national regional geological mapping data with project-sheet-data type as the link, establishes the correlation between the multi-type data throughout the whole life cycle of regional geological mapping work, such as past geological data, field hand-drawn maps, measured profiles, field general map libraries, actual material maps, original maps for editing, spatial databases, regional geological survey reports, etc., and supports the comprehensive storage and rapid retrieval of national regional geological survey data.

[0034] As a specific embodiment, the data storage system comprises: a data acquisition module for uploading a geological mapping data compression package to be warehoused and buffering and decompressing locally; a database management module for managing a PostgreSQL business database and a MinIO original file database in the system; an original file storage module for storing entity files of the geological mapping data and updating a storage path and file directory structure information to an association information table of the PostgreSQL business database; and a business data storage module for extracting attribute information, spatial position information and business association information of regional geological mapping data and storing into an attribute information table and an association information table of the PostgreSQL business database.

[0035] As a specific embodiment, the association information table system takes "hierarchical association and accurate mapping" as a design principle, and realizes traceable management of the whole life cycle of data through multi-table cooperation. The overall architecture includes a project information table, a sheet table, a DGSS data table, a file directory level table, a thumbnail table and various main tables, forming an association network of "project - sheet - data - attribute".

[0036] As a specific embodiment, the project information table and the sheet table: as the top index of data management, the project information table takes the project ID as the core primary key, and is associated with the project name, project cycle and other basic information to provide the project dimension attribution mark for all data; the sheet table establishes the mapping relationship between the project and the specific sheet through the association field of the sheet number and the project ID, realizes the first-level association of "project - sheet", and provides the first constraint dimension for data retrieval, as shown in Table 1.

[0037] Table 1

[0038]

[0039]

[0040] As a specific embodiment, the DGSS data table: as the hub of data classification management, its field design takes into account the multi-dimensional association requirements. Among them, the ID is the unique identifier, the sheet number and the project ID realize the association with the upper layer information, the data classification field corresponds to the field hand drawing, the exploration engineering library, the sheet PRB library, the actual material drawing, the original drawing for editing and the spatial database and other data types, and the data upload state field reflects the data warehousing state (in warehousing / warehoused / warehousing failure) in real time, which provides the basis for data validity check. As shown in Table 2.

[0041] Table 2

[0042]

[0043]

[0044] As a specific example, the file directory hierarchy table: adopts a tree structure design (through the parent-child association of ID and PID), accurately records the storage logic of the file. The basic attributes such as file name, file type and file size realize the rapid identification of the file, the file storage directory and the project field establish the association of physical storage location and business attribute, and the upload person field provides the responsibility subject information for data traceability. As shown in Table 3.

[0045] Table 3

[0046]

[0047]

[0048] As a specific example, the thumbnail table: for visual data such as geological photos, the original file management is realized through the photo name, format and storage directory, the thumbnail storage directory field optimizes the picture preview efficiency, and the project and geological point number fields associate the picture data with the specific geological work scene, and the photo serial number guarantees the orderliness of multiple pictures of the same point. As shown in Table 4.

[0049] Table 4

[0050]

[0051] As a specific example, the main table system is the core hub of the associated information table, and various main tables (field hand-drawing map main table, sheet prb library main table, etc.) realize unique identification through the ID field, the associated sheet ID and the project field are connected to the upper layer information, and the storage location field of the data in MinIO connects the channel of physical storage and logical management, finally realizes the seamless association of the DGSS data table and the attribute information table, and provides accurate data positioning basis for secondary retrieval.

[0052] As a specific example, the attribute information table is a key component of regional geological mapping data management, and cooperates with the associated information table to build a complete data management system. Its design combines with the geological mapping data standard specification, and realizes deep integration with business scenarios through the expansion field.

[0053] As a specific example, the attribute information table is designed according to the seven categories of geological mapping data, and each category of data corresponds to a set of independent attribute information table system. Taking the prb map library as an example, because it contains 14 layers such as geological points, point-to-point routes, and point-to-point boundaries, 14 attribute information tables are designed to match. The naming rule adopts the combination of "prefix + standard layer name", the prefix is unified as the data type identifier (such as the prefix of the prb map library is "prbmap_"), and the suffix is the layer name defined in the standard specification (such as the geological point layer name is "gpoint"), forming "prbmap_gpoint" and other standardized names. Other types of attribute information tables are similar, ensuring the uniformity and readability of the names, and facilitating quick identification of the type of data and the corresponding layer.

[0054] As a specific example, the structure of the attribute information table is based on the attributes defined in the standard specification, and rich business attribute fields are extended to build a field system that balances standardization and business adaptation. The core fields include: association identifier fields: project ID, map number, main table ID, which realize accurate association with project information table, map table and main table, and provide key link for cross-table query; management attribute fields: upload time, uploader, record data flow track, support data traceability and responsibility traceability; spatial attribute fields: integrate spatial coordinates and other information, provide data basis for spatial analysis and query; standard attribute fields: follow the fields defined in the standard specification of geological mapping data, guarantee the professionalism and universality of the data. Through the organic combination of these fields, the attribute information table not only meets the requirements of standardized management, but also realizes the deep integration with the business associated information table, laying a foundation for efficient management and application of data.

[0055] As a specific example, in order to improve the query efficiency, the attribute information table constructs a perfect index system for key extended fields. The project ID, map number and main table ID are indexed to speed up the field matching in multi-table association query; spatial fields are indexed to combine with the spatial indexing technology of PostGIS, which significantly improves the speed of spatial query. This indexing mechanism greatly shortens the response time of multi-table association query and spatial query, effectively solving the query performance bottleneck in the scenario of massive data. At the same time, relying on the powerful spatial analysis capability of PostGIS, the attribute information table supports various spatial relationship queries (such as inclusion, intersection, proximity, etc.) and spatial analysis operations (such as buffer analysis, overlay analysis, etc.), providing rich spatial data processing means for geological mapping work and enhancing the application value of data.

[0056] In one embodiment, regional geological mapping data retrieval adopts a multi-level progressive process of "project - sheet - data type - main table - attribute information table", and precise positioning is achieved through the key fields of the associated information table. The specific process is as follows: (1) project and sheet screening: taking the project ID as the entry, matching the associated sheet number from the sheet table, and determining the spatial data range covered by the project; (2) data type positioning: combining the sheet number and data type parameters, screening the records that meet the conditions in the DGSS data table, and extracting the data ID; (3) main table association: according to the data type (such as field sketch, sheet prb library, etc.), positioning to the corresponding main table, and obtaining the main table record through the data ID association, and clarifying the association relationship and data storage path of the attribute information table; (4) attribute information extraction: based on the association field (such as main table ID) in the main table, performing secondary retrieval in the corresponding attribute information table, combining the PostGIS spatial query capability, and realizing the collaborative extraction of attribute data and spatial information.

[0057] In one embodiment, the PostGIS-based spatial analysis engine performs diversified spatial query operations in the retrieval process: (1) buffer analysis query: by inputting point coordinates and buffer radius (such as 40 meters), the records in the attribute information table whose spatial fields fall within the range are screened, and batch extraction of surrounding data is realized; (2) point query: accurately matching the geological data corresponding to the specified coordinate point, supporting instant query triggered by clicking the map point; (3) multimedia data association: for a specified geological point, the thumbnail table is associated through the geological point number, distinguishing between photo points and sketch points, extracting the file storage address in MinIO, and realizing online browsing of photos and sketch maps through file conversion.

[0058] In one embodiment, project data hierarchical display and retrieval instances are performed. In the project data information query display page, the system realizes data display and retrieval through the following technical logic: range locking: taking the project ID as the index, determining the range of the sheet number from the sheet table, and combining the project ID and sheet number fields of the DGSS data table to determine the basic range of data retrieval; secondary retrieval: in the attribute information table, precise screening is performed through data classification, layer classification and spatial range parameters (such as latitude and longitude interval), and attribute data that meet the conditions are returned; interactive query: in the sheet data browsing scene, after the user triggers the attribute query instruction, the system captures the spatial coordinates of the map click point, calls the PostGIS buffer analysis interface, retrieves the associated data of the specified layer around the point, and realizes the real-time interaction of "click - analysis - feedback".

[0059] In one embodiment, the route data multimedia association query instance is carried out, in the route data browsing, the retrieval process of the photo and the sketch map adopts the "multi-field cooperative positioning" mechanism: attribute association: according to the project ID, the sheet number, the geological point number and the route number, matching record in the field route photo point attribute information table is matched, and the photo name and the like key identification are extracted;Multimedia mapping: through the photo name and the geological point number association thumbnail table, the photo or sketch map record meeting the condition is filtered, and the file storage address in MinIO is acquired;Safe transmission: the file stream is converted into Base64 encoding, and after encryption processing, it is transmitted to the front end, to ensure the safety of multimedia data in the display process.

[0060] As shown in Figure 2 The national regional geological mapping data retrieval system of the application comprises a query request analysis module, a first retrieval module, a second retrieval module, a result arrangement module and a result visualization module. The query request analysis module is used for analyzing a data query request and obtaining retrieval constraint conditions;The first retrieval module is used for performing first-level retrieval in an associated information table of a business database according to the retrieval constraint conditions, to determine all relevant project numbers and sheet numbers;The second retrieval module is used for performing second-level retrieval in an attribute information table of the business database according to the retrieval constraint conditions, to retrieve all attribute records meeting the retrieval conditions under the relevant sheets;The result arrangement module is used for grouping the retrieval results and merging the retrieval results of the same type of geological mapping data into one retrieval result set;The result visualization module visually displays the retrieval results in the form of spatial graphics.

[0061] In view of the sensitivity of geological spatial data, the system constructs a security protection system from the interface layer: parameter encryption: the interface parameters (such as coordinate information, project ID) are processed by using an asymmetric encryption algorithm to prevent information leakage during transmission;Interface authentication: through a token (Token) verification mechanism, the identity of the calling party is checked for legality, and only authorized users can access the core interface.

[0062] The application realizes the high unification of "business logic-storage logic-retrieval logic" of data management. Through the structured field design, various information tables not only maintain independent management functions, but also form an organic whole through key fields, avoiding the problem of data island. For the geological mapping business, this technical architecture not only meets the efficiency requirement of data retrieval, but also provides geological workers with the whole-process traceability from project planning to data application through the multi-dimensional association of projects, sheets and data types, and lays a good foundation for the effective management of regional geological mapping data.

[0063] The above explanation of the application is not limited to the foregoing embodiments and drawings, and it is obvious to those skilled in the art of the application that various substitutions, modifications and changes can be made without departing from the scope of the application.

Claims

1. A method for organizing and retrieving data for national regional geological mapping, characterized in that, The method comprises the following steps: A user initiates a data query request from a client; The data query request is parsed to obtain a search constraint condition; First-level search is performed in an associated information table of a business database according to the search constraint condition to determine all relevant project numbers and sheet numbers; Second-level search is performed in an attribute information table of the business database according to the search constraint condition to search for all attribute records that meet the search condition under the relevant sheets; The search results are grouped according to the types of regional geological mapping data, and the search results of the same type of regional geological mapping data are merged into one search result set; The search results are returned to the client and visually displayed in the form of spatial graphics.

2. The method for organizing and retrieving national regional geological mapping data according to claim 1, characterized in that, The associated information table comprises a project information table, a sheet table, a DGSS data table, a file directory hierarchy table, a thumbnail table and various main tables, forming an associated network of project-sheet-data-attribute.

3. The method of claim 2, wherein the method is characterized by, The first-level search in the associated information table of the business database according to the search constraint condition to determine all relevant project numbers and sheet numbers comprises the following steps: Taking the project ID as an entry, the associated sheet numbers are matched from the sheet table to determine the spatial data range covered by the project; According to the sheet number and the data type parameter, the records meeting the condition are filtered from the DGSS data table to extract the data ID; According to the data type, the corresponding main table is located, the main table record is obtained through the data ID association to clarify the association relationship of the attribute information table and the data storage path.

4. The method of claim 3, wherein the method further comprises: The attribute information table is designed according to the seven categories of geological mapping data, and each category of data corresponds to an independent attribute information table system, which comprises an association identifier field, a management attribute field, a spatial attribute field and a standard attribute field.

5. The method of claim 4, wherein the method further comprises: The second-level search in the attribute information table of the business database according to the search constraint condition to search for all attribute records that meet the search condition under the relevant sheets comprises the following steps:

6. A national regional geological mapping data organization and retrieval system characterized by, Based on the association field in the main table, second-level search is performed in the corresponding attribute information table, and attribute data and spatial information are cooperatively extracted through the PostGIS spatial query capability. The method comprises the following steps: A query request parsing module is configured to parse a data query request and obtain a search constraint condition; A first search module is configured to perform first-level search in an associated information table of a business database according to the search constraint condition to determine all relevant project numbers and sheet numbers; A second search module is configured to perform second-level search in an attribute information table of the business database according to the search constraint condition to search for all attribute records that meet the search condition under the relevant sheets; A result arrangement module is configured to group the search results and merge the search results of the same type of geological mapping data into one search result set; A result visualization module is configured to visually display the search results in the form of spatial graphics.

Images