Geological data retrieval method and device based on word segmentation and weighted retrieval, medium and product
Through the geological data retrieval method based on word segmentation and weighted retrieval, the problem of insensitivity of database field weights in traditional retrieval methods is solved through word segmentation index construction and dynamic weight adjustment, and higher retrieval accuracy and flexibility are achieved.
Patent Information
- Application Number
- CN202510732982.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-03
- Publication Date
- 2025-09-12
AI Technical Summary
Traditional geological data retrieval methods cannot effectively distinguish the importance of different database fields, resulting in low retrieval accuracy.
A method based on word segmentation and weighted retrieval is adopted. Through word segmentation index construction and dynamic weight adjustment, the total weight is determined according to the different field information of geological data, and data matching high-weight fields are returned first.
It improves the accuracy of geological data retrieval and significantly enhances the accuracy and flexibility of retrieval.
Smart Images
Figure CN120632067A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of geological data information retrieval, and in particular to a geological data retrieval method, device, medium and product based on word segmentation and weighted retrieval. Background Art
[0002] This vast amount of geological data has formed a vast database, encompassing both original and refined geological data in various formats, including text, charts, audio, and video, as well as physical geological data such as rock cores and specimens. This data is not only extremely valuable in geological research but also plays a vital role in a variety of fields, including mineral resource development, environmental monitoring, and urban planning.
[0003] Traditional geological data retrieval is primarily accomplished through full-text search technology. Full-text search is based on word segmentation. In typical data retrieval, various textual information within the data is aggregated to form a large text file. This large text file is then segmented and indexed. During the search phase, user-entered words are analyzed and matched against the pre-defined word segmentation index, returning matching records. However, for geological data, this method cannot effectively distinguish the importance of information in different database fields, is insensitive to the weighting of different database fields, and therefore suffers from low retrieval accuracy. Summary of the Invention
[0004] The purpose of this application is to provide a geological data retrieval method, device, medium and product based on word segmentation and weighted retrieval to solve the problem of low accuracy of geological data retrieval based on word segmentation and weighted retrieval.
[0005] To achieve the above objectives, this application provides the following solutions:
[0006] In a first aspect, the present application provides a geological data retrieval method based on word segmentation and weighted retrieval, comprising:
[0007] Get the search keywords entered by the user;
[0008] Segmenting the search keyword to obtain a search segmentation result contained in the search keyword; the search segmentation result includes: a plurality of search segmentations;
[0009] Comparing the search word segmentation result with all word segmentation indexes in various geological data documents to obtain multiple geological data documents to be screened;
[0010] Determine the total weight of each geological data document based on the hit status of all field information in each geological data document to be screened;
[0011] The geological data document to be screened with the highest total weight is determined as the target geological data document to complete the geological data retrieval.
[0012] In one embodiment, each word segmentation index in each geological data document is preset.
[0013] In one embodiment, the pre-setting process of each word segmentation index in any geological data document includes:
[0014] Extracting segmentation words from each field of information in the geological data document; the segmentation words include: name segmentation words, mineral type segmentation words, formation unit segmentation words, work area segmentation words and content summary segmentation words;
[0015] Create corresponding word segmentation indexes for each word segmentation.
[0016] In one embodiment, based on each field information in the geological data document, the segmentation words in each field information are extracted, including:
[0017] According to the author field information in the geological data document, the name segmentation is extracted;
[0018] Extract mineral type segmentation words based on the mineral type field information in the geological data document;
[0019] Extracting the formation unit segmentation according to the formation unit field information in the geological data document;
[0020] Extract the working area segmentation words according to the working area field information in the geological data document;
[0021] According to the content summary field in the geological data document, the content summary word segmentation is extracted.
[0022] In one embodiment, the search segmentation result is compared with all segmentation indexes in each geological data document to obtain a plurality of geological data documents to be screened, including:
[0023] A geological data document having at least one segmentation index matching a search segmentation in the search segmentation result is determined as a geological data document to be screened.
[0024] In one embodiment, the total weight of each geological data document is determined based on the hit status of all field information in each geological data document to be screened, including:
[0025] Determine any geological data file to be screened as the current geological data file;
[0026] Based on each segmentation index in the current geological data document and each search segmentation in the search segmentation result, determining a hit condition of field information corresponding to each segmentation index in the current geological data document;
[0027] Obtaining preset weights of field information corresponding to each word segmentation index in the current geological data document where the hit condition is hit;
[0028] The preset weights of the field information corresponding to all the word segmentation indexes in the current geological data document with a hit status are added together to obtain the total weight of the current geological data document.
[0029] In one embodiment, based on each segmentation index in the current geological data document and each search segmentation in the search segmentation result, determining a hit status of field information corresponding to each segmentation index in the current geological data document includes:
[0030] Determine any word segmentation index in the current geological data document as the current word segmentation index;
[0031] If the current word segmentation index matches the search word segmentation in the search word segmentation result, it is determined that the hit condition of the field information corresponding to the current word segmentation index is a hit.
[0032] In a second aspect, the present application provides a computer device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement any of the above-mentioned geological data retrieval methods based on word segmentation and weighted retrieval.
[0033] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the above-mentioned geological data retrieval methods based on word segmentation and weighted retrieval.
[0034] In a fourth aspect, the present application provides a computer program product, comprising a computer program, which, when executed by a processor, implements any of the above-mentioned geological data retrieval methods based on word segmentation and weighted retrieval.
[0035] According to the specific embodiments provided in this application, this application discloses the following technical effects:
[0036] The present application discloses a geological data retrieval method, device, medium and product based on word segmentation and weighted retrieval. First, the search keyword input by the user is obtained; then, the search keyword is segmented to obtain the search word segmentation result contained in the search keyword; the search word segmentation result includes: multiple search word segmentations; again, the search word segmentation result is compared with all the word segmentation indexes in each geological data document to obtain multiple geological data documents to be screened; then, based on the hit situation of all field information in each geological data document to be screened, the total weight of each geological data document is determined; finally, the geological data document to be screened with the highest total weight is determined as the target geological data document to complete the geological data retrieval. The present application compares the search keyword input by the user with the word segmentation index, and determines the total weight based on the hit situation of field information in the geological data document to be screened, and determines the geological data document to be screened with the highest total weight as the target geological data document. Compared with full-text retrieval, the present application sets different weights to improve the retrieval accuracy of geological data. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0038] Figure 1 This is an application environment diagram of a geological data retrieval method based on word segmentation and weighted retrieval in one embodiment of the present application;
[0039] Figure 2 A flowchart of a geological data retrieval method based on word segmentation and weighted retrieval provided in one embodiment of the present application;
[0040] Figure 3 Implement an architecture diagram for geological data retrieval methods based on word segmentation and weighted retrieval;
[0041] Figure 4 A schematic diagram of the structure of a computer device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0042] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0043] The purpose of this application is to provide a geological data retrieval method, device, medium and product based on word segmentation and weighted retrieval, aiming to improve the retrieval accuracy of geological data.
[0044] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.
[0045] The geological data retrieval method based on word segmentation and weighted retrieval provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the server 104 needs to process. The data storage system can be set up separately, integrated on the server 104, or placed on the cloud or other servers. The terminal 102 can send the search keywords entered by the user to the server 104. After the server 104 receives the search keywords entered by the user, the server 104 obtains the search keywords entered by the user; performs word segmentation on the search keywords to obtain the search word segmentation results contained in the search keywords; compares the search word segmentation results with all the word segmentation indexes in each geological data document to obtain multiple geological data documents to be screened; determines the total weight of each geological data document based on the hit status of all field information in each geological data document to be screened; determines the geological data document to be screened with the highest total weight as the target geological data document, and completes the geological data retrieval. The server 104 can feedback the obtained target geological data document to the terminal 102. In addition, in some embodiments, the geological data retrieval method based on word segmentation and weighted retrieval can also be implemented independently by the server 104 or the terminal 102. For example, the terminal 102 can directly perform geological data retrieval based on word segmentation and weighted retrieval for the retrieval keywords entered by the user, or the server 104 can obtain the retrieval keywords entered by the user from the data storage system and perform geological data retrieval based on word segmentation and weighted retrieval for the retrieval keywords entered by the user.
[0046] In an exemplary embodiment, Figure 2 As shown in FIG, a geological data retrieval method based on word segmentation and weighted retrieval is provided, including:
[0047] Step 1: Get the search keywords entered by the user.
[0048] Step 2: Segment the search keyword to obtain a search segmentation result contained in the search keyword; the search segmentation result includes: multiple search segmentations.
[0049] Specifically, natural text processing technology is used to segment the search keywords to obtain search segmentation results contained in the search keywords.
[0050] Step 3: Compare the search segmentation results with all segmentation indexes in various geological data documents to obtain multiple geological data documents to be screened.
[0051] As an optional implementation, each word segmentation index in each geological data document is preset.
[0052] As an optional implementation, in step 3, the pre-setting process of each word segmentation index in any geological data document includes:
[0053] Step 311: extracting the segmentation words in each field information according to each field information in the geological data document; the segmentation words include: name segmentation words, mineral type segmentation words, formation unit segmentation words, work area segmentation words and content summary segmentation words.
[0054] Specifically, natural text processing technology is used to extract the segmented words in each field information according to each field information in the geological data document.
[0055] As an optional implementation, step 311 includes:
[0056] Step 3111: Extract the name segmentation based on the author field information in the geological data document.
[0057] Step 3112: Extract the mineral type segmentation words based on the mineral type field information in the geological data document.
[0058] Step 3113: Extract the formation unit segmentation according to the formation unit field information in the geological data document.
[0059] Specifically, the formation unit refers to the organization that travels and compiles geological data documents.
[0060] Step 3114: Extract the working area segmentation words based on the working area field information in the geological data document.
[0061] Specifically, the working area refers to the area for which the geological data document is studied.
[0062] Step 3115: extract the content summary word segmentation according to the content summary field in the geological data document.
[0063] Step 312: Create a corresponding word segmentation index for each word segmentation.
[0064] Specifically, different word segmentation indexes are established according to different word segmentation source fields, including 4 high-weight field word segmentation indexes and 1 ordinary weight word segmentation index. The high-weight field word segmentation indexes include: name word segmentation index, mineral type word segmentation index, formation unit word segmentation index and work area word segmentation index.
[0065] As an optional implementation, step 3 includes:
[0066] Step 321: Determine a geological data document having at least one segmentation index matching a search segmentation in the search segmentation result as a geological data document to be screened.
[0067] Step 4: Determine the total weight of each geological data document based on the hit status of all field information in each geological data document to be screened.
[0068] As an optional implementation, step 4 includes:
[0069] Step 41: Determine any geological data document to be screened as the current geological data document.
[0070] Step 42: Based on each segmentation index in the current geological data document and each search segmentation in the search segmentation result, determine the hit status of the field information corresponding to each segmentation index in the current geological data document.
[0071] As an optional implementation, step 42 includes:
[0072] Step 421: Determine any word segmentation index in the current geological data document as the current word segmentation index.
[0073] Step 422: If the current word segmentation index matches the search word segmentation in the search word segmentation result, then the hit status of the field information corresponding to the current word segmentation index is determined to be a hit.
[0074] Step 43: Obtain the preset weight of the field information corresponding to each word segmentation index in the current geological data document in which the hit condition is hit.
[0075] Step 44: Add the preset weights of the field information corresponding to all the word segmentation indexes in the current geological data document with a hit status to obtain the total weight of the current geological data document.
[0076] Step 5: Determine the geological data document to be screened with the highest total weight as the target geological data document to complete the geological data retrieval.
[0077] The implementation architecture of the geological data retrieval method based on word segmentation and weighted retrieval in this application is as follows: Figure 3 As shown, the implementation architecture includes: index management unit, search word segmentation unit, search keyword cache unit, full-text search matching unit and weighted enhancement unit. The execution steps of the implementation architecture include:
[0078] S1: Extract the segmented words in each field information according to each field information in the geological data document.
[0079] S2: Create a corresponding word segmentation index for each word segmentation, and store all word segmentation indexes in an index management unit.
[0080] S3: The search word segmentation unit uses natural text processing technology to segment the search keyword input by the user, obtains the search word segmentation result contained in the search keyword, and transfers the search word segmentation result to the search keyword cache unit.
[0081] S4: The full-text search matching unit receives the search word segmentation results in the search keyword cache unit, compares them with the word segmentation index in the index management unit, finds the geological data document containing the search word segmentation results based on the word segmentation index, and summarizes them to form a hit geological data catalog list.
[0082] S5: The hit geological data catalog list generated by the full-text search matching unit is input into the weighted enhancement unit. The weighted enhancement unit analyzes the hit geological data catalog list output by the full-text search matching unit, reads the weight of each field information pre-configured in the index management unit, and calculates the weight of each geological data document to be screened in the hit geological data catalog list generated by the full-text search matching unit. If the author field of a record is a hit, the record is weighted w1; if the mineral type field is a hit, the record is weighted w2, and so on. For other common fields, the default weight wn is used. Finally, the target geological data documents are returned in descending order of their matched weights.
[0083] This application mainly addresses the problem that traditional full-text retrieval is insensitive to the weights of different database fields of geological data and has low retrieval accuracy. By constructing a field-by-field index, a word-by-field index is formed. During the retrieval phase, dynamic weight adjustments are made based on the weights of different fields of geological data, so that data that match high-weight fields such as authors and mineral types are returned first, thereby significantly improving retrieval accuracy.
[0084] The preset weights of the field information proposed in this application can be dynamically adjusted and set during the retrieval phase. After the adjustment, there is no need to rebuild the existing index, which greatly improves the flexibility of the system.
[0085] In an exemplary embodiment, a computer device is provided, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement a geological data retrieval method based on word segmentation and weighted retrieval.
[0086] In an exemplary embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, a geological data retrieval method based on word segmentation and weighted retrieval is implemented.
[0087] In an exemplary embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements a geological data retrieval method based on word segmentation and weighted retrieval.
[0088] In an exemplary embodiment, a computer device is provided. The computer device may be a server or a terminal. The internal structure diagram thereof may be as follows: Figure 4 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O) and a communication interface. The processor, memory and input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a geological data retrieval method based on word segmentation and weighted retrieval is implemented.
[0089] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.
[0090] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM may be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0091] The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processors involved in the various embodiments provided herein may include, but are not limited to, general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic units, data processing logic units based on quantum computing, and the like.
[0092] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0093] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0094] This document uses specific examples to illustrate the principles and implementation methods of this application. The description of the above examples is only intended to help understand the method and core concept of this application. At the same time, for those skilled in the art, based on the concept of this application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.
Claims
1. A geological data retrieval method based on word segmentation and weighted retrieval, characterized in that: The geological data retrieval method based on word segmentation and weighted retrieval includes: Get the search keywords entered by the user; Segmenting the search keyword to obtain a search segmentation result contained in the search keyword; the search segmentation result includes: a plurality of search segmentations; Comparing the search word segmentation result with all word segmentation indexes in various geological data documents to obtain multiple geological data documents to be screened; Determine the total weight of each geological data document based on the hit status of all field information in each geological data document to be screened; The geological data document to be screened with the highest total weight is determined as the target geological data document to complete the geological data retrieval.
2. The geological data retrieval method based on word segmentation and weighted retrieval according to claim 1, characterized in that: The word segmentation indexes in each geological data document are pre-set.
3. The geological data retrieval method based on word segmentation and weighted retrieval according to claim 2 is characterized in that: The pre-setting process of each word index in any geological data document includes: Extracting segmentation words from each field of information in the geological data document; the segmentation words include: name segmentation words, mineral type segmentation words, formation unit segmentation words, work area segmentation words and content summary segmentation words; Create corresponding word segmentation indexes for each word segmentation.
4. The geological data retrieval method based on word segmentation and weighted retrieval according to claim 3 is characterized in that: According to the information of each field in the geological data document, the word segmentation in each field information is extracted, including: According to the author field information in the geological data document, the name segmentation is extracted; Extract mineral type segmentation words based on the mineral type field information in the geological data document; Extracting the formation unit segmentation according to the formation unit field information in the geological data document; Extract the working area segmentation words according to the working area field information in the geological data document; According to the content summary field in the geological data document, the content summary word segmentation is extracted.
5. The geological data retrieval method based on word segmentation and weighted retrieval according to claim 1 is characterized in that: The search word segmentation results are compared with all word segmentation indexes in various geological data documents to obtain multiple geological data documents to be screened, including: A geological data document having at least one segmentation index matching a search segmentation in the search segmentation result is determined as a geological data document to be screened.
6. The geological data retrieval method based on word segmentation and weighted retrieval according to claim 1 is characterized in that: Based on the hit status of all field information in each geological data document to be screened, the total weight of each geological data document is determined, including: Determine any geological data file to be screened as the current geological data file; Based on each segmentation index in the current geological data document and each search segmentation in the search segmentation result, determining a hit condition of field information corresponding to each segmentation index in the current geological data document; Obtaining preset weights of field information corresponding to each word segmentation index in the current geological data document where the hit condition is hit; The preset weights of the field information corresponding to all the word segmentation indexes in the current geological data document with a hit status are added together to obtain the total weight of the current geological data document.
7. The geological data retrieval method based on word segmentation and weighted retrieval according to claim 6 is characterized in that: Based on each segmentation index in the current geological data document and each search segmentation in the search segmentation result, determining a hit condition of field information corresponding to each segmentation index in the current geological data document, including: Determine any word segmentation index in the current geological data document as the current word segmentation index; If the current word segmentation index matches the search word segmentation in the search word segmentation result, it is determined that the hit condition of the field information corresponding to the current word segmentation index is a hit.
8. A computer device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the geological data retrieval method based on word segmentation and weighted retrieval as described in any one of claims 1 to 7.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the geological data retrieval method based on word segmentation and weighted retrieval described in any one of claims 1 to 7 is implemented.
10. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the geological data retrieval method based on word segmentation and weighted retrieval described in any one of claims 1 to 7 is implemented.