A method and system for extracting, identifying and comparing information of international cooperative visit plans

Through the information extraction and identification comparison method of international cooperation visit plan information extraction and identification comparison method, similar plans are screened out using data retrieval and similarity comparison algorithm, which solves the problems of inaccurate information identification and delayed approval in international cooperation management, and improves management efficiency and cooperative execution efficiency .

CN118658172BActive Publication Date: 2024-11-29DEV RES CENT OF CHINA GEOLOGICAL SURVEY
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410812037.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-06-21
Publication Date
2024-11-29
Estimated Expiration
2044-06-21

AI Technical Summary

Technical Problem

The inefficient management of international cooperation visit plans has led to inaccurate information identification and delayed approval, which affects the cooperation process, and it is difficult to efficiently sort out and classify it in massive applications.

Method used

A method for extracting and identifying information comparison of international cooperation visit plans is proposed, and similar plans are extracted and screened from the international cooperation plan declaration database using preset data retrieval, primary and secondary similarity comparison algorithm, and auxiliary factor similarity plan comparison algorithm. , realize fast and accurate information extraction and comparison.

Benefits of technology

It has improved the level of international cooperation management and service, achieved rapid approval and processing of international cooperation plans, enhanced the effectiveness of international cooperation implementation, and ensured information accuracy and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118658172B_ABST
    Figure CN118658172B_ABST
Patent Text Reader

Abstract

The present invention discloses a method and system for extracting, identifying and comparing information of international cooperation plans for overseas visits, the method comprising performing a primary comparison between an international cooperation plan to be compared and an international cooperation plan in a declaration database to screen out international cooperation plans similar to the international cooperation plan to be compared, performing a secondary comparison method based on comparing international cooperation plans in a primary international cooperation plan screening pool with international cooperation plans to be compared to screen out international cooperation plans similar to the international cooperation plan to be compared, marking and sorting plans in a secondary international cooperation plan screening pool based on the importance of auxiliary factors in the identified international cooperation plans and the comparison method, and realizing accurate marking and auxiliary comparison of similar international cooperation plans. The present invention can realize rapid extraction, accurate identification, step-by-step screening, hierarchical comparison and auxiliary marking of international cooperation information, and thus has important significance for serving the daily management and optimization adjustment of international cooperation plans.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of information extraction, and in particular to a method and system for extracting, identifying and comparing information on international cooperative visit plans. Background Art

[0002] In recent years, the rapid development of science and technology has greatly promoted the innovation of theories, technologies and methods in the field of geological survey. The emergence of many novel geological survey theories, technologies and methods has not only provided stronger support for geological work, but also greatly enriched human knowledge and understanding of the earth.

[0003] In order to promote my country's advanced geological survey technology and practical experience, and learn advanced foreign theories and equipment, international cooperation in geological survey has gradually opened up and deepened exchanges in recent years. The China Geological Survey system has reported an increasing number of international cooperation plans for visits and exchanges and invitations to China each year. These international cooperation plans involve multiple disciplines, with rich and diverse cooperation content, high personnel mobility, and many participating units. While greatly promoting international cooperation and exchanges in geological surveys, they have undoubtedly brought many challenges to the management of international cooperation plans such as approval, information classification, and submission and processing.

[0004] International cooperation has a long working cycle and involves many people, methods and equipment. In particular, bilateral or multilateral cooperation involves many factors such as politics, diplomacy and international influence. In the past, the approval process of international cooperation plans required a lot of human, material and financial resources to support and strictly control, which would lead to low efficiency in management and service work. Inaccurate identification of international cooperation information often occurs, and the timeliness of submission and approval is seriously affected. Not only does it delay the approval time of visiting and inviting visitors, but it may also cause cooperation impacts due to wrong information submission and approval, damage the rights and interests of both parties in international cooperation, and even have an adverse impact on the progress of cooperation. When dealing with a large number of international cooperation plan applications, how to efficiently organize and classify these plans in an orderly manner, accurately capture key information in international cooperation, and quickly realize the extraction, accurate identification, hierarchical comparison and auxiliary marking of this information has become a major challenge facing international cooperation management. Therefore, international cooperation management requires a set of efficient auxiliary processing solutions to support the integration of international cooperation plans and the elimination of redundant plans, so as to strengthen the top-level design of the China Geological Survey system in international cooperation, improve the level of integrated management and the ability to cooperate in overseas visits, and thus form a joint force to significantly enhance the effectiveness of international cooperation execution. Summary of the invention

[0005] The present invention aims to solve one of the technical problems in the related art at least to a certain extent.

[0006] To this end, the present invention proposes a method for extracting, identifying and comparing international cooperation visit plan information, establishes an algorithm model, can accurately identify international cooperation information, and realize rapid extraction, accurate identification, layered comparison, and efficient merging of international cooperation. It can meet the needs of assisting in the rapid approval and processing and adjustment of international cooperation plans, and comprehensively improve the level of international cooperation management and services.

[0007] Another object of the present invention is to provide an international cooperative visit plan information extraction and identification comparison system.

[0008] To achieve the above-mentioned purpose, the present invention proposes, on one hand, a method for extracting and identifying international cooperative visit plan information, comprising:

[0009] The international cooperation plans to be compared are extracted from the international cooperation plan application database using the preset data retrieval method;

[0010] Using the initial similarity comparison algorithm, the international cooperation plan to be compared is compared with the cooperation plans in the international cooperation plan application database to screen out similar international cooperation plans, so as to construct an initial international cooperation plan screening pool and realize rapid preliminary screening of similar international cooperation plans;

[0011] Using a secondary similarity comparison algorithm, the international cooperation plan to be compared is compared with the international cooperation plans in the primary international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool and realize accurate screening of similar international cooperation plans;

[0012] The auxiliary factor similar plan comparison and marking algorithm is used to judge and mark the plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plans according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results, thereby realizing accurate marking and auxiliary comparison of similar international cooperation plans.

[0013] The method for extracting and identifying international cooperative visit plan information according to the embodiment of the present invention may also have the following additional technical features:

[0014] In one embodiment of the present invention, the international cooperation plan to be compared is extracted from the international cooperation plan application database using a preset data retrieval method, including:

[0015] Using Boolean logic operators to search and extract international cooperation plans containing search keywords from the international cooperation plan application database; and,

[0016] Use the field-limited search method to set the field information of the international cooperation plan to be searched, and set the content to be searched for different field information, so as to search and extract the international cooperation plan application database through matching searches of multiple fields to extract the individual international cooperation plans that need to be approved;

[0017] The international cooperation plans to be compared are determined based on the individual international cooperation plans that require approval.

[0018] In one embodiment of the present invention, the international cooperation plan to be compared is compared with the cooperation plans in the international cooperation plan application database using a primary similarity comparison algorithm to screen out similar international cooperation plans, so as to construct a primary international cooperation plan screening pool, including:

[0019] Acquire the first international cooperation plan to be compared, traverse the international cooperation plans in the international cooperation plan declaration database, sequentially acquire the second international cooperation plan, and use a special character algorithm to delete all special characters in the first international cooperation plan and the second international cooperation plan to be compared, so as to obtain a text string of the first international cooperation plan and a text string of the second international cooperation plan without special characters;

[0020] Performing character conversion on the first international cooperation plan text string and the second international cooperation plan text string using a character conversion algorithm to obtain a character set of the first international cooperation plan text and a character set of the second international cooperation plan text;

[0021] Calculate the length of the first international cooperation plan text character set, calculate the length of the second international cooperation plan text character set, and compare the lengths of the first international cooperation plan and the second international cooperation plan character set;

[0022] The international cooperation plan text character set with a shorter character set length is traversed from left to right, and it is determined whether each character is included in the international cooperation plan character set with a longer character set length, and the total number of included characters is recorded.

[0023] The number of characters included is compared with the length of the longer character set, and then percentage processing is performed to obtain the percentage of similar characters. If the similarity percentage is greater than a preset first similarity threshold, the second international cooperation plan to be compared is placed in the initial international cooperation plan screening pool.

[0024] In one embodiment of the present invention, a secondary similarity comparison algorithm is used to perform a secondary comparison between the international cooperation plan to be compared and the international cooperation plans in the primary international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool, including:

[0025] Using the NPL corpus to perform word segmentation analysis on the first international cooperation plan to be compared, so as to obtain the text characters of the first international cooperation plan after word segmentation analysis, and judging whether the text characters of the first international cooperation plan contain the country name, if so, extracting the first country name;

[0026] A special character extraction and filtering algorithm function is established by using regular expressions to filter the special characters of the first international cooperation plan string, and the special characters are deleted to obtain the text of the first international cooperation plan without special characters;

[0027] Using the NPL stop word corpus to filter the text characters, and deleting the stop words under the preset conditions to obtain the processed text;

[0028] Processing the processed text characters to delete character information related to the year to obtain a pre-processed text;

[0029] Traversing the initial international cooperation plan screening pool, analyzing and processing the international cooperation plans in the initial international cooperation plan screening pool to obtain the second country name of the second international cooperation plan;

[0030] Determine whether the first country name is the same as the second country name; if they are the same, delete the country name from the first international cooperation plan and the second international cooperation plan based on the obtained second country name; if the country names are different, retain the country names in the texts of the first international cooperation plan and the second international cooperation plan;

[0031] The NPL word segmentation corpus was used to establish a corresponding replacement algorithm for the full names and abbreviations of units related to geological survey institutions, the full names and abbreviations of international conferences, and the Chinese names and English abbreviations of international conferences, and to unify the dimensions of the unit names and international conference names in the first and second international cooperation plans.

[0032] The cosine vector comparison algorithm is used to calculate the similarity results of the texts of the first international cooperation plan and the second international cooperation plan after data unification to obtain a similarity percentage. If the similarity percentage is greater than a preset second similarity threshold, the second international cooperation plan to be compared is placed in the secondary international cooperation plan screening pool.

[0033] In one embodiment of the present invention, the auxiliary factor similarity plan comparison algorithm is used to judge and mark the international cooperation plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plans according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results, including:

[0034] Extracting international cooperation plan auxiliary factors from the international cooperation plan application database, and sorting the international cooperation plan auxiliary factors according to their importance to obtain auxiliary factor sorting results;

[0035] Traversing the international cooperation plans in the secondary international cooperation plan screening pool, and determining the mutual relationship between the auxiliary factors in the international cooperation plan to be compared and the international cooperation plans traversed in the secondary international cooperation plan screening pool in turn based on the extracted auxiliary factors combined with the auxiliary factor comparison logic processing method;

[0036] Based on the mutual relationship of the auxiliary factors, the traversed international cooperation plans are judged and marked and sorted according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results.

[0037] To achieve the above-mentioned purpose, the present invention further provides a system for extracting and identifying international cooperative visit plan information, comprising:

[0038] The original plan extraction module is used to extract the international cooperation plan to be compared from the international cooperation plan application database using a preset data retrieval method;

[0039] A first screening pool determination module is used to use a primary similarity comparison algorithm to compare the international cooperation plan to be compared with the cooperation plans in the international cooperation plan application database to screen out similar international cooperation plans, so as to construct a primary international cooperation plan screening pool and realize rapid preliminary screening of similar international cooperation plans;

[0040] A second screening pool determination module is used to use a secondary similarity comparison algorithm to perform a secondary comparison between the international cooperation plan to be compared and the international cooperation plans in the primary international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool and realize accurate screening of similar international cooperation plans;

[0041] The final screening pool determination module is used to use the auxiliary factor similarity plan comparison and marking algorithm to judge and mark the plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plans according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results, and realize accurate marking and auxiliary comparison of similar international cooperation plans.

[0042] The method and system for extracting, identifying and comparing international cooperation visit plan information of the embodiment of the present invention accurately identifies international cooperation information, realizes rapid extraction, accurate identification, hierarchical comparison and auxiliary marking of international cooperation, assists in the rapid adjustment, approval and other needs of international cooperation plans, and comprehensively improves the management and service level of international cooperation. In combination with the characteristics of international cooperation business, the structure and comprehensive content of international cooperation information are analyzed, and a dedicated word segmentation corpus in the field of geological survey and international cooperation is created by designing the technical process of international cooperation information identification and information processing. In combination with the NLP natural language processing algorithm and the auxiliary factor processing judgment method, an international cooperation text information similarity identification program is developed, and a three-level model for international cooperation information identification and processing is established. The method and algorithm of step-by-step comparison, hierarchical screening and gradual refinement are used to realize the identification, extraction and comparison of multiple categories of international cooperation information, which can provide efficient and accurate auxiliary tools for international cooperation management, information services and business approval, so as to initially achieve the expected purpose of international cooperation management.

[0043] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0045] Figure 1 is a flow chart of a method for extracting and identifying and comparing international cooperative visit plan information according to an embodiment of the present invention;

[0046] Figure 2 1. It is a model architecture diagram of the method for extracting, identifying and comparing international cooperative visit plan information according to an embodiment of the present invention;

[0047] Figure 3 is a logic flow chart of the comparison of auxiliary factors of the international cooperation plan according to an embodiment of the present invention;

[0048] Figure 4 It is a structural diagram of a system for extracting, identifying and comparing international cooperative visit plan information according to an embodiment of the present invention. DETAILED DESCRIPTION

[0049] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0050] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0051] The following describes a method and system for extracting, identifying and comparing international cooperative visit plan information according to an embodiment of the present invention with reference to the accompanying drawings.

[0052] Figure 1 FIG. 1 is a flow chart of a method for extracting and identifying international cooperative visit plan information according to an embodiment of the present invention. Figure 1 As shown, the method includes:

[0053] S1, using the preset data retrieval method to extract the international cooperation plans to be compared from the international cooperation plan declaration database.

[0054] It can be understood that the present invention first requires each international cooperation plan dispatching unit to fill in various information of the annual international cooperation plan, and realizes the storage of annual international cooperation plan information of each unit under the China Geological Survey through the international cooperation system platform, so as to form an international cooperation plan declaration database for each year.

[0055] Furthermore, through the convenient data retrieval and query function algorithm provided by the international cooperation system, the individual international cooperation plans that need to be approved are extracted as the international cooperation plans to be compared. Therefore, the international cooperation system has developed an information retrieval function. The present invention uses the existing Boolean operation retrieval method and the field-limited retrieval method to extract the international cooperation plans, such as Figure 2 shown.

[0056] It is understandable that the Boolean logic retrieval algorithm is a basic and important method in the field of information retrieval, which allows users to combine search terms through logical operators to accurately express information needs and filter out qualified records from the database. The Boolean logic retrieval algorithm process applied by the present invention is as follows:

[0057] Specifically, the program uses Boolean logic operators AND, OR, and NOT to judge the search terms and implement logical combination, so as to accurately find relevant information. For example: when a user searches for international cooperation plans that include both the keywords "World Geological Congress" and "France", the program searches through the Boolean logic AND keyword to find international cooperation plans that contain the same content as "World Geological Congress" and "France". Or when a user searches for international cooperation plans that include "zircon experimental testing" but do not include "Oceania", the result can also be obtained through Boolean logic operations. The Boolean logic search of the present invention may include the following steps:

[0058] 1) The user enters the search keyword (system setting: less than or equal to 3) and requires to extract all international cooperation plans containing keyword A, keyword B and keyword C, then the Boolean logic judgment and is used for retrieval;

[0059] 2) The user enters the search keywords (system setting: less than or equal to 3) and requires to extract all international cooperation plans containing keyword A and keyword B but not keyword C, then the Boolean logic judgment and and not are used for retrieval;

[0060] 3) The user enters the search keyword (system setting: less than or equal to 3) and requires to extract all international cooperation plans containing keyword A, keyword B, or keyword C, then the Boolean logic judgment or is used for retrieval.

[0061] Therefore, international cooperation plans can be combined and retrieved through Boolean logic judgment.

[0062] It is understood that field-limited retrieval is a technique for precisely controlling the information retrieval process, which allows the user to specify which specific fields of the database records the search terms should match. This method helps to improve the accuracy and efficiency of retrieval and avoid interference from irrelevant information. The process of the field-limited retrieval method used in the present invention is as follows:

[0063] Specifically, the field information of international cooperation plans can be set for retrieval and query, such as unit, institution, year, type and other fields. Users set the content to be searched for different fields. For example, the visiting unit is "Chengdu Geological Survey Center of China Geological Survey", the visiting year is 2023, and the visiting institution is "Australian Geological Survey". The retrieved international cooperation plans are queried and extracted through the matching of these three fields.

[0064] Therefore, the system provides multiple fields to limit the search conditions and extract international cooperation plans.

[0065] Therefore, the international cooperation plans that need to be compared are retrieved and extracted by using a mixed search method of Boolean logic operations and field restrictions. The international cooperation plans to be compared can be compared individually (one-to-one) or one-to-many (one-to-many). In this system, the international cooperation plans to be compared are usually compared with multiple other plans in the international cooperation plan declaration database.

[0066] S2, using the initial similarity comparison algorithm to compare the international cooperation plan to be compared with the cooperation plans in the international cooperation plan declaration database to screen out similar international cooperation plans, so as to build an initial international cooperation plan screening pool and realize rapid preliminary screening of similar international cooperation plans.

[0067] It is understandable that the present invention sets up a primary similarity comparison algorithm, sets a first similarity threshold (50% is the empirical optimal value, and the user can configure different weights such as 60%, 70%... based on the amount of data and needs), screens similar international cooperation plans, and forms a primary international cooperation plan screening pool to achieve the purpose of rapid rough screening and retrieval filtering. The purpose of the initial screening of the present invention is to quickly screen out an international cooperation plan comparison library (pool) that meets the similarity threshold from a large number of international cooperation plans, so as to achieve the purpose of rapid preliminary comparison. The specific steps of the initial similarity comparison algorithm are as follows:

[0068] Step 1: Use the search program (function) provided by the system to obtain an international cooperation plan A that meets the requirements and needs to be compared.

[0069] Step 2: Develop and establish a regular expression function program, use the regular expression function program to filter special characters (-? "!"!'', / &~ and other symbols) of International Cooperation Plan A, and delete all special characters to obtain the character text of International Cooperation Plan A without special characters.

[0070] Step 3: Use a character conversion program to convert the character text of the International Cooperation Plan A obtained in Step 2 into pinyin letters to obtain the International Cooperation Plan A character set.

[0071] Step 4: Traverse all international cooperation plans submitted by various units in the system, and select the international cooperation plan J to be compared in sequence, and perform step 2 (special character filtering processing) and step 3 (character set conversion) on the international cooperation plan J to obtain the text character set of the international cooperation plan J to be compared.

[0072] Step 5: Develop a character matching algorithm, start comparing the character set of International Cooperation Program A that has been converted into phonetic letters with the character set of International Cooperation Program J, and compare the lengths of the two character sets.

[0073] Step 6: Get the international cooperation plan with a shorter character set length, and traverse all characters in the international cooperation plan character set from left to right, and determine whether the character is included in the international cooperation plan character set with a longer character set length, until all letters are traversed, and the total number of included characters is recorded as TolCount.

[0074] Step 7: Divide TolCount by the longer character set length LenAJ after converting International Cooperation Plan A and International Cooperation Plan J into character sets, and percentile the quotient to finally obtain the similarity percentage SimJ.

[0075] Step 8: According to the weight factor configured by the user (50%, 60%... users can set different weights), determine whether SimJ is greater than the weight factor. If it is greater than the weight factor, put the international cooperation plan J into the list of international cooperation plans for the initial screening (screening pool) and wait for the second screening. International cooperation plans with a weight factor less than the weight factor will not be recorded.

[0076] Step 9: Repeat step 4 to traverse and compare other international cooperation plans until all plans have been traversed.

[0077] Therefore, in the text content processing of international cooperation plans, especially in the comparison algorithm design stage, considering the diversity of texts, language differences, the usage habits of special symbols and possible noise information, it is particularly important to add filtering algorithms for characters and special contents and set reasonable threshold comparison and screening. The present invention uses the initial similarity comparison algorithm, combined with the characteristics of international cooperation plans, to ensure that the algorithm meets business needs. At the same time, it uses technical means to effectively filter out irrelevant noise and relatively accurately extract valuable information, which is the key to improving the comparison effect.

[0078] S3, using the secondary similarity comparison algorithm, conducts a secondary comparison between the international cooperation plan to be compared and the international cooperation plans in the primary international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool and realize accurate screening of similar international cooperation plans.

[0079] It is understandable that before the secondary screening, it is necessary to establish an NLP geological survey international cooperation word segmentation corpus to form a sub-corpus of word segmentation such as employee lists, countries and regions, international conferences, cooperative institutions, dispatching units, and stop words, to provide a basis for the NLP-based secondary screening and comparison algorithm. The corpus here refers to a dedicated corpus, which needs to be expanded and established by itself. The dedicated corpus is mainly established based on the characteristics of international cooperation in geological surveys and the use of proprietary corpora, such as incorporating geological survey terms, international conference names, international cooperation institutions, employee names, etc. into the dedicated corpus.

[0080] Furthermore, by using the NLP international cooperation corpus for geological surveys, a secondary similarity comparison algorithm is set up, and a second similarity threshold is set (70% is the optimal experience, and users can configure higher weights such as 60%, 80%, 90%, etc.). Similar international cooperation plans are screened to form a secondary international cooperation plan screening pool, achieving a more accurate matching of international cooperation plans. As Figure 2 shown. The specific steps of this secondary similarity comparison algorithm are as follows:

[0081] Step 1: Inherit the international cooperation plan A to be compared extracted during the initial screening.

[0082] Step 2: Use the NPL corpus (professional corpus and general corpus) to perform word segmentation and parsing on the international cooperation plan A to obtain the text characters of the international cooperation plan A after word segmentation and parsing.

[0083] Step 3: Determine whether the text characters of the international cooperation plan A after word segmentation contain country names. If so, extract the country names and record them in the variable CountryA.

[0084] Step 4: Develop and establish a regular expression function program. Use the regular expression function program to filter special characters (-? ""! '' ', / & ~, etc.) from the international cooperation plan A and delete all special characters to obtain the character text of the international cooperation plan A without special characters.

[0085] Step 5: Through the NPL stop word corpus, perform stop word processing on the text of the international cooperation plan A obtained in the fourth step, filter out modal particles and auxiliary words such as "de", "di", "de" to obtain the further purified text characters of the international cooperation plan A.

[0086] Step 6: Process the text string obtained in the fifth step and delete characters related to the year, such as 2024, etc., to make the content of the international cooperation text more objective and the content information contained more pure.

[0087] Step 7: Traverse the initial screening pool of international cooperation plans. Each time an international cooperation plan J to be compared is obtained, analyze and process the international cooperation plan J according to steps 2 to 6 (word segmentation and parsing of the plan name, filtering of invalid characters, extraction and filtering of annual characters, extraction of country names), and obtain the country name CountryJ of the international cooperation plan J.

[0088] Step 8: Determine whether the country name of the international cooperation plan A to be compared is the same as the country name of the international cooperation plan J, that is, determine whether CountryA is the same as CountryJ.

[0089] Step 9: If CountryA is the same as CountryJ, delete the country names of International Cooperation Plan A and International Cooperation Plan J respectively, and then proceed to Step 10; if the country names of CountryA and CountryJ are different, retain their respective country names in the text, and then proceed to Step 10.

[0090] Step 10: Use the word segmentation corpus to determine whether the international cooperation plans A and J to be compared contain information such as the names of the dispatching units, the names of international conferences, and the names of visiting institutions. Through the replacement algorithm of the full name and abbreviation of the R&D unit, the full name and abbreviation of the international conference, the Chinese and English abbreviations of the international conference, and the full name and abbreviation of the visiting institution, the unit names, international conference names, visiting institution names, etc. in the international cooperation plans A and J are unified in terms of dimensionality, which is convenient for comparing the text character similarity of the international cooperation plans A and J.

[0091] Step 11: Develop a text character cosine vector similarity comparison algorithm program. Pass the International Cooperation Plan A and International Cooperation Plan J text characters obtained after dimensional unification in the tenth step as two parameters into the cosine vector similarity comparison algorithm program function, calculate the similarity of the two strings, and express the results as a percentage, recorded as SimJ.

[0092] Step 12: According to the weight factor configured by the user (50%, 60%...), determine whether SimJ is greater than the configured weight factor. If it is greater than the weight factor, the international cooperation plan J will be placed in the secondary international cooperation plan screening pool. International cooperation plans with a value less than the weight factor will not be recorded.

[0093] The present invention utilizes the word segmentation technology of NLP to cut the text into meaningful vocabulary units for subsequent processing. Based on the above-mentioned stop word library, meaningless stop words and special characters are identified and filtered out to reduce information interference. Using named entity recognition (NER) technology, key information such as international cooperation institutions, unit names, years, etc. are extracted from the text, and standardized processing is performed to prepare for subsequent information comparison. Combined with the text processed by NLP, an advanced text similarity algorithm is used to calculate text similarity, which more accurately reflects semantic similarity than simple character comparison. A reasonable similarity threshold is set according to actual needs and test results to filter out matches with low similarity. The threshold may need to be dynamically adjusted according to initial experimental feedback and actual application effects. Through the above steps, the screening pool obtained contains strictly screened international cooperation project information that is highly relevant to the target, providing a high-quality data basis for subsequent analysis and decision-making.

[0094] Therefore, using natural language processing (NLP) technology to establish a dedicated corpus and improve comparison algorithms for international cooperation projects in the field of geological surveys can greatly improve the accuracy and efficiency of data processing.

[0095] S4, using the auxiliary factor similar plan comparison and marking algorithm to judge and mark the plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plans according to the comparison logic, so as to obtain the final international cooperation plan screening pool based on the plan marking results, and realize accurate marking and auxiliary comparison of similar international cooperation plans.

[0096] The embodiment of the present invention introduces auxiliary factors for comparing international cooperation plans. By using the visiting countries, visiting cycles, visiting times, visiting institutions, organizing units, dispatching units and visiting purposes in the international cooperation plans as auxiliary factors, auxiliary factors are extracted and automatically identified and compared for the international cooperation plans. This is the third level (secondary) comparison of the similarity of international cooperation plans. The comparison of auxiliary factors is used to supplement the accuracy of the second screening and comparison results of the international cooperation plans, and the screened international cooperation plans are marked and sorted, assisting international cooperation managers in identifying, evaluating, optimizing and adjusting international cooperation plans. Figure 2 shown.

[0097] It is understandable that the determination of auxiliary factors for the comparison of international cooperation plans is summarized based on the historical data of international cooperation plans over the years. Auxiliary factors mainly include "cooperating units, visiting countries, visiting cycles, visiting times, and visiting institutions". These auxiliary factor information can be extracted from each international cooperation plan through the program. The use of auxiliary factors to participate in the comparison of the similarity of the characters in the international cooperation plan text is also the last step of the three-level automated comparison of the similarity of the international cooperation plan. On the basis of the above-mentioned initial and secondary international cooperation plan text comparisons, the content of the international cooperation is used for comparison. According to the importance of the auxiliary factors and the similarity logic judgment process, the international cooperation plans screened out for the second time are marked and sorted, and finally a pool of similar international cooperation plans with marks is provided to managers, so that managers can judge whether the plans in the final international cooperation screening pool are consistent with the international cooperation plan A to be compared, and optimize and adjust the international cooperation plan according to the results of the judgment.

[0098] The specific steps of auxiliary factor alignment in the embodiment of the present invention are as follows:

[0099] Step 1: Determine the importance and interrelationship of the auxiliary factors of the international cooperation plan. Sort them by importance level, in the following order: country of visit, organization of visit (name of conference to be attended), time of visit, group unit, and visit period.

[0100] Step 2: Based on the secondary international cooperation program screening, traverse the secondary screening pool of international cooperation programs.

[0101] Step 3: Through the "auxiliary factor logic judgment process algorithm" for the traversed international cooperation plans, the relationship between the auxiliary factors of the international cooperation plan A to be compared and the "visited country-visited organization (conference)-visit time-group unit" in the traversed secondary screening pool international cooperation plans is judged in turn (same, included, different).

[0102] Step 4: Traverse the international cooperation plans of the secondary screening pool, according to Figure 3 The "Auxiliary Factor Logical Judgment Process Algorithm" is used to mark each international cooperation plan (two types of marks: auxiliary judgment mark 1 and auxiliary judgment mark 2), and the final marking results provide a basis for assisting managers in judging and optimizing international cooperation plans.

[0103] Furthermore, the final screening pool of international cooperation plans obtained after analysis and comparison of auxiliary factors can assist management personnel in merging, splitting, optimizing and adjusting plans, and form the final draft of the international cooperation plan for approval.

[0104] It can be known that the present invention proposes for the first time the use of auxiliary factors to judge, compare and mark the similarity of international cooperation plans, which can be used as a new means of comparing international cooperation plans, and creatively proposes auxiliary factor logical judgment, providing a basis for subsequent manual judgment and optimization adjustment of international cooperation plans.

[0105] According to the method for extracting, identifying and comparing international cooperation visit plan information in an embodiment of the present invention, a geological survey international cooperation visit information extraction and identification comparison model system is designed in combination with the business characteristics and actual needs of international cooperation in geological surveys. The NLP natural language model is used to integrate geological survey professional word segmentation data, and an international cooperation information similarity comparison algorithm is developed. Through the processes of extracting, retrieving, analyzing, comparing and judging auxiliary factors of international cooperation information, accurate classification and identification of international cooperation information can be achieved, providing a convenient tool for the classification, processing, integration and approval of international cooperation plans.

[0106] In order to implement the above embodiment, Figure 4 As shown, this embodiment also provides an international cooperative visit plan information extraction and identification comparison system 10, which includes:

[0107] The original plan extraction module 100 is used to extract the international cooperation plan to be compared from the international cooperation plan application database using a preset data retrieval method;

[0108] The first screening pool determination module 200 is used to use the initial similarity comparison algorithm to compare the international cooperation plan to be compared with the cooperation plans in the international cooperation plan application database to screen out similar international cooperation plans, so as to construct an initial international cooperation plan screening pool and realize rapid preliminary screening of similar international cooperation plans;

[0109] The second screening pool determination module 300 is used to perform a secondary comparison between the international cooperation plan to be compared and the international cooperation plans in the primary international cooperation plan screening pool using a secondary similarity comparison algorithm to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool and realize accurate screening of similar international cooperation plans;

[0110] The final screening pool determination module 400 is used to use the auxiliary factor similar plan comparison and marking algorithm to judge and mark and sort the plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plans according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results, and realize accurate marking and auxiliary comparison of similar international cooperation plans.

[0111] Furthermore, the original plan extraction module 100 is also used for:

[0112] Using Boolean logic operators to search and extract international cooperation plans containing search keywords from the international cooperation plan application database; and,

[0113] Use the field-limited search method to set the field information of the international cooperation plan to be searched, and set the content to be searched for different field information, so as to search and extract the international cooperation plan application database through matching searches of multiple fields to extract the individual international cooperation plans that need to be approved;

[0114] The international cooperation plans to be compared are determined based on the individual international cooperation plans that require approval.

[0115] Furthermore, the first screening pool determination module 200 is also used for:

[0116] Acquire the first international cooperation plan to be compared, traverse the international cooperation plans in the international cooperation plan declaration database, sequentially acquire the second international cooperation plan, and use a special character algorithm to delete all special characters in the first international cooperation plan and the second international cooperation plan to be compared, so as to obtain a text string of the first international cooperation plan and a text string of the second international cooperation plan without special characters;

[0117] Performing character conversion on the first international cooperation plan text string and the second international cooperation plan text string using a character conversion algorithm to obtain a character set of the first international cooperation plan text and a character set of the second international cooperation plan text;

[0118] Calculate the length of the first international cooperation plan text character set, calculate the length of the second international cooperation plan text character set, and compare the lengths of the first international cooperation plan and the second international cooperation plan character set;

[0119] The international cooperation plan text character set with a shorter character set length is traversed from left to right, and it is determined whether each character is included in the international cooperation plan character set with a longer character set length, and the total number of included characters is recorded.

[0120] The number of characters included is compared with the length of the longer character set, and then percentage processing is performed to obtain the percentage of similar characters. If the similarity percentage is greater than a preset first similarity threshold, the second international cooperation plan to be compared is placed in the initial international cooperation plan screening pool.

[0121] Furthermore, the second screening pool determination module 300 is further used for:

[0122] Using the NPL corpus to perform word segmentation analysis on the first international cooperation plan to be compared, so as to obtain the text characters of the first international cooperation plan after word segmentation analysis, and judging whether the text characters of the first international cooperation plan contain the country name, if so, extracting the first country name;

[0123] A special character extraction and filtering algorithm function is established by using regular expressions to filter the special characters of the first international cooperation plan string, and the special characters are deleted to obtain the text of the first international cooperation plan without special characters;

[0124] Using the NPL stop word corpus to filter the text characters, and deleting the stop words under the preset conditions to obtain the processed text;

[0125] Processing the processed text characters to delete character information related to the year to obtain a pre-processed text;

[0126] Traversing the initial international cooperation plan screening pool, analyzing and processing the international cooperation plans in the initial international cooperation plan screening pool to obtain the second country name of the second international cooperation plan;

[0127] Determine whether the first country name is the same as the second country name; if they are the same, delete the country name from the first international cooperation plan and the second international cooperation plan based on the obtained second country name; if the country names are different, retain the country names in the texts of the first international cooperation plan and the second international cooperation plan;

[0128] The NPL word segmentation corpus was used to establish a corresponding replacement algorithm for the full names and abbreviations of units related to geological survey institutions, the full names and abbreviations of international conferences, and the Chinese names and English abbreviations of international conferences, and to unify the dimensions of the unit names and international conference names in the first and second international cooperation plans.

[0129] The cosine vector comparison algorithm is used to calculate the similarity results of the texts of the first international cooperation plan and the second international cooperation plan after data unification to obtain a similarity percentage. If the similarity percentage is greater than a preset second similarity threshold, the second international cooperation plan to be compared is placed in the secondary international cooperation plan screening pool.

[0130] Furthermore, the above-mentioned final screening pool determination module 400 is also used for:

[0131] Extracting international cooperation plan auxiliary factors from the international cooperation plan application database, and sorting the international cooperation plan auxiliary factors according to their importance to obtain auxiliary factor sorting results;

[0132] Traversing the international cooperation plans in the secondary international cooperation plan screening pool, and determining the mutual relationship between the auxiliary factors in the international cooperation plan to be compared and the international cooperation plans traversed in the secondary international cooperation plan screening pool in turn based on the extracted auxiliary factors combined with the auxiliary factor comparison logic processing method;

[0133] Based on the mutual relationship of the auxiliary factors, the traversed international cooperation plans are judged and marked and sorted according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results.

[0134] According to the international cooperation visit plan information extraction and identification comparison system of the embodiment of the present invention, combined with the business characteristics and actual needs of international cooperation in geological surveys, a geological survey international cooperation visit information extraction and identification comparison model system is designed, and the NLP natural language model is used to integrate geological survey professional word segmentation data, develop a three-level comparison algorithm for international cooperation information similarity, and establish a comparison model. Through the processes of extraction, retrieval, analysis and comparison of international cooperation information, accurate classification and identification of international cooperation information can be achieved, providing a convenient tool for the classification, processing, integration and approval of international cooperation plans.

[0135] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0136] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

Claims

1. A method for extracting and identifying international cooperative visit plan information, characterized in that: include: The international cooperation plans to be compared are extracted from the international cooperation plan application database using the preset data retrieval method; Using the initial similarity comparison algorithm, the international cooperation plan to be compared is compared with the cooperation plans in the international cooperation plan application database to screen out similar international cooperation plans, so as to construct an initial international cooperation plan screening pool and realize rapid preliminary screening of similar international cooperation plans; Using a secondary similarity comparison algorithm, the international cooperation plan to be compared is compared with the international cooperation plans in the primary international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool and realize accurate screening of similar international cooperation plans; Using the auxiliary factor similar plan comparison and marking algorithm, the plans in the secondary international cooperation plan screening pool are judged and marked and sorted according to the comparison logic according to the importance of the auxiliary factors in the identified international cooperation plan, so as to obtain the final international cooperation plan screening pool according to the plan marking results, and realize accurate marking and auxiliary comparison of similar international cooperation plans; The international cooperation plan to be compared is compared with the cooperation plans in the international cooperation plan application database by using the initial similarity comparison algorithm to screen out similar international cooperation plans, so as to construct an initial international cooperation plan screening pool, including: Acquire the first international cooperation plan to be compared, traverse the international cooperation plans in the international cooperation plan declaration database, sequentially acquire the second international cooperation plan, and use a special character algorithm to delete all special characters in the first international cooperation plan and the second international cooperation plan to be compared, so as to obtain a text string of the first international cooperation plan and a text string of the second international cooperation plan without special characters; Performing character conversion on the first international cooperation plan text string and the second international cooperation plan text string using a character conversion algorithm to obtain a character set of the first international cooperation plan text and a character set of the second international cooperation plan text; Calculate the length of the first international cooperation plan text character set, calculate the length of the second international cooperation plan text character set, and compare the lengths of the first international cooperation plan and the second international cooperation plan character set; Traversing the international cooperation plan text character set with a shorter character set length from left to right, and determining whether each character is included in the international cooperation plan character set with a longer character set length, and recording the total number of included characters; The number of characters included is compared with the length of the longer character set, and then percentage processing is performed to obtain the percentage of similar characters. If the similarity percentage is greater than a preset first similarity threshold, the second international cooperation plan to be compared is placed in the initial international cooperation plan screening pool; The secondary similarity comparison algorithm is used to perform a secondary comparison between the international cooperation plan to be compared and the international cooperation plans in the initial international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool, including: Using the NPL corpus to perform word segmentation analysis on the first international cooperation plan to be compared, so as to obtain the text characters of the first international cooperation plan after word segmentation analysis, and judging whether the text characters of the first international cooperation plan contain the country name, if so, extracting the first country name; A special character extraction and filtering algorithm function is established by using regular expressions to filter the special characters of the first international cooperation plan string, and the special characters are deleted to obtain the text of the first international cooperation plan without special characters; Using the NPL stop word corpus to filter the text characters, and deleting the stop words under the preset conditions to obtain the processed text; Processing the processed text characters to delete character information related to the year to obtain a pre-processed text; Traversing the initial international cooperation plan screening pool, analyzing and processing the international cooperation plans in the initial international cooperation plan screening pool to obtain the second country name of the second international cooperation plan; Determine whether the first country name is the same as the second country name; if they are the same, delete the country name from the first international cooperation plan and the second international cooperation plan based on the obtained second country name; if the country names are different, retain the country names in the texts of the first international cooperation plan and the second international cooperation plan; The NPL word segmentation corpus was used to establish a corresponding replacement algorithm for the full names and abbreviations of units related to geological survey institutions, the full names and abbreviations of international conferences, and the Chinese names and English abbreviations of international conferences, and to unify the dimensions of the unit names and international conference names in the first and second international cooperation plans. Calculate the text similarity of the first international cooperation plan and the second international cooperation plan after data unification by using a cosine vector comparison algorithm to obtain a similarity percentage. If the similarity percentage is greater than a preset second similarity threshold, place the second international cooperation plan to be compared into a secondary international cooperation plan screening pool. The auxiliary factor similarity plan comparison algorithm is used to judge and mark the international cooperation plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plans according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results, including: Extracting international cooperation plan auxiliary factors from the international cooperation plan application database, and sorting the international cooperation plan auxiliary factors according to their importance to obtain auxiliary factor sorting results; Traversing the international cooperation plans in the secondary international cooperation plan screening pool, and determining the mutual relationship between the auxiliary factors in the international cooperation plan to be compared and the international cooperation plans traversed in the secondary international cooperation plan screening pool in turn based on the extracted auxiliary factors combined with the auxiliary factor comparison logic processing method; Based on the mutual relationship of the auxiliary factors, the traversed international cooperation plans are judged and marked and sorted according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results.

2. The method according to claim 1, characterized in that The international cooperation plans to be compared are extracted from the international cooperation plan application database using the preset data retrieval method, including: Using Boolean logic operators to search and extract international cooperation plans containing search keywords from the international cooperation plan application database; and, Use the field-limited search method to set the field information of the international cooperation plan to be searched, and set the content to be searched for different field information, so as to search and extract the international cooperation plan application database through matching searches of multiple fields to extract the individual international cooperation plans that need to be approved; The international cooperation plans to be compared are determined based on the individual international cooperation plans that require approval.

3. An international cooperative visit plan information extraction and identification comparison system, characterized in that: include: The original plan extraction module is used to extract the international cooperation plan to be compared from the international cooperation plan application database using a preset data retrieval method; A first screening pool determination module is used to use a primary similarity comparison algorithm to compare the international cooperation plan to be compared with the cooperation plans in the international cooperation plan application database to screen out similar international cooperation plans, so as to construct a primary international cooperation plan screening pool and realize rapid preliminary screening of similar international cooperation plans; A second screening pool determination module is used to use a secondary similarity comparison algorithm to perform a secondary comparison between the international cooperation plan to be compared and the international cooperation plans in the primary international cooperation plan screening pool to screen out similar international cooperation plans, so as to construct a secondary international cooperation plan screening pool and realize accurate screening of similar international cooperation plans; The final screening pool determination module is used to use the auxiliary factor similarity plan comparison and marking algorithm to judge and mark the plans in the secondary international cooperation plan screening pool according to the importance of the auxiliary factors in the identified international cooperation plan according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results, and realize accurate marking and auxiliary comparison of similar international cooperation plans; The first screening pool determination module is further used for: Acquire the first international cooperation plan to be compared, traverse the international cooperation plans in the international cooperation plan declaration database, sequentially acquire the second international cooperation plan, and use a special character algorithm to delete all special characters in the first international cooperation plan and the second international cooperation plan to be compared, so as to obtain a text string of the first international cooperation plan and a text string of the second international cooperation plan without special characters; Performing character conversion on the first international cooperation plan text string and the second international cooperation plan text string using a character conversion algorithm to obtain a character set of the first international cooperation plan text and a character set of the second international cooperation plan text; Calculate the length of the first international cooperation plan text character set, calculate the length of the second international cooperation plan text character set, and compare the lengths of the first international cooperation plan and the second international cooperation plan character set; Traversing the international cooperation plan text character set with a shorter character set length from left to right, and determining whether each character is included in the international cooperation plan character set with a longer character set length, and recording the total number of included characters; The number of characters included is compared with the length of the longer character set, and then percentage processing is performed to obtain the percentage of similar characters. If the similarity percentage is greater than a preset first similarity threshold, the second international cooperation plan to be compared is placed in the initial international cooperation plan screening pool; The second screening pool determination module is further used for: Using the NPL corpus to perform word segmentation analysis on the first international cooperation plan to be compared, so as to obtain the text characters of the first international cooperation plan after word segmentation analysis, and judging whether the text characters of the first international cooperation plan contain the country name, if so, extracting the first country name; A special character extraction and filtering algorithm function is established by using regular expressions to filter the special characters of the first international cooperation plan string, and the special characters are deleted to obtain the text of the first international cooperation plan without special characters; Using the NPL stop word corpus to filter the text characters, and deleting the stop words under the preset conditions to obtain the processed text; Processing the processed text characters to delete character information related to the year to obtain a pre-processed text; Traversing the initial international cooperation plan screening pool, analyzing and processing the international cooperation plans in the initial international cooperation plan screening pool to obtain the second country name of the second international cooperation plan; Determine whether the name of the first country is the same as the name of the second country; If they are the same, based on the obtained second country name, the country names of the first international cooperation plan and the second international cooperation plan are deleted respectively; If the country names are different, the country names in the texts of the first and second international cooperation plans shall be retained; The NPL word segmentation corpus was used to establish a corresponding replacement algorithm for the full names and abbreviations of units related to geological survey institutions, the full names and abbreviations of international conferences, and the Chinese names and English abbreviations of international conferences, and to unify the dimensions of the unit names and international conference names in the first and second international cooperation plans. Calculate the text similarity of the first international cooperation plan and the second international cooperation plan after data unification by using a cosine vector comparison algorithm to obtain a similarity percentage. If the similarity percentage is greater than a preset second similarity threshold, place the second international cooperation plan to be compared into a secondary international cooperation plan screening pool. The final screening pool determination module is also used for: Extracting international cooperation plan auxiliary factors from the international cooperation plan application database, and sorting the international cooperation plan auxiliary factors according to their importance to obtain auxiliary factor sorting results; Traversing the international cooperation plans in the secondary international cooperation plan screening pool, and determining the mutual relationship between the auxiliary factors in the international cooperation plan to be compared and the international cooperation plans traversed in the secondary international cooperation plan screening pool in turn based on the extracted auxiliary factors combined with the auxiliary factor comparison logic processing method; Based on the mutual relationship of the auxiliary factors, the traversed international cooperation plans are judged and marked and sorted according to the comparison logic, so as to obtain the final international cooperation plan screening pool according to the plan marking results.

4. The system according to claim 3, characterized in that The original plan extraction module is also used for: Using Boolean logic operators to search and extract international cooperation plans containing search keywords from the international cooperation plan application database; and, Use the field-limited search method to set the field information of the international cooperation plan to be searched, and set the content to be searched for different field information, so as to search and extract the international cooperation plan application database through matching searches of multiple fields to extract the individual international cooperation plans that need to be approved; The international cooperation plans to be compared are determined based on the individual international cooperation plans that require approval.

Citation Information

Patent Citations

  • Data retrieval method, device and equipment and readable storage medium

    CN110334178A

  • Similar document searching method and device, electronic equipment and storage medium

    CN114756733A