Knowledge base management system based on large model

Through a knowledge base management system based on a large model, social security data is collected and analyzed in real time, and knowledge graphs are built and verified, which solves the problem that existing systems are difficult to update and share information in real time, and efficient social security data management and query are achieved.

CN119558397AActive Publication Date: 2025-03-04ZHONGHE YUNKE INFORMATION TECH GRP CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
CN202510118526.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-24
Publication Date
2025-03-04
Estimated Expiration
2045-01-24

AI Technical Summary

Technical Problem

The existing social security management system is difficult to synchronize the latest policy information in real time, which makes it difficult for users and staff to obtain the latest policy information. Moreover, the social security policies and processes in different places vary greatly, and the lack of unified knowledge base support, resulting in difficulty in sharing information.

Method used

It provides a knowledge base management system based on large models, collects social security data in real time through the API interface, and is divided into structured, semi-structured and unstructured data. It uses large models to analyze and build a knowledge graph, verify the quality of the graph and adjust the data processing process and model parameters.

Benefits of technology

Real-time update and management of social security data is realized, the management efficiency of the knowledge base is improved, the availability and query efficiency of data are enhanced, and the ability of users to obtain the latest policy information is ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119558397A_ABST
    Figure CN119558397A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of knowledge base management, in particular to a knowledge base management system based on a large model, which comprises a data acquisition module, a data processing module, a knowledge base construction module and a verification module. According to the method, the text data is continuously scanned to remove repeated content and avoid word segmentation errors, the source data in the social security field is classified to collect the unstructured data in the source data to perform data conversion, namely, the text in the unstructured data is processed to identify entities and concepts in the text, and the data conversion efficiency is improved. And identifying and recording the relationship between entities, improving the availability and query efficiency of data, verifying the accuracy of word segmentation processing by combining feedback data of a user, automatically identifying whether a wrong word segmentation result appears or not by recording query data of the user, and further adjusting a word segmentation processing flow and model training parameters. The social security service system is effectively managed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of knowledge base management, and in particular to a knowledge base management system based on a large model. Background Art

[0002] There are numerous documents in the field of social insurance and the organization and management are complex. As an important part of the social security system, social insurance is closely related to everyone's life. With the development of the Internet, people are paying more and more attention to social insurance. How to quickly obtain social insurance knowledge in the complex ocean of data has become an urgent problem that people need to solve.

[0003] A Chinese patent document with publication number CN118917390A discloses a service knowledge base management system and method based on a knowledge big model. The system monitors and preprocesses the running status data of the knowledge base system in real time, extracts features and identifies key performance indicators using a decision tree algorithm, and comprehensively analyzes abnormal changes and fluctuations in the hit rate and update frequency of the knowledge base, accurately evaluates the system operation stability, and classifies the system status according to the evaluation results; monitors the performance and response effect of the knowledge big model when the system is unstable, and uses fuzzy logic to quantify the degree of its impact on user experience, so as to take targeted optimization management measures; it can be seen that the existing social security management system generally has the following problems: social security policies are frequently updated, but the existing system is difficult to synchronize the latest policy information in real time, which makes it difficult for users and handling personnel to obtain the latest policy information; social security policies and processes vary greatly from place to place, and lack of a unified knowledge base support makes information sharing difficult. Summary of the invention

[0004] To this end, the present invention provides a knowledge base management system based on a large model to overcome the problem in the prior art that due to the complex organization and management of social security data, the system is difficult to update data in a timely and effective manner, resulting in low knowledge base management efficiency.

[0005] To achieve the above object, the present invention provides a knowledge base management system based on a large model, comprising: The data collection module collects data in real time through the API interface and various social security data sources to obtain the original social security data; A data processing module, which is connected to the data acquisition module, and is used to divide the original social security data into first-category social security data and second-category social security data, and clean the first-category social security data to obtain target social security data; Among them, the first type of social security data is structured data and semi-structured data, and the second type of social security data is unstructured data; A knowledge base construction module, which is connected to the data processing module, uses a large model to analyze the target social security data to extract entity words, and combines the relationship extraction model to obtain a social security ontology graph, thereby constructing a knowledge graph; A verification module, which is connected to the knowledge base construction module and is used to verify the knowledge graph and adjust the model setting parameters or data processing flow according to the verification results; Among them, the process of adjusting the data processing flow is to store the query keywords into the social security database for storage; the model setting parameter is the batch size of the model training.

[0006] Furthermore, the data processing module includes a data cleaning unit and a data classification unit, wherein: The data cleaning unit is used to scan and detect the type of social security data to obtain target social security data; The data classification unit is used to analyze the types of the original social security data to obtain type one social security data and type two social security data.

[0007] Furthermore, the data cleaning unit includes a scanning subunit, a matching subunit and a detection subunit, wherein: The scanning subunit is used to scan the type of social security data to obtain a detection text segment; The matching subunit is used to extract entity keywords from the detection text segment and match them in the social security database, and determine the entity to be detected according to the matching result; The detection subunit is used to continuously scan the entity to be detected to obtain an extended text segment, perform a matching detection on the entity to be detected according to the entity to be detected, and determine whether to delete the extended text segment according to the result of the matching detection to obtain the target social security data.

[0008] Furthermore, the continuous scanning includes taking the character length of the entity to be detected as the detection length, taking the next adjacent character of the entity to be detected as the starting node, and scanning the type of social security data with the detection length to obtain an extended text segment.

[0009] Furthermore, the knowledge base construction module includes a data extraction unit, an ontology construction unit and a knowledge graph construction unit, wherein: The data extraction unit is used to extract text data from the second type of social security data to obtain target social security data; The ontology construction unit is used to perform entity recognition and relationship extraction on the target social security data to obtain a social security ontology graph; The knowledge graph construction unit is used to store the social security ontology graph as a knowledge graph using a graph database.

[0010] Furthermore, the ontology construction unit includes a word segmentation subunit and a construction subunit, wherein: The word segmentation subunit divides the target social security data into a plurality of sentences to be processed using a period as an identifier, and performs word segmentation processing on each of the sentences to be processed to obtain a plurality of entity words; The construction subunit is used to form a social security ontology graph based on entity words and relationship extraction models.

[0011] Furthermore, the verification module includes a recording unit, a calculation unit, a determination unit and an adjustment unit, wherein: The recording unit is used to record user query data, wherein the user query data includes query keywords, timestamps and query results; The calculation unit is used to calculate the actual effective query rate based on the query result; The actual effective query rate is the percentage of effective keywords to the total number of keywords after word segmentation; The determination unit is used to determine the actual effective query rate according to the standard effective query rate to determine whether the quality of the constructed knowledge graph meets the standard; The adjustment unit is used to select and adjust the model setting parameters or the data processing flow based on the historical query frequency of any query keyword.

[0012] Further, the adjustment unit includes a first adjustment unit and a second adjustment unit, wherein: The first adjustment unit is used to store the query keyword in the social security database for storage when the historical query frequency is greater than the standard query frequency; The second adjustment unit is used to adjust a hyperparameter of the model based on a change trend of an actual effective query rate when the historical query frequency is less than or equal to the standard query frequency, wherein the hyperparameter is a batch size for model training; Among them, a curve of the actual effective query rate changing with time is plotted to obtain an effective query curve, and the slope of the effective query curve is analyzed. If the slope of the effective query curve is less than the standard slope, the batch size is increased.

[0013] Furthermore, the word segmentation subunit performs word segmentation processing on each of the sentences to be processed, including: The social security professional vocabulary in the social security database is obtained, the social security professional vocabulary is added to the word segmentation library, and the word segmentation is performed using the word segmentation library to obtain a plurality of entity words.

[0014] Furthermore, the construction subunit is used to form a social security ontology graph based on word fragments and relationship extraction models, including: Obtaining the relationship between each entity word and the entity word through a relationship extraction model; Each entity word is matched in the ontology database, and the matched entity words and the relationship corresponding to the entity words are linked to the ontology to form a social security ontology graph.

[0015] Compared with the prior art, the beneficial effect of the present invention lies in that the source data in the social security field is classified to collect the unstructured data therein for data conversion, that is, by processing the text in the unstructured data, identifying the entities and concepts in the text, and identifying and recording the relationship between entities, thereby improving the data availability and query efficiency, and by combining the user's feedback data to verify the accuracy of the word segmentation processing, adjust the word segmentation processing flow and model training parameters, and realize effective management of the social security service system.

[0016] Furthermore, the collected data is cleaned by a data cleaning unit to remove irrelevant information, noise and duplicate content to ensure the quality of the data.

[0017] Furthermore, when it is determined that the quality of the constructed knowledge graph does not meet the standards, it means that the results of the retrieval using the keywords entered by the user are invalid. The number of times the keyword is entered, that is, the historical query frequency, is analyzed. If the historical query frequency is greater than the standard query frequency, it means that invalid queries occur frequently. This is due to word segmentation errors, which lead to the failure of keyword matching in the social security database, thereby affecting the accuracy of the query results returned by the system. For example, if a user queries for "medical insurance" and the system incorrectly segments it into "medical" and "insurance", the system may return results related to "medical" or "insurance" instead of specific information about "medical insurance". In this case, the query keywords are stored in the social security database for corresponding optimization to improve the accuracy of word segmentation and the overall performance of the system.

[0018] Furthermore, when it is determined that the quality of the constructed knowledge graph does not meet the standard and the historical query frequency is less than or equal to the standard query frequency, the changing trend of the actual effective query rate within the monitoring period is obtained to analyze the changing trend of the query accuracy rate. If it is determined that the query accuracy rate has decreased, the batch size is adjusted to retrain the relationship extraction model, update the model parameters, and improve the stability and performance of the model. By generating an effective query curve to analyze the changing trend of the query accuracy rate, the batch size is adjusted according to the changing trend of the query accuracy rate. When it is determined that the slope of the effective query curve is greater than or equal to the standard slope, it indicates that the changing trend of the actual effective query rate is decreasing, and the batch size is increased; when it is determined that the slope of the effective query curve is less than the standard slope, it indicates that the changing trend of the actual effective query rate is increasing, which means that the performance of the model is good and the batch size is not adjusted. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1This is a schematic diagram of the structure of a knowledge base management system based on a large model according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the structure of a data processing module according to an embodiment of the present invention; Figure 3 A schematic diagram of the structure of a knowledge base building module according to an embodiment of the present invention; Figure 4 It is a schematic diagram of the structure of the verification module according to an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0021] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0022] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0023] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0024] See also Figure 1 As shown, it is a schematic diagram of the structure of a knowledge base management system based on a large model according to an embodiment of the present invention. The present invention provides a knowledge base management system based on a large model, including: The data collection module collects data in real time through the API interface and various social security data sources to obtain the original social security data; A data processing module, which is connected to the data acquisition module, and is used to divide the original social security data into first-category social security data and second-category social security data, and clean the first-category social security data to obtain target social security data; A knowledge base construction module, which is connected to the data processing module, uses a large model to analyze the target social security data to extract entity words, and combines the relationship extraction model to obtain a social security ontology graph, thereby constructing a knowledge graph; A verification module is connected to the knowledge base construction module and is used to verify the knowledge graph and adjust the model setting parameters or data processing flow according to the verification results.

[0025] The various types of social security data sources in this embodiment are social security policies, processes and results data of provinces and cities across the country, including policy documents, social security cases, user feedback, social media comments, news reports, etc.; the first type of social security data is structured data and semi-structured data, and the second type of social security data is unstructured data; the API interface is a RESTful API interface to provide access and query functions to the ontology database.

[0026] By classifying the source data in the social security field and collecting the unstructured data for data conversion, that is, by processing the text in the unstructured data, identifying the entities and concepts in the text, and identifying and recording the relationship between entities, the data availability and query efficiency are improved. By combining the user's feedback data, the accuracy of the word segmentation processing is verified. By recording the user's query data, it is automatically identified whether there are erroneous word segmentation results, and then the word segmentation processing process and model training parameters are adjusted to achieve effective management of the social security service system.

[0027] See also Figure 2 As shown, it is a structural diagram of a data processing module according to an embodiment of the present invention; Specifically, the data processing module includes a data cleaning unit and a data classification unit, wherein: The data cleaning unit is used to scan and detect the type of social security data to obtain target social security data; The data classification unit is used to analyze the types of the original social security data to obtain type one social security data and type two social security data.

[0028] The collected data is cleaned by the data cleaning unit to remove irrelevant information, noise and duplicate content to ensure the quality of the data.

[0029] Specifically, the data cleaning unit includes a scanning subunit, a matching subunit and a detection subunit, wherein: The scanning subunit is used to scan the type of social security data to obtain a detection text segment; The matching subunit is used to extract entity keywords from the detection text segment and match them in the social security database, and determine the entity to be detected according to the matching result; The detection subunit is used to continuously scan the entity to be detected to obtain an extended text segment, perform a matching detection on the entity to be detected according to the entity to be detected, and determine whether to delete the extended text segment according to the result of the matching detection to obtain the target social security data; In this embodiment, a type of social security data is continuously scanned with a preset scanning length to remove duplicate content and avoid word segmentation errors.

[0030] Specifically, the continuous scanning includes taking the character length of the entity to be detected as the detection length, taking the next adjacent character of the entity to be detected as the starting node, and scanning the type of social security data with the detection length to obtain an extended text segment.

[0031] See also Figure 3 As shown, it is a schematic diagram of the structure of the knowledge base building module according to an embodiment of the present invention; Specifically, the knowledge base construction module includes a data extraction unit, an ontology construction unit and a knowledge graph construction unit, wherein: The data extraction unit is used to extract text data from the second type of social security data to obtain target social security data; The ontology construction unit is used to perform entity recognition and relationship extraction on the target social security data to obtain a social security ontology graph; The knowledge graph construction unit is used to store the social security ontology graph as a knowledge graph using a graph database.

[0032] Specifically, the ontology construction unit includes a word segmentation subunit and a construction subunit, wherein: The word segmentation subunit divides the target social security data into a plurality of sentences to be processed using a period as an identifier, and performs word segmentation processing on each of the sentences to be processed to obtain a plurality of entity words; The construction subunit is used to form a social security ontology graph based on entity words and relationship extraction models.

[0033] See also Figure 4 As shown, it is a schematic diagram of the structure of the verification module of an embodiment of the present invention; Specifically, the verification module includes a recording unit, a calculation unit, a determination unit and an adjustment unit, wherein: The recording unit is used to record user query data, wherein the user query data includes query keywords, timestamps and query results; The calculation unit is used to calculate the actual effective query rate based on the query result; The actual effective query rate is the percentage of effective keywords to the total number of keywords after word segmentation; The determination unit is used to determine the actual effective query rate according to the standard effective query rate to determine whether the quality of the constructed knowledge graph meets the standard; The determination unit is used to determine the actual effective query rate according to the standard effective query rate: If the actual effective query rate is less than or equal to the standard effective query rate, it is determined that the quality of the constructed knowledge graph does not meet the standard; If the actual effective query rate is greater than the standard effective query rate, it is determined that the quality of the constructed knowledge graph meets the standard; The adjustment unit is used to select and adjust the model setting parameters or the data processing flow based on the historical query frequency of any query keyword.

[0034] In this embodiment, the standard effective query rate represents the ideal query accuracy threshold, which is generally set at 75%-85%. The actual effective query rate represents the query effect of the user. The higher the actual effective query rate, the better the query effect. By recording user query data, user feedback information is obtained, that is, whether the keywords or entities provided by the system are correct. Users choose "yes" or "no" to confirm whether a keyword is relevant to their query.

[0035] When it is determined that the quality of the constructed knowledge graph does not meet the standards, it means that the results of the retrieval using the keywords entered by the user are invalid. The number of times the keyword is entered, that is, the historical query frequency, is analyzed. If the historical query frequency is greater than the standard query frequency, it means that invalid queries occur frequently. This is due to word segmentation errors, which lead to the failure of keyword matching in the social security database, thereby affecting the accuracy of the query results returned by the system. For example, if a user queries for "medical insurance" and the system incorrectly segments it into "medical" and "insurance", the system may return results related to "medical" or "insurance" instead of specific information about "medical insurance". In this case, the query keywords are stored in the social security database for corresponding optimization to improve the accuracy of word segmentation and the overall performance of the system.

[0036] Specifically, the adjustment unit includes a first adjustment unit and a second adjustment unit, wherein: The first adjustment unit is used to store the query keyword in the social security database for storage when the historical query frequency is greater than the standard query frequency; The second adjustment unit is used to adjust a hyperparameter of the model based on a change trend of an actual effective query rate when the historical query frequency is less than or equal to the standard query frequency, wherein the hyperparameter is a batch size for model training; Among them, a curve of the actual effective query rate changing with time is plotted to obtain an effective query curve, and the slope of the effective query curve is analyzed. If the slope of the effective query curve is greater than or equal to the standard slope, the batch size is not adjusted. If the slope of the effective query curve is less than the standard slope, the batch size is increased.

[0037] The batch size is the number of samples passed through the network in each iteration during training; In this embodiment, the query accuracy rate after each training cycle is obtained to adjust the batch size according to the change of the query accuracy rate. For example, the following query accuracy rates are obtained during the training process: Epoch 1: Query accuracy is 70% (using batch size 32); Epoch 2: Query accuracy is 75% (using batch size 32). Epoch 3: Query accuracy is 72% (using batch size 32). Epoch 4: query accuracy is 78% (using batch size 32); Among them, Epoch is the training cycle; In the third epoch, the query accuracy rate dropped, and the query accuracy rate did not improve significantly in the consecutive epochs. In order to improve the stability and performance of the model, the batch size is increased from 32 to 64; the actual effective query rate is continued to be obtained. If the query accuracy rate is still not ideal after using the batch size of 64 (for example, it drops to 70%), the batch size is reduced to 16. For example, the following results are obtained after adjusting the batch size: Epoch 5: Using a batch size of 64, the query accuracy is 73% Epoch 6: Using a batch size of 64, the query accuracy is 75% Epoch 7: Using a batch size of 16, the query accuracy is 80% Epoch 8: Using a batch size of 16, the query accuracy is 82% After reducing the batch size to 16, the query accuracy improves significantly, indicating that the model performs better in this setting.

[0038] The batch size is a hyperparameter that affects the training speed and convergence effect of the model. When it is determined that the quality of the constructed knowledge graph does not meet the standard and the historical query frequency is less than or equal to the standard query frequency, the change trend of the actual effective query rate within the monitoring period is obtained to analyze the change trend of the query accuracy rate. If the query accuracy rate is determined to have decreased, the batch size is adjusted to retrain the relationship extraction model, update the model parameters, and improve the stability and performance of the model. The effective query curve is generated to analyze the change trend of the query accuracy rate, and the batch size is adjusted according to the change trend of the query accuracy rate. When the slope of the effective query curve is determined to be greater than or equal to the standard slope, it means that the change trend of the actual effective query rate is decreasing, and the batch size is increased; when the slope of the effective query curve is determined to be less than the standard slope, it means that the change trend of the actual effective query rate is increasing, which means that the performance of the model is good and the batch size is not adjusted.

[0039] Specifically, the word segmentation subunit performs word segmentation processing on each of the sentences to be processed, including: The social security professional vocabulary in the social security database is obtained, the social security professional vocabulary is added to the word segmentation library, and the word segmentation is performed using the word segmentation library to obtain a plurality of entity words.

[0040] The social security professional vocabulary in this embodiment includes "social security", "pension insurance", "unemployment insurance", "work-related injury insurance", "maternity insurance", "social security card", "payment", "treatment", "policy", "insurance", "subsidy", "pension", "medical expenses", "insurance", etc.; the word library is the jieba dictionary.

[0041] Specifically, the construction subunit is used to form a social security ontology graph based on word fragments and relationship extraction models, including: Obtaining the relationship between each entity word and the entity word through a relationship extraction model; Each entity word is matched in the ontology database, and the matched entity words and the relationship corresponding to the entity words are linked to the ontology to form a social security ontology graph.

[0042] The relationship extraction model in this embodiment uses the BERT model as a basis and combines PyTorch and Hugging Face's Transformers library to implement relationship extraction. By training the relationship extraction model, entity words and their corresponding relationships are extracted from the social security text, that is, the target social security data.

[0043] The RelationExtractionDataset class is used to process input text and labels, encode using BERT tokenizer, prepare text and labels, and divide the data into training and test sets; use BertForSequenceClassification to initialize the BERT model and set the number of classification labels; use AdamW optimizer to train the model, calculate the loss and update the model parameters; evaluate on the test set and output the prediction results and true labels; when preparing the data, divide the dataset into training and test sets with a ratio of 70% for training, 20% for validation, and 10% for testing.

[0044] The ontology database in this embodiment is a structured knowledge representation framework that facilitates information storage, retrieval and reasoning. By determining the relationship between concepts, such as the relationship between "employees" and "social security contributions", and defining the set of operating objects of concepts, the attributes and behaviors of each concept are clarified. The ontology model framework is a hierarchical design. The ontology hierarchy includes top-level ontology, domain ontology and application ontology. The top-level ontology is an abstract description of objective things, defining basic concept categories such as "object" and "event". The domain ontology is to describe concepts and their relationships unique to the social security field and to build the core of domain knowledge. The application ontology is a description of specific instances, refining the concepts in the domain ontology. For example, in the top-level ontology, objects include "social security", "employees", "units", etc., events include "payment", "receiving pensions", etc., in the domain ontology, concepts include "average wage of employees", "social security payment ratio", etc., relationships include "belong to", "association", etc., in the application ontology, instances include "employee A", "unit B", etc.; ontology modeling tools (such as Protégé) are used to build the ontology model, and ontology classes and attributes are created based on the extracted concepts and relationships; the extracted entity terms are matched with the concepts in the ontology database, and for the matched entities, their corresponding relationships are recorded and linked to the ontology, and the matched entities and their relationships are linked to the ontology. Arranged into triples (entity 1, relationship, entity 2), the ontology database is a graph database (Neo4j), the ontology database stores these triples, and identifies entity words from the subject, predicate, and object triples extracted from the target social security data, matches the identified entity words with the concepts in the ontology database to establish the relationship between entities and link them to the ontology, extracts subject, predicate, and object triples from the text to form a structured data representation, traverses the extracted triples, matches the subject and object of each triple, uses the concepts in the ontology database to ensure that existing nodes are not added repeatedly, and determines the relationship between entities based on the predicate verbs , and record them as attributes, insert the matching entities and their relationships into the ontology database to form a social security ontology graph; extract all entities (such as "employee", "social security payment", "pension", etc.) and relationships (such as "belong to", "association", etc.) from the social security ontology graph, determine the attributes of each entity and the type of relationship, form a knowledge graph in the field of social security, and store the knowledge graph through a graph database (Neo4j). The graph database can efficiently process node and edge queries; use the query language of the graph database (such as Cypher) to query the knowledge graph. Based on the knowledge graph, users can ask social security-related questions, and the system can quickly return accurate answers.

[0045] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0046] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A knowledge base management system based on a large model, characterized in that: include, The data collection module collects data in real time through the API interface and various social security data sources to obtain the original social security data; A data processing module, which is connected to the data acquisition module, and is used to divide the original social security data into first-category social security data and second-category social security data, and clean the first-category social security data to obtain target social security data; Among them, the first type of social security data is structured data and semi-structured data, and the second type of social security data is unstructured data; A knowledge base construction module, which is connected to the data processing module, uses a large model to analyze the target social security data to extract entity words, and combines the relationship extraction model to obtain a social security ontology graph, thereby constructing a knowledge graph; A verification module, which is connected to the knowledge base construction module and is used to verify the knowledge graph and adjust the model setting parameters or data processing flow according to the verification results; Among them, the process of adjusting the data processing flow is to store the query keywords into the social security database for storage; the model setting parameter is the batch size of the model training.

2. The knowledge base management system based on a large model according to claim 1 is characterized in that: The data processing module includes a data cleaning unit and a data classification unit, wherein: The data cleaning unit is used to scan and detect the type of social security data to obtain target social security data; The data classification unit is used to analyze the types of the original social security data to obtain type one social security data and type two social security data.

3. The knowledge base management system based on a large model according to claim 2 is characterized in that: The data cleaning unit includes a scanning subunit, a matching subunit and a detection subunit, wherein: The scanning subunit is used to scan the type of social security data to obtain a detection text segment; The matching subunit is used to extract entity keywords from the detection text segment and match them in the social security database, and determine the entity to be detected according to the matching result; The detection subunit is used to continuously scan the entity to be detected to obtain an extended text segment, perform a matching detection on the entity to be detected according to the entity to be detected, and determine whether to delete the extended text segment according to the result of the matching detection to obtain the target social security data.

4. The knowledge base management system based on a large model according to claim 3 is characterized in that: The continuous scanning includes taking the character length of the entity to be detected as the detection length, taking the next adjacent character of the entity to be detected as the starting node, and scanning the type of social security data with the detection length to obtain an extended text segment.

5. The knowledge base management system based on a large model according to claim 1, characterized in that: The knowledge base construction module includes a data extraction unit, an ontology construction unit and a knowledge graph construction unit, wherein: The data extraction unit is used to extract text data from the second type of social security data to obtain target social security data; The ontology construction unit is used to perform entity recognition and relationship extraction on the target social security data to obtain a social security ontology graph; The knowledge graph construction unit is used to store the social security ontology graph as a knowledge graph using a graph database.

6. The knowledge base management system based on a large model according to claim 5 is characterized in that: The ontology construction unit includes a word segmentation subunit and a construction subunit, wherein: The word segmentation subunit divides the target social security data into a plurality of sentences to be processed using a period as an identifier, and performs word segmentation processing on each of the sentences to be processed to obtain a plurality of entity words; The construction subunit is used to form a social security ontology graph based on entity words and relationship extraction models.

7. The knowledge base management system based on a large model according to claim 6 is characterized in that: The verification module includes a recording unit, a calculation unit, a determination unit and an adjustment unit, wherein: The recording unit is used to record user query data, wherein the user query data includes query keywords, timestamps and query results; The calculation unit is used to calculate the actual effective query rate based on the query result; The actual effective query rate is the percentage of effective keywords to the total number of keywords after word segmentation; The determination unit is used to determine the actual effective query rate according to the standard effective query rate to determine whether the quality of the constructed knowledge graph meets the standard; The adjustment unit is used to select and adjust the model setting parameters or the data processing flow based on the historical query frequency of any query keyword.

8. The knowledge base management system based on a large model according to claim 7 is characterized in that: The adjustment unit includes a first adjustment unit and a second adjustment unit, wherein: The first adjustment unit is used to store the query keyword in the social security database for storage when the historical query frequency is greater than the standard query frequency; The second adjustment unit is used to adjust a hyperparameter of the model based on a change trend of an actual effective query rate when the historical query frequency is less than or equal to the standard query frequency, wherein the hyperparameter is a batch size for model training; Among them, a curve of the actual effective query rate changing with time is plotted to obtain an effective query curve, and the slope of the effective query curve is analyzed. If the slope of the effective query curve is less than the standard slope, the batch size is increased.

9. The knowledge base management system based on a large model according to claim 6, characterized in that: The word segmentation subunit performs word segmentation processing on each of the sentences to be processed, including: The social security professional vocabulary in the social security database is obtained, the social security professional vocabulary is added to the word segmentation library, and the word segmentation is performed using the word segmentation library to obtain a plurality of entity words.

10. The knowledge base management system based on a large model according to claim 6, characterized in that: The construction subunit is used to form a social security ontology graph based on word fragments and relationship extraction models, including: Obtaining the relationship between each entity word and the entity word through a relationship extraction model; Each entity word is matched in the ontology database, and the matched entity words and the relationship corresponding to the entity words are linked to the ontology to form a social security ontology graph.

Citation Information

Patent Citations

  • Service knowledge base management system and method based on knowledge big model

    CN118917390A

  • Knowledge graph construction method based on big data of smart community

    CN112883201A

  • Social security data processing method and system based on big data

    CN117314163A

  • Business expansion whole process monitoring method based on data medium station

    CN118153881A

  • Deep reading method and system based on knowledge graph

    CN118193748A