Certificate management method and system based on pre-trained large language model, and readable medium
Through the certificate management method of pre-trained large language model, the problem of low data integration efficiency and manual dependence on compliance inspection in digital certificate management is solved, efficient personalized services and real-time compliance inspection are realized, and the overall certificate management is improved. Efficiency and accuracy.
Patent Information
- Application Number
- CN202411135444.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2024-11-26
AI Technical Summary
The existing digital certificate management methods have insufficient data integration and management efficiency, lack of intelligent analysis and personalized services, the question-and-answer system depends on the matching of rules, and the compliance inspection depends on manual review efficiency and error-prone, and cannot adapt to regulations and policies in real time. change.
Using pre-trained large language model, collects and standardizes certificate information through ETL tools, stores it in a distributed system, uses NLP and machine learning to perform feature extraction and association analysis, provides personalized recommendations and real-time compliance checks, and combines deep learning to achieve intelligence Q&A and risk assessment.
It improves data integration efficiency, provides personalized services, enhances user interaction and query efficiency, realizes real-time compliance inspection, and reduces manual processing costs and errors.
Smart Images

Figure CN119025760A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a certificate management method, system and readable medium based on a pre-trained large language model, and belongs to the technical field of certificate management for artificial intelligence applications. Background Art
[0002] A digital certificate is a file that contains public key owner information and public key digitally signed by a certificate authority. It is an authoritative electronic document for identity authentication on the Internet. Existing digital certificate management methods have insufficient data integration and management efficiency, that is, most existing technologies are based on traditional databases for certificate information management, with low data integration efficiency and difficulty in meeting the management needs of large-scale data. Data processing often lacks intelligent analysis and cannot meet the needs of personalized services; it lacks intelligent recommendation and question-and-answer functions, that is, existing technologies often lack intelligent recommendation algorithms based on deep learning and cannot provide personalized certificate recommendation services based on user needs. Question-and-answer systems are mostly based on rule matching and are difficult to handle complex and changeable user queries. And compliance checks are not intelligent enough, that is, existing technologies rely on manual review in compliance checks, which is inefficient and error-prone. It is difficult to adapt to the rapid changes in laws and policies, and it is impossible to achieve real-time compliance checks. Summary of the invention
[0003] In response to the above problems, the purpose of the present invention is to provide a certificate management method, system and readable medium based on a pre-trained large language model, aiming to provide efficient and personalized certificate management services for large group companies and their second- and third-tier companies by introducing pre-trained large language model technology.
[0004] To achieve the above-mentioned purpose, the present invention proposes the following technical solutions: a certificate management method based on a pre-trained large language model, comprising the following steps: collecting certificate information from different subsidiaries, different departments and different formats, and standardizing it; storing the standardized certificate information in a distributed storage system to support the storage and rapid retrieval of a large amount of certificate information; extracting features from the certificate information of the distributed storage system, and establishing associations between the certificate information; recommending relevant certificate information based on the associations between the certificate information according to user needs and historical behaviors; checking whether the certificate information in the distributed storage system complies with company policies and industry standards, conducting risk assessments, and providing corresponding solutions.
[0005] Furthermore, the standardized processing method includes: collecting certificate information of different subsidiaries, different departments and different formats through ETL tools; cleaning the collected certificate information to remove duplicate, erroneous or incomplete data; and formatting the cleaned data through a data formatting algorithm according to the preset format and specifications of the certificate information.
[0006] Furthermore, the standardization process includes: format conversion and field mapping.
[0007] Furthermore, the distributed storage system stores data in multiple nodes in a dispersed manner, and adopts analytical query, which can quickly read and analyze the data in a certain column, and select fields for indexing according to the query frequency and filtering conditions.
[0008] Furthermore, the method for extracting features from the certificate information of the distributed storage system and establishing associations between the certificate information is as follows: performing text processing on the certificate information through natural language processing; extracting key information from the certificate information through a machine learning algorithm, and classifying, clustering and performing association analysis on the key information, thereby establishing associations between the certificate information.
[0009] Furthermore, the text information includes word segmentation, part-of-speech tagging and named entity recognition; the key information includes validity period, certificate type and holder.
[0010] Furthermore, based on collaborative filtering and content filtering technology, relevant certificate information or training resources are recommended according to user historical behavior; a knowledge graph of certificate information is constructed, and a deep learning model is combined to implement natural language-based question and answering, so that the system can understand and answer users' questions about certificates and provide personalized services.
[0011] Furthermore, the method for checking whether the certificate information in the distributed storage system complies with company policies and industry standards and conducting risk assessment is as follows: defining compliance check rules, and automatically checking whether the certificate complies with company policies and industry standards through the rule engine; building a risk assessment model through a machine learning algorithm, and conducting risk assessment and prediction on the certificate; real-time monitoring and alarming, setting monitoring thresholds, and conducting real-time alarming and processing of discovered compliance risks.
[0012] The present invention also discloses a certificate management system based on a pre-trained large language model, comprising: a certificate information collection layer, used to collect certificate information of different subsidiaries, different departments and different formats, and perform standardization processing on it; a data storage module, used to store the standardized certificate information in a distributed storage system to support the storage and rapid retrieval of a large amount of certificate information; a business logic processing module, used to extract features from the certificate information of the distributed storage system and establish associations between the certificate information; a user interaction module, used to recommend relevant certificate information based on the associations between the certificate information according to the needs and historical behaviors of the user; a risk assessment module, used to check whether the certificate information in the distributed storage system complies with company policies and industry standards, perform risk assessment, and provide corresponding solutions.
[0013] The present invention also discloses a computer-readable storage medium, on which a computer program is stored. The computer program is executed by a processor to implement any of the above-mentioned certificate management methods based on a pre-trained large language model.
[0014] The technical solution of the present invention has at least the following technical effects or advantages: 1. By adopting ETL tools, the solution of the present invention can integrate certificate information from different sources and in different formats more quickly and accurately, greatly improving the efficiency of data integration; through data cleaning and formatting, the system can ensure that all certificate information is stored and managed in accordance with unified standards, reducing errors and confusion caused by inconsistent data formats.
[0015] 2. The use of distributed storage system and column storage technology enables the solution in the present invention to retrieve a large amount of certificate information in a short time, greatly improving the user query efficiency. The distributed storage architecture ensures that the system can still maintain stable operation when facing large amounts of data and high concurrent requests, meeting the actual needs of certificate management.
[0016] 3. By using NLP and machine learning technology, the solution of the present invention can automatically extract key information from the certificate information, reducing the time and cost of manual processing; through classification and clustering algorithms, the system can accurately classify and analyze the association of certificates, providing users with more personalized services.
[0017] 4. The solution of the present invention can recommend relevant certificates or resources based on the user's historical behavior and needs, thereby improving user satisfaction; it can answer users' questions about certificates in real time, thereby enhancing the interactivity between users and the system. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 is a flow chart of a certificate management method based on a pre-trained large language model in one embodiment of the present invention; Figure 2 It is a structural diagram of a certificate management system based on a pre-trained large language model in one embodiment of the present invention. DETAILED DESCRIPTION
[0019] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention is described in detail through specific embodiments. However, it should be understood that the provision of specific embodiments is only for a better understanding of the present invention, and they should not be understood as limitations of the present invention. In the description of the present invention, it should be understood that the terms used are only for the purpose of description and cannot be understood as indicating or implying relative importance.
[0020] In order to solve the lack of intelligent recommendation and question-and-answer functions in the prior art, that is, the prior art often lacks an intelligent recommendation algorithm based on deep learning, and cannot provide personalized certificate recommendation services according to user needs. The question-and-answer system is mostly based on rule matching, which is difficult to handle complex and changeable user queries. And the compliance check is not intelligent enough, that is, the prior art relies on manual review in compliance checking, which is inefficient and error-prone. It is difficult to adapt to the rapid changes in laws and regulations and policies, and it is impossible to achieve real-time compliance checks. The present invention proposes a certificate management method, system and readable medium based on a pre-trained large language model, including multiple modular services, each of which is responsible for processing specific business functions, such as intelligent question and answer, user management, logging, etc. These services can run, upgrade and expand independently, which improves the maintainability and scalability of the system. The business logic layer also integrates natural language processing and machine learning algorithms to realize functions such as intelligent question and answer and personalized recommendation. It can interact directly with users, including receiving user input and displaying system output, and supports access to multiple channels, such as web pages, mobile applications, social media, etc., to ensure that users can access the system in their preferred way. The user interaction layer is also responsible for the design and implementation of the user interface, providing an intuitive and easy-to-use operating experience. The present invention is described in detail below through embodiments in conjunction with the accompanying drawings.
[0021] Embodiment 1 This embodiment discloses a certificate management method based on a pre-trained large language model. Figure 1 As shown, the following steps are included: S1 collects certificate information from different subsidiaries, departments and in different formats, and standardizes it.
[0022] The standardization processing methods include: collecting certificate information from different subsidiaries, departments and formats through ETL (Extract Transform Load) tools to ensure the comprehensiveness and integrity of the data; ETL tools extract, transform and load certificate information to ensure the accuracy and consistency of the data. Clean the collected certificate information, remove duplicate, erroneous or incomplete data, and apply Normalization algorithms, Functional Dependency (FD) processing and other redundancy to ensure data quality. According to the preset format and specifications of the certificate information, the cleaned data is formatted through the data formatting algorithm, that is, the certificate information is standardized into a unified format, and the consistency and standardization of the data are ensured through the data formatting algorithm (such as XML, JSON, etc.) to meet the unified format requirements of the system. This is to facilitate the subsequent storage, query and processing of certificate information. Standardization processing includes: format conversion and field mapping.
[0023] S2 stores the standardized certificate information in a distributed storage system to support the storage and fast retrieval of large amounts of certificate information.
[0024] A distributed storage system (such as Hadoop HDFS) is an efficient and scalable data storage system that supports the storage and rapid retrieval of large amounts of certificate information. Using distributed storage systems such as Hadoop's HDFS or Amazon's S3, the distributed storage system stores data in multiple nodes in a dispersed manner to improve scalability and high availability. Such as Apache Parquet and ORC. The certificate information uses appropriate data structures, such as indexes, hash tables, etc., and uses analytical queries to quickly read and analyze data in a certain column. Fields are selected for indexing based on query frequency and filter conditions to improve data query performance, retrieval efficiency and accuracy, such as using index structures such as B-tree and Bitmap to improve query efficiency. In this embodiment, the storage system can also use a column storage system, or a storage system that combines a distributed storage system with a column storage system.
[0025] S3 extracts features from the certificate information of the distributed storage system and establishes associations between the certificate information.
[0026] The method for extracting features from the certificate information of the distributed storage system and establishing associations between the certificate information is as follows: text processing of the certificate information is performed through natural language processing (NLP); key information in the certificate information is extracted through a machine learning algorithm, and the key information is classified, clustered, and associated, thereby establishing associations between the certificate information. The text information includes word segmentation, part-of-speech tagging, and named entity recognition; the key information includes validity period, certificate type, and holder.
[0027] Natural Language Processing (NLP): Use deep learning algorithms and models (such as BERT and GPT series) to perform text standardization, stem extraction, and stop word removal on certificate information. Use classification, clustering and other algorithms to classify and analyze the association of certificates and extract key information.
[0028] S4 recommends relevant certificate information based on the user's needs and historical behavior and the association between certificate information.
[0029] According to the intelligent recommendation method, relevant certificates or training resources are recommended based on the user's needs and historical behavior. It is necessary to build an intelligent question-answering system that can understand and answer users' questions about certificates and provide personalized services.
[0030] Based on collaborative filtering and content filtering technology, relevant certificate information or training resources are recommended according to user historical behavior; a knowledge graph of certificate information is constructed, and deep learning models (such as BERT and ChatGLM) are combined to implement natural language-based question and answer, providing real-time question and answer support, so that the system can understand and answer users' questions about certificates and provide personalized services.
[0031] S5 checks whether the certificate information in the distributed storage system complies with company policies and industry standards, conducts risk assessment, and provides corresponding solutions.
[0032] Check whether the certificate information in the distributed storage system complies with company policies and industry standards. The method of risk assessment is: define compliance check rules, automatically check whether the certificate complies with company policies and industry standards through the rule engine; build a risk assessment model through machine learning algorithms to conduct risk assessment and prediction for certificates; real-time monitoring and alarm, set monitoring thresholds, and conduct real-time alarm and processing of discovered compliance risks. It can identify potential risks and problems in certificates and provide corresponding solutions.
[0033] Embodiment 2 Based on the same inventive concept, this embodiment discloses a certificate management system based on a pre-trained large language model, including: The certificate information collection layer is used to collect certificate information from different subsidiaries, departments and in different formats, and standardize it; The data storage module is used to store the standardized certificate information in a distributed storage system to support the storage and rapid retrieval of a large amount of certificate information. This module is responsible for the storage, retrieval and management of data. It uses a distributed database and cache system to ensure that the system can efficiently handle a large amount of data read and write operations. The data storage and management layer also provides a data backup and recovery mechanism to ensure data security and availability. In addition, it also supports data analysis and mining to provide support for system optimization and decision-making.
[0034] The business logic processing module is used to extract features from the certificate information of the distributed storage system and establish associations between the certificate information; this module is the core of the system and is responsible for processing user requests and executing the corresponding business logic. It includes multiple services, each of which is responsible for handling specific business functions such as intelligent question and answer, user management, logging, etc. These services can run, upgrade, and expand independently, which improves the maintainability and scalability of the system. The business logic layer also integrates natural language processing and machine learning algorithms to implement functions such as intelligent question and answer and personalized recommendations.
[0035] The user interaction module is used to recommend relevant certificate information based on the association between certificate information and user needs and historical behaviors. It is mainly responsible for direct interaction with users, including receiving user input and displaying system output. It supports access through multiple channels, such as web pages, mobile applications, social media, etc., to ensure that users can access the system in their preferred way. The user interaction layer is also responsible for the design and implementation of the user interface, providing an intuitive and easy-to-use operating experience.
[0036] The risk assessment module is used to check whether the certificate information in the distributed storage system complies with company policies and industry standards, conduct risk assessment, and provide corresponding solutions.
[0037] The system also includes a support module to provide stable and efficient basic model support and basic business data support for the upper-level business logic. This module integrates the basic components, model library, data processing capabilities, etc. required by the system, ensuring that the business logic layer can focus on implementing the core business logic without paying attention to the underlying details.
[0038] The system also includes an infrastructure module, which is the physical basis for the operation of the entire system, including hardware resources such as servers, storage devices, and network devices, as well as software resources such as operating systems and database management systems. The infrastructure layer is responsible for providing a stable and reliable computing and storage environment to ensure the normal operation of the system.
[0039] Embodiment 3 Based on the same inventive concept, this embodiment discloses a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to implement any of the above-mentioned certificate management methods based on a pre-trained large language model.
[0040] Based on the same inventive concept, this embodiment discloses a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to implement any of the above items.
[0041] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0042] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0043] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0044] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0045] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation of the present invention can still be modified or replaced by equivalents, and any modification or equivalent replacement that does not deviate from the spirit and scope of the present invention should be included in the protection scope of the claims of the present invention. The above content is only a specific implementation of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.
Claims
1. A certificate management method based on a pre-trained large language model, characterized in that: The following steps are involved: Collect certificate information from different subsidiaries, departments and in different formats and standardize them; Store standardized certificate information in a distributed storage system to support storage and fast retrieval of large amounts of certificate information; Extracting features from the certificate information of the distributed storage system and establishing associations between the certificate information; Recommend relevant certificate information based on the user's needs and historical behavior and the association between certificate information; Check whether the certificate information in the distributed storage system complies with company policies and industry standards, conduct risk assessment, and provide corresponding solutions.
2. The certificate management method based on the pre-trained large language model according to claim 1, characterized in that: The method of the standardization process comprises: Collect certificate information from different subsidiaries, departments and in different formats through ETL tools; clean the collected certificate information to remove duplicate, erroneous or incomplete data; format the cleaned data through data formatting algorithms according to the preset certificate information format and specifications.
3. The certificate management method based on the pre-trained large language model according to claim 2, characterized in that: The standardization process includes: format conversion and field mapping.
4. The certificate management method based on the pre-trained large language model according to claim 1, characterized in that: The distributed storage system stores data in multiple nodes in a dispersed manner, adopts analytical query, can quickly read and analyze data in a certain column, and selects fields for indexing according to query frequency and filter conditions.
5. The certificate management method based on the pre-trained large language model according to claim 1, characterized in that: The method for extracting features from the certificate information of the distributed storage system and establishing associations between the certificate information is as follows: performing text processing on the certificate information through natural language processing; extracting key information from the certificate information through a machine learning algorithm, and classifying, clustering and performing association analysis on the key information, thereby establishing associations between the certificate information.
6. The certificate management method based on the pre-trained large language model according to claim 5, characterized in that: The text information includes word segmentation, part-of-speech tagging and named entity recognition; the key information includes validity period, certificate type and holder.
7. The certificate management method based on the pre-trained large language model according to claim 1, characterized in that: Based on collaborative filtering and content filtering technology, relevant certificate information or training resources are recommended according to user historical behavior; a knowledge graph of certificate information is constructed, and a deep learning model is combined to implement natural language-based question and answering, so that the system can understand and answer users' questions about certificates and provide personalized services.
8. The certificate management method based on the pre-trained large language model according to claim 1, characterized in that: Check whether the certificate information in the distributed storage system complies with company policies and industry standards. The method for risk assessment is: define compliance check rules, automatically check whether the certificate complies with company policies and industry standards through the rule engine; build a risk assessment model through machine learning algorithms to conduct risk assessment and prediction on certificates; Real-time monitoring and alarm, set monitoring thresholds, and issue real-time alarms and handle discovered compliance risks.
9. A certificate management system based on a pre-trained large language model, characterized in that: include: The certificate information collection layer is used to collect certificate information from different subsidiaries, departments and in different formats, and standardize it; The data storage module is used to store the standardized certificate information in a distributed storage system to support the storage and rapid retrieval of a large amount of certificate information; A business logic processing module, used to extract features from the certificate information of the distributed storage system and establish associations between the certificate information; A user interaction module is used to recommend relevant certificate information based on the association between certificate information according to user needs and historical behavior; The risk assessment module is used to check whether the certificate information in the distributed storage system complies with company policies and industry standards, conduct risk assessment, and provide corresponding solutions.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the certificate management method based on a pre-trained large language model as described in any one of claims 1-8.
Citation Information
Patent Citations
Electronic certificate distributed management method and system based on micro-service
CN111953799A
Enterprise qualification authentication intelligent analysis management method based on big data analysis and cloud service platform
CN113139754A
System and method for storing and retrieving massive electronic certificates in distributed database
CN116010523A
Personalized recommendation system and method based on knowledge graph and collaborative filtering
CN118227884A
Data management method and device based on large model, equipment and medium
CN118503235A
Cited By
Insurance product recommendation method and related device
CN119693089A
Digital certificate security auditing system and method based on multi-modal analysis cross-cloud architecture
CN120342640A
Digital certificate security audit system and method based on multimodal analysis and cross-cloud architecture
CN120342640B
Security authentication data management method and system
CN121029748A
