Operation and maintenance question and answer data processing method and system based on large language model

Abstract

The invention discloses an operation and maintenance question and answer data processing method and system based on a large language model. The method comprises the steps of obtaining operation and maintenance question data and user parameters of a target operation and maintenance user; inputting the operation and maintenance question into a trained large language model to obtain direct answer data and reference data corresponding to the operation and maintenance question; according to the user parameter and the reference data, based on a neural network algorithm, predicting an answer fine tuning parameter; inputting the answer fine tuning parameter and the direct answer data into the large language model to obtain corrected answer data; the correction answer data is used for being sent to the terminal of the target operation and maintenance user to be displayed. Therefore, the operation and maintenance question and answer service can be provided for the operation and maintenance user more accurately and efficiently, the efficiency and the convenience degree of operation and maintenance work are improved, and the operation and maintenance cost and operation and maintenance errors are reduced.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method and system for processing operation and maintenance question and answer data based on a large language model. Background Art

[0002] In the field of modern information technology, operation and maintenance work plays a vital role. It is a key link to ensure the normal operation of information technology systems, covering server management, application deployment, performance monitoring, troubleshooting and other aspects. With the continuous development of technology and the increase in business complexity, the importance of operation and maintenance has become increasingly prominent, and at the same time, the threshold for operation and maintenance work has been greatly raised, requiring operation and maintenance personnel to have knowledge and skills in system management, network management, security management and other aspects. The existing technology proposes a standard operation and maintenance information database technology to meet the data search needs of operation and maintenance personnel, but this technology cannot achieve more intelligent operation and maintenance Q&A, nor can it provide efficient and automated operation and maintenance Q&A to improve the work efficiency of operation and maintenance personnel. It can be seen that the existing technology has defects that need to be solved urgently. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide an operation and maintenance question and answer data processing method and system based on a large language model, which can provide operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improve the efficiency and convenience of operation and maintenance work, and reduce operation and maintenance costs and operation and maintenance errors.

[0004] In order to solve the above technical problems, the first aspect of the present invention discloses a method for processing operation and maintenance question and answer data based on a large language model, the method comprising: Obtain the operation and maintenance problem data and user parameters of the target operation and maintenance user; Input the operation and maintenance question into the trained large language model to obtain direct answer data and reference data corresponding to the operation and maintenance question; According to the user parameters and the reference data, based on a neural network algorithm, predicting answer fine-tuning parameters; The answer fine-tuning parameters and the direct answer data are input into the large language model to obtain modified answer data; the modified answer data is sent to the terminal of the target operation and maintenance user for display.

[0005] As an optional implementation, in the first aspect of the present invention, the large language model is trained by the following steps: Collecting operation and maintenance standard data and operation and maintenance question and answer template data, cleaning and splitting the operation and maintenance standard data and operation and maintenance question and answer template data, extracting valid question and answer pair data, performing part-of-speech analysis and entity naming task processing on the question and answer pair data, and storing the processed question and answer pair data in a question and answer pair database; Noun entities and verb entities are extracted from the question-answer pair database, and related clustering data is analyzed after vectorization conversion of the noun entities and verb entities to obtain multiple groups of mapping pairs, and the understanding ability of the PLM pre-trained large language model is evaluated through the multiple groups of mapping pairs, and a knowledge dialogue set is constructed based on the mapping pairs with negative evaluation results; manual answer fine-tuning parameter annotation is performed on the question-answer pair database, and a task dialogue set is constructed based on the question-answer pair data and the manual answer fine-tuning parameter annotation; The training corpus and test corpus are constructed through the knowledge dialogue set and the task dialogue set. The training corpus is input into the large language model pre-trained by PLM for instruction fine-tuning, and the test corpus is input into the large language model to verify the accuracy. This process is repeated until the verification result of the large language model meets the preset requirements to obtain a trained large language model.

[0006] As an optional embodiment, in the first aspect of the present invention, the answer fine-tuning parameters or the manual answer fine-tuning parameter annotations include at least one of answer tone parameters, answer information volume parameters, answer citation material volume parameters and answer text style parameters.

[0007] As an optional implementation, in the first aspect of the present invention, the user parameters include user position, user department, user working experience, user gender and user educational background.

[0008] As an optional implementation, in the first aspect of the present invention, predicting the answer fine-tuning parameters based on the user parameters and the reference data and based on a neural network algorithm comprises: Based on the user parameters, multiple similar user historical operation and maintenance question and answer records are screened out from multiple candidate user historical operation and maintenance question and answer records; All the similar user historical operation and maintenance question and answer records and the reference data are input into the trained fine-tuning parameter prediction neural network to obtain the output answer fine-tuning parameters.

[0009] As an optional implementation manner, in the first aspect of the present invention, the selecting a plurality of similar user historical operation and maintenance question and answer records from a plurality of candidate user historical operation and maintenance question and answer records based on the user parameters comprises: For each candidate user's historical operation and maintenance question and answer record, obtain the candidate user parameters and multiple question and answer record texts corresponding to the candidate user's historical operation and maintenance question and answer record; Calculating a first similarity between the candidate user parameter and the user parameter; Calculating an average of the similarities between all the question and answer record texts and the current question and answer data to obtain a second similarity; the current answer data includes the operation and maintenance question data and the direct answer data; Calculate the product of the first similarity and the second similarity to obtain the record parameter corresponding to the historical operation and maintenance question and answer record of the candidate user; Sorting all the candidate user's historical operation and maintenance question and answer records from large to small according to the record parameters to obtain a record sequence; All the candidate user historical operation and maintenance question and answer records whose first preset number in the record sequence and whose record parameters are greater than the parameter threshold are screened out to obtain a plurality of similar user historical operation and maintenance question and answer records.

[0010] As an optional embodiment, in the first aspect of the present invention, the fine-tuning parameter prediction neural network is a CNN neural network, which is trained by a training data set including multiple training user operation and maintenance question and answer record data and corresponding reference material annotations and answer fine-tuning parameter annotations, and is trained based on the cross entropy loss function and gradient descent algorithm until convergence.

[0011] As an optional implementation, in the first aspect of the present invention, the step of inputting the answer fine-tuning parameter and the direct answer data into the large language model to obtain the modified answer data comprises: Based on the preset language organization rules, a fine-tuning command statement is determined according to the answer fine-tuning parameter; Combining the direct answer data and the fine-tuning command sentence into an input command sentence; The input command sentence is input to the large language model to obtain modified answer data of the output of the large language model.

[0012] A second aspect of an embodiment of the present invention discloses an operation and maintenance question and answer data processing system based on a large language model, the system comprising: The acquisition module is used to obtain the operation and maintenance problem data and user parameters of the target operation and maintenance user; An input module, used to input the operation and maintenance problem into the trained large language model to obtain direct answer data and reference data corresponding to the operation and maintenance problem; A prediction module, used to predict answer fine-tuning parameters based on the user parameters and the reference data and a neural network algorithm; A correction module is used to input the answer fine-tuning parameters and the direct answer data into the large language model to obtain corrected answer data; the corrected answer data is used to be sent to the terminal of the target operation and maintenance user for display.

[0013] As an optional implementation, in the second aspect of the present invention, the large language model is trained by the following steps: Collecting operation and maintenance standard data and operation and maintenance question and answer template data, cleaning and splitting the operation and maintenance standard data and operation and maintenance question and answer template data, extracting valid question and answer pair data, performing part-of-speech analysis and entity naming task processing on the question and answer pair data, and storing the processed question and answer pair data in a question and answer pair database; Noun entities and verb entities are extracted from the question-answer pair database, and related clustering data is analyzed after vectorization conversion of the noun entities and verb entities to obtain multiple groups of mapping pairs, and the understanding ability of the PLM pre-trained large language model is evaluated through the multiple groups of mapping pairs, and a knowledge dialogue set is constructed based on the mapping pairs with negative evaluation results; manual answer fine-tuning parameter annotation is performed on the question-answer pair database, and a task dialogue set is constructed based on the question-answer pair data and the manual answer fine-tuning parameter annotation; The training corpus and test corpus are constructed through the knowledge dialogue set and the task dialogue set. The training corpus is input into the large language model pre-trained by PLM for instruction fine-tuning, and the test corpus is input into the large language model to verify the accuracy. This process is repeated until the verification result of the large language model meets the preset requirements to obtain a trained large language model.

[0014] As an optional embodiment, in the second aspect of the present invention, the answer fine-tuning parameters or the manual answer fine-tuning parameter annotations include at least one of answer tone parameters, answer information volume parameters, answer citation material volume parameters and answer text style parameters.

[0015] As an optional implementation, in the second aspect of the present invention, the user parameters include user position, user department, user working experience, user gender and user educational background.

[0016] As an optional implementation, in the second aspect of the present invention, the prediction module predicts the specific manner of answer fine-tuning parameters based on the user parameters and the reference data and based on a neural network algorithm, including: Based on the user parameters, multiple similar user historical operation and maintenance question and answer records are screened out from multiple candidate user historical operation and maintenance question and answer records; All the similar user historical operation and maintenance question and answer records and the reference data are input into the trained fine-tuning parameter prediction neural network to obtain the output answer fine-tuning parameters.

[0017] As an optional implementation, in the second aspect of the present invention, the prediction module selects a plurality of similar user historical operation and maintenance question and answer records from a plurality of candidate user historical operation and maintenance question and answer records based on the user parameters, and the specific manner includes: For each candidate user's historical operation and maintenance question and answer record, obtain the candidate user parameters and multiple question and answer record texts corresponding to the candidate user's historical operation and maintenance question and answer record; Calculating a first similarity between the candidate user parameter and the user parameter; Calculating an average of the similarities between all the question and answer record texts and the current question and answer data to obtain a second similarity; the current answer data includes the operation and maintenance question data and the direct answer data; Calculate the product of the first similarity and the second similarity to obtain the record parameter corresponding to the historical operation and maintenance question and answer record of the candidate user; Sorting all the candidate user's historical operation and maintenance question and answer records from large to small according to the record parameters to obtain a record sequence; All the candidate user historical operation and maintenance question and answer records whose first preset number in the record sequence and whose record parameters are greater than the parameter threshold are screened out to obtain a plurality of similar user historical operation and maintenance question and answer records.

[0018] As an optional embodiment, in the second aspect of the present invention, the fine-tuning parameter prediction neural network is a CNN neural network, which is trained by a training data set including multiple training user operation and maintenance question and answer record data and corresponding reference material annotations and answer fine-tuning parameter annotations, and is trained based on the cross entropy loss function and gradient descent algorithm until convergence.

[0019] As an optional implementation, in the second aspect of the present invention, the correction module inputs the answer fine-tuning parameter and the direct answer data into the large language model to obtain a specific method for correcting the answer data, including: Based on the preset language organization rules, a fine-tuning command statement is determined according to the answer fine-tuning parameter; Combining the direct answer data and the fine-tuning command sentence into an input command sentence; The input command sentence is input to the large language model to obtain modified answer data of the output of the large language model.

[0020] The third aspect of the present invention discloses another operation and maintenance question and answer data processing system based on a large language model, the system comprising: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute part or all of the steps in the operation and maintenance question and answer data processing method based on a large language model disclosed in the first aspect of the present invention.

[0021] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute part or all of the steps in the operation and maintenance question and answer data processing method based on a large language model disclosed in the first aspect of the present invention.

[0022] Compared with the prior art, the embodiments of the present invention have the following beneficial effects: The present invention can obtain direct answer data and reference data corresponding to operation and maintenance questions based on the trained large language model, and then predict answer fine-tuning parameters based on user parameters and reference data, so as to correct the direct answer data based on the large language model to obtain more accurate corrected answer data, thereby being able to provide operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improve the efficiency and convenience of operation and maintenance work, and reduce operation and maintenance costs and operation and maintenance errors. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 It is a flowchart of a method for processing operation and maintenance question and answer data based on a large language model disclosed in an embodiment of the present invention.

[0025] Figure 2 It is a structural diagram of an operation and maintenance question and answer data processing system based on a large language model disclosed in an embodiment of the present invention.

[0026] Figure 3 It is a structural diagram of another operation and maintenance question and answer data processing system based on a large language model disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0028] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or equipment.

[0029] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0030] The present invention discloses a method and system for processing operation and maintenance question and answer data based on a large language model, which can obtain direct answer data and reference data corresponding to operation and maintenance questions according to the trained large language model, and then predict answer fine-tuning parameters based on user parameters and reference data, so as to correct the direct answer data based on the large language model to obtain more accurate corrected answer data, thereby being able to provide operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improve the efficiency and convenience of operation and maintenance work, and reduce operation and maintenance costs and errors. The following are detailed descriptions.

[0031] Embodiment 1 See also Figure 1 , Figure 1 : is a flow chart of a method for processing operation and maintenance question and answer data based on a large language model disclosed in an embodiment of the present invention. Figure 1 The described operation and maintenance question and answer data processing method based on a large language model can be applied to a data processing system / data processing device / data processing server (wherein the server includes a local processing server or a cloud processing server). Figure 1 As shown, the operation and maintenance question and answer data processing method based on the large language model may include the following operations: 101. Obtain operation and maintenance problem data and user parameters of the target operation and maintenance user.

[0032] 102. Input the operation and maintenance questions into the trained large language model to obtain the direct answer data and reference data corresponding to the operation and maintenance questions. 103. According to user parameters and reference data, based on the neural network algorithm, the answer fine-tuning parameters are predicted. 104. Input the answer fine-tuning parameters and the direct answer data into the large language model to obtain the corrected answer data.

[0033] Optionally, the modified answer data is sent to a terminal of a target operation and maintenance user for display.

[0034] It can be seen that the above-mentioned embodiments of the invention can obtain direct answer data and reference data corresponding to operation and maintenance questions based on the trained large language model, and then predict answer fine-tuning parameters based on user parameters and reference data, so as to correct the direct answer data based on the large language model to obtain more accurate corrected answer data, thereby being able to provide operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improve the efficiency and convenience of operation and maintenance work, and reduce operation and maintenance costs and operation and maintenance errors.

[0035] As an optional embodiment, in the above steps, the large language model is trained by the following steps: Collect operation and maintenance standard data and operation and maintenance question and answer template data, clean and split the operation and maintenance standard data and operation and maintenance question and answer template data, extract valid question and answer pair data, perform part-of-speech analysis and entity naming task processing on the question and answer pair data, and store the processed question and answer pair data into the question and answer pair database; Extract noun entities and verb entities from the question-answer pair database, vectorize and convert the noun entities and verb entities, and then analyze the related clustering data to obtain multiple sets of mapping pairs. Use the multiple sets of mapping pairs to evaluate the understanding ability of the PLM pre-trained large language model, and build a knowledge dialogue set based on the mapping pairs with negative evaluation results. Optionally, manually fine-tune the parameters of the question-answer pair database, and build a task dialogue set based on the question-answer pair data and the manual fine-tune parameter annotations. The training corpus and test corpus are constructed through the knowledge dialogue set and the task dialogue set. The training corpus is input into the large language model pre-trained by PLM for instruction fine-tuning, and the test corpus is input into the large language model to verify the accuracy. This process is repeated until the verification result of the large language model meets the preset requirements to obtain a trained large language model.

[0036] It can be seen that through the above optional embodiments, the training details of the large language model are limited, and the large language model can be fully trained based on the collected operation and maintenance data and manual answer fine-tuning parameter annotations to obtain a model that can accurately predict answer data and correct answer data, thereby assisting in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0037] As an optional embodiment, in the above steps, the answer fine-tuning parameters or manual answer fine-tuning parameter annotations include at least one of answer tone parameters, answer information volume parameters, answer citation material volume parameters and answer text style parameters.

[0038] It can be seen that through the above-mentioned optional embodiments, the answer fine-tuning parameters or the content of the answer fine-tuning parameter annotations are limited, which can more accurately characterize the characteristics of the answers that users may be more willing to accept, so as to facilitate the subsequent acquisition of more accurate corrected answer data, and assist in providing operation and maintenance users with more accurate and efficient operation and maintenance question and answer services, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0039] As an optional embodiment, in the above steps, the user parameters include user position, user department, user working experience, user gender and user education background.

[0040] It can be seen that through the above optional embodiments, the content of user parameters is limited, which can fully characterize the user's characteristics, so as to facilitate the subsequent accurate prediction of fine-tuning parameters, and assist in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0041] As an optional embodiment, in the above steps, according to the user parameters and reference data, based on the neural network algorithm, predicting the answer fine-tuning parameters includes: Based on user parameters, multiple similar user historical operation and maintenance question and answer records are selected from multiple candidate user historical operation and maintenance question and answer records; All similar user historical operation and maintenance question and answer records and reference data are input into the trained fine-tuning parameter prediction neural network to obtain the output answer fine-tuning parameters.

[0042] It can be seen that through the above-mentioned optional embodiments, multiple similar user historical operation and maintenance question and answer records can be screened out from multiple candidate user historical operation and maintenance question and answer records according to user parameters, so as to accurately predict the fine-tuning parameters according to the trained fine-tuning parameter prediction neural network combined with similar user question and answer records and reference data, thereby assisting in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and operation and maintenance errors.

[0043] As an optional embodiment, in the above step, based on the user parameters, multiple similar user historical operation and maintenance question and answer records are screened out from multiple candidate user historical operation and maintenance question and answer records, including: For each candidate user's historical operation and maintenance question and answer record, obtain the candidate user parameters and multiple question and answer record texts corresponding to the candidate user's historical operation and maintenance question and answer record; Calculating a first similarity between the candidate user parameters and the user parameters; Calculate the average of the similarities between all question and answer record texts and the current question and answer data to obtain a second similarity; optionally, the current answer data includes operation and maintenance question data and direct answer data; Calculate the product of the first similarity and the second similarity to obtain the record parameter corresponding to the historical operation and maintenance question and answer record of the candidate user; Sort all candidate user historical operation and maintenance question and answer records from large to small according to the record parameters to obtain a record sequence; All candidate user historical operation and maintenance question and answer records whose record parameters are greater than the parameter threshold before a preset number in the record sequence are screened out to obtain multiple similar user historical operation and maintenance question and answer records.

[0044] It can be seen that through the above-mentioned optional embodiments, user question and answer records can be screened by comparing the similarity between the user parameters and question and answer record text in the candidate user's historical operation and maintenance question and answer records and the current user parameters and question and answer data, so as to facilitate the subsequent accurate prediction of fine-tuning parameters, and assist in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and operation and maintenance errors.

[0045] As an optional embodiment, in the above steps, the fine-tuning parameter prediction neural network is a CNN neural network, which is trained by a training data set including multiple training user operation and maintenance question and answer record data and corresponding reference material annotations and answer fine-tuning parameter annotations, and is trained based on the cross entropy loss function and gradient descent algorithm until convergence.

[0046] It can be seen that through the above optional embodiments, the network details and training details of the fine-tuning parameter prediction neural network are defined to accurately predict the answer fine-tuning parameters, thereby assisting in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0047] As an optional embodiment, in the above step, inputting the answer fine-tuning parameters and the direct answer data into the large language model to obtain the modified answer data includes: Based on the preset language organization rules, a fine-tuning command statement is determined according to the answer fine-tuning parameter; The direct answer data and the fine-tuning command statement form an input command statement; The input command sentence is input to the large language model to obtain the modified answer data of the output of the large language model.

[0048] It can be seen that through the above-mentioned optional embodiments, the fine-tuning command statement can be determined according to the answer fine-tuning parameters through the preset language organization rules, so as to combine the direct answer data to form the input command statement, so as to facilitate the large language model to directly understand and execute the fine-tuning command, obtain more accurate corrected answer data, and realize more accurate and efficient provision of operation and maintenance question and answer services to operation and maintenance users, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0049] Embodiment 2 See also Figure 2 , Figure 2 : is a schematic diagram of the structure of an operation and maintenance question and answer data processing system based on a large language model disclosed in an embodiment of the present invention. Figure 2 The described operation and maintenance question and answer data processing system based on a large language model can be applied to a data processing system / data processing device / data processing server (wherein the server includes a local processing server or a cloud processing server). Figure 2 As shown, the operation and maintenance question and answer data processing system based on the large language model may include: The acquisition module 201 is used to acquire the operation and maintenance problem data and user parameters of the target operation and maintenance user.

[0050] The input module 202 is used to input the operation and maintenance questions into the trained large language model to obtain direct answer data and reference data corresponding to the operation and maintenance questions. The prediction module 203 is used to predict the answer fine-tuning parameters based on the user parameters and reference data and the neural network algorithm. The correction module 204 is used to input the answer fine-tuning parameters and the direct answer data into the large language model to obtain the corrected answer data.

[0051] Optionally, the modified answer data is sent to a terminal of a target operation and maintenance user for display.

[0052] It can be seen that the above-mentioned embodiments of the invention can obtain direct answer data and reference data corresponding to operation and maintenance questions based on the trained large language model, and then predict answer fine-tuning parameters based on user parameters and reference data, so as to correct the direct answer data based on the large language model to obtain more accurate corrected answer data, thereby being able to provide operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improve the efficiency and convenience of operation and maintenance work, and reduce operation and maintenance costs and operation and maintenance errors.

[0053] As an optional embodiment, the large language model is trained by the following steps: Collect operation and maintenance standard data and operation and maintenance question and answer template data, clean and split the operation and maintenance standard data and operation and maintenance question and answer template data, extract valid question and answer pair data, perform part-of-speech analysis and entity naming task processing on the question and answer pair data, and store the processed question and answer pair data into the question and answer pair database; Extract noun entities and verb entities from the question-answer pair database, vectorize and convert the noun entities and verb entities, and then analyze the related clustering data to obtain multiple sets of mapping pairs. Use the multiple sets of mapping pairs to evaluate the understanding ability of the PLM pre-trained large language model, and build a knowledge dialogue set based on the mapping pairs with negative evaluation results. Optionally, manually fine-tune the parameters of the question-answer pair database, and build a task dialogue set based on the question-answer pair data and the manual fine-tune parameter annotations. The training corpus and test corpus are constructed through the knowledge dialogue set and the task dialogue set. The training corpus is input into the large language model pre-trained by PLM for instruction fine-tuning, and the test corpus is input into the large language model to verify the accuracy. This process is repeated until the verification result of the large language model meets the preset requirements to obtain a trained large language model.

[0054] It can be seen that through the above optional embodiments, the training details of the large language model are limited, and the large language model can be fully trained based on the collected operation and maintenance data and manual answer fine-tuning parameter annotations to obtain a model that can accurately predict answer data and correct answer data, thereby assisting in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0055] As an optional embodiment, the answer fine-tuning parameters or manual answer fine-tuning parameter annotations include at least one of an answer tone parameter, an answer information volume parameter, an answer citation material volume parameter, and an answer text style parameter.

[0056] It can be seen that through the above-mentioned optional embodiments, the answer fine-tuning parameters or the content of the answer fine-tuning parameter annotations are limited, which can more accurately characterize the characteristics of the answers that users may be more willing to accept, so as to facilitate the subsequent acquisition of more accurate corrected answer data, and assist in providing operation and maintenance users with more accurate and efficient operation and maintenance question and answer services, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0057] As an optional embodiment, the user parameters include user position, user department, user working experience, user gender and user education background.

[0058] It can be seen that through the above optional embodiments, the content of user parameters is limited, which can fully characterize the user's characteristics, so as to facilitate the subsequent accurate prediction of fine-tuning parameters, and assist in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0059] As an optional embodiment, the prediction module predicts the specific method of fine-tuning the answer parameters based on the user parameters and reference data and the neural network algorithm, including: Based on user parameters, multiple similar user historical operation and maintenance question and answer records are selected from multiple candidate user historical operation and maintenance question and answer records; All similar user historical operation and maintenance question and answer records and reference data are input into the trained fine-tuning parameter prediction neural network to obtain the output answer fine-tuning parameters.

[0060] It can be seen that through the above-mentioned optional embodiments, multiple similar user historical operation and maintenance question and answer records can be screened out from multiple candidate user historical operation and maintenance question and answer records according to user parameters, so as to accurately predict the fine-tuning parameters according to the trained fine-tuning parameter prediction neural network combined with similar user question and answer records and reference data, thereby assisting in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and operation and maintenance errors.

[0061] As an optional embodiment, the specific manner in which the prediction module selects multiple similar user historical operation and maintenance question and answer records from multiple candidate user historical operation and maintenance question and answer records based on user parameters includes: For each candidate user's historical operation and maintenance question and answer record, obtain the candidate user parameters and multiple question and answer record texts corresponding to the candidate user's historical operation and maintenance question and answer record; Calculating a first similarity between the candidate user parameters and the user parameters; Calculate the average of the similarities between all question and answer record texts and the current question and answer data to obtain a second similarity; optionally, the current answer data includes operation and maintenance question data and direct answer data; Calculate the product of the first similarity and the second similarity to obtain the record parameter corresponding to the historical operation and maintenance question and answer record of the candidate user; Sort all candidate user historical operation and maintenance question and answer records from large to small according to the record parameters to obtain a record sequence; All candidate user historical operation and maintenance question and answer records whose record parameters are greater than the parameter threshold before a preset number in the record sequence are screened out to obtain multiple similar user historical operation and maintenance question and answer records.

[0062] It can be seen that through the above-mentioned optional embodiments, user question and answer records can be screened by comparing the similarity between the user parameters and question and answer record text in the candidate user's historical operation and maintenance question and answer records and the current user parameters and question and answer data, so as to facilitate the subsequent accurate prediction of fine-tuning parameters, and assist in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and operation and maintenance errors.

[0063] As an optional embodiment, the fine-tuning parameter prediction neural network is a CNN neural network, which is trained by a training data set including multiple training user operation and maintenance question and answer record data and corresponding reference material annotations and answer fine-tuning parameter annotations, and is trained based on the cross entropy loss function and gradient descent algorithm until convergence.

[0064] It can be seen that through the above optional embodiments, the network details and training details of the fine-tuning parameter prediction neural network are defined to accurately predict the answer fine-tuning parameters, thereby assisting in providing operation and maintenance question and answer services to operation and maintenance users more accurately and efficiently, improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0065] As an optional embodiment, the correction module inputs the answer fine-tuning parameters and the direct answer data into the large language model to obtain a specific method for correcting the answer data, including: Based on the preset language organization rules, a fine-tuning command statement is determined according to the answer fine-tuning parameter; The direct answer data and the fine-tuning command statement form an input command statement; The input command sentence is input to the large language model to obtain the modified answer data of the output of the large language model.

[0066] It can be seen that through the above-mentioned optional embodiments, the fine-tuning command statement can be determined according to the answer fine-tuning parameters through the preset language organization rules, so as to combine the direct answer data to form the input command statement, so as to facilitate the large language model to directly understand and execute the fine-tuning command, obtain more accurate corrected answer data, and realize more accurate and efficient provision of operation and maintenance question and answer services to operation and maintenance users, thereby improving the efficiency and convenience of operation and maintenance work, and reducing operation and maintenance costs and errors.

[0067] Embodiment 3 See also Figure 3 , Figure 3 It is another operation and maintenance question and answer data processing system based on a large language model disclosed in an embodiment of the present invention. Figure 3 The described operation and maintenance question and answer data processing system based on a large language model is applied to a data processing system / data processing device / data processing server (wherein the server includes a local processing server or a cloud processing server). Figure 3As shown, the operation and maintenance question and answer data processing system based on the large language model may include: A memory 301 storing executable program codes; a processor 302 coupled to the memory 301; The processor 302 calls the executable program code stored in the memory 301 to execute the steps of the operation and maintenance question and answer data processing method based on a large language model described in the first embodiment.

[0068] Embodiment 4 An embodiment of the present invention discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the operation and maintenance question and answer data processing method based on a large language model described in the first embodiment.

[0069] Embodiment 5 An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps of the operation and maintenance question and answer data processing method based on a large language model described in Example 1.

[0070] The above describes specific embodiments of the present specification, and other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily have to be performed in the specific order or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0071] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0072] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0073] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification may be in the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the embodiments of this specification may be in the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0074] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0075] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0076] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0077] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0078] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0079] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0080] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0081] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0082] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0083] Finally, it should be noted that the operation and maintenance question and answer data processing method and system based on a large language model disclosed in the embodiment of the present invention only discloses a preferred embodiment of the present invention, which is only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A method for processing operation and maintenance question and answer data based on a large language model, characterized in that: The method comprises: Obtain the operation and maintenance problem data and user parameters of the target operation and maintenance user; Input the operation and maintenance question into the trained large language model to obtain direct answer data and reference data corresponding to the operation and maintenance question; According to the user parameters and the reference data, based on a neural network algorithm, predicting answer fine-tuning parameters; The answer fine-tuning parameters and the direct answer data are input into the large language model to obtain modified answer data; the modified answer data is sent to the terminal of the target operation and maintenance user for display.

2. The operation and maintenance question and answer data processing method based on a large language model according to claim 1 is characterized in that: The large language model is trained by the following steps: Collecting operation and maintenance standard data and operation and maintenance question and answer template data, cleaning and splitting the operation and maintenance standard data and operation and maintenance question and answer template data, extracting valid question and answer pair data, performing part-of-speech analysis and entity naming task processing on the question and answer pair data, and storing the processed question and answer pair data in a question and answer pair database; Noun entities and verb entities are extracted from the question-answer pair database, and related clustering data is analyzed after vectorization conversion of the noun entities and verb entities to obtain multiple groups of mapping pairs, and the understanding ability of the PLM pre-trained large language model is evaluated through the multiple groups of mapping pairs, and a knowledge dialogue set is constructed based on the mapping pairs with negative evaluation results; manual answer fine-tuning parameter annotation is performed on the question-answer pair database, and a task dialogue set is constructed based on the question-answer pair data and the manual answer fine-tuning parameter annotation; The training corpus and test corpus are constructed through the knowledge dialogue set and the task dialogue set. The training corpus is input into the large language model pre-trained by PLM for instruction fine-tuning, and the test corpus is input into the large language model to verify the accuracy. This process is repeated until the verification result of the large language model meets the preset requirements to obtain a trained large language model.

3. The operation and maintenance question and answer data processing method based on a large language model according to claim 2 is characterized in that: The answer fine-tuning parameter or the manual answer fine-tuning parameter annotation includes at least one of an answer tone parameter, an answer information volume parameter, an answer citation material volume parameter, and an answer text style parameter.

4. The operation and maintenance question and answer data processing method based on a large language model according to claim 1 is characterized in that: The user parameters include user position, user department, user working experience, user gender and user education background.

5. The operation and maintenance question and answer data processing method based on a large language model according to claim 1 is characterized in that: The step of predicting answer fine-tuning parameters based on the user parameters and the reference data and a neural network algorithm includes: Based on the user parameters, multiple similar user historical operation and maintenance question and answer records are screened out from multiple candidate user historical operation and maintenance question and answer records; All the similar user historical operation and maintenance question and answer records and the reference data are input into the trained fine-tuning parameter prediction neural network to obtain the output answer fine-tuning parameters.

6. The operation and maintenance question and answer data processing method based on a large language model according to claim 5 is characterized in that: The method of screening out a plurality of similar user historical operation and maintenance question and answer records from a plurality of candidate user historical operation and maintenance question and answer records based on the user parameters includes: For each candidate user's historical operation and maintenance question and answer record, obtain the candidate user parameters and multiple question and answer record texts corresponding to the candidate user's historical operation and maintenance question and answer record; Calculating a first similarity between the candidate user parameter and the user parameter; Calculating an average of the similarities between all the question and answer record texts and the current question and answer data to obtain a second similarity; the current answer data includes the operation and maintenance question data and the direct answer data; Calculate the product of the first similarity and the second similarity to obtain the record parameter corresponding to the historical operation and maintenance question and answer record of the candidate user; Sorting all the candidate user's historical operation and maintenance question and answer records from large to small according to the record parameters to obtain a record sequence; All the candidate user historical operation and maintenance question and answer records whose first preset number in the record sequence and whose record parameters are greater than the parameter threshold are screened out to obtain a plurality of similar user historical operation and maintenance question and answer records.

7. The operation and maintenance question and answer data processing method based on a large language model according to claim 5 is characterized in that: The fine-tuning parameter prediction neural network is a CNN neural network, which is trained by a training data set including a plurality of training user operation and maintenance question and answer record data and corresponding reference material annotations and answer fine-tuning parameter annotations, and is trained based on a cross entropy loss function and a gradient descent algorithm until convergence.

8. The operation and maintenance question and answer data processing method based on a large language model according to claim 1 is characterized in that: The step of inputting the answer fine-tuning parameter and the direct answer data into the large language model to obtain the modified answer data comprises: Based on the preset language organization rules, a fine-tuning command statement is determined according to the answer fine-tuning parameter; Combining the direct answer data and the fine-tuning command sentence into an input command sentence; The input command sentence is input to the large language model to obtain modified answer data of the output of the large language model.

9. An operation and maintenance question and answer data processing system based on a large language model, characterized in that: The system comprises: The acquisition module is used to obtain the operation and maintenance problem data and user parameters of the target operation and maintenance user; An input module, used to input the operation and maintenance problem into the trained large language model to obtain direct answer data and reference data corresponding to the operation and maintenance problem; A prediction module, used to predict answer fine-tuning parameters based on the user parameters and the reference data and a neural network algorithm; A correction module is used to input the answer fine-tuning parameters and the direct answer data into the large language model to obtain corrected answer data; the corrected answer data is used to be sent to the terminal of the target operation and maintenance user for display.

10. An operation and maintenance question and answer data processing system based on a large language model, characterized in that: The system comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the operation and maintenance question and answer data processing method based on a large language model as described in any one of claims 1-8.

Images