Joint decision model-based undertaking word acquisition method and system

Abstract

The invention discloses an undertaking word acquisition method and system based on a joint decision model, and belongs to the technical field of artificial intelligence, and the method comprises the following steps: dividing user behaviors according to business experience to obtain user behavior categories, and obtaining an undertaking word candidate list according to historical dialogue records, incorporating the undertaking words in the undertaking word candidate list into user behavior categories to obtain an affiliation list; acquiring a next user behavior corresponding to the historical dialogue record through the supervision model to obtain a behavior data set, and further acquiring an undertaking word score under the next user behavior through the affiliation table to obtain a score data set; and training the joint decision model based on the behavior data set and the score data set, and obtaining a final undertaking word through the successfully trained joint decision model. The technical problem that in the prior art, the obtaining efficiency of the undertaking words and the scene adaptability are difficult to improve is solved.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a method and system for acquiring a continuation word based on a joint decision-making model. Background Art

[0002] With the development of artificial intelligence, in order to improve the user interaction experience, the existing technology mainly generates reply information through a large language model to meet the real-time requirements. For example, a voice interaction method, device, electronic device and storage medium with patent publication number CN119649816A involves the field of large language models. The specific implementation scheme is: in response to receiving input voice, initiating multiple first generation requests according to the input voice and historical interaction information, and obtaining multiple candidate continuation words corresponding to the multiple first generation requests, wherein the historical interaction information includes historical input text, historical continuation words and historical reply text for replying to the historical input text; determining from the multiple candidate continuation words a candidate continuation word whose repetition with the historical continuation word meets the preset requirements as the target continuation word; and outputting the voice of the target continuation word. However, the performance of the large language model in the above method is highly dependent on the quality and scale of training data. To improve the quality and scale of training data, existing technologies mainly obtain training data through manual labeling, but this has limitations. On the one hand, the efficiency of manual labeling is limited by labor costs and time investment. On the other hand, the inevitable subjective bias and standard inconsistency in the labeling process will directly affect the accuracy of data labeling. Therefore, the accuracy of the large language model is difficult to guarantee, which in turn makes it difficult to improve the efficiency of obtaining transition words and scene adaptability. Summary of the Invention

[0003] To address the technical problem that existing technologies have difficulty improving the efficiency of acquiring continuation words and their adaptability to specific scenarios, the present invention provides a method and system for acquiring continuation words based on a joint decision-making model. This method uses the powerful semantic understanding capabilities of a supervised model to conduct in-depth analysis of historical conversation records to obtain high-quality behavioral and scoring datasets, overcoming the limitations of manually annotating datasets. The joint decision-making model is then trained using these high-quality behavioral and scoring datasets. The final continuation words are acquired from the successfully trained joint decision-making model, improving the accuracy of user behavior predicted by the joint decision-making model and the adaptability of the final continuation words to specific scenarios. This overcomes the technical problem that existing technologies have difficulty improving the efficiency of acquiring continuation words and their adaptability to specific scenarios.

[0004] To solve the above technical problems, the present invention provides a method for obtaining a transition word based on a joint decision model, comprising the following steps: Divide user behaviors into categories based on business experience, obtain a list of candidate continuation words based on historical conversation records, and classify the continuation words in the candidate continuation word list into user behavior categories to obtain an attribution table; The supervised model is used to obtain the next user behavior corresponding to the historical conversation record to obtain a behavior dataset, and then the attribution table is used to obtain the continuation word score of the next user behavior to obtain a score dataset; The joint decision model is trained based on the behavior dataset and the rating dataset, and the final continuation word is obtained through the successfully trained joint decision model.

[0005] After adopting the above technical solution, the present invention has the following advantages: Considering the limitation of existing technologies that require manual annotation of conversation records and the next user behavior corresponding to the conversation records, and the strong semantic understanding capabilities of supervised models, we use supervised models to conduct in-depth analysis of historical conversation records to obtain high-quality behavior datasets and scoring datasets, breaking through the limitations of manually annotating datasets. The joint decision-making model is trained with high-quality behavior datasets, which improves the accuracy of user behavior predicted by the joint decision-making model. On this basis, the joint decision-making model is trained with high-quality scoring datasets, which also improves the scene adaptability of the final transition words, overcoming the technical problem of existing technologies that make it difficult to improve the efficiency of transition word acquisition and scene adaptability. By obtaining user behavior categories through business experience and obtaining a list of candidate continuation words through historical conversation records, the practicality of the attribution table is improved. At the same time, by obtaining the attribution table, the continuation words under the user behavior can be quickly located through the attribution table based on the user behavior, further improving the efficiency of obtaining the continuation words.

[0006] Preferably, obtaining a candidate list of connecting words based on historical conversation records includes: Obtain the first continuation word candidate list based on the frequency of reply prefixes in historical conversation records; Calculating the similarity of the connecting words in the initial connecting word candidate list through the supervision model, and preliminarily grouping the connecting words in the initial connecting word candidate list according to the similarity; A regrouping threshold is obtained according to the similarity of the continuation words in each group and the user behavior category, the continuation words in each group are regrouped based on the regrouping threshold, and a continuation word candidate list is obtained according to the regrouping result.

[0007] Preferably, obtaining the next user behavior corresponding to the historical conversation record through the supervision model to obtain the behavior dataset includes: Use user behavior categories as output constraints for the supervision model; Structuring the historical conversation records according to the roles, conversation order, and conversation content of the two parties in the historical conversation records to obtain structured conversation records; Construct prompt words based on the output constraints, concatenate the prompt words with the structured conversation record as the input text of the supervision model, and obtain the next user behavior corresponding to the historical conversation record; The next user behavior corresponding to the historical conversation record is associated with the historical conversation record to obtain a behavior dataset.

[0008] Preferably, obtaining the score of the continuation word under the next user behavior through the attribution table to obtain the score data set includes: Obtain the continuation word for the next user behavior through the attribution table; The supervised model vectorizes the next user action, the subsequent word under the next user action, and the contextual information of the historical conversation records to obtain the historical action vector, the historical subsequent word vector, and the historical context vector. Obtain the first semantic similarity and the second semantic similarity of the historical continuation word vector with the historical behavior vector and the historical context vector respectively; The score of the continuation word under the next user behavior is obtained based on the first semantic similarity and the second semantic similarity to obtain a score data set.

[0009] Preferably, before training the joint decision model based on the behavior dataset and the scoring dataset, the method further includes: The behavior dataset is divided into a first behavior dataset and a second behavior dataset based on the acquisition time of the historical conversation records. The supervision model is trained once using the second behavior dataset. Inputting the historical conversation records corresponding to the first behavior dataset into a trained supervised model to obtain predicted user behavior, comparing the predicted user behavior with the next user behavior corresponding to the first behavior dataset to obtain a first comparison result, correcting the first behavior dataset based on the first comparison result, and updating the behavior dataset based on the corrected first behavior dataset; The scoring dataset is divided into a first scoring dataset and a second scoring dataset based on the acquisition time of the historical conversation records, and the supervision model is trained twice using the second scoring dataset; The historical conversation records corresponding to the first scoring dataset are input into the supervised model that has completed secondary training to obtain predicted scores, and the predicted scores are compared with the continuation word scores corresponding to the first scoring dataset to obtain a second comparison result. The first scoring dataset is corrected according to the second comparison result, and the scoring dataset is updated according to the corrected first scoring dataset.

[0010] Preferably, the training of the joint decision-making model based on the behavior dataset and the scoring dataset includes: The classification model in the joint decision-making model is trained using the behavior dataset, and the ranking model in the joint decision-making model is trained using the scoring dataset.

[0011] Preferably, the training of the classification model in the joint decision-making model by the behavior dataset and the training of the refinement model in the joint decision-making model by the scoring dataset include: Divide the behavior dataset into several parts, input each behavior dataset into the classification model in turn to obtain the classification model output, and modify the classification model according to the difference between the classification model output and the first actual result; The scoring data set is divided into several parts, and each scoring data set is input into the refined ranking model in turn to obtain the refined ranking model output, and the refined ranking model is corrected according to the gap between the refined ranking model output and the second actual result.

[0012] Preferably, it also includes: When the gap between the classification model output and the first actual result and the gap between the refined ranking model output and the second actual result both meet the preset conditions, it means that the joint decision model training is successful.

[0013] Preferably, the step of obtaining the final connecting word through the successfully trained joint decision model includes: Input the real-time conversation record into the classification model to obtain the real-time user behavior, obtain the continuation word under the real-time user behavior through the attribution table, input the continuation word under the real-time user behavior into the refined ranking model to obtain the continuation word score under the real-time user behavior, and use the continuation word with the highest score under the real-time user behavior as the final continuation word.

[0014] Beneficial effects of this program: Considering the limitation of existing technologies that require manual annotation of conversation records and the next user behavior corresponding to the conversation records, and the strong semantic understanding capabilities of supervised models, we use supervised models to conduct in-depth analysis of historical conversation records to obtain high-quality behavior datasets and scoring datasets, breaking through the limitations of manually annotating datasets. The joint decision-making model is trained with high-quality behavior datasets, which improves the accuracy of user behavior predicted by the joint decision-making model. On this basis, the joint decision-making model is trained with high-quality scoring datasets, which also improves the scene adaptability of the final transition words, overcoming the technical problem of existing technologies that make it difficult to improve the efficiency of transition word acquisition and scene adaptability. The behavior dataset and the rating dataset are divided, and the supervised models are trained separately. The trained supervised models are used to obtain predicted user behavior and predicted scores, which are then compared with the actual results. The behavior dataset and the rating dataset are then updated. By batching and performing cyclical quality inspections, the quality of the dataset is significantly improved, further enhancing the scenario adaptability of the transition words. By obtaining user behavior categories through business experience and obtaining a list of candidate continuation words through historical conversation records, the practicality of the attribution table is improved. At the same time, by obtaining the attribution table, the continuation words under the user behavior can be quickly located through the attribution table based on the user behavior, further improving the efficiency of obtaining the continuation words.

[0015] The present invention also provides a system for acquiring a continuation word based on a joint decision model, which is applicable to the method for acquiring a continuation word based on a joint decision model, and includes: The attribution table acquisition module is used to classify user behaviors according to business experience to obtain user behavior categories, obtain a list of candidate continuation words based on historical conversation records, and classify the continuation words in the candidate continuation word list into user behavior categories to obtain an attribution table; The training set acquisition module is used to obtain the next user behavior corresponding to the historical conversation record through the supervision model to obtain a behavior dataset, and then obtain the continuation word score of the next user behavior through the attribution table to obtain a score dataset; The continuation word acquisition module is used to train the joint decision model based on the behavior dataset and the rating dataset, and obtain the final continuation word through the successfully trained joint decision model.

[0016] Beneficial effects of this program: Considering the limitation of existing technologies that require manual annotation of conversation records and the next user behavior corresponding to the conversation records, and the strong semantic understanding capabilities of supervised models, we use supervised models to conduct in-depth analysis of historical conversation records to obtain high-quality behavior datasets and scoring datasets, breaking through the limitations of manually annotating datasets. The joint decision-making model is trained with high-quality behavior datasets, which improves the accuracy of user behavior predicted by the joint decision-making model. On this basis, the joint decision-making model is trained with high-quality scoring datasets, which also improves the scene adaptability of the final transition words, overcoming the technical problem of existing technologies that make it difficult to improve the efficiency of transition word acquisition and scene adaptability. By obtaining user behavior categories through business experience and obtaining a list of candidate continuation words through historical conversation records, the practicality of the attribution table is improved. At the same time, by obtaining the attribution table, the continuation words under the user behavior can be quickly located through the attribution table based on the user behavior, further improving the efficiency of obtaining the continuation words. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Other features, objects, and advantages of the present invention will become more apparent upon reading the detailed description of non-limiting embodiments made with reference to the following drawings. The drawings are provided for the purpose of illustrating preferred embodiments only and are not to be construed as limiting the present invention. Like reference characters are used throughout the drawings to designate like parts.

[0018] Figure 1 Schematic diagram of the flow of the method for obtaining a connecting word based on the joint decision model of the present invention; Figure 2 This is a flow chart for obtaining a behavior data set in the method for obtaining a linking word based on a joint decision-making model of the present invention; Figure 3 This is a flowchart for obtaining a scoring data set in the method for obtaining a linking word based on a joint decision-making model of the present invention. DETAILED DESCRIPTION

[0019] In order to make the objectives, technical solutions and advantages of the present invention more clear, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific implementation method described herein is only an optimal embodiment of the present invention, which is only used to explain the present invention and does not limit the scope of protection of the present invention. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0020] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the operations (or steps) as sequential processes, many of the operations (or steps) therein can be performed in parallel, concurrently, or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operations are completed, but can also have additional steps not included in the figures; the process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0021] Example 1: Figure 1 As shown, the method for obtaining the continuation word based on the joint decision model includes the following steps: S1: Divide user behaviors into categories based on business experience, obtain a list of candidate continuation words based on historical conversation records, and classify the continuation words in the candidate continuation word list into user behavior categories to obtain an attribution table.

[0022] Specifically, user behavior categories include: regaining customers through interest points, collecting (asking for) information, making suggestions (solutions), introducing activities (interest points), soothing emotions, expressing understanding / resonance, clarifying issues (removing doubts), ending the conversation, guiding the next step, changing the topic, returning to the main thread, expressing gratitude, requesting repetition or unclear hearing, text noise, irrelevant text, etc.

[0023] As a preferred embodiment, the step of obtaining a candidate list of continuation words based on historical conversation records includes: Obtain the first continuation word candidate list based on the frequency of reply prefixes in historical conversation records; Calculating the similarity of the connecting words in the initial connecting word candidate list through the supervision model, and preliminarily grouping the connecting words in the initial connecting word candidate list according to the similarity; A regrouping threshold is obtained according to the similarity of the continuation words in each group and the user behavior category, the continuation words in each group are regrouped based on the regrouping threshold, and a continuation word candidate list is obtained according to the regrouping result.

[0024] In this embodiment, obtaining a list of candidate initial continuation words based on the frequency of reply prefixes in historical conversation records is performed by, for example, using SQL statements to collect 300,000 historical conversation records from a business database. The top 150 most frequent customer service reply prefixes in these historical conversation records are then counted to generate a list of candidate initial continuation words. By filtering frequently occurring continuation words from actual user usage scenarios, redundant information is reduced while also improving the practicality of the continuation words. The supervised model can be GPT-O1, also known as the Strawberry model, which has demonstrated outstanding performance in natural language processing, enabling efficient and accurate text generation and understanding. Through large-scale data training, this model possesses strong generalization capabilities and excels in a variety of language tasks. Determining a regrouping threshold based on the similarity of continuation words within each group and user behavior categories is performed by, for example, using the number of user behavior categories as the final number of groups, adjusting the initial grouping threshold corresponding to the initial grouping by combining the final number of groups with the similarity of the continuation words within each group, and thereby obtaining a regrouping threshold. The final number of groups is the number of groups in the regrouping result. By utilizing the powerful semantic understanding ability of the supervised model for grouping, the accuracy of grouping is improved. In this embodiment, by obtaining an attribution table, the subsequent attribution table can quickly locate the continuation word under the user behavior based on the user behavior, further improving the efficiency of obtaining the continuation word.

[0025] S2: Obtain the next user behavior corresponding to the historical conversation record through the supervision model to obtain a behavior dataset, and then obtain the continuation word score under the next user behavior through the attribution table to obtain a score dataset.

[0026] Specifically, such as Figure 2 As shown, the behavior dataset is obtained by obtaining the next user behavior corresponding to the historical conversation record through the supervision model, including: S21a: Use user behavior categories as output constraints for the supervision model; S21b: Structuring the historical conversation records according to the roles, conversation order, and conversation content of the two parties in the historical conversation records to obtain structured conversation records; S21c: Construct a prompt word based on the output constraints, concatenate the prompt word with the structured conversation record as the input text of the supervision model, and obtain the next user behavior corresponding to the historical conversation record; S21d: Associating the next user behavior corresponding to the historical conversation record with the historical conversation record to obtain a behavior dataset.

[0027] Taking the e-commerce customer service conversation scenario as an example, the structured conversation record can be specifically expressed as follows: [User 1]: The clothes I bought are too small. Can this be fixed? [Customer Service 1]: Please take a photo of the tag of the clothes and I will arrange a replacement after confirmation.

[0028] [User 2]: The photos have been sent, please take a look.

[0029] [Customer Service 2]: We have received the photos and have applied for a replacement for you. The new product will be sent out within 3 days.

[0030] The prompt words can be specifically expressed as: Based on the structured conversation record, predict the user's next 'next behavior', which is constrained by the output constraints.

[0031] The input text can be specifically expressed as: [User 1]: The clothes I bought are too small. Can this be fixed? [Customer Service 1]: Please take a photo of the tag of the clothes and I will arrange a replacement after confirmation.

[0032] [User 2]: The photos have been sent, please take a look.

[0033] [Customer Service 2]: We have received the photos and have applied for a replacement for you. The new product will be sent out within 3 days.

[0034] Based on the structured conversation record, the user's next action is predicted, which is subject to output constraints.

[0035] Based on the input text, the supervised model can infer that the next user action corresponding to the historical conversation record is "confirming order logistics." By binding the order logistics confirmation to the historical conversation record using a unique identifier, a set of first-bound data is obtained. It can be understood that each set of historical conversation records corresponds to a set of first-bound data, and thus each set of first-bound data constitutes a behavior dataset. Through in-depth analysis of historical conversation records by the supervised model, high-quality behavior and scoring datasets are obtained, overcoming the limitations of manually annotated datasets.

[0036] It is understandable that if Figure 3 As shown, the scoring dataset is obtained by obtaining the score of the continuation word under the next user behavior through the attribution table, including: S22a: Obtain the continuation word for the next user behavior through the attribution table; S22b: Using the supervised model, the next user action, the subsequent word under the next user action, and the contextual information of the historical conversation records are vectorized to obtain a historical action vector, a historical subsequent word vector, and a historical context vector. S22c: Obtaining first semantic similarity and second semantic similarity between the historical continuation word vector and the historical behavior vector and the historical context vector respectively; S22d: Obtain a score of the continuation word under the next user behavior based on the first semantic similarity and the second semantic similarity to obtain a score dataset.

[0037] S3: Train the joint decision model based on the behavior dataset and the rating dataset, and obtain the final continuation word through the successfully trained joint decision model.

[0038] As a preferred embodiment, before training the joint decision model based on the behavior dataset and the scoring dataset, the method further includes: The behavior dataset is divided into a first behavior dataset and a second behavior dataset based on the acquisition time of the historical conversation records. The supervision model is trained once using the second behavior dataset. Inputting the historical conversation records corresponding to the first behavior dataset into a trained supervised model to obtain predicted user behavior, comparing the predicted user behavior with the next user behavior corresponding to the first behavior dataset to obtain a first comparison result, correcting the first behavior dataset based on the first comparison result, and updating the behavior dataset based on the corrected first behavior dataset; The scoring dataset is divided into a first scoring dataset and a second scoring dataset based on the acquisition time of the historical conversation records, and the supervision model is trained twice using the second scoring dataset; The historical conversation records corresponding to the first scoring dataset are input into the supervised model that has completed secondary training to obtain predicted scores, and the predicted scores are compared with the continuation word scores corresponding to the first scoring dataset to obtain a second comparison result. The first scoring dataset is corrected according to the second comparison result, and the scoring dataset is updated according to the corrected first scoring dataset.

[0039] In this embodiment, before dividing the behavioral dataset into the first and second behavioral datasets based on the acquisition time of the historical conversation records, the process also includes cleaning the historical conversation records and removing duplicate historical conversation records using the edit distance. This removal of redundant data further improves the training efficiency of the supervised model.

[0040] In this embodiment, the user can flexibly set the number of groups of first-bound data in the first behavior dataset as needed. If the number of groups of first-bound data in the first behavior dataset is 1000 and the number of behavior dataset groups is 6000, the behavior dataset is divided into a first behavior dataset and a second behavior dataset based on the time when the historical conversation records were acquired. Specifically, each group of first-bound data is labeled according to the time when the historical conversation records were acquired, and the behavior dataset is divided into two major groups according to the labels, namely the first behavior dataset and the second behavior dataset. The first behavior dataset consists of the first-bound data numbered 1-1000, and the second behavior data consists of the first-bound data numbered 1001-6000. Training the supervised model once using the second behavior dataset specifically means inputting the first-bound data numbered 1001-2000 into the supervised model to train the supervised model. When the degree of match between the output of the supervised model and the next user behavior in the first-bound data is greater than a first preset value, it indicates that the training is successful. The first preset value can be flexibly set by the user as needed. Updating the behavior dataset using the corrected first behavior dataset includes: using the corrected first behavior dataset as the first behavior dataset in the behavior dataset, and using the first binding data numbered 1001-6000 as the first behavior dataset, and using the first binding data numbered 2001-3000 as the second behavior dataset, training the supervision model again using the second behavior dataset, inputting the historical conversation records corresponding to the first behavior dataset into the once trained supervision model to obtain predicted user behavior, comparing the predicted user behavior with the next user behavior corresponding to the first behavior dataset to obtain a first comparison result, correcting the first behavior dataset using the first comparison result, and updating the behavior dataset using the corrected first behavior dataset, and continuously looping the above steps until the first binding data constituting the first behavior data is numbered 5001-6000, and then stopping the loop.

[0041] It is understandable that the scores of the next user and the next word of the next user in the scoring dataset constitute the second binding data. The scoring dataset is composed of several groups of second binding data. The user can flexibly set the number of groups of second binding data in the first scoring dataset according to needs. If the number of groups of second binding data in the first scoring dataset is 1000, and the number of groups of the scoring dataset is 6000, then the scoring dataset is divided into the first scoring dataset and the second scoring dataset according to the acquisition time of the historical conversation records. Specifically, it means: each group of second binding data is numbered according to the acquisition time of the historical conversation records, and the scoring dataset is divided into two major groups according to the number. The first scoring dataset consists of second binding data numbered 1-1000, and the second scoring data consists of second binding data numbered 1001-6000. Secondary training of the supervised model through the second scoring dataset specifically refers to training the supervised model through second binding data numbered 1001-2000. When the degree of match between the output of the supervised model and the score of the continuation word in the second binding data is greater than a second preset value, it indicates that the secondary training is successful, wherein the second preset value can be flexibly set by the user according to needs. Updating the scoring dataset using the revised first scoring dataset includes: using the revised first scoring dataset as the first scoring dataset in the scoring dataset, using the second binding data numbered 1001-6000 as the first scoring dataset, and using the second binding data numbered 2001-3000 as the second scoring dataset, retraining the supervised model using the second scoring dataset, inputting the historical conversation records corresponding to the first scoring dataset into the supervised model after the secondary training to obtain a predicted score, comparing the predicted score with the score of the continuation word corresponding to the first scoring dataset to obtain a second comparison result, correcting the first scoring dataset based on the second comparison result, and updating the scoring dataset using the revised first scoring dataset, and continuously looping the above steps until the second binding data constituting the first scoring dataset is numbered 5001-6000, at which time the loop stops. By implementing a batch-by-batch cyclic quality inspection of data sets, the quality of the behavioral and scoring data sets has been greatly improved, thereby improving the scenario adaptability of the transition words.

[0042] The training of the joint decision-making model based on the behavior dataset and the scoring dataset includes: The classification model in the joint decision-making model is trained using the behavior dataset, and the ranking model in the joint decision-making model is trained using the scoring dataset.

[0043] As a preferred embodiment, the training of the classification model in the joint decision-making model using the behavior dataset and the training of the refinement model in the joint decision-making model using the scoring dataset include: Divide the behavior dataset into several parts, input each behavior dataset into the classification model in turn to obtain the classification model output, and modify the classification model according to the difference between the classification model output and the first actual result; The scoring data set is divided into several parts, and each scoring data set is input into the refined ranking model in turn to obtain the refined ranking model output, and the refined ranking model is corrected according to the gap between the refined ranking model output and the second actual result.

[0044] In this embodiment, the classification model is specifically the LLM classification model, which is also called the large language model. It is a model built based on the pre-trained large language model and used to solve classification tasks. The refinement model is specifically the BERT refinement model. The BERT ranking model mainly uses the powerful semantic understanding ability of the BERT model to capture the semantic relevance between query terms and documents, thereby scoring and ranking documents. Each behavioral data set is input into the classification model in turn to obtain the classification model output, and the classification model is corrected according to the gap between the classification model output and the first actual result. Specifically, the following steps are used: input the historical conversation records in each behavioral data set into the classification model in turn to obtain the classification model output, and the conditional probability distribution function in the classification model is corrected according to the gap between the classification model output and the next user behavior corresponding to the historical conversation record in each behavioral data set, where the next user behavior corresponding to the historical conversation record in each behavioral data set is the first actual result. The expression of the conditional probability distribution function is: , Indicates the category of the next user behavior predicted by the classification model, Indicates that the historical conversation record is When , the category of the next user behavior is The conditional probability of Indicates that the historical conversation record is When the prompt word, Indicates gpt-o1 based on prompt word , is the probability of the answer, and A, B, and K represent user behavior categories.

[0045] In this embodiment, each scoring data set is sequentially input into the refined ranking model to obtain the refined ranking model output, and the refined ranking model is corrected according to the difference between the refined ranking model output and the second actual result. Specifically, the following steps are performed: sequentially input the continuation words in each scoring data set into the refined ranking model to obtain the refined ranking model output, and the parameters in the refined ranking model are corrected according to the difference between the refined ranking model output and the continuation word score in each scoring data set, wherein the continuation word score in each scoring data set is the second actual result. The formula for correcting the parameters in the refined ranking model is: , represents the parameters in the refined model, It represents the mean square error between the output of the refined ranking model and the score of the continuation word in each scoring dataset. Indicates the total number of scoring datasets, represents the connecting word in the i-th scoring dataset, It represents the output of the refined sorting model corresponding to the continuation word in the i-th scoring dataset, , represents the score of the continuation word in the i-th scoring dataset, By training the joint decision-making model with a high-quality behavioral dataset, the accuracy of the user behavior predicted by the joint decision-making model is improved. On this basis, by training the joint decision-making model with a high-quality rating dataset, the scene adaptability of the final follow-up word is also improved, overcoming the technical problem of the existing technology that it is difficult to improve the efficiency of follow-up word acquisition and scene adaptability.

[0046] As a preferred embodiment, it also includes: When the difference between the classification model output and the first actual result, and the difference between the refined ranking model output and the second actual result, both meet the preset conditions, the joint decision model training is successful. The preset conditions can be flexibly set by the user according to actual needs.

[0047] Specifically, obtaining the final connecting word through the successfully trained joint decision model includes: Input the real-time conversation record into the classification model to obtain the real-time user behavior, obtain the continuation word under the real-time user behavior through the attribution table, input the continuation word under the real-time user behavior into the refined ranking model to obtain the continuation word score under the real-time user behavior, and use the continuation word with the highest score under the real-time user behavior as the final continuation word.

[0048] Embodiment 2: This embodiment further provides a system for acquiring a continuation word based on a joint decision model, which is applicable to the method for acquiring a continuation word based on a joint decision model, and includes: The attribution table acquisition module is used to classify user behaviors according to business experience to obtain user behavior categories, obtain a list of candidate continuation words based on historical conversation records, and classify the continuation words in the candidate continuation word list into user behavior categories to obtain an attribution table; The training set acquisition module is used to obtain the next user behavior corresponding to the historical conversation record through the supervision model to obtain a behavior dataset, and then obtain the continuation word score of the next user behavior through the attribution table to obtain a score dataset; The continuation word acquisition module is used to train the joint decision model based on the behavior dataset and the rating dataset, and obtain the final continuation word through the successfully trained joint decision model.

[0049] In this embodiment, user behavior categories include: customer acquisition through interest points, information collection (inquiry), suggestions (solutions), activity introduction (interest points), emotional soothing, expressing understanding / empathy, clarifying questions (resolving concerns), concluding a conversation, guiding the next step, changing the topic, returning to the main thread, expressing gratitude, requesting repetition or unclear audio, text noise, and irrelevant text. The supervisory model can be GPT-O1. The joint decision-making model consists of a classification model and a refined ranking model.

[0050] The comparison table of the effects of the present invention and the prior art obtained by testing the machine Nvidia L20 is shown in Table 1: Table 1. Comparison of the effects of the present invention and the prior art ; Acc indicates the classification accuracy. f1_score indicates the adaptability of the linker. A larger value indicates higher adaptability. qps@p99 200ms indicates the maximum number of requests that can be achieved while maintaining a p99 latency of less than 200ms.

[0051] The specific implementation described above is a preferred implementation of the method and system for obtaining continuation words based on the joint decision-making model of the present invention, and is not intended to limit the specific implementation scope of the present invention. The scope of the present invention includes but is not limited to this specific implementation. Any equivalent changes made in accordance with the shape and structure of the present invention are within the scope of protection of the present invention.

Claims

1. A method for obtaining a continuation word based on a joint decision model, characterized in that: The following steps are involved: Divide user behaviors into categories based on business experience, obtain a list of candidate continuation words based on historical conversation records, and classify the continuation words in the candidate continuation word list into user behavior categories to obtain an attribution table; The supervised model is used to obtain the next user behavior corresponding to the historical conversation record to obtain a behavior dataset, and then the attribution table is used to obtain the continuation word score of the next user behavior to obtain a score dataset; The joint decision model is trained based on the behavior dataset and the rating dataset, and the final continuation word is obtained through the successfully trained joint decision model.

2. The method for obtaining a transition word based on a joint decision model according to claim 1, characterized in that: The step of obtaining a candidate list of continuation words based on historical conversation records includes: Obtain the first continuation word candidate list based on the frequency of reply prefixes in historical conversation records; Calculating the similarity of the connecting words in the initial connecting word candidate list through the supervision model, and preliminarily grouping the connecting words in the initial connecting word candidate list according to the similarity; A regrouping threshold is obtained according to the similarity of the continuation words in each group and the user behavior category, the continuation words in each group are regrouped based on the regrouping threshold, and a continuation word candidate list is obtained according to the regrouping result.

3. The method for obtaining a transition word based on a joint decision model according to claim 1, characterized in that: The method of obtaining the next user behavior corresponding to the historical conversation record through the supervision model to obtain the behavior dataset includes: Use user behavior categories as output constraints for the supervision model; Structuring the historical conversation records according to the roles, conversation order, and conversation content of the two parties in the historical conversation records to obtain structured conversation records; Construct prompt words based on the output constraints, concatenate the prompt words with the structured conversation record as the input text of the supervision model, and obtain the next user behavior corresponding to the historical conversation record; The next user behavior corresponding to the historical conversation record is associated with the historical conversation record to obtain a behavior dataset.

4. The method for obtaining a transition word based on a joint decision model according to claim 1, characterized in that: The scoring dataset is obtained by obtaining the score of the continuation word under the next user behavior through the attribution table, including: Obtain the continuation word for the next user behavior through the attribution table; The supervised model vectorizes the next user action, the subsequent word under the next user action, and the contextual information of the historical conversation records to obtain the historical action vector, the historical subsequent word vector, and the historical context vector. Obtain the first semantic similarity and the second semantic similarity of the historical continuation word vector with the historical behavior vector and the historical context vector respectively; The scores of the continuation words under the next user behavior are obtained based on the first semantic similarity and the second semantic similarity to obtain a score data set.

5. The method for obtaining a transition word based on a joint decision model according to claim 1, characterized in that: Before training the joint decision model based on the behavior dataset and the scoring dataset, the method further includes: The behavior dataset is divided into a first behavior dataset and a second behavior dataset based on the acquisition time of the historical conversation records. The supervision model is trained once using the second behavior dataset. Inputting the historical conversation records corresponding to the first behavior dataset into a trained supervised model to obtain predicted user behavior, comparing the predicted user behavior with the next user behavior corresponding to the first behavior dataset to obtain a first comparison result, correcting the first behavior dataset based on the first comparison result, and updating the behavior dataset based on the corrected first behavior dataset; The scoring dataset is divided into a first scoring dataset and a second scoring dataset based on the acquisition time of the historical conversation records, and the supervision model is trained twice using the second scoring dataset; The historical conversation records corresponding to the first scoring dataset are input into the supervised model that has completed secondary training to obtain predicted scores, and the predicted scores are compared with the continuation word scores corresponding to the first scoring dataset to obtain a second comparison result. The first scoring dataset is corrected according to the second comparison result, and the scoring dataset is updated according to the corrected first scoring dataset.

6. The method for obtaining transition words based on a joint decision model according to claim 5, characterized in that: The training of the joint decision-making model based on the behavior dataset and the scoring dataset includes: The classification model in the joint decision-making model is trained using the behavior dataset, and the ranking model in the joint decision-making model is trained using the scoring dataset.

7. The method for obtaining a transition word based on a joint decision model according to claim 6, characterized in that: The training of the classification model in the joint decision-making model using the behavior dataset and the training of the refinement model in the joint decision-making model using the scoring dataset include: Divide the behavior dataset into several parts, input each behavior dataset into the classification model in turn to obtain the classification model output, and modify the classification model according to the difference between the classification model output and the first actual result; The scoring data set is divided into several parts, and each scoring data set is input into the refined ranking model in turn to obtain the refined ranking model output, and the refined ranking model is corrected according to the gap between the refined ranking model output and the second actual result.

8. The method for obtaining transition words based on a joint decision model according to claim 7, characterized in that: Also includes: When the gap between the classification model output and the first actual result and the gap between the refined ranking model output and the second actual result both meet the preset conditions, it means that the joint decision model training is successful.

9. The method for obtaining a transition word based on a joint decision model according to claim 6, characterized in that: The method of obtaining the final connecting word through the successfully trained joint decision model includes: Input the real-time conversation record into the classification model to obtain the real-time user behavior, obtain the continuation word under the real-time user behavior through the attribution table, input the continuation word under the real-time user behavior into the refined ranking model to obtain the continuation word score under the real-time user behavior, and use the continuation word with the highest score under the real-time user behavior as the final continuation word.

10. A system for acquiring a continuation word based on a joint decision model, applicable to the method for acquiring a continuation word based on a joint decision model according to any one of claims 1 to 9, characterized in that: include: The attribution table acquisition module is used to classify user behaviors according to business experience to obtain user behavior categories, obtain a list of candidate continuation words based on historical conversation records, and classify the continuation words in the candidate continuation word list into user behavior categories to obtain an attribution table; The training set acquisition module is used to obtain the next user behavior corresponding to the historical conversation record through the supervision model to obtain a behavior dataset, and then obtain the continuation word score of the next user behavior through the attribution table to obtain a score dataset; The continuation word acquisition module is used to train the joint decision model based on the behavior dataset and the rating dataset, and obtain the final continuation word through the successfully trained joint decision model.

Images