Implicit chapter relation identification method for big language model generation data enhancement
Diversity and context enhanced examples are generated through large language models, and combined with pre -training language models and two -way attention mechanisms to solve the lack of practicality and accuracy of the existing hidden chapter relationship recognition method, and achieve higher Identify performance and generalization capabilities.
Patent Information
- Application Number
- CN202411946424.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-27
- Publication Date
- 2025-01-28
- Estimated Expiration
- 2044-12-27
AI Technical Summary
The existing implicit chapter relationship recognition methods have shortcomings in terms of practicality and accuracy, especially the lack of diversity and contextual information, resulting in low recognition performance and generalization capabilities.
Use large language models to generate data enhancement methods. Through diversity enhancement and context enhance new examples, combined with pre -training language models and two -way attention mechanisms, multi -level interaction and dynamic classification to improve recognition performance.
Effectively increase the diversity of training data and contextual information, improve the performance and accuracy of hidden chapter relationship recognition, and enhance practicality.
Smart Images

Figure CN119378563A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of natural language processing, and in particular to an implicit chapter relationship recognition method for enhancing data generated by a large language model. Background Art
[0002] With the rapid development of digitalization and informatization, text information is everywhere, whether in social media interactions or news reports. However, faced with massive amounts of data, how to efficiently use and accurately understand text information has become a major challenge. In this context, discourse relation recognition, as a basic research task in the field of natural language processing (NLP), aims to parse the logical relationship between arguments (i.e., sentences or clauses) in the text and infer their semantic connections, including but not limited to "progression" and "transition" relationships. This technology can greatly enhance the machine's ability to deeply understand human language. Therefore, discourse relation recognition has shown important application value in fields such as information retrieval, machine translation, and automatic summarization, and helps to improve the accuracy of information processing.
[0003] Discourse relationship recognition is usually divided into explicit discourse relationship recognition (EDRR) and implicit discourse relationship recognition (IDRR). Explicit discourse relationship recognition mainly determines the semantic relationship between sentences or clauses based on explicit connectives. For example, in the example "He was well prepared, but because of nervousness, he still failed the interview", "however" connects the two clauses, indicating a "transition" relationship. Since connectives can clearly express semantic relationships, the recognition of explicit relationships can achieve a high accuracy rate (over 95%) and is reflected in practical applications. In contrast, implicit discourse relationship recognition requires in-depth semantic analysis of the text due to the lack of explicit connectives. For example, "Xiao Ming bought a new book yesterday, and he has been reading it today." There is no connective in this sentence to directly indicate the relationship between the two clauses, but the sequential relationship can be inferred, that is, "Xiao Ming read the new book after buying it." It can be seen that the main challenges faced by implicit relationship recognition are: 1) There is a lack of explicit connectives, and semantic relationships cannot be judged by connectives; 2) The understanding and inference of sentence semantics are high and highly dependent on contextual information. At present, the accuracy of implicit chapter relationship recognition is still low and cannot meet the requirements of practical applications. Therefore, improving the performance of implicit chapter relationship recognition is crucial to improving the effect of practical applications.
[0004] In the early days, implicit chapter relationship recognition methods mainly relied on manual features and combined with traditional machine learning models such as support vector machines to complete semantic relationship recognition. At present, with the development of deep learning, pre-trained language models (such as BERT, RoBERTa, etc.) and graph neural networks (GNNs) have become mainstream methods. Pre-trained models obtain rich contextual information by training on large-scale unlabeled texts. After fine-tuning on a small amount of manually annotated chapter corpus, they have achieved good performance in implicit chapter relationship recognition tasks. Graph neural networks significantly improve the performance of implicit chapter relationship recognition by constructing a relationship graph between arguments and combining new technologies such as attention mechanisms. The training of implicit chapter relationship recognition methods based on deep learning requires a large amount of manually annotated chapter relationship data. However, the existing manually annotated data is not only limited in quantity but also low in diversity, which greatly limits the performance and generalization ability of the method, resulting in its low practicality. In addition, existing methods usually only take two arguments (clauses or sentences) as input, lack more contextual information (for example, paragraph-level information), which often leads to inaccurate understanding of chapter semantic relations. Summary of the invention
[0005] To this end, an embodiment of the present invention proposes an implicit chapter relationship recognition method enhanced by large language model generation data to solve the problems of low practicality and inaccurate understanding of the prior art.
[0006] According to an embodiment of the present invention, a large language model-generated data-enhanced implicit chapter relationship recognition method is applied to an implicit chapter relationship recognition model, wherein the implicit chapter relationship recognition model includes a data generation module based on a large language model, an encoding module based on a pre-trained model, a multi-level interaction module, and a dynamic classification module; The method comprises: The data generation module based on the large language model uses diversity enhancement prompts to obtain diversity enhanced instances based on the original instances, and uses context enhancement prompts to obtain context enhanced instances based on the original instances; In the encoding module based on the pre-trained model, the original instance is encoded by the pre-trained language model to obtain an initial semantic matrix representation of the original argument, and the diversity-enhanced instance is encoded by the pre-trained language model to obtain an initial semantic matrix representation of the diversity-enhanced argument, and the context-enhanced instance is encoded by the pre-trained language model to obtain an initial semantic matrix representation of the context-enhanced argument; In the multi-level interaction module, the initial semantic matrix representation of the original arguments is used to model the interaction between the original arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the original instance, and the initial semantic matrix representation of the original arguments and the initial semantic matrix representation of the diversity-enhanced arguments are used to model the interaction between the original arguments and the diversity-enhanced arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the diversity-enhanced instance, and the initial semantic matrix representation of the original arguments and the initial semantic matrix representation of the context-enhanced arguments are used to model the interaction between the original arguments and the context-enhanced arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the context-enhanced instance; The dynamic classification module includes the first classification layer, the second classification layer and the third classification layer. The first classification layer performs classification based on the final semantic vector representation of the original instance, the second classification layer performs classification based on the final semantic vector representation of the instance after diversity enhancement, and the third classification layer performs classification based on the final semantic vector representation of the instance after context enhancement. Three classification results are calculated respectively, and the classification result with the highest credibility is selected from the three classification results as the final prediction result.
[0007] According to the implicit chapter relationship recognition method with data enhancement generated by a large language model according to an embodiment of the present invention, the data generation module based on the large language model uses diversity enhancement prompts to obtain diversity enhanced instances on the basis of the original instances, which can effectively increase the diversity of training data, improve the recognition performance and generalization ability, and increase practicality. In addition, by using context enhancement prompts, context enhanced instances are obtained on the basis of the original instances, which can effectively enrich the context information, so as to better capture the deep meaning relationship between arguments and improve the accuracy of understanding the semantic relationship of the chapter. Then, each instance is encoded through a pre-trained language model, and a bidirectional attention mechanism is used to model the interaction between the original instance and each data enhanced instance. Finally, the dynamic classification module uses the three final semantic vector representations as input for classification, and selects the classification result with the highest credibility as the final prediction result, which can effectively improve the performance and accuracy of implicit chapter relationship recognition. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and / or additional aspects and advantages of the embodiments of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which: Figure 1 4 is a schematic diagram of the structure of an implicit chapter relationship recognition model according to an embodiment of the present invention. DETAILED DESCRIPTION
[0009] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0010] The embodiment of the present invention proposes a method for identifying implicit chapter relations using data enhancement generated by a large language model, which is applied to an implicit chapter relation identification model. Figure 1 The implicit text relationship recognition model includes a data generation module based on a large language model, an encoding module based on a pre-trained model, a multi-level interaction module and a dynamic classification module.
[0011] The method comprises steps S1 to S4: S1, the data generation module based on the large language model uses diversity enhancement prompts to obtain diversity enhanced instances based on the original instances, and uses context enhancement prompts to obtain context enhanced instances based on the original instances.
[0012] The data generation module based on the large language model uses predefined prompts to guide the large language model (LLM) to generate arguments with enhanced diversity and context information. The large model performs data enhancement from two aspects: on the one hand, based on the diversity enhancement prompts Enrich the original instances respectively ( and ) Examples of content diversity enhancement ( and On the other hand, context-based enhancement Expand the context information of the original instance to obtain a context-enhanced instance ( ).
[0013] First, design a diversity enhancement prompt Guide the large model to generate instances with enhanced diversity and maintain the same text semantic relationship with the original instances, as shown below ; in, and are arguments 1 and 2 in the original instance, It is a large language model. and are arguments 1 and 2 in the diversity enhancement example, is a diversity enhancement hint, which is used to motivate the large language model to enhance the diversity of the original examples.
[0014] It should be noted that diversity enhancement prompts You can set it as needed, for example, rewrite the given argument and argument , the wording and syntax are different, but ensure that the rewritten content is semantically consistent with the original content and has a certain degree of coherence.
[0015] Then, design a context-enhanced prompt , which is used to guide the large language model to convert the arguments in the original instance and argument The content of is expanded to obtain an instance of context enhancement, as follows: ; in, and are arguments 1 and 2 in the context-enhanced instance, It is a context enhancement hint, which is used to inspire the large language model to expand the context information of the original instance.
[0016] Context-enhanced tips You can set it as needed, for example, to expand the given arguments and argument , forming a logically clear and coherent narrative, which can provide appropriate background information and output arguments enhanced by contextual information.
[0017] S2, in the encoding module based on the pre-trained model, the original instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the original argument, and the diversity-enhanced instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the diversity-enhanced argument, and the context-enhanced instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the context-enhanced argument.
[0018] The encoding module based on the pre-trained model is used to encode the initial semantic matrix representation of the original arguments and data-enhanced arguments. This process mainly relies on pre-trained language models (PLM) such as BERT or RoBERTa. The PLM trained on large-scale datasets has powerful language understanding and semantic modeling capabilities. It can capture deep semantic information in the text, including contextual relationships, dependencies between words, and sentence structure, and has achieved good performance in many natural language repair tasks. By inputting arguments into these models, their initial semantic matrix representation can be obtained. It should be noted that: the original instance ( and ), examples of diversity enhancement ( and ), context-enhanced instances ( and ) are respectively marked with “[ CLS ]+argument1+[ SEP ]+argument2+[ SEP ]" format is input into the pre-trained model, [ CLS ] is used as a global placeholder, [ SEP ] is used as a separator placeholder.
[0019] Specifically, in the encoding module based on the pre-trained model, the original instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the original argument, and the following conditional formula is satisfied: ;
[0020] in, and They are and The initial semantic matrix representation of It is a pre-trained language model; In the process of encoding the diversity-enhanced instances through the pre-trained language model and obtaining the initial semantic matrix representation of the diversity-enhanced arguments, the following conditional formula is satisfied: ; in, and They are and The initial semantic matrix representation of ; The context-enhanced instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the context-enhanced argument, and the following conditional formula is satisfied: ; in, and They are and The initial semantic matrix representation of .
[0021] S3, in the multi-level interaction module, the initial semantic matrix representation of the original arguments is used to model the interaction between the original arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the original instance, and the initial semantic matrix representation of the original arguments and the initial semantic matrix representation of the diversity-enhanced arguments are used to model the interaction between the original arguments and the diversity-enhanced arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the diversity-enhanced instance, and the initial semantic matrix representation of the original arguments and the initial semantic matrix representation of the context-enhanced arguments are used to model the interaction between the original arguments and the context-enhanced arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the context-enhanced instance.
[0022] Among them, the multi-level interaction module models the interaction between original arguments, the interaction between original arguments and diversity-enhanced arguments, and the interaction between original arguments and context-enhanced arguments. This module mainly uses a bidirectional attention mechanism to implement the interaction process. Compared with the traditional unidirectional attention mechanism, the bidirectional attention mechanism can better model the interaction between two input sequences, thereby improving the model's understanding ability and performance.
[0023] Specifically, in the multi-level interaction module, the initial semantic matrix representation of the original argument is used to model the interaction between the original arguments through the bidirectional attention mechanism, and the final semantic vector representation of the original instance is obtained, satisfying the following conditional formula: ; ;
[0024] in, and After interaction and The semantic matrix representation of To perform row-wise averaging on the semantic matrix, is the final semantic vector representation of the original instance, It is an assembly operation. It is a bidirectional attention mechanism using the first set of parameters; Using the initial semantic matrix representation of the original argument and the initial semantic matrix representation of the diversity-enhanced argument, the interaction between the original argument and the diversity-enhanced argument is modeled through a bidirectional attention mechanism. In the process of obtaining the final semantic vector representation of the diversity-enhanced instance, the following conditional formula is satisfied: ; ; ; ;
[0025] in, and After interaction and The semantic matrix representation of and After interaction and The semantic matrix representation of and are the final semantic matrix representations of argument 1 and argument 2 in the diversity-enhanced instance, is the final semantic vector representation of the instance after diversity enhancement, It is a bidirectional attention mechanism using the second set of parameters. It is a bidirectional attention mechanism using the third set of parameters. It is a bidirectional attention mechanism using the fourth set of parameters; Using the initial semantic matrix representation of the original argument and the initial semantic matrix representation of the context-enhanced argument, the interaction between the original argument and the context-enhanced argument is modeled through a bidirectional attention mechanism. In the process of obtaining the final semantic vector representation of the instance after context enhancement, the following conditional formula is satisfied: ; ; ; ; in, and After interaction and The semantic matrix representation of and After interaction and The semantic matrix representation of and are the final semantic matrix representations of argument 1 and argument 2 in the context-enhanced instance, respectively. is the final semantic vector representation of the instance after context enhancement, It is a bidirectional attention mechanism using the fifth set of parameters. It is a bidirectional attention mechanism using the sixth set of parameters. It is a bidirectional attention mechanism using the 7th set of parameters.
[0026] S4, the dynamic classification module includes the first classification layer, the second classification layer and the third classification layer. The first classification layer performs classification based on the final semantic vector representation of the original instance, the second classification layer performs classification based on the final semantic vector representation of the instance after diversity enhancement, and the third classification layer performs classification based on the final semantic vector representation of the instance after context enhancement. Three classification results are calculated respectively, and the classification result with the highest credibility is selected from the three classification results as the final prediction result.
[0027] Among them, the first classification layer satisfies the following conditional formula in the process of classification based on the final semantic vector representation of the original instance: ; in, is the prediction result calculated by the first classification layer, and are the parameters to be learned in the first classification layer, is the normalized exponential function; The second classification layer classifies the final semantic vector representation of the instance after diversity enhancement, and the following condition is satisfied: ; in, is the prediction result calculated by the second classification layer, and are the parameters that need to be learned in the second classification layer; The third classification layer classifies the final semantic vector representation of the context-enhanced instance based on the following condition: ; in, is the prediction result calculated by the third classification layer, and are the parameters that need to be learned in the third classification layer; Finally, the prediction result with the highest credibility among the three prediction results is calculated by the minimum entropy principle as the final result, that is, the smaller the entropy value, the higher the credibility of the classification result.
[0028] Specifically, in the process of selecting the classification result with the highest credibility from the three classification results as the final prediction result, the following conditional formula is satisfied: ; in, For the final prediction result, A function for selecting the classification result with the minimum entropy.
[0029] In this embodiment, the cross entropy cost of the implicit chapter relationship recognition model is The expression is: ; in, is a manually annotated dataset. is the cross entropy loss function, is the probability distribution of the true label. During training, the parameters of the model are gradually optimized by minimizing the cross entropy until convergence.
[0030] In addition, it should be noted that: 1) The data generation module based on the large language model can directly call the API of the existing large model for data enhancement without fine-tuning its parameters. 2) During the training process, the multi-level interaction module involves multiple argument interactions, and the model can automatically optimize and adjust the corresponding interaction module parameters based on the final selected prediction results.
[0031] In summary, according to the implicit chapter relationship recognition method enhanced by large language model generation data of the present embodiment, the data generation module based on the large language model uses diversity enhancement prompts to obtain diversity enhanced instances on the basis of the original instances, which can effectively increase the diversity of training data, improve the recognition performance and generalization ability, and increase practicality. In addition, by using context enhancement prompts, context enhanced instances are obtained on the basis of the original instances, which can effectively enrich the context information, so as to better capture the deep meaning relationship between arguments and improve the accuracy of understanding the semantic relationship of the chapter. Then, each instance is encoded through a pre-trained language model, and a bidirectional attention mechanism is used to model the interaction between the original instance and each data enhanced instance. Finally, the dynamic classification module uses the three final semantic vector representations as input for classification, and selects the classification result with the highest credibility as the final prediction result, which can effectively improve the performance and accuracy of implicit chapter relationship recognition.
[0032] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.
[0033] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.
Claims
1. A method for identifying implicit chapter relations enhanced by large language model generation data, characterized in that: Applied to an implicit chapter relationship recognition model, the implicit chapter relationship recognition model includes a data generation module based on a large language model, an encoding module based on a pre-trained model, a multi-level interaction module and a dynamic classification module; The method comprises: The data generation module based on the large language model uses diversity enhancement prompts to obtain diversity enhanced instances based on the original instances, and uses context enhancement prompts to obtain context enhanced instances based on the original instances; In the encoding module based on the pre-trained model, the original instance is encoded by the pre-trained language model to obtain an initial semantic matrix representation of the original argument, and the diversity-enhanced instance is encoded by the pre-trained language model to obtain an initial semantic matrix representation of the diversity-enhanced argument, and the context-enhanced instance is encoded by the pre-trained language model to obtain an initial semantic matrix representation of the context-enhanced argument; In the multi-level interaction module, the initial semantic matrix representation of the original arguments is used to model the interaction between the original arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the original instance, and the initial semantic matrix representation of the original arguments and the initial semantic matrix representation of the diversity-enhanced arguments are used to model the interaction between the original arguments and the diversity-enhanced arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the diversity-enhanced instance, and the initial semantic matrix representation of the original arguments and the initial semantic matrix representation of the context-enhanced arguments are used to model the interaction between the original arguments and the context-enhanced arguments through a bidirectional attention mechanism to obtain the final semantic vector representation of the context-enhanced instance; The dynamic classification module includes the first classification layer, the second classification layer and the third classification layer. The first classification layer performs classification based on the final semantic vector representation of the original instance, the second classification layer performs classification based on the final semantic vector representation of the instance after diversity enhancement, and the third classification layer performs classification based on the final semantic vector representation of the instance after context enhancement. Three classification results are calculated respectively, and the classification result with the highest credibility is selected from the three classification results as the final prediction result.
2. The implicit chapter relationship recognition method based on large language model generation data enhancement according to claim 1 is characterized in that: The data generation module based on the large language model uses diversity enhancement prompts to obtain diversity-enhanced instances based on the original instances, satisfying the following conditions: ; in, and are arguments 1 and 2 in the original instance, It is a large language model. and are arguments 1 and 2 in the diversity enhancement example, is a diversity enhancement hint, which is used to stimulate the large language model to enhance the diversity of the original examples; The data generation module based on the large language model uses context enhancement prompts to obtain context-enhanced instances based on the original instances, satisfying the following conditions: ; in, and are arguments 1 and 2 in the context-enhanced instance, It is a context enhancement hint, which is used to inspire the large language model to expand the context information of the original instance.
3. The implicit chapter relationship recognition method based on large language model generation data enhancement according to claim 2 is characterized in that: In the encoding module based on the pre-trained model, the original instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the original argument, and the following conditional formula is satisfied: ; in, and They are and The initial semantic matrix representation of It is a pre-trained language model; In the process of encoding the diversity-enhanced instances through the pre-trained language model and obtaining the initial semantic matrix representation of the diversity-enhanced arguments, the following conditional formula is satisfied: ; in, and They are and The initial semantic matrix representation of ; The context-enhanced instance is encoded by the pre-trained language model to obtain the initial semantic matrix representation of the context-enhanced argument, and the following conditional formula is satisfied: ; in, and They are and The initial semantic matrix representation of .
4. The implicit chapter relationship recognition method enhanced by large language model generation data according to claim 3 is characterized in that: In the multi-level interaction module, the initial semantic matrix representation of the original argument is used to model the interaction between the original arguments through the bidirectional attention mechanism. In the process of obtaining the final semantic vector representation of the original instance, the following conditional formula is satisfied: ; ; in, and After interaction and The semantic matrix representation of To perform row-wise averaging on the semantic matrix, is the final semantic vector representation of the original instance, It is an assembly operation. It is a bidirectional attention mechanism using the first set of parameters; Using the initial semantic matrix representation of the original argument and the initial semantic matrix representation of the diversity-enhanced argument, the interaction between the original argument and the diversity-enhanced argument is modeled through a bidirectional attention mechanism. In the process of obtaining the final semantic vector representation of the diversity-enhanced instance, the following conditional formula is satisfied: ; ; ; ; in, and After interaction and The semantic matrix representation of and After interaction and The semantic matrix representation of and are the final semantic matrix representations of argument 1 and argument 2 in the diversity-enhanced instance, is the final semantic vector representation of the instance after diversity enhancement, It is a bidirectional attention mechanism using the second set of parameters. It is a bidirectional attention mechanism using the third set of parameters. It is a bidirectional attention mechanism using the fourth set of parameters; Using the initial semantic matrix representation of the original argument and the initial semantic matrix representation of the context-enhanced argument, the interaction between the original argument and the context-enhanced argument is modeled through a bidirectional attention mechanism. In the process of obtaining the final semantic vector representation of the instance after context enhancement, the following conditional formula is satisfied: ; ; ; ; in, and After interaction and The semantic matrix representation of and After interaction and The semantic matrix representation of and are the final semantic matrix representations of argument 1 and argument 2 in the context-enhanced instance, respectively. is the final semantic vector representation of the instance after context enhancement, It is a bidirectional attention mechanism using the fifth set of parameters. It is a bidirectional attention mechanism using the sixth set of parameters. It is a bidirectional attention mechanism using the 7th set of parameters.
5. The implicit chapter relationship recognition method based on data enhancement generated by a large language model according to claim 4 is characterized in that: The first classification layer performs classification based on the final semantic vector representation of the original instance, satisfying the following condition: ; in, is the prediction result calculated by the first classification layer, and are the parameters to be learned in the first classification layer, is the normalized exponential function; The second classification layer classifies the final semantic vector representation of the instance after diversity enhancement, and the following condition is satisfied: ; in, is the prediction result calculated by the second classification layer, and are the parameters that need to be learned in the second classification layer; The third classification layer classifies the final semantic vector representation of the context-enhanced instance based on the following condition: ; in, is the prediction result calculated by the third classification layer, and are the parameters that need to be learned in the third classification layer; In the process of selecting the classification result with the highest credibility from the three classification results as the final prediction result, the following conditional formula is satisfied: ; in, For the final prediction result, A function that selects the classification result with the minimum entropy.
6. The implicit chapter relationship recognition method enhanced by large language model generation data according to claim 5 is characterized in that: Cross-entropy cost of implicit discourse relation recognition model The expression is: ; in, is a manually annotated dataset. is the cross entropy loss function, is the true label probability distribution.
Citation Information
Patent Citations
Implicit discourse relation identification method fusing parameter validity and relation label level semantic priori
CN116822526A
Implicit discourse relation identification method and system based on phrase interaction
CN116882398A
Method and apparatus of NER-oriented chinese clinical text data augmentation
US20240013000A1
Cited By
Multi-expert mechanism-based chapter structure analysis system
CN120180242A