Word Semantic Classification Model Training Method, Word Semantic Classification Method, Word Semantic Classification Model Training Device, Word Semantic Classification Device, Electronic Device, Non-Transitory Computer-Readable Storage Medium, and Computer Program
The unified word sense classification model training method addresses unbalanced samples and diverse classification scenes by using a sample query template and label category, improving accuracy and efficiency in text classification.
Patent Information
- Application Number
- JP2023050552
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-04-22
- Filing Date
- 2023-03-27
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2043-03-27
AI Technical Summary
Existing text classification models face challenges in handling unbalanced samples and require separate training for different classification scenes, leading to inefficiencies and reduced versatility.
A unified word sense classification model training method that uses a sample query template and label category to train a word sense classification model, incorporating a sample category filler phrase and system filling sub-phrases to adapt to diverse classification scenarios, and includes mechanisms for correcting label anomalies.
Improves the versatility and accuracy of word sense classification by uniformly handling unbalanced samples and diverse classification tasks without the need for multiple models, enhancing training efficiency and classification ability.
Smart Images

Figure 0007586951000001 
Figure 0007586951000002 
Figure 0007586951000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to the technical field of artificial intelligence, in particular to techniques such as knowledge graphs, deep learning and natural semantic processing. [Background technology]
[0002] Text classification, also called automatic text classification, refers to the process in which a computer maps information-laden text to a predefined category or themes of several categories, and can be used in many scenarios such as sentiment analysis, topic marking, news classification, question and answering systems, natural language reasoning, dialogue act classification, relationship classification, and event prediction. Summary of the Invention [Problem to be solved by the invention]
[0003] The present disclosure provides classification model training, semantic classification methods, devices, apparatus, and media. [Means for solving the problem]
[0004] According to one aspect of the present disclosure, A word semantic classification model training method for use in a classification model training device, comprising: Obtaining a sample query template and a label category of a predicted waiting category in the sample query template, and constructing the sample query template based on a sample query term and a number of the predicted waiting categories; inputting the sample query template into a pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted; training the semantic classification model according to the label categories of the sample semantic categories and the categories to be predicted; fruit , The sample query template is: constructing sample category filling phrases including sample semantic category filling regions, the number of the sample semantic category filling regions being equal to the number of the categories waiting to be predicted, and the sample semantic category filling regions being used to fill in the sample semantic categories of the corresponding categories waiting to be predicted; constructing the sample query template according to the sample query phrases and the sample category filler phrases; The number of systems to which the predicted waiting category belongs is at least one; Constructing sample category fill phrases including sample semantic category fill regions, as described above, includes: constructing sample system-filled subphrases for each system that include sample semantic category fill regions in the system, the number of sample semantic category fill regions in the system being equal to the number of categories waiting to be predicted in the system; determining the sample category fill phrases in response to sample system fill subphrases in all systems; A classification model training method is provided.
[0005] According to another aspect of the present disclosure, A word sense classification method for use in a word sense classification device, comprising: obtaining a predicted query template, the predicted query template being constructed based on a predicted query term and a number of categories waiting to be predicted; obtaining a predicted semantic category of the category to be predicted in response to the predicted query template. fruit , The predicted query template may include: constructing a predicted category filling phrase including a predicted semantic category filling area, the number of the predicted semantic category filling areas is equal to the number of the prediction waiting categories, and the predicted semantic category filling area is used to fill the predicted semantic category of the corresponding prediction waiting category; constructing the predicted query template in response to the predicted query phrases and the predicted category filler phrases; The number of systems to which the predicted waiting category belongs is at least one; The step of constructing predicted category fill phrases including the predicted semantic category fill regions includes: constructing, for each system, a predicted system-filled subphrase including a predicted semantic category fill region in the system, the number of predicted semantic category fill regions in the system being equal to the number of categories waiting to be predicted in the system; determining the predicted category fill phrases as a function of predicted system fill sub-phrases in all systems; Obtaining a predicted semantic category of the category to be predicted in response to the predicted query template includes: The method includes: using the predicted query template as input data for a trained semantic classification model; and determining a predicted semantic category of the category waiting to be predicted according to an output result of the semantic classification model, the semantic classification model being obtained by training using a semantic classification model training method. A method for semantic classification is further provided.
[0006] According to another aspect of the present disclosure, At least one processor; and a memory communicatively coupled to the at least one processor, wherein: The present invention further provides an electronic device, the memory storing instructions executable by at least one processor, the instructions being executed by the at least one processor such that the at least one processor can perform any one of the classification model training methods and / or semantic classification methods according to embodiments of the present disclosure.
[0007] According to another aspect of the present disclosure, there is further provided a non-transitory computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions are adapted to cause a computer to perform any one of the classification model training methods and / or the word semantic classification methods according to the embodiments of the present disclosure. Effect of the Invention
[0008] The techniques disclosed herein can improve the generalizability of the model and address the problem of sample imbalance.
[0009] It should be understood that the contents described in this section are not intended to identify key or critical features of the embodiments of the present disclosure, nor are they intended to be used to limit the scope of the present disclosure. Other features of the present disclosure will become more readily apparent from the following specification. [Brief description of the drawings]
[0010] The drawings are used for a better understanding of the present embodiments and are not intended to limit the present disclosure.
[0011] [Figure 1A] 1 is a flowchart of a classification model training method according to an embodiment of the present disclosure. [Figure 1B] FIG. 2 is a structural diagram of a semantic classification model according to an embodiment of the present disclosure. [Diagram 2] 1 is a flowchart of another classification model training method according to an embodiment of the present disclosure. [Diagram 3] 1 is a flowchart of another classification model training method according to an embodiment of the present disclosure. [Figure 4A] 1 is a flowchart of one method for semantic classification according to an embodiment of the present disclosure. [Figure 4B] FIG. 2 is a structural diagram of a semantic classification model according to an embodiment of the present disclosure. [Diagram 5] 13 is a flowchart of another method for semantic classification according to an embodiment of the present disclosure. [Figure 6]FIG. 2 is a structural diagram of one classification model training apparatus according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a structural diagram of a word semantic classification device according to an embodiment of the present disclosure. [Figure 8] FIG. 1 is a block diagram of an electronic device for implementing the classification model training method and / or the word semantic classification method of an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings. In order to facilitate understanding, various details of the embodiments of the present disclosure are included herein, but should be considered as merely illustrative. Therefore, those skilled in the art should recognize that the embodiments described herein can be changed and modified in various ways without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and simplicity, the following description omits descriptions of known functions and structures.
[0013] Each classification model training method according to the embodiments of the present disclosure can be applied to a scene in which semantic classification model training is performed, and the method can be executed by a classification model training device, which can be realized using software and / or hardware, and specifically, can be disposed in an electronic device.
[0014] Referring to the classification model training method shown in FIG. 1A, it includes:
[0015] In S101, a sample query template and a label category of a predicted waiting category in the sample query template are obtained, where the sample query template is constructed based on a sample query term and a number of predicted waiting categories.
[0016] Here, the query phrase can be understood as a phrase constructed from at least one semantic character, and the sample query phrase is a query phrase that is a training sample in the model training process. Here, the category to be predicted can be understood as the most predictable category of the sample query phrase. The number of categories to be predicted can be set by an engineer according to needs or experience, or can be determined through a large amount of experiments. Here, the number of categories to be predicted can be at least one. In order to avoid a situation where a semantic category prediction miss occurs in a semantic classification model obtained by subsequent training, the number of categories to be predicted is usually set to at least two, for example, five.
[0017] It should be noted that the category waiting for prediction is at least one type of predictable category, and the number of categories waiting for prediction is usually significantly smaller than the number of predictable categories.
[0018] Here, the sample query template is a phrase having a unified format requirement that is constructed based on the number of sample query phrases and categories to be predicted. Here, the label category of the category to be predicted can be understood as a standard semantic category corresponding to the preset sample query phrase. Here, the present disclosure does not limit the specific setting method of the label category, and can be realized, for example, by using an artificial labeling method.
[0019] It should be noted that the sample query templates and / or corresponding label categories can be stored locally on the computing device that performs the classification model training, or in other storage devices or clouds associated with the computing device, and the corresponding data can be acquired when needed. The present disclosure does not limit the manner of acquiring each of the above data.
[0020] Preferably, further, before performing classification model training, sample query phrases may be obtained, and according to the sample query phrases and the number of categories to be predicted, sample query templates may be constructed in real time for use in subsequent classification model training.
[0021] It should be noted that both the computing device that performs the retrieval of the sample query templates and corresponding label categories, and the computing device that performs the construction of the sample query templates, may be the same or different, and the present disclosure is not limited in this respect.
[0022] In S102, the sample query template is input to a pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted.
[0023] A sample query template is input as a training sample into a semantic classification model constructed in advance, and a sample semantic category of at least one category waiting to be predicted in the sample query template is obtained. Note that the number of sample semantic categories to be predicted may be equal to or less than the number of categories waiting to be predicted, and the present disclosure does not place any limitations on the specific number of sample semantic categories.
[0024] Here, the semantic classification model can be realized based on a conventional machine learning model or a deep learning model, and the present disclosure does not limit the specific network structure of the semantic classification model. Exemplarily, the semantic classification model can be realized using a PLM (Pre-trained Language Model). For example, the semantic classification model may be a BERT (Bidirectional Encoder Representation from Transformers) or an ERNIE (Enhanced Representation through Knowledge Integration) model, etc.
[0025] In one preferred embodiment, the direct sample query templates may be input as training samples into a pre-constructed semantic classification model, and the output of the semantic classification model may be the sample semantic categories of the categories to be directly predicted.
[0026] In another preferred embodiment, a sample query template may be input into a pre-constructed semantic classification model to obtain at least one sample semantic character of a to-be-predicted category, and each sample semantic character may be combined according to a prediction order to obtain a sample semantic category of the to-be-predicted category.
[0027] Here, the sample semantic character of the prediction-waiting category can be understood as character information corresponding to the semantic feature of the extracted sample query template in the prediction-waiting category dimension. For example, since the number of sample semantic characters that can be obtained for any prediction-waiting category dimension is at least one, the sample semantic characters may be combined in order according to the prediction order of the sample semantic characters to obtain the sample semantic category of the prediction-waiting category.
[0028] First, it can be seen that the method of determining the sample semantic category by predicting the sample semantic characters, combining each sample semantic character according to the prediction order, and obtaining the sample semantic category of the category to be predicted improves the mechanism of determining the sample semantic category. At the same time, in view of the small granularity of the sample semantic characters, enabling the extraction of semantic features by the granularity of the characters increases the accuracy of the predicted sample semantic characters.
[0029] Illustratively, a sample query template is input into a pre-constructed semantic classification model to extract sample semantic features in the sample query template, and feature transformation is performed on the sample semantic features to obtain at least one sample semantic character of a prediction-waiting category, where the number of sample semantic characters of each prediction-waiting category can be the same or different, and the present disclosure only needs to limit the maximum number of sample semantic characters of different prediction-waiting categories.
[0030] Specifically, referring to the semantic classification model structure diagram shown in Figure 1B, the semantic classification model may include a feature extraction network and a feature transformation network. For any category to be predicted, the feature extraction network may perform feature extraction on the sample query template in the category dimension to be predicted, obtain sample semantic features in the category dimension to be predicted, and the feature transformation network may perform feature transformation on the sample semantic features to map the sample semantic features from the semantic feature space to the semantic character space, and match the mapping result in the semantic character space with the standard semantic character library to obtain sample semantic characters. Correspondingly, each sample semantic character may be combined according to a prediction order to obtain a sample semantic category of the category to be predicted.
[0031] Here, the feature transformation may be a linear feature transformation or a nonlinear feature transformation, and the present disclosure is not limited thereto. Here, the standard semantic character library may be set or adjusted by engineers according to needs or experience, or may be set through a large amount of experimentation.
[0032] It can be understood that the above technical aspect does not require complex data processing, but determines sample meaning characters using only the feature conversion method, thereby simplifying the amount of data calculation in the process of determining sample meaning characters, and contributing to improving the efficiency of model training.
[0033] In S103, a semantic classification model is trained according to the label categories of the sample semantic categories and the categories to be predicted.
[0034] Until the trained semantic classification model satisfies a training end condition, a loss function is determined according to the discrepancy between the sample semantic category and the label category of the label to be predicted, and model parameters of the semantic classification model are adjusted based on the loss function so as to reduce the discrepancy between the sample semantic label and the label category and improve the classification ability of the semantic classification model.
[0035] Here, the training end condition may be at least one of the following: the number of sample query templates for training the semantic classification model satisfies a preset number threshold, the function value of the loss function tends to be stable, the model evaluation index satisfies a preset evaluation index threshold, etc. Here, the specific values of the preset number threshold and the preset evaluation index threshold may be set by an engineer according to needs or experience, or may be determined through a large amount of experiments. Here, the model evaluation index may include at least one of accuracy, sensitivity, specificity, etc.
[0036] In the embodiment of the present disclosure, a sample query template constructed based on the sample query template and the number of categories to be predicted is obtained, and a pre-constructed semantic classification model is trained according to the label category of the sample query template and the category to be predicted. The present disclosure trains a semantic classification model based on a unified sample query template, and performs sample classification from the semantic dimension rather than the inter-category difference dimension, so that the trained semantic classification model can adapt to diversified classification scenes, and there is no need to train different classification models for different classification scenes, thereby improving the versatility of the trained semantic classification model. At the same time, the template format is used to unify the diversified sample query phrases, which can effectively address the problem of imbalanced samples in diversified category prediction scenes, thereby contributing to improving the classification ability of the trained semantic classification model for small samples.
[0037] In consideration of the above technical aspects, the present disclosure further provides a preferred embodiment. In the preferred embodiment, the mechanism of constructing the sample query template used in S101 is sub-divided. Note that for parts not described in detail in the embodiment of the present disclosure, reference can be made to related descriptions in other embodiments.
[0038] Refer to the classification model training method shown in Figure 2, which includes:
[0039] In S201, a sample category filling phrase including a sample semantic category filling area is constructed, where the number of the sample semantic category filling areas is equal to the number of categories waiting to be predicted, and the sample semantic category filling area is used to fill the sample semantic category of the corresponding category waiting to be predicted.
[0040] Here, the sample semantic category filling area may be a pre-set blank area or an area to which a preset mark is added, where the preset mark may be set or adjusted by an engineer according to needs or experience, such as a null value or a “MASK” mark.
[0041] It can be understood that in order to facilitate the distinction of different sample semantic categories in the sample category fill phrase, a range delimiter can be added between different sample semantic category fill ranges. Here, the range delimiter can be realized by using a preset character, and the present disclosure does not limit the specific expression form of the preset character. For example, the preset character may be a comma, a comma, a space, or other symbols, etc.
[0042] In addition, the predicted waiting categories related to the present disclosure may be categories in the same system or categories in different systems. Here, the systems to which different predicted waiting categories belong may be set or adjusted by engineers according to needs or experience, and the present disclosure does not limit the type of system.
[0043] For example, it can be divided into two types of systems: themes and intentions. Here, a category with attributes to which a species belongs is divided into a theme system, for example, people, entertainment people, etc., both belong to the theme system, and a category with an intention to obtain data is divided into an intention system, for example, height, weight, etc., both belong to the intention system.
[0044] In a situation where the number of prediction-awaiting categories is at least one and the systems to which different prediction-awaiting categories belong are different, i.e., the number of systems to which each prediction-awaiting category belongs is at least one, a sample system filling sub-phrase including a sample semantic category filling area is constructed for any of the systems, where the number of sample semantic category filling areas is equal to the number of prediction-awaiting categories in the system, and sample category filling phrases can be determined according to the different sample system filling sub-phrases.
[0045] Specifically, for any one of the systems, the same number of sample semantic category filling areas are set according to the number of categories waiting to be predicted in the system, and sample system filling sub-phrases including the set sample semantic category filling areas are constructed. If the number of systems corresponding to the number of categories waiting to be predicted is at least two, sample category filling phrases are determined according to each sample system filling sub-phrase corresponding to a different system.
[0046] For example, sample system filling subphrases corresponding to different systems may be combined to obtain a sample category filling phrase. Furthermore, in order to facilitate the classification of categories to be predicted in different systems, subphrase delimiters may be set between different sample system filling subphrases when generating sample category filling phrases. Here, the subphrase delimiters may be realized using preset characters, and the present disclosure does not limit the specific expression form of the preset characters. For example, the preset characters may be commas, commas, spaces, or other symbols. Note that the subphrase delimiters may be the same as or different from the aforementioned range delimiters, as long as it is ensured that different sample system filling subphrases can be distinguished.
[0047] It can be seen that by introducing a system to which the category to be predicted belongs, constructing a sample system filling sub-phrase for each system, and further determining a sample category filling phrase according to the sample system filling sub-phrase, the generated sample category filling phrase can perform system classification for the category to be predicted. At the same time, the sample category filling phrase is used as the basis for generating a sample query template, which makes it easy to add or adjust a system, so there is no need to train a subsequent semantic classification model for each different system, and it can adapt to diversifying sample query phrases, which contributes to improving the versatility of the model. Furthermore, in the training process of a multi-system, multi-category semantic classification model, it is possible to realize reuse of network parameters trained with different sample query phrases, which contributes to improving training efficiency.
[0048] Furthermore, when a multi-body, multi-category sample query template is introduced, in the process of training the model, cross-enhancement of semantic features in different dimensions is usually performed within the model, which contributes to improving the semantic feature extraction ability of the trained model and further contributes to improving the accuracy of the trained model.
[0049] In order to facilitate differentiation of prediction waiting categories in different systems, the same range delimiters may be set for sample system filler subphrases of the same system, and different range delimiters may be set for sample system filler subphrases of different systems.
[0050] At S202, a sample query template is constructed according to the sample query phrases and the sample category filler phrases.
[0051] A sample query template is generated that includes sample query phrases and sample category filler phrases.
[0052] Exemplarily, the sample query phrase and the sample category filling phrase are combined to obtain a sample query template. Furthermore, in order to ensure the readability of the sample query template obtained after the sample semantic category is filled into the sample semantic category filling area of the sample query template when predicting the sample semantic category subsequently, a connecting phrase can be added between the sample query phrase and the sample category filling phrase when constructing the sample query template. Here, the connecting phrase can be artificially set, for example, the connecting phrase can be a conjunction. Of course, in order to improve the readability of the sample query template after the sample semantic category is filled into the sample semantic category filling area, a connecting phrase can be further added between different sample system filling sub-phrases. The present disclosure does not limit the number and contents of connecting phrases at different positions in the sample query template.
[0053] For example, if a sample query phrase is “Zhang San’s height and weight”, and the systems to which the prediction-awaiting categories belong include a theme system and an intention system, and the number of prediction-awaiting categories corresponding to each system is three, then a template can be constructed as “Zhang San’s height and weight are [MASK], [MASK], [MASK]; [MASK], [MASK], [MASK]”. Here, "[MASK]" is a sample semantic category fill region, "[MASK],[MASK],[MASK];[MASK],[MASK],[MASK]" are sample category fill phrases, "wa" is a conjunction, "[MASK],[MASK],[MASK]" are sample system fill subphrases corresponding to the thematic scheme, where "," is a region delimiter corresponding to the thematic scheme, "[MASK],[MASK],[MASK]" are sample system fill subphrases corresponding to the intention scheme, where "," is a region delimiter corresponding to the intention scheme, and ";" is a subphrase delimiter between sample system fill subphrases. Of course, the above is merely an illustrative description of the sample query template to be constructed, and should not be understood as limiting the construction manner of the sample query template.
[0054] In S203, a sample query template and a label category of a category to be predicted in the sample query template are obtained.
[0055] In S204, the sample query template is input to a pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted.
[0056] Continuing with the above example, if the sample query template is "Zhang San's height and weight are [MASK], [MASK], [MASK]; [MASK], [MASK], [MASK]", the prediction waiting categories in the determined theme system include "person" and "entertainment person", and the prediction waiting categories in the determined intent system include "height" and "weight", then after the sample semantic category filling area in the sample query template is filled, "Zhang San's height and weight are person, entertainment person, [MASK]; height, weight, [MASK]" is obtained. In order to ensure the conciseness of the filled sample query template, the unfilled sample semantic categories and adjacent area delimiters may not be displayed. That is, the filled sample query template may be "Zhang San's height and weight are person, entertainment person; height, weight".
[0057] In S205, a semantic classification model is trained according to the label categories of the sample semantic categories and the categories to be predicted.
[0058] The embodiment of the present disclosure introduces a sample semantic category filling region to construct a sample category filling phrase, and constructs a sample query template according to the sample query phrase and the sample category filling phrase, thereby improving the mechanism of constructing the sample query template and providing data support for training the semantic classification model. At the same time, the above unified manner for generating sample query templates for different sample query phrases allows the network structure to train and output good classification ability without requiring a particularly complex semantic classification model, which simplifies the model complexity and contributes to improving the training efficiency.
[0059] In addition, during the training process of the semantic classification model, the semantic classification model gradually becomes capable of classifying semantic categories based on the semantic features in the sample query template. Since the label categories of the categories to be predicted in the sample query template may be inappropriately labeled in the labeling process, a mechanism for correcting label category errors can be introduced to correct the inappropriately labeled label categories, so as to avoid the influence of labeling errors on the classification ability of the semantic classification model.
[0060] In view of this, the present disclosure further provides a preferred embodiment, in which a label category error correction mechanism is introduced into the process of training the semantic classification model in S103 in order to improve the classification ability of the semantic classification model. Note that for parts not described in detail in the embodiment of the present disclosure, reference may be made to related descriptions in other embodiments.
[0061] Furthermore, refer to the classification model training method shown in FIG. 3, which includes:
[0062] In S301, a sample query template and a label category of a predicted waiting category in the sample query template are obtained, where the sample query template is constructed based on a sample query term and a number of predicted waiting categories.
[0063] In S302, a sample query template is input to a pre-constructed semantic classification model to obtain a sample semantic category of a category to be predicted.
[0064] In S303, a label anomaly type is determined according to the sample semantic category and the label category.
[0065] Here, the label anomaly type is used to represent the discrepancy situation when the sample semantic category and the label category are different from each other in the type dimension.
[0066] Illustratively, the label anomaly type can be determined according to the discrepancy between the sample semantic category and the label category.
[0067] In one preferred embodiment, if the sample semantic category is a subcategory of the label category, the label anomaly type is determined to be a top-to-bottom predictive type.
[0068] Specifically, if the label category and the sample semantic category have a relationship of hierarchical affiliation, and the label category is a higher-level category of the sample semantic category and the sample semantic category is a lower-level category of the label category, the label anomaly type is determined to be a type that predicts from higher to lower. For example, the label category is "game", the sample semantic category is "shogi game", and "shogi game" is a lower-level category of "game", and the corresponding label anomaly type is the "type that predicts from higher to lower".
[0069] In another preferred embodiment, if the sample semantic category is a cognate variant of the label category, the label anomaly type is determined to be noise type.
[0070] Here, the same-origin variant category of the label category can be understood as a category obtained by directly adding or deleting characters from the label category. For example, by determining the ratio or similarity of the same characters between the label category and the sample semantic category, it is possible to recognize whether the sample semantic category is the same-origin variant category of the label category. If it is the same-origin variant category of the label category, the label anomaly type is determined to be a noise type. For example, the sample query phrase is "the next sentence of Kubya Naryoi", and the label category corresponding to the prediction waiting category in the intention system of the sample query phrase is "other", but the sample semantic category output by the semantic classification model is "other sentence", and "other sentence" is the same-origin variant category of "other", so the label anomaly type is set to a noise type.
[0071] In a further preferred embodiment, if the sample semantic category is a combination category of decomposable categories of the label category, the label anomaly type is determined to be a mixed type.
[0072] Here, the decomposable category of the label category can be understood as the result of decomposing the single meaning of the label category of the compound meaning. Here, the compound meaning may include at least two layers of single meanings. For example, if "box office ranking" is a compound meaning of "box office" and "ranking list", the decomposable category corresponding to the label category "box office ranking" includes "box office" and "ranking list". If the sample meaning category is "box office ranking list", the label anomaly type is set to a mixed type.
[0073] It can be seen that by subdividing the above label anomaly types to include at least one of the top-to-bottom prediction type, the noise type, and the mixed type, the richness and diversity of the label anomaly types are increased, and different types of label anomaly types are limited, the mechanism for determining different label anomaly types is improved, and a foundation is laid for correction of label categories with different label anomaly types.
[0074] In S304, the label category is adjusted according to the label correction method corresponding to the label anomaly type.
[0075] Exemplarily, different label correction schemes can be pre-set for different label anomaly types, and the label correction schemes corresponding to the label anomaly types are used to correct the anomaly label categories accordingly.
[0076] In one preferred embodiment, if the label anomaly type is a top-to-bottom predictive type, the label category may be directly replaced with the sample semantic category.
[0077] Continuing with the previous example, if the label category is "game" and the sample semantic category is "shogi game," the label category is directly changed from "game" to "shogi game."
[0078] In another preferred embodiment, if the label anomaly type is a noise type, the label category can be adjusted according to the substitutable labels of the cognate variant category of the label category.
[0079] For example, one of the replaceable labels of the same origin variant category of the label category can be selected as the label category. Preferably, the replaceable category may be selected using a method of determining the similarity between the sample query phrase and the replaceable label, or using an artificial method, and the present disclosure does not limit the method of selecting the replaceable label.
[0080] Continuing with the above example, if the sample query phrase is “the next sentence of Kubya Naryoi,” and the label category corresponding to the prediction waiting category in the intent system of the sample query phrase is “other,” and the sample semantic category output by the semantic classification model is “other sentence,” then “next sentence” may be selected as a new label category from the replaceable labels “previous sentence” and “next sentence” of “other sentence.”
[0081] In a further preferred embodiment, if the label anomaly type is a mixed type, replace the label category with the sample sense or a decomposable category of the label category.
[0082] Continuing with the previous example, if the label category is “box office revenue ranking” and the sample semantic category is “box office revenue ranking list”, in a single-intent prediction scene, the single-intent prediction can be converted to a multi-category prediction in a single-intent system, and the label category can be corrected to include “box office revenue” and “ranking list”. Alternatively, in a double-intent system, single-category prediction scene, the label category of the new intent system “box office revenue ranking list” is added after the existing “box office revenue” in the first intent system and “ranking list” in the second intent system.
[0083] It can be seen that by subdividing the correction process for label categories for the above different label anomaly types, the diversity and richness of the label category correction process can be increased and different label anomaly situations can be effectively dealt with, thereby laying a foundation for further improvement of the accuracy of the semantic classification model.
[0084] In S305, a semantic classification model is trained according to the sample semantic categories and the adjusted label categories.
[0085] Training the semantic classification model according to the adjusted label categories rather than the abnormally labeled label categories helps to improve the accuracy and robustness of the semantic classification model by avoiding the occurrence of a situation in which the performance of the semantic classification model deteriorates and the accuracy becomes low by using network parameters of the semantic classification model based on the abnormally labeled label categories.
[0086] The process of training the classification model has been described in detail above. The process of semantic classification will now be described in detail.
[0087] Each word semantic classification method according to the embodiments of the present disclosure is applicable to the scene of word semantic classification, in particular, word semantic classification based on the word semantic classification model obtained by the above classification model training method. The method can be executed by a word semantic classification device, and the device can be realized using software and / or hardware and specifically disposed in an electronic device. The electronic device and the computing device that executes the above classification model training method may be the same or different electronic devices, and the present disclosure does not limit this in any way.
[0088] Referring to the semantic classification method shown in FIG. 4A, it includes the following:
[0089] In S401, a predicted query template is obtained, where the predicted query template is constructed based on a predicted query term and a number of categories waiting to be predicted.
[0090] Here, the query phrase can be understood as a phrase obtained by constructing at least one semantic character, and the predicted query phrase is a query phrase waiting for semantic category prediction in the semantic classification process. Here, the waiting-for-prediction category can be understood as a predictable category of the predicted query phrase, and the number of waiting-for-prediction categories can be set by engineers according to needs or experience, or determined through a large amount of experimentation. Here, the number of waiting-for-prediction categories can be at least 1. When determining the waiting-for-prediction categories for different predicted query phrases, in order to avoid the occurrence of a situation where a category prediction is missed, the number of waiting-for-prediction categories is usually set to at least 2, for example 5.
[0091] It should be noted that the category waiting for prediction is at least one type of predictable category, and the number of categories waiting for prediction is usually significantly smaller than the number of predictable categories.
[0092] Here, the predicted query template is a phrase with a unified format requirement that is constructed based on the predicted query phrase and the number of categories to be predicted. Note that the predicted query template can be stored in advance locally in the computing device that executes the semantic classification method, or in other storage devices or clouds related to the computing device, and response data is acquired when semantic classification needs to be performed. The present disclosure does not limit the manner of acquiring the predicted query template.
[0093] Preferably, before performing the semantic classification, the predicted query phrase may be obtained, and a predicted query template may be constructed in real time according to the predicted query phrase and the number of categories to be predicted.
[0094] It should be noted that the computing device that performs the retrieval of the predicted query template and the computing device that performs the construction of the predicted query template may be the same or different, and this disclosure is not limited in this respect.
[0095] In S402, a predicted semantic category of a category waiting to be predicted is obtained according to the predicted query template.
[0096] For example, the predicted query template can be used as input data for a trained semantic classification model, and the predicted semantic category of the category waiting to be predicted can be determined according to the output result of the model. Note that the number of predicted semantic categories obtained may be equal to or less than the number of categories waiting to be predicted, and the present disclosure does not limit the specific number of predicted semantic categories. Here, the semantic classification model can be obtained by training using at least one of the classification model training methods described above.
[0097] In one preferred embodiment, the direct prediction query template may be input to a trained semantic classification model, and the output of the semantic classification model may be the predicted semantic category of the category to be predicted.
[0098] In another preferred embodiment, at least one predicted semantic character of the prediction-waiting category may be determined according to the predicted query template, and each predicted semantic character may be combined according to a prediction order to obtain a predicted semantic category of the prediction-waiting category.
[0099] Here, the predicted meaning characters of the prediction waiting category can be understood as character information corresponding to the semantic features of the extracted prediction query template in the prediction waiting category dimension. Here, the number of predicted meaning characters of each prediction waiting category may be the same or different, and the present disclosure only needs to limit the maximum number of predicted meaning characters of different prediction waiting categories.
[0100] For example, the predicted query template can be input to a trained semantic classification model to obtain at least one predicted semantic character of a waiting-to-predict category. Correspondingly, for any waiting-to-predict category dimension, the number of predicted semantic characters that can be obtained is at least one, so that according to the predicted order of the predicted semantic characters, each predicted semantic character order can be combined to obtain a predicted semantic category of the waiting-to-predict category.
[0101] It can be seen that the method of determining a predicted semantic category by determining a predicted semantic character in advance, combining each predicted semantic character according to the prediction order, and obtaining a predicted semantic category of a category waiting to be predicted has improved the mechanism of determining a predicted semantic category. At the same time, in view of the small granularity of the predicted semantic characters, making it possible to extract semantic features at the granularity of the characters has improved the accuracy of the determined predicted semantic characters. At the same time, since there are many different predicted semantic characters, combining the predicted semantic characters in different orders has increased the richness and diversity of the determined predicted semantic categories.
[0102] Exemplarily, determining at least one predicted semantic character of the predicted-to-be-predicted category in response to the predicted query template may include extracting predictive semantic features in the predicted query template, performing feature transformation on the predictive semantic features, and obtaining at least one predicted semantic character of the predicted-to-be-predicted category.
[0103] Specifically, referring to the semantic classification model structure diagram shown in Figure 4B, the semantic classification module may include a feature extraction network and a feature transformation network. For any category waiting for prediction, the feature extraction network may perform feature extraction on the predicted query template in the category waiting for prediction dimension to obtain a predicted semantic feature in the category waiting for prediction dimension, and the feature transformation network may perform feature transformation on the predicted semantic feature to map the predicted semantic feature from the semantic feature space to the semantic character space, and match the mapping result in the semantic character space with the standard semantic character library to obtain a predicted semantic character. Correspondingly, each predicted semantic character may be combined according to a prediction order to obtain a predicted semantic category of the category waiting for prediction.
[0104] Here, the feature transformation may be a linear feature transformation or a nonlinear transformation, and the present disclosure does not limit the same. Here, the standard semantic character library may be set or adjusted by engineers according to needs or experience, or may be set through a large amount of experimentation.
[0105] In addition, in order to ensure the accuracy of the semantic classification results, when the predicted semantic characters are determined based on the semantic classification model, the maximum number of predicted semantic characters of the category waiting to be predicted in the predicted query template should be consistent with the maximum number of sample semantic characters of the category waiting to be predicted in the sample query template, the feature transformation method used for feature transformation should also be consistent, and the standard semantic character library used in the semantic classification process and the standard semantic character library used in the classification model training process should also be maintained to be consistent.
[0106] It can be seen that the above technical aspect does not require complex data processing, but determines predictive meaning characters only by the feature conversion method, simplifies the amount of data calculation in the process of determining predictive meaning characters, and contributes to the efficiency of meaning classification.
[0107] Since the predicted meaning category can be obtained by sequentially combining predicted meaning characters at at least one character prediction position, in consideration of the diversity of predicted meaning characters, the predicted meaning category obtained by sequentially combining them may not have an actual meaning, which affects the accuracy of the determination result of the predicted meaning category. For example, the predicted meaning characters at different character prediction positions are "entertainment", "pleasure", "person" and "thing", respectively, and the predicted meaning category obtained by combining them is "entertainment pleasure person", but "entertainment pleasure person" does not have an actual meaning.
[0108] Preferably, consideration may be given to the presence of the predicted semantic category in the standard semantic category library, and if the predicted semantic category exists in the standard semantic category library, it indicates that actual semantic information exists, and if the predicted semantic category does not exist in the standard semantic category library, actual semantic information does not exist. Here, the standard semantic category library stores standard semantic categories that can be used as predictable categories, and each standard semantic category has an actual semantic meaning. Note that the standard semantic category library may be set or adjusted by a technician according to needs or experience, and the present disclosure does not limit this in any way.
[0109] In order to improve the accuracy of the predicted meaning category, when a predicted meaning character is determined, among at least one predicted meaning character, there are at least two predicted meaning characters in the same prediction order, that is, at least two predicted meaning characters are determined at the same character prediction position, and a probability of the predicted meaning character is introduced to distinguish the possibility that different predicted meaning characters are set at the corresponding character prediction position.
[0110] Correspondingly, combining each predicted semantic character according to the prediction order to obtain a predicted semantic category of the category waiting to be predicted may include combining each predicted semantic character of different prediction orders according to the prediction order to obtain at least one candidate semantic category, determining a category prediction probability of the candidate semantic category according to the character prediction probabilities of the different predicted semantic characters in the candidate semantic category, and selecting a predicted semantic category from each candidate semantic category according to the category prediction probability and a matching result between the candidate semantic category and each standard semantic category in the standard semantic category library.
[0111] Exemplarily, for any prediction-waiting category, a character prediction probability at each character prediction position in the prediction-waiting category is determined, predicted semantic characters at different character prediction positions are combined according to a prediction order to obtain a candidate semantic category, and a category prediction probability of the candidate semantic category is determined according to the character prediction probabilities of the different predicted semantic characters in the candidate semantic category based on a preset probability determination function, where the preset probability determination function is an increasing function of the character prediction probability, and a candidate semantic category having a relatively high category prediction probability (e.g., the highest) and matching with each standard semantic category in the standard semantic category library is selected as the predicted semantic category from the candidate semantic categories.
[0112] Specifically, based on the method of beam search or Bk-tree (Burkhard Keller Tree), at least one candidate semantic category having a relatively high category prediction probability is determined, and from among them, a candidate semantic category having a relatively high category prediction probability and capable of matching with a standard semantic category in the standard semantic category library can be selected as a predicted semantic category.
[0113] Continuing with the above example, if the candidate semantic categories include “entertainment person,” “entertainment person,” “entertainment personnel,” and “entertainment personnel,” and the category prediction probability decreases successively, and only “entertainment person” is a standard semantic category in the standard semantic category library, then “entertainment person” is selected as the final predicted semantic category.
[0114] When there are predictions for multiple systems and categories, it is possible to classify and set standard semantic category libraries for the different systems. This improves the accuracy of the results of determining predicted semantic categories in each system and avoids an increase in the amount of calculations that would be required due to the mixed use of standard semantic category libraries in different systems.
[0115] The above technical aspect determines at least two predicted meaning characters in the same prediction order, and determines a category prediction probability by introducing a character prediction probability of the predicted meaning characters, and determines a predicted semantic category based on the category prediction probability and a standard semantic category in a standard semantic category library, thereby avoiding the occurrence of a situation in which the classification result becomes inaccurate in the semantic classification process, and contributing to improving the accuracy and appropriateness of the classification prediction result.
[0116] In the embodiment of the present disclosure, a prediction query template is obtained based on a prediction query phrase and the number of categories to be predicted, and a predicted semantic category of the category to be predicted is obtained according to the prediction query template. In the present disclosure, category prediction is performed based on a unified prediction query template, and classification is performed based on a semantic dimension rather than a difference dimension between categories, so that the classification method can adapt to diversified classification scenes, and the versatility of semantic classification is improved.
[0117] Furthermore, based on the above-mentioned trained semantic classification model, a predicted semantic category for each category waiting to be predicted in the predicted query template is determined, and the model can deal with the problem of sample imbalance in diverse category prediction scenes, thereby contributing to improving the small sample classification ability of the trained semantic classification model and improving the accuracy of semantic classification results in small sample situations.
[0118] In consideration of the above technical aspects, the present disclosure further provides a preferred embodiment, in which the mechanism for constructing the predicted query template used in S401 is optimized. Note that for parts not described in detail in the embodiment of the present disclosure, reference can be made to related descriptions in other embodiments.
[0119] Furthermore, referring to the semantic classification method shown in FIG. 5, it includes the following:
[0120] In S501, a predicted category filling phrase including a predicted semantic category filling area is constructed, where the number of the predicted semantic category filling areas is equal to the number of prediction waiting categories, and the predicted semantic category filling area is used to fill with the predicted semantic category of the corresponding prediction waiting category.
[0121] Here, the predicted semantic category filling area may be a blank area or an area to which a preset mark is added, where the preset mark may be set or adjusted by an engineer according to needs or experience, for example, a null value or a "MASK" mark. Note that the preset mark here and the preset mark in the training process of the classification model may be the same or different. Preferably, the preset mark used in both are the same.
[0122] It can be understood that in order to facilitate distinguishing different predicted semantic categories in a predicted category fill phrase, a range delimiter can be added between different predicted semantic category fill ranges. Here, the range delimiter can be realized using a preset character, and the present disclosure does not limit the specific expression form of the preset character. For example, the preset character may be a comma, a comma, a space, or other symbols, etc.
[0123] In addition, the predicted waiting categories related to the present disclosure may be categories in the same system or categories in different systems. Here, the systems to which different predicted waiting categories belong may be set or adjusted by engineers according to needs or experience, and the present disclosure does not limit the type of system.
[0124] For example, it can be divided into two types of systems: themes and intentions. Here, a category with attributes to which a species belongs is divided into a theme system, for example, people, entertainment people, etc., both belong to the theme system, and a category with an intention to obtain data is divided into an intention system, for example, height, weight, etc., both belong to the intention system.
[0125] In a situation where the number of predicted waiting categories is at least one and the systems to which different predicted waiting categories belong are different, i.e., the number of systems to which each predicted waiting category belongs is at least one, a predicted system filling subphrase including a predicted semantic category filling area is constructed for any system, where the number of predicted semantic category filling areas is equal to the number of predicted waiting categories in the system, and the predicted category filling phrase can be determined according to the different predicted system filling subphrases.
[0126] Specifically, for any one of the systems, the same number of predicted semantic category filling regions are set according to the number of categories waiting to be predicted in the system, and a prediction system filling subphrase including the set predicted semantic category filling region is constructed. If the number of systems corresponding to the number of categories waiting to be predicted is at least two, a predicted category filling phrase is determined according to each prediction system filling subphrase corresponding to a different system.
[0127] For example, prediction system filling sub-phrases corresponding to different systems may be combined to obtain a prediction category filling phrase. Furthermore, in order to facilitate the classification of categories to be predicted in different systems, when generating a prediction category filling phrase, a sub-phrase delimiter may be set between different prediction system filling sub-phrases. Here, the sub-phrase delimiter may be realized using a preset character, and the present disclosure does not limit the specific expression form of the preset character. For example, the preset character may be a comma, a comma, a space, or other symbols. Note that the sub-phrase delimiter may be the same as or different from the above-mentioned range delimiter, as long as it is ensured that different prediction system filling sub-phrases can be distinguished.
[0128] It can be understood that by introducing a system to which the prediction waiting category belongs, constructing a predicted system filling sub-phrase for each system, and further determining a predicted category filling phrase according to the predicted system filling sub-phrase, it is possible to perform system classification for the prediction waiting category in the generated predicted category filling phrase. At the same time, since the predicted category filling phrase is used as the basis for generating a prediction query template, and it is easy to add or adjust a system, it can be adapted to classification scenes in multiple systems, and the versatility of semantic classification is improved.
[0129] Furthermore, when a multi-system, multi-category predictive query template is introduced, if the predictive query template is processed based on the above-mentioned trained semantic classification model, cross-enhancement of semantic features in different dimensions is usually performed within the model, thereby increasing the richness and precision of the semantic features extracted by the semantic classification model, and further contributing to improving the accuracy of semantic classification in multi-system, multi-classification.
[0130] In order to facilitate differentiation of prediction waiting categories in different schemes, the same range delimiters may be set for prediction scheme fill subphrases of the same scheme, and different range delimiters may be set for prediction scheme fill subphrases of different schemes.
[0131] It should be noted that the range delimiters in the embodiments of the present disclosure may be the same as or different from the range delimiters used in the training process of the classification model, and the subphrase delimiters in the embodiments of the present disclosure may be the same as or different from the subphrase delimiters used in the training process of the classification model. Preferably, the range delimiters in the embodiments of the present disclosure and the range delimiters used in the training process of the classification model are the same, and the subphrase delimiters in the embodiments of the present disclosure and the subphrase delimiters used in the training process of the classification model are also the same.
[0132] At S502, a predicted query template is constructed as a function of the predicted query phrases and the predicted category filler phrases.
[0133] A predicted query template is generated that includes the predicted query phrases and the predicted category filler phrases.
[0134] Exemplarily, the predicted query phrase and the predicted category filler phrase are combined to obtain a predicted query template. Furthermore, subsequently, when determining the predicted semantic category, in order to ensure the readability of the predicted query template obtained after the predicted semantic category is filled into the predicted semantic category filling area of the predicted query template, a conjunction phrase can be added between the predicted query phrase and the predicted category filler phrase when constructing the predicted query template. Here, the conjunction phrase can be artificially set, for example, the conjunction phrase can be a conjunction. Of course, in order to improve the readability of the predicted query template after the predicted semantic category filling area is filled with the predicted semantic category, a conjunction phrase can be further added between different prediction system filling subphrases. The present disclosure does not limit the number and contents of the conjunction phrases at different positions in the predicted query template.
[0135] It should be noted that the conjunctions used here and those used in the training process of the classification model may be the same or different, preferably the conjunctions used in both are correspondingly the same.
[0136] For example, if the predicted query phrase is “Zhang San’s height and weight”, and the systems to which the prediction-awaiting categories belong include a theme system and an intention system, and the number of prediction-awaiting categories corresponding to each system is three, then a template can be constructed as “Zhang San’s height and weight are [MASK], [MASK], [MASK]; [MASK], [MASK], [MASK]”. Here, "[MASK]" is a predicted semantic category fill region, "[MASK], [MASK], [MASK]; [MASK], [MASK], [MASK]" are predicted category fill phrases, "wa" is a conjunction, "[MASK], [MASK], [MASK]" are prediction system fill subphrases corresponding to the thematic scheme, where "," is a region delimiter corresponding to the thematic scheme, "[MASK], [MASK], [MASK]" are prediction system fill subphrases corresponding to the intent scheme, where "," is a region delimiter corresponding to the intent scheme, and ";" is a subphrase delimiter between prediction system fill subphrases. Of course, the above is merely an exemplary description of the constructed predicted query template, and should not be understood as limiting the construction method of the predicted query template.
[0137] In S503, a predicted semantic category of a category waiting to be predicted is obtained according to the predicted query template.
[0138] The embodiment of the present disclosure introduces a predicted semantic category filler to construct sample category filler phrases, and constructs a predicted query template according to the predicted query phrase and the predicted category filler phrase, thereby improving the mechanism of constructing a predicted query template and providing data support for the subsequent determination of a predicted semantic category. At the same time, the above unified method of generating predicted query templates for different predicted query phrases facilitates batch processing of predicted query phrases, which is helpful in improving the efficiency of semantic classification.
[0139] As an implementation of the above classification model training methods, the present disclosure further provides a preferred embodiment of an execution device for implementing the above classification model training methods, which is suitable for the scene of semantic classification model training, and can be realized by using software and / or hardware and specifically deployed in an electronic device.
[0140] Further, refer to the classification model training apparatus 600 shown in FIG. 6, which includes a sample query template obtaining module 601, a sample semantic category determining module 602 and a semantic classification model training module 603, where: The sample query template acquisition module 601 acquires a sample query template and a label category of a predicted waiting category in the sample query template, where the sample query template is used to construct the sample query phrase and the number of predicted waiting categories; The sample semantic category determination module 602 is used to input the sample query template into the pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted; The semantic classification model training module 603 is used to train a semantic classification model according to the label categories of the sample semantic categories and the categories to be predicted.
[0141] The present disclosure trains a semantic classification model based on a unified sample query template, and performs sample classification from the semantic dimension rather than the inter-category difference dimension, so that the trained semantic classification model can adapt to diverse classification scenes, and there is no need to train different classification models for different classification scenes, thereby improving the versatility of the trained semantic classification model. At the same time, the template format is used to unify the matching of diverse sample query terms, which can effectively address the problem of imbalanced samples in diverse category prediction scenes, thereby contributing to improving the small sample classification ability of the trained semantic classification model.
[0142] In one preferred embodiment, the device 600 specifically comprises: a sample category filler phrase constructing unit for constructing a sample category filler phrase including a sample semantic category filler region, where the number of the sample semantic category filler regions is equal to the number of categories waiting to be predicted, and the sample semantic category filler regions are used to fill the sample semantic categories of the corresponding categories waiting to be predicted; and a sample query template building unit for building a sample query template according to the sample query phrases and the sample category filler phrases.
[0143] In one preferred embodiment, the number of systems to which the prediction waiting category belongs is at least one; A sample category-filling phrase-building unit is a sample system filler subphrase construction subunit for constructing sample system filler subphrases including sample semantic category filler regions for any system, where the number of sample semantic category filler regions is equal to the number of categories waiting to be predicted in the system; and a sample category filler phrase determining subunit for determining sample category filler phrases according to different sample system filler subphrases.
[0144] In one preferred embodiment, subphrase delimiters are provided between different sample system fill subphrases in a sample category fill phrase, and / or range delimiters are provided between different sample semantic category fill ranges in a sample system fill subphrase.
[0145] In a preferred embodiment, if range delimiters are set in sample system fill subphrases, the range delimiters in the same sample system fill subphrase are the same, and the range delimiters in different sample system fill subphrases are different.
[0146] In one preferred embodiment, the semantic classification model training module 603 comprises: a label anomaly category determining unit for determining a label anomaly type according to the sample semantic category and the label category; a label category adjustment unit for adjusting a label category according to a label correction method corresponding to a label anomaly type; and a semantic classification model training unit for training a semantic classification model according to the sample semantic categories and the adjusted label categories.
[0147] In one preferred embodiment, the label anomaly type determining unit comprises: a top-bottom type determining subunit for determining that the label anomaly type is a top-to-bottom predictive type if the sample semantic category is a subcategory of the label category; a noise type determining subunit for determining that the label anomaly type is a noise type if the sample semantic category is a cognate variant category of the label category; and a mixture type determining subunit for determining that the label anomaly type is a mixture type if the sample semantic category is a combination category of the decomposable categories of the label category.
[0148] In one preferred embodiment, the label category adjusting unit comprises: if the label anomaly type is a type of predicting from top to bottom, a top-bottom type adjustment subunit for replacing the label category with a sample semantic category; a noise type adjustment subunit for adjusting the label category according to the substitutable labels of the same origin variant category of the label category if the label anomaly type is a noise type; and a mixture type determining subunit for replacing the label category with the sample semantic category or a decomposable category of the label category if the label anomaly type is a mixture type.
[0149] In one preferred embodiment, the sample semantic category determination module 602 comprises: A sample semantic character determination unit for inputting the sample query template into a pre-constructed semantic classification model to obtain at least one sample semantic character of a category to be predicted; a sample semantic category determining unit for combining each sample semantic character according to the predicted order to obtain a sample semantic category of the category waiting to be predicted.
[0150] In one preferred embodiment, the sample meaning character determining unit specifically includes: The sample query template is input into a pre-constructed semantic classification model to extract sample semantic features in the sample query template, and feature transformation is performed on the sample semantic features to obtain at least one sample semantic character of the category to be predicted.
[0151] The classification model training apparatus is capable of executing the classification model training methods according to any embodiment of the present disclosure, and includes functional modules and beneficial effects corresponding to the execution of each classification model training method.
[0152] As an implementation of the above-mentioned semantic classification methods, the present disclosure further provides a preferred embodiment of an execution device for implementing the above-mentioned semantic classification methods. The device is applied to a scene of semantic classification, in particular, a semantic classification based on a semantic classification model obtained by the above-mentioned classification model training method. The device can be realized by using software and / or hardware and specifically arranged in an electronic device.
[0153] Further, referring to FIG. 7, a word semantic classification device 700 includes a predicted query module 701 and a predicted word semantic category determination module 702, where: The predicted query module acquisition module 701 is used to acquire a predicted query template, where the predicted query template is constructed based on the predicted query phrase and the number of predicted waiting categories; The predicted semantic category determination module 702 is used to obtain a predicted semantic category of a category to be predicted in response to the predicted query template.
[0154] In the embodiment of the present disclosure, a prediction query template is obtained based on a prediction query phrase and the number of categories to be predicted, and a predicted semantic category of the category to be predicted is obtained according to the prediction query template. In the present disclosure, category prediction is performed based on a unified prediction query template, and classification is performed based on a semantic dimension rather than a difference dimension between categories, so that the classification method can adapt to diversified classification scenes, and the versatility of semantic classification is improved.
[0155] In one preferred embodiment, the device 700 specifically comprises: A predicted category filler construction unit for constructing a predicted category filler phrase including a predicted semantic category filler region, where the number of the predicted semantic category filler regions is equal to the number of categories waiting to be predicted, and the predicted semantic category filler region is used to fill the predicted semantic category of the corresponding category waiting to be predicted; and a predicted query template construction unit for constructing a predicted query template according to the predicted query phrases and the predicted category filler phrases.
[0156] In one preferred embodiment, the number of systems to which the prediction waiting category belongs is at least one; The predictive category filling phrase building unit is a predictive scheme filler subphrase construction subunit for constructing predictive scheme filler subphrases including predicted semantic category filler regions for any scheme, where the number of predicted semantic category filler regions is equal to the number of categories waiting to be predicted in the scheme; and a predicted category filler phrase building subunit for determining predicted category filler phrases according to different prediction scheme filler subphrases.
[0157] In one preferred embodiment, subphrase delimiters are provided between different prediction scheme fill subphrases in a predicted category fill phrase, and / or range delimiters are provided between different predicted semantic category fill ranges in a prediction scheme fill subphrase.
[0158] In one preferred embodiment, if range delimiters are set in predictive scheme fill subphrases, the range delimiters in the same predictive scheme fill subphrase are the same, and the range delimiters in different predictive scheme fill subphrases are different.
[0159] In one preferred embodiment, the predictive semantic category determination module 702 comprises: a predicted meaning character determination unit for determining at least one predicted meaning character of a category to be predicted according to the predicted query template; and a predicted semantic category determination unit for combining each predicted semantic character according to a predicted order to obtain a predicted semantic category of the category waiting to be predicted.
[0160] In one preferred embodiment, among the at least one predicted meaning character, there are at least two predicted meaning characters in the same predicted order; The predictive semantic category determination unit is a candidate semantic category determination subunit for combining each predicted semantic character of the different predicted orders according to the predicted orders to obtain at least one candidate semantic category; a category prediction probability determining subunit for determining a category prediction probability of the candidate semantic category according to character prediction probabilities of different predicted semantic characters in the candidate semantic category; and a predicted semantic category selection subunit for selecting a predicted semantic category from each candidate semantic category according to the category prediction probability and a matching result between the candidate semantic category and each standard semantic category in the standard semantic category library.
[0161] In one preferred embodiment, the predictive meaning character determination unit comprises: a predictive semantic feature extraction subunit for extracting predictive semantic features in the predictive query template; and a predicted meaning character determining subunit for performing feature transformation on the predicted meaning features to obtain at least one predicted meaning character for the category to be predicted.
[0162] The above-mentioned word semantic classification device can execute the word semantic classification methods according to any embodiment of the present disclosure, and includes functional modules and beneficial effects corresponding to the execution of each word semantic classification method.
[0163] In the technical aspects of the present disclosure, the collection, storage, use, processing, transmission, provision, disclosure, and other processes of such sample query templates, label categories, and predicted query templates all conform to the provisions of relevant laws and regulations and are not contrary to public order and morals.
[0164] According to an embodiment of the present disclosure, the present disclosure further provides an electronic device, a readable storage medium, and a computer program.
[0165] 8 shows a schematic block diagram of an exemplary electronic device 800 that can be used to implement embodiments of the present disclosure. The electronic device is intended to represent various types of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can further represent various types of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components, their connections and relationships, and their functions shown herein are merely exemplary and are not intended to limit the practice of the present disclosure as described and / or claimed herein.
[0166] As shown in Fig. 8, the device 800 comprises a computing unit 801 capable of performing various suitable operations and processes according to a computer program stored in a Read Only Memory (ROM) 802 or loaded from a storage unit 808 into a Random Access Memory (RAM) 803. The RAM 803 may also store various programs and data required for the operation of the device 800. The computing unit 801, the ROM 802 and the RAM 803 are connected to each other by a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0167] The I / O interface 805 connects several components in the device 800, including an input unit 806, e.g. a keyboard, a mouse, etc., an output unit 807, e.g. various types of displays, speakers, etc., a storage unit 808, e.g. a magnetic disk, an optical disk, etc., and a communication unit 809, e.g. a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 enables the electronic device 800 to exchange information / data with other devices, e.g. via a computer network of the Internet and / or various telecommunication networks.
[0168] The computing unit 801 may be a general-purpose and / or special-purpose processing component having various processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that execute algorithms of machine learning models, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 executes each of the methods and processes described above, such as the classification model training method and / or the semantic classification method. For example, in some embodiments, the classification model training method and / or the semantic classification method can be realized as a computer software program, which is tangibly included in a machine-readable medium, such as the storage unit 808. In some embodiments, the computer program can be partially or completely loaded and / or installed in the device 800 via the ROM 802 and / or the communication unit 809. The computer program may be loaded into RAM 803 and executed by the computation unit 801 to perform one or more steps of the classification model training method and / or the word semantic classification method described above. Alternatively, in other embodiments, the computation unit 801 is configured to perform the classification model training method and / or the word semantic classification method in any other suitable manner (e.g., by firmware).
[0169] Various embodiments of the systems and techniques described herein may be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include being embodied in one or more computer programs that can be executed and / or interpreted by a programmable system including at least one programmable processor, which may be a special-purpose or general-purpose programmable processor that can receive data and instructions from a memory system, at least one input device, and at least one output device, and transmit data and instructions to the memory system, the at least one input device, and the at least one output device.
[0170] Program codes for implementing the methods of the present disclosure may be written employing any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, a special purpose computer or other programmable data processing apparatus, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are performed. The program codes may be executed entirely on the device, partially on the device, as a separate software package, partially on the device and partially on a remote device, or entirely on a remote device or server.
[0171] In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use in or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include an electrical connection by one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above.
[0172] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user, and a keyboard and pointing device (e.g., a mouse or trackball) by which the user can provide input to the computer. Other types of devices can be used to provide interaction with a user, for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or haptic feedback), and input from the user can be received in any form (including sound input, speech input, or tactile input).
[0173] The systems and techniques described herein may be implemented in a computing system that includes background components (e.g., as a data server), or in a computing system that includes middleware components (such as an application server), or in a computing system that includes a front-end component (a user computer having a graphical user interface or a network browser through which a user can interact with embodiments of the systems and techniques described herein), or in a computing system that includes any combination of such background components, middleware components, or front-end components. The components of the system may be connected together by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include a local area network (LAN), a wide area network (WAN), and the Internet.
[0174] The computer system may include a client terminal and a server. The client terminal and the server are generally separate from each other and usually interact with each other via a communication network. The relationship between the client terminal and the server is established by a computer program running on a corresponding computer and having a client terminal-server relationship with each other. The server may be a cloud server, also called a cloud computing server or cloud host, which is a hosting product in a cloud computing service system to solve the defects of the large management difficulty and weak business deployment that exist in traditional physical host and VPS services. The server may be a server of a distributed system or a server combined with a blockchain.
[0175] Artificial intelligence is a discipline that studies how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware and software level technologies. Artificial intelligence hardware technology generally includes sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, etc., while artificial intelligence software technology mainly includes several directions, such as computer vision technology, voice recognition technology, natural language processing technology, machine learning / deep learning, big data processing technology, and knowledge graph technology.
[0176] It should be understood that the various types of flows shown above can be used, and steps can be rearranged, added, or removed. For example, the steps described in the present disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present disclosure can be achieved, and are not limited thereto in this specification.
[0177] The above specific embodiments do not limit the scope of protection of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions are possible based on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims
1. A method for training a semantic classification model for use in a classification model training device, comprising: Obtaining a sample query template and a label category of a predicted waiting category in the sample query template, and constructing the sample query template based on a sample query term and a number of the predicted waiting categories; inputting the sample query template into a pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted; training the semantic classification model according to the label categories of the sample semantic categories and the categories to be predicted; The sample query template is: constructing sample category filling phrases including sample semantic category filling regions, the number of the sample semantic category filling regions being equal to the number of the categories waiting to be predicted, and the sample semantic category filling regions being used to fill in the sample semantic categories of the corresponding categories waiting to be predicted; constructing the sample query template according to the sample query phrases and the sample category filler phrases; The number of systems to which the predicted waiting category belongs is at least one; Constructing sample category fill phrases including sample semantic category fill regions, as described above, includes: constructing sample system-filled subphrases for each system that include sample semantic category fill regions in the system, the number of sample semantic category fill regions in the system being equal to the number of categories waiting to be predicted in the system; determining the sample category fill phrases as a function of sample system fill sub-phrases in all systems; A method for training a semantic classification model.
2. For the sample category fill phrases, subphrase delimiters are established between sample system fill subphrases in different systems, and / or for each system, range delimiters are established between at least one sample semantic category fill range in the sample system fill subphrases. The method for training a semantic classification model according to claim 1 .
3. If a range delimiter is set between at least one sample semantic category fill range in a sample system fill subphrase, the range delimiters in the same system are the same, and the range delimiters in different systems are different. The method for training a semantic classification model according to claim 2 .
4. The training of the semantic classification model according to the label categories of the sample semantic categories and the category to be predicted includes: determining a label anomaly type in response to the sample semantic category and the label category; adjusting the label category according to a label correction scheme corresponding to the label anomaly type; training the semantic classification model according to the sample semantic categories and the adjusted label categories; The method for training a semantic classification model according to claim 1 .
5. Determining a label anomaly type according to the sample semantic category and the label category includes: if the sample semantic category is a subcategory of the label category, determining that the label anomaly type is a top-to-bottom prediction type; determining that the label anomaly type is a noise type if the sample semantic category is a cognate variant of the label category; If the sample semantic category is a combination category of the decomposable categories of the label category, determining that the label anomaly type is a mixed type. The method for training a semantic classification model according to claim 4.
6. The label category is adjusted according to a label correction method corresponding to the label anomaly type. If the label anomaly type is a top-to-bottom prediction type, replacing the label category with the sample semantic category; If the label anomaly type is a noise type, adjusting the label category according to a substitutable label of a homogeneous variant category of the label category; If the label anomaly type is a mixed type, replacing the label category with the sample semantic category or a decomposable category of the label category. The method for training a semantic classification model according to claim 5.
7. The above-mentioned inputting the sample query template into a pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted includes: inputting the sample query template into a pre-constructed semantic classification model to obtain at least one sample semantic character of the category to be predicted; and combining each of the sample semantic characters according to a prediction order to obtain a sample semantic category of the category to be predicted. The method for training a semantic classification model according to any one of claims 1 to 6.
8. The step of inputting the sample query template into a pre-constructed semantic classification model to obtain at least one sample semantic character of the category to be predicted includes the steps of: inputting the sample query template into a pre-constructed semantic classification model to extract sample semantic features in the sample query template, and performing feature transformation on the sample semantic features to obtain at least one sample semantic character of the category to be predicted; The method for training a semantic classification model according to claim 7.
9. A word semantic classification method for use in a word semantic classification device, comprising: obtaining a predicted query template, the predicted query template being constructed based on a predicted query term and a number of categories waiting to be predicted; obtaining a predicted semantic category of the category to be predicted in response to the predicted query template; The predicted query template may include: constructing a predicted category filling phrase including a predicted semantic category filling area, the number of the predicted semantic category filling areas is equal to the number of the prediction waiting categories, and the predicted semantic category filling area is used to fill the predicted semantic category of the corresponding prediction waiting category; constructing the predicted query template in response to the predicted query phrases and the predicted category filler phrases; The number of systems to which the predicted waiting category belongs is at least one; The step of constructing predicted category fill phrases including the predicted semantic category fill regions includes: constructing, for each system, a predicted system-filled subphrase including a predicted semantic category fill region in the system, the number of predicted semantic category fill regions in the system being equal to the number of categories waiting to be predicted in the system; determining the predicted category fill phrases as a function of predicted system fill sub-phrases in all systems; Obtaining a predicted semantic category of the category to be predicted in response to the predicted query template includes: The method includes: using the predicted query template as input data for a trained semantic classification model; and determining a predicted semantic category of the category waiting to be predicted according to an output result of the semantic classification model, the semantic classification model being obtained by training using the semantic classification model training method according to claim 1. Semantic classification method.
10. For predicted category fill phrases, subphrase delimiters are established between predicted scheme fill subphrases in different schemes, and / or for each scheme, range delimiters are established between at least one predicted semantic category fill range in the predicted scheme fill subphrases. The method of claim 9 .
11. If a range delimiter is set between at least one predicted semantic category fill range in the predicted scheme fill subphrase, the range delimiters in the same scheme are the same and the range delimiters in different schemes are different. The method of claim 10.
12. The step of obtaining a predicted semantic category of the category to be predicted in response to the predicted query template includes: determining at least one predicted semantic character for the category to be predicted in response to the predicted query template; and combining the predicted meaning characters according to a prediction order to obtain a predicted meaning category of the category waiting to be predicted. The method of claim 9 .
13. Among the at least one predicted meaning character, there are at least two predicted meaning characters in the same predicted order; The above-mentioned step of combining each of the predicted meaning characters according to a prediction order to obtain a predicted meaning category of the category waiting to be predicted includes: combining the predicted semantic characters of the different predicted orders according to a predicted order to obtain at least one candidate semantic category; determining a category prediction probability of the candidate semantic category according to character prediction probabilities of different predicted semantic characters in the candidate semantic category; selecting the predicted semantic category from each candidate semantic category according to the category prediction probability and a matching result between the candidate semantic category and each standard semantic category in a standard semantic category library; The method of claim 12.
14. Determining at least one predicted semantic character for the category to be predicted in response to the predicted query template includes: extracting predictive semantic features in the predicted query template; and performing feature transformation on the predicted semantic features to obtain at least one predicted semantic character of the category to be predicted. The method of claim 12.
15. A sample query template acquisition module for acquiring a sample query template and a label category of a predicted waiting category in the sample query template, the sample query template being constructed according to a sample query term and a number of the predicted waiting categories; a sample semantic category determination module for inputting the sample query template into a pre-constructed semantic classification model to obtain a sample semantic category of the category to be predicted; a semantic classification model training module for training the semantic classification model according to the sample semantic categories and the label categories of the categories to be predicted; specifically, a sample category filler phrase construction unit for constructing sample category filler phrases including sample semantic category filler regions, the number of the sample semantic category filler regions being equal to the number of the categories waiting to be predicted, and the sample semantic category filler regions being used to fill the sample semantic categories of the corresponding categories waiting to be predicted; and a sample query template construction unit for constructing the sample query template according to the sample query phrases and the sample category filler phrases; The number of systems to which the predicted waiting category belongs is at least one; The sample category filler phrase building unit comprises: a sample system filling subphrase construction subunit for constructing sample system filling subphrases including sample semantic category filling regions in each system, so that the number of sample semantic category filling regions in each system is equal to the number of categories to be predicted in each system; a sample category fill phrase determination subunit for determining the sample category fill phrases according to sample system fill sub-phrases in all systems; A device for training semantic classification models.
16. For the sample category fill phrases, subphrase delimiters are established between sample system fill subphrases in different systems, and / or for each system, range delimiters are established between at least one sample semantic category fill range in the sample system fill subphrases. The apparatus for training a semantic categorization model according to claim 15.
17. If a range delimiter is set between at least one sample semantic category fill range in a sample system fill subphrase, the range delimiters in the same system are the same, and the range delimiters in different systems are different. The apparatus for training a semantic categorization model according to claim 16.
18. The semantic classification model training module includes: a label anomaly category determining unit for determining a label anomaly type according to the sample semantic category and the label category; a label category adjusting unit for adjusting the label category according to a label correction manner corresponding to the label anomaly type; a semantic classification model training unit for training the semantic classification model according to the sample semantic categories and the adjusted label categories. The apparatus for training a semantic categorization model according to claim 15.
19. The label anomaly category determining unit includes: a top-bottom type determining subunit for determining that the label anomaly type is a top-to-bottom predictive type if the sample semantic category is a subcategory of the label category; a noise type determining subunit for determining that the label anomaly type is a noise type if the sample semantic category is a cognate variant category of the label category; and a mixture type determining subunit for determining that the label anomaly type is a mixture type if the sample semantic category is a combination category of the decomposable categories of the label category.
20. The apparatus for training a semantic categorization model according to claim 18.
20. The label category adjusting unit includes: if the label anomaly type is a high-to-low prediction type, a high-to-low type adjustment subunit is used to replace the label category with the sample semantic category; a noise type adjustment subunit for adjusting the label category according to a substitutable label of a homogeneous variant category of the label category if the label anomaly type is a noise type; and a mixture type determination subunit for replacing the label category with the sample semantic category or a decomposable category of the label category if the label anomaly type is a mixture type.
20. The apparatus for training a semantic categorization model according to claim 19.
21. The sample semantic category determination module includes: a sample semantic character determination unit for inputting the sample query template into a pre-constructed semantic classification model to obtain at least one sample semantic character of the category to be predicted; a sample semantic category determining unit for combining each of the sample semantic characters according to a predicted order to obtain a sample semantic category of the category to be predicted; The device for training a semantic classification model according to any one of claims 15 to 20.
22. The sample meaning character determination unit specifically includes: The sample query template is input into a pre-constructed semantic classification model to extract sample semantic features in the sample query template, and feature transformation is performed on the sample semantic features to obtain at least one sample semantic character of the category to be predicted.
22. The apparatus for training a semantic classification model according to claim 21.
23. a predicted query template acquisition module for acquiring a predicted query template, the predicted query template being constructed based on a predicted query term and a number of categories to be predicted; a predicted semantic category determination module for obtaining a predicted semantic category of the category to be predicted in response to the predicted query template; specifically, a predicted category filling phrase construction unit for constructing a predicted category filling phrase including a predicted semantic category filling area, the number of the predicted semantic category filling areas being equal to the number of the categories waiting to be predicted, and the predicted semantic category filling areas being used to fill the predicted semantic categories of the corresponding categories waiting to be predicted; and a predicted query template construction unit for constructing the predicted query template according to the predicted query phrases and the predicted category filler phrases; The number of systems to which the predicted waiting category belongs is at least one; The predictive category fill phrase building unit includes: a predictive scheme filler subphrase construction subunit for constructing predictive scheme filler subphrases for each scheme, the predictive scheme filler subphrases including predicted semantic category filler regions in the scheme, such that the number of predicted semantic category filler regions in the scheme is equal to the number of categories to be predicted in the scheme; a predicted category fill phrase construction subunit for determining the predicted category fill phrases according to predicted system fill sub-phrases in all systems; Obtaining a predicted semantic category of the category to be predicted in response to the predicted query template includes: The method includes: using the predicted query template as input data for a trained semantic classification model; and determining a predicted semantic category of the category waiting to be predicted according to an output result of the semantic classification model, the semantic classification model being obtained by training using the semantic classification model training method according to claim 1. Word meaning classification device.
24. For predicted category fill phrases, subphrase delimiters are established between predicted scheme fill subphrases in different schemes, and / or for each scheme, range delimiters are established between at least one predicted semantic category fill range in the predicted scheme fill subphrases.
24. The apparatus of claim 23.
25. If a range delimiter is set between at least one predicted semantic category fill range in the predicted scheme fill subphrase, the range delimiters in the same scheme are the same and the range delimiters in different schemes are different.
25. The apparatus of claim 24.
26. The predictive semantic category determination module includes: a predicted meaning character determination unit for determining at least one predicted meaning character of the category to be predicted in response to the predicted query template; a predicted semantic category determination unit for combining each of the predicted semantic characters according to a predicted order to obtain a predicted semantic category of the category waiting to be predicted; The word meaning classification device according to any one of claims 23 to 25.
27. Among the at least one predicted meaning character, there are at least two predicted meaning characters in the same predicted order; The predictive semantic category determination unit includes: a candidate semantic category determination subunit for combining the predicted semantic characters of different predicted orders according to the predicted orders to obtain at least one candidate semantic category; a category prediction probability determining subunit for determining a category prediction probability of the candidate semantic category according to character prediction probabilities of different predicted semantic characters in the candidate semantic category; a predicted semantic category selection subunit for selecting the predicted semantic category from each candidate semantic category according to the category prediction probability and a matching result between the candidate semantic category and each standard semantic category in a standard semantic category library; 27. The apparatus of claim 26.
28. The predictive meaning character determination unit includes: a predictive semantic feature extraction subunit for extracting predictive semantic features in the predictive query template; and a predicted meaning character determining subunit for performing feature transformation on the predicted meaning features to obtain at least one predicted meaning character of the category to be predicted.
27. The apparatus of claim 26.
29. At least one processor; a memory communicatively coupled to the at least one processor; The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor such that the at least one processor can execute the word semantic classification model training method according to any one of claims 1 to 6 and / or the word semantic classification method according to any one of claims 9 to 14. electronic equipment.
30. A non-transitory computer-readable storage medium having computer instructions stored thereon, comprising: The computer instructions are used to cause a computer to execute the method for training a word semantic classification model according to any one of claims 1 to 6 and / or the method for word semantic classification according to any one of claims 9 to 14. A non-transitory computer-readable storage medium.
31. When executed by a processor, the method for training a word semantic classification model according to any one of claims 1 to 6 and / or the method for word semantic classification according to any one of claims 9 to 14 are realized. Computer program.
Citation Information
Patent Citations
Analytical device, analysis method and program
JP2021043491A
Document display support system and document display support method, and program executing the method
JP2021114057A
Method for establishing label labeling model, device, electronic equipment, program, and readable storage medium
JP2021149916A
