Information processing device, information processing method, and program

Abstract

In order to extend a taxonomy more accurately, an information processing device (1) comprises: an acquisition unit (11) that acquires a taxonomy representing relationships between a plurality of phrases; a generation unit (12) that generates a new phrase which is different from any of the plurality of phrases by referring to a first sentence set; and an extension unit (13) that extends the taxonomy by associating any of the plurality of phrases with the new phrase. One or both of the generation unit (12) and the extension unit (13) use(s) a language model.

Description

[Technical field]

[0001] The present invention relates to a technology for extending a taxonomy. [Background technology]

[0002] There is a known technology for extending taxonomies. A taxonomy is information that represents relationships between multiple phrases, and is expressed as a hierarchical directed graph.

[0003] For example, non-patent document 1 describes a technology for expanding a taxonomy horizontally or vertically by identifying phrases that are similar to or have a parent-child relationship with the phrase to be added from among existing phrases contained in the target taxonomy.

[0004] For example, non-patent document 2 describes a technology for expanding a taxonomy by using a discriminant model that determines the parent-child relationships between existing phrases included in the target taxonomy, and identifying existing phrases that have a parent-child relationship with the phrase to be added.

[0005] Furthermore, for example, Non-Patent Document 3 describes a technology for extending a product-related taxonomy by using product descriptions, and a user's search query and behavior log. [Prior art documents] [Non-patent literature]

[0006] [Non-Patent Document 1] Jiaming Shen et al., "HiExpan: Task-Guided Taxonomy Construction by Hierarchical Tree Expansion", KDD 2018. [Non-Patent Document 2] Jiaming Shen et al., "TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural Network", WWW 2020. [Non-Patent Document 3] Yuning Mao et al., "Octet: Online Catalog Taxonomy Enrichment with Self-Supervision", KDD 2020. Summary of the Invention [Problem to be solved by the invention]

[0007] The techniques described in Non-Patent Documents 1 to 3 have room for improvement in terms of accurately expanding a taxonomy. For example, the techniques described in Non-Patent Documents 1 and 2 have difficulty in accurately expanding a taxonomy when the number of phrases included in the taxonomy before expansion is small, or when the set of sentences referenced to extract phrases to be added is small. In addition, the technique described in Non-Patent Document 3 has difficulty in accurately expanding a taxonomy when the user's search query and behavior log cannot be obtained.

[0008] One aspect of the present invention has been made in consideration of the above problems, and one example of a purpose of the present invention is to provide a technique for expanding a taxonomy with greater precision. [Means for solving the problem]

[0009] An information processing device according to one aspect of the present invention includes an acquisition means for acquiring a taxonomy that represents relationships between a plurality of phrases, a generation means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences, and an expansion means for expanding the taxonomy by associating any of the plurality of phrases with the new phrase, and a language model is used in one or both of the generation means and the expansion means.

[0010] An information processing method according to one aspect of the present invention includes obtaining a taxonomy that represents relationships between a plurality of phrases, generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences, and extending the taxonomy by associating any of the plurality of phrases with the new phrase, and using a language model in one or both of generating the new phrase and extending the taxonomy.

[0011] A program according to one aspect of the present invention is a program for causing a computer to function as an information processing device, causing the computer to function as an acquisition means for acquiring a taxonomy representing relationships between multiple phrases, a generation means for generating a new phrase different from any of the multiple phrases by referring to a first set of sentences, and an expansion means for expanding the taxonomy by associating any of the multiple phrases with the new phrase, and a language model is used in one or both of the generation means and the expansion means. Effect of the Invention

[0012] According to one aspect of the present invention, taxonomies can be expanded with greater precision. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a functional configuration of an information processing device according to a first exemplary embodiment of the present invention. [Diagram 2] 1 is a flow chart showing the flow of an information processing method according to an exemplary embodiment 1 of the present invention. [Diagram 3] FIG. 11 is a block diagram showing a functional configuration of an information processing device according to a second exemplary embodiment of the present invention. [Figure 4] FIG. 13 is a diagram illustrating an example of a taxonomy T1 according to an exemplary embodiment 2 of the present invention. [Diagram 5] 11 is a flow chart showing the flow of an information processing method according to an exemplary embodiment 2 of the present invention. [Figure 6]FIG. 11 is a flowchart showing a detailed flow of a language model construction process in the second exemplary embodiment of the present invention. [Figure 7] FIG. 11 is a flow chart showing a detailed flow of an example of a generation process in the exemplary embodiment 2 of the present invention. [Figure 8] FIG. 11 is a flowchart showing a detailed flow of another example of the generation process in the exemplary embodiment 2 of the present invention. [Figure 9] FIG. 11 is a flow chart showing a detailed flow of an example of an extension process in exemplary embodiment 2 of the present invention. [Figure 10] FIG. 11 is a flowchart showing a detailed flow of another example of the extension process in the exemplary embodiment 2 of the present invention. [Figure 11] FIG. 11 is a block diagram showing a functional configuration of an information processing device 3 according to an exemplary embodiment 3 of the present invention. [Figure 12] FIG. 11 is a flow chart showing the flow of an information processing method according to an exemplary embodiment 3 of the present invention. [Figure 13] 1 is a block diagram showing an example of a hardware configuration of an information processing device according to each exemplary embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Example 1 A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described later.

[0015] <Configuration of information processing device 1> The configuration of an information processing device 1 according to this exemplary embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the functional configuration of the information processing device 1.

[0016] As shown in Fig. 1, the information processing device 1 includes an acquisition unit 11, a generation unit 12, and an extension unit 13. The acquisition unit 11 is an example of a configuration for realizing an acquisition means recited in the claims. The generation unit 12 is an example of a configuration for realizing a generation means recited in the claims. The extension unit 13 is an example of a configuration for realizing an extension means recited in the claims.

[0017] The acquisition unit 11 acquires a taxonomy that represents relationships between a plurality of phrases. The generation unit 12 refers to the first sentence set and generates a new phrase different from any of the plurality of phrases. The expansion unit 13 expands the taxonomy by associating any of the plurality of phrases with the new phrase. One or both of the generation unit 12 and the expansion unit 13 use a language model.

[0018] (phrase) A phrase is represented by one or more words and represents a concept. For example, the phrase "pasta" represents the concept of a dough made mainly from wheat flour, which is one of the staple foods in Italian cuisine. The phrase "Italian cuisine" represents the concept of a cooking method that originated in Italy. In the following, the "concept represented by a phrase" will be simply referred to as a "phrase." Therefore, "there is a relationship between the concepts represented by two phrases" will be described as "there is a relationship between two phrases." For example, the phrase "pasta" is included in the phrase "Italian cuisine." Therefore, there is a parent-child relationship between these phrases.

[0019] (Taxonomy) A taxonomy is information that represents the relationship between multiple phrases. For example, a taxonomy is represented by a hierarchical directed graph. Specifically, a taxonomy includes information that represents a node that represents each phrase and an edge that connects two nodes that have a parent-child relationship.

[0020] (New phrase) The new phrase is a phrase that is different from any of the phrases included in the taxonomy and is a phrase to be added to the taxonomy. In other words, the new phrase is a phrase that is not included in the taxonomy before the expansion.

[0021] (Existing phrase) Hereafter, each phrase included in the pre-expansion taxonomy will be referred to as an "existing phrase" to distinguish it from new phrases not included in the pre-expansion taxonomy.

[0022] (1st sentence set) The first sentence set is a set of sentences. The first sentence set is referenced when generating phrases to be added to the taxonomy. The first sentence set is preferably a set of sentences related to existing phrases.

[0023] (Language Model) A language model is a model that outputs the probability of an input word string. For example, the probability of outputting the word string "his age is 100" when inputted into a certain language model is greater than the probability of outputting the word string "his birthday is 100" when inputted into the language model. This is because the language model holds the probability that the relationship between "he" and "100" is "age" and the probability that it is "birthday", and the probability that it is "age" is higher than the probability that it is "birthday". In addition, using the language model, it is possible to predict words that fit the masked parts of a word string in which some words are masked. As an example of a language model, for example, a language model generated by Reference 1 or Reference 2 below can be applied.

[0024] [References 1] Jacob Devlin et al., "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", NAACL 2019. [Reference 2] Yinhan Liu et al., "RoBERTa: A Robustly Optimized BERT Pretraining Approach", arXiv 2019. <Flow of information processing method S1> The flow of the information processing method S1 executed by the information processing device 1 configured as above will be described with reference to Fig. 2. Fig. 2 is a flow diagram showing the flow of the information processing method S1. As shown in Fig. 2, the information processing method S1 includes steps S11 to S13.

[0025] (Step S11) In step S11, the acquisition unit 11 acquires a taxonomy to be expanded. For example, the acquisition unit 11 may acquire a taxonomy stored in a memory (not shown) of the information processing device 1, or may acquire a taxonomy from another device connected via a network.

[0026] (Step S12) In step S12, the generation unit 12 refers to the first sentence set and generates a new phrase different from any of the multiple phrases. For example, the generation unit 12 may refer to the first sentence set stored in a memory (not shown) of the information processing device 1, or may refer to the first sentence set stored in another device connected via a network. In this step, the generation unit 12 may or may not use a language model to generate a new phrase by referring to the first sentence set. However, at least one of step S12 and step S13 described later uses a language model.

[0027] (When using a language model) For example, the generation unit 12 may use a language model stored in a memory (not shown) of the information processing device 1, or may use a language model stored in another device connected via a network. Specifically, for example, the generation unit 12 may generate a new phrase that matches a portion of an existing phrase in the first sentence set by predicting the new phrase using the language model. Note that the method of generating a new phrase by referring to the first sentence set using the language model is not limited to this.

[0028] (If you do not use a language model) For example, the generation unit 12 may extract new phrases related to existing phrases from the first sentence set by referring to a general knowledge base. Note that the method of generating new phrases by referring to the first sentence set without using a language model is not limited to this.

[0029] (Step S13) In step S13, the extension unit 13 extends the taxonomy by associating any one of a plurality of existing phrases with the new phrase. In this step, the extension unit 13 may or may not use a language model to associate any one of a plurality of existing phrases with the new phrase. However, as described above, at least one of the above-mentioned step S12 and step S13 uses a language model. Note that, when a language model is used in both step S12 and step S13, the language models used by each unit may be the same or different.

[0030] (When using a language model) For example, the extension unit 13 may use a language model stored in a memory (not shown) of the information processing device 1, or may use a language model stored in another device connected via a network. Specifically, for example, the generation unit 12 may calculate the accuracy of a sentence that assumes a relationship between any of a plurality of existing phrases and a new phrase using a language model, and perform association based on the calculated accuracy. Note that the method of associating any of a plurality of existing phrases with a new phrase by using a language model is not limited to this.

[0031] (If you do not use a language model) For example, the extension unit 13 calculates the similarity between the existing phrase and the new phrase, and associates them based on the calculated similarity. For example, the similarity may be a score indicating the degree of association between the existing phrase and the new phrase. Also, the similarity may be a probability value that the existing phrase and the new phrase are associated with each other. However, the similarity is not limited to these examples. Note that the method of associating any one of a plurality of existing phrases with the new phrase without using a language model is not limited to this.

[0032] <Advantages of this exemplary embodiment> As described above, the information processing device 1 according to the present exemplary embodiment uses a language model in one or both of (i) a generation process for generating a new phrase by referring to the first sentence set, and (ii) an extension process for associating the new phrase with any of a plurality of existing phrases included in the taxonomy. As a result, when a language model is used in the generation process, information included in the language model can be used in addition to information included in the first sentence set, so that a new phrase to be added to the taxonomy can be generated with higher accuracy. Also, when a language model is used in the extension process, the relationship between the phrases represented by the language model can be used to correct the relationship between the new phrase and the existing phrase, so that the new phrase and the existing phrase can be associated with higher accuracy. Therefore, the present exemplary embodiment can extend the taxonomy with higher accuracy.

[0033] Exemplary embodiment 2 A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first exemplary embodiment are given the same reference numerals, and the description thereof will be omitted as appropriate.

[0034] <Configuration of information processing device 2> The configuration of the information processing device 2 according to this exemplary embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the functional configuration of the information processing device 2.

[0035] As shown in FIG. 3, the information processing device 2 includes an acquisition unit 21, a generation unit 22, an expansion unit 23, a construction unit 24, and an adjustment unit 25. The acquisition unit 21 is an example of a configuration for realizing the acquisition means recited in the claims. The generation unit 22 is an example of a configuration for realizing the generation means recited in the claims. The expansion unit 23 is an example of a configuration for realizing the expansion means recited in the claims. The construction unit 24 is an example of a configuration for realizing the construction means recited in the claims. The adjustment unit 25 is an example of a configuration for realizing the adjustment means recited in the claims.

[0036] The acquisition unit 21 acquires a taxonomy T1 related to a target domain, a sentence set D1 related to the target domain, and a general sentence set D2. The construction unit 24 constructs a language model M1 based on the sentence set D2. The adjustment unit 25 adjusts the language model M1 based on the sentence set D1. The generation unit 22 generates a new phrase by referring to the sentence set D1, with or without using the language model M1. The extension unit 23 extends the taxonomy T1 by associating a new phrase with any of a plurality of existing phrases, with or without using the language model M1. At least one of the generation unit 22 and the extension unit 23 uses the language model M1.

[0037] (Taxonomy T1 for the target domain) In this embodiment, the taxonomy T1 related to the target domain is the extension target. The taxonomy T1 related to the target domain represents the relationship between multiple phrases in the target domain. As an example, when the target domain is "cooking", the taxonomy T1 represents the relationship between multiple phrases in the target domain "cooking".

[0038] FIG. 4 is a diagram showing a schematic example of a taxonomy T1 related to a target domain "cuisine". The taxonomy T1 is represented by a directed graph including nodes N1 to N7 and edges E1 to E6. The nodes N1 to N7 correspond to a plurality of phrases in the target domain "cuisine", respectively. For example, the node N2 corresponds to the phrase "Italian cuisine", the node N4 corresponds to the phrase "dessert", the node N5 corresponds to the phrase "pizza", and the node N7 corresponds to the phrase "tea". The edges E1 to E6 represent a parent-child relationship between two phrases connected to both ends. In FIG. 4, the edges E1 to E6 are represented by arrows, and the node connected to the root is the parent, and the node connected to the arrowhead is the child. For example, the edge E4 represents that the phrase "Italian cuisine" corresponding to the node N2 connected to the root is the parent, and the phrase "pizza" corresponding to the node N5 connected to the arrowhead is the child. In other words, there is a parent-child relationship between the phrase "Italian cuisine" and the phrase "pizza", and the phrase "Italian cuisine" is the parent of the phrase "pizza".

[0039] (Sentence set D1 related to the target domain) The sentence set D1 is an example of a "first sentence set" as described in the claims, and is a set of sentences related to the target domain. For example, the sentence set D1 constitutes part or all of the information related to the target domain. For example, the sentence set D1 may be a set of sentences that constitute part or all of an online recipe site, which is information related to the domain "cooking."

[0040] (General sentence set D2) The sentence set D2 is an example of the "second sentence set" described in the claims, and is a general sentence set. Here, "general" means that it is not limited to the target domain. In other words, "general" means that it relates to a plurality of domains. It can be said that the more domains the sentence set D2 includes, the higher the degree of generality. It is possible that the sentence set D2 includes a sentence related to the target domain as one of the general sentences. For example, the sentence set D2 is a set of sentences that constitute a part or all of general information. For example, the sentence set D2 may be a set of sentences that constitute a part or all of the Wikipedia site, which is general information.

[0041] (Language model M1) The language model M1 is a model that outputs the accuracy for an input word string, and details thereof are as described in the embodiment 1. In this embodiment, the language model M1 is constructed by the construction unit 24.

[0042] <Flow of information processing method S2> (Overview of information processing method S2) The flow of the information processing method S2 executed by the information processing device 2 configured as above will be described with reference to Fig. 5. Fig. 5 is a flow diagram showing the flow of the information processing method S2. As shown in Fig. 5, the information processing method S2 includes steps S21 to S24.

[0043] (Step S21) In step S21, the acquisition unit 21 acquires the taxonomy T1, the sentence set D1, and the sentence set D2. For example, the acquisition unit 21 may acquire the taxonomy T1, the sentence set D1, or the sentence set D2 stored in a memory (not shown) of the information processing device 2, or may acquire the taxonomy T1, the sentence set D1, or the sentence set D2 from another device connected via a network.

[0044] (Step S22) In step S22, the construction unit 24 and the adjustment unit 25 execute a construction process for constructing the language model M1. The construction process will be described in detail later.

[0045] (Step S23) In step S23, the generation unit 22 executes one of the generation processes S23A and S23B using the language model M1 to generate a new phrase by referring to the sentence set D1. The generation process S23A is a process for generating a new phrase by extracting it from the sentence set D1 using the language model M1. That is, the new phrase generated by the generation process S23A is a phrase included in the sentence set D1. The generation process S23B is a process for generating a new phrase by predicting it from the sentence set D1 using the language model M1. That is, the new phrase generated by the generation process S23B may not be included in the sentence set D1. Note that the generation unit 22 may execute one of the generation processes that do not use the language model M1 instead of executing one of the generation processes S23A and S23B. Details of these generation processes will be described later.

[0046] (Step S24) In step S24, the extension unit 23 executes one of the extension processes S24A and S24B using the language model M1 to extend the taxonomy T1. Alternatively, the extension unit 23 may execute an extension process that does not use the language model M1 instead of executing one of the extension processes S24A and S24B. Details of these extension processes will be described later.

[0047] At least one of steps S23 and S24 uses the language model M1. For example, when a generation process that does not use the language model M1 is executed in step S23, one of the extension processes S24A and S24B that use the language model M1 is executed in that step, and the extension process that does not use the language model M1 is not executed.

[0048] (Details of the construction process of the language model M1) A detailed flow of the construction process of the language model M1 in step S22 will be described with reference to Fig. 6. Fig. 6 is a flow diagram showing a detailed flow of the construction process of the language model M1. As shown in Fig. 6, the process of step S22 includes steps S221 and S222.

[0049] (Step S221) In step S221, the construction unit 24 constructs a language model M1 using the sentence set D2. As a technique for constructing the language model M1, the technique described in the above-mentioned reference 1 or reference 2 can be applied. The language model M1 generated using the general sentence set D2 is a model for general phrases.

[0050] (Step S222) In step S222, the adjustment unit 25 adjusts the language model M1 using the sentence set D1. One technique for adjusting the sentence set is fine-tuning, which transfers an existing language model to a language model of a specific domain. For fine-tuning, the technique described in Reference 3 below can be applied. In this case, the adjustment unit 25 can transfer the language model M1 related to general phrases to the target domain using the sentence set D1. However, the technique by which the adjustment unit 25 adjusts the language model M1 is not limited to that described in Reference 3.

[0051] [Reference 3] Suchin Gururangan et al., "Don't Stop Pretraining: Adapt Language Models to Domains and Tasks", ACL 2020. (Details of the generation process S23A using the language model M1) A detailed flow of the generation process S23A using the language model M1 that may be executed in step S23 will be described with reference to Fig. 7. The generation process S23A is a process of extracting new phrases from the sentence set D1 using an extraction model M10 including the language model M1. The new phrases extracted are phrases included in the sentence set D1. Fig. 7 is a flow diagram showing a detailed flow of the generation process S23A. As shown in Fig. 7, the generation process S23A includes steps S231A and S232A.

[0052] (Step S231A) In step S231A, the generation unit 22 generates an extraction model M10 using the language model M1. The extraction model M10 includes the language model M1 and a classifier M2 to which an output from the language model M1 is input. The extraction model M10 is machine-trained so that when a sentence included in the sentence set D1 is input to the language model M1, the classifier M2 classifies a new phrase in the sentence. This machine learning is performed using training data in which a plurality of existing phrases appearing in the first sentence set are regarded as correct answers. For example, a sequence labeler can be applied as the classifier M2. The extraction model M10 outputs the phrases identified by the classifier M2.

[0053] In the machine learning of the extraction model M10, the sentence set D1 is used as training data in which existing phrases appearing in the sentence set D1 are labeled as correct answers. In the sentence set D1 as training data, no labels are assigned to phrases other than the existing phrases. In other words, the sentence set D1 is used as training data to which the correct answer label is partially assigned.

[0054] The processing of this step will be described using a specific example shown in FIG. 7. In this specific example, the taxonomy T1 of the target domain "cooking" shown in FIG. 4 is expanded. The sentence set D1 related to the target domain "cooking" includes a sentence 1 of "Reviewing the recipe for classic Italian pasta from the basics". The generation unit 22 generates training data by assigning a label of "correct" to the existing phrase "Italian cuisine" that appears in the sentence 1. The generation unit 22 does not assign a label to other phrases that appear in the sentence 1, such as "classic", "pasta", "recipe", "basic", and "review", but does not assign a label to them. By machine learning using the training data to which such partial labels are assigned, the extraction model M10 is trained to output the existing phrase "Italian cuisine" and the new phrase "pasta" as phrases related to the target domain "cooking" when the sentence 1 is input.

[0055] As a technique for generating the extraction model M10 in this way, for example, the technique BERT-CRF described in Reference 4 below can be used. BERT-CRF is a technique for extracting named entities from a sentence collection using a language model. The generation unit 22 can generate the extraction model M10 by changing the process of extracting named entities in BERT-CRF to a process of extracting phrases related to the target domain.

[0056] [Reference 4]: Fabio Souza et al., "Portuguese Named Entity Recognition using BERT-CRF", arXiv 2019. As a technique for using partially labeled training data, for example, the technique described in Reference 5 below can be used.

[0057] [References 5]:Zhanming Jie et al., "Better Modeling of Incomplete Annotations for Named Entity Recognition", NAACL-HLT 2019. The extraction model M10 may be machine-trained to output each of different phrases containing a common word. This is because different phrases related to the target domain may contain a common word. For example, sentence 1 related to the target domain "cooking" may be considered to include "Italian cuisine" and "standard Italian cuisine" as phrases related to cooking. In other words, "Italian cuisine" and "standard Italian cuisine" are different phrases containing the common word "Italian cuisine". In this case, it is desirable that the extraction model M10 is machine-trained so that when sentence 1 is input to the language model M1, the classifier M2 not only identifies "Italian cuisine" and "pasta", but also identifies "standard Italian cuisine". As a technology for identifying each of such different phrases (i.e., multiple nested phrases) containing a common word, the technology described in the following reference 6 can be used.

[0058] [References 6]:Jue Wang et al., "Pyramid: A Layered Model for Nested Named Entity Recognition", ACL 2020. (Step S232A) In step S232A, the generation unit 22 extracts new phrases from the sentence set D1 using the extraction model M10 generated in step S231A.

[0059] The processing of this step will be described using a specific example shown in Fig. 7. Specifically, the generation unit 22 inputs the sentence 1 to the extraction model M10, and extracts, as a new phrase, "pasta" that is different from existing phrases from the output phrases "Italian cuisine" and "pasta".

[0060] (Details of the generation process S23B using the language model M1) A detailed flow of the generation process S23B using the language model M1, which may be executed in step S23, will be described with reference to Fig. 8. The generation process S23B is a process of predicting a new phrase using the sentence set D1 with the language model M1. Since the predicted new phrase may not be included in the sentence set D1, the generation process S23B may be able to generate more new phrases than the generation process S23A. Fig. 8 is a flow diagram showing a detailed flow of the new phrase generation process S23B. As shown in Fig. 8, the generation process S23B includes steps S231B and S232B.

[0061] (Step S231B) In step S231B, the generation unit 22 identifies a position where any one of a plurality of existing phrases appears in a sentence included in the sentence set D1.

[0062] The processing of this step will be described using a specific example shown in Fig. 8. In this specific example, the taxonomy T1 of the target domain "cooking" shown in Fig. 4 is expanded. Furthermore, a sentence set D1 related to the target domain "cooking" includes a sentence 2 of "A poured hot tea." The generation unit 22 identifies the location of the existing phrase "tea" that appears in the sentence 2.

[0063] (Step S232B) In step S232B, the generation unit 22 generates a new phrase that matches the identified portion by predicting it using the language model M1.

[0064] The processing of this step will be described using a specific example shown in Fig. 8. The generation unit 22 inputs the sentence in which the specified portion in the sentence 2 is masked into the language model M1. The generation unit 22 extracts, as a new phrase, "coffee" that is different from existing phrases from "tea" and "coffee" predicted by the language model M1.

[0065] (An example of a generation process that does not use the language model M1) An example of a process for generating a new phrase without using the language model M1, which may be executed in step S23, will be described.

[0066] For example, the generation unit 22 may extract new phrases from the sentence set D1 using a knowledge base instead of using the language model M1. The new phrases to be extracted are phrases included in the sentence set D1. The knowledge base is preferably a knowledge base about general information. For example, the generation unit 22 may use a knowledge base stored in a memory (not shown) of the information processing device 2, or may obtain and use a knowledge base from another device connected via a network.

[0067] For example, the generation unit 22 uses a knowledge base to assign a correct label to phrases related to the target domain among the phrases included in the sentence set D1. The generation unit 22 also uses the sentence set D1 with the correct label assigned as training data to generate an extraction model that extracts phrases from the sentence set D1 by machine learning. The generation unit 22 also uses the generated extraction model to extract phrases from the sentence set D1 that are different from existing phrases as new phrases. Note that the technology described in Reference 7 below can be applied as a technology for generating an extraction model that extracts phrases of the target domain from the sentence set D1 using a knowledge base.

[0068] [Reference 7]: Jingbo Shang et al.., "Automated Phrase Mining from Massive Text Corpora", TKDE 2018. (Another example of generation processing that does not use the language model M1) Another example of the process for generating a new phrase without using the language model M1, which may be executed in step S23, will be described.

[0069] For example, the generation unit 22 may extract new phrases from the sentence set D1 using a BiLSTM-CRF model without using the language model M1. One input of the BiLSTM-CRF model is a string of words, and the other input is a label that identifies a phrase in the target domain. In this case, the generation unit 22 generates training data from the taxonomy T1 and the sentence set D1, and trains the BiLSTM-CRF model using the generated training data. As a technique for generating training data used for training the BiLSTM-CRF model from the taxonomy T1 and the sentence set D1, the technique described in Non-Patent Document 3 can be applied. In addition, the generation unit 22 extracts new phrases from the sentence set D1 using the generated BiLSTM-CRF model.

[0070] (Details of the extension process S24A: an example of the extension process using the language model M1) A detailed flow of the extension process S24A of the taxonomy T1 that may be executed in step S24 will be described with reference to Fig. 9. The extension process S24A is a process of associating a new phrase with any of the existing phrases by using the language model M1. Fig. 9 is a flow diagram showing a detailed flow of the extension process S24A. As shown in Fig. 9, the extension process S24A includes steps S241A to S243A.

[0071] (Step S241A) In step S241A, the extension unit 23 generates a sentence including a new phrase and any one of a plurality of existing phrases included in the taxonomy T1. Specifically, the extension unit 23 generates a sentence including the existing phrase and the new phrase by assuming a relationship between the existing phrase and the new phrase.

[0072] The processing of this step will be described using a specific example shown in FIG. 9. Here, a specific example will be described in which a new phrase "pasta" is added to and extended to the taxonomy T1 related to the target domain "cuisine" shown in FIG. 4. The extension unit 23 applies the sentence "<cuisine name> is one of <cuisine categories>" as a sentence assuming a relationship between an existing phrase and a new phrase. For example, the extension unit 23 generates a sentence of pattern 1, "pasta is one of Italian cuisines," as a sentence assuming a relationship between the existing phrase "Italian cuisine" and the new phrase "pasta." In addition, the extension unit 23 generates a sentence of pattern 2, "pasta is one of desserts," as a sentence assuming a relationship between the existing phrase "dessert" and the new phrase "pasta." In this way, the extension unit 23 generates a sentence assuming a relationship between each of the existing phrases included in the taxonomy T1 and the new phrase "pasta."

[0073] (Step S242A) In step S242A, the expansion unit 23 calculates the accuracy of the generated sentence using the language model M1.

[0074] The processing of this step will be described using a specific example shown in Fig. 9. The extension unit 23 obtains an output accuracy of 0.9 by inputting a sentence of pattern 1 into the language model M1. The extension unit 23 also obtains an output accuracy of 0.1 by inputting a sentence of pattern 2 into the language model M1. In this way, the extension unit 23 obtains the accuracy of each of the existing phrases included in the taxonomy T1.

[0075] (Step S243A) In step S243A, the expansion unit 23 refers to the calculated accuracy and associates the new phrase with any one of a plurality of existing phrases.

[0076] The processing of this step will be described using a specific example shown in FIG. 9. For example, the extension unit 23 associates the new phrase "pasta" with the existing phrase "Italian cuisine" that has the highest accuracy of a sentence assumed to have a relationship with the new phrase "pasta" among the existing phrases included in the taxonomy T1. In other words, as shown in FIG. 9, the extension unit 23 connects a new node N8 corresponding to the new phrase "pasta" to the node N2 corresponding to the existing phrase "Italian cuisine" by a new edge E7. The edge E7 indicates that the phrase "Italian cuisine" corresponding to the node N2 connected to the root is the parent, and the phrase "pasta" corresponding to the node N8 connected to the arrowhead is the child. In other words, the phrase "Italian cuisine" is the parent of the phrase "pasta". In this way, the taxonomy T1 is extended.

[0077] (Details of the extension process S24B: Another example of the extension process using the language model M1) A detailed flow of the extension process S24B using the language model M1 that may be executed in step S24 will be described with reference to Fig. 10. The extension process S24B is a process of associating any one of a plurality of existing phrases with a new phrase using a discrimination model M20 including the language model M1. Fig. 10 is a flow diagram showing a detailed flow of the extension process S24B. As shown in Fig. 10, the extension process S24B includes steps S241B to S244B.

[0078] (Step S241B) In step S241B, the extension unit 23 generates a discrimination model M20 using the language model M1. The discrimination model M20 includes the language model M1 and a classifier M3 to which the output from the language model M1 is input. The discrimination model M20 is trained so that when a sentence including any one of a plurality of existing phrases and a new phrase is input to the language model M1, the classifier M3 outputs information indicating the presence or absence of a relationship. This training is performed using teacher data in which the correct answer is the presence or absence of a relationship between two of a plurality of existing phrases indicated by the taxonomy T1. The discrimination model M20 outputs the output from the classifier M3.

[0079] The processing of this step will be described using a specific example shown in Fig. 10. Here, a specific example will be described in which a new phrase "pasta" is added to and extended to the taxonomy T1 of the target domain "cooking" shown in Fig. 4.

[0080] In this specific example, teacher data is generated for each combination of two existing phrases included in the sentence set D1. The teacher data includes a sentence including two existing phrases and information indicating the presence or absence of a relationship between the two phrases. For example, the taxonomy T1 indicates that there is a parent-child relationship between the existing phrase "pizza" and the existing phrase "Italian food". Then, the extension unit 23 generates teacher data including a sentence of pattern 3 "pizza is one of Italian dishes" that assumes a relationship between the two phrases, and information "parent and child" as the correct answer. Also, the taxonomy T1 indicates that there is no parent-child relationship between the existing phrase "pizza" and the existing phrase "dessert". Then, the extension unit 23 generates teacher data including a sentence of pattern 4 "pizza is one of desserts" that assumes a relationship between the two existing phrases, and information "not parent and child" as the correct answer. In this way, the extension unit 23 generates teacher data for each combination of two existing phrases included in the taxonomy T1. Moreover, the extension unit 23 uses the generated teacher data to train the discriminant model M20.

[0081] (Step S242B) In step S242B, the extension unit 23 generates a sentence including a new phrase and any one of the existing phrases included in the taxonomy T1. Specifically, the extension unit 23 generates a sentence including the existing phrase and the new phrase by assuming a relationship between the existing phrase and the new phrase.

[0082] The processing of this step will be described using a specific example shown in FIG. 10. Here, the expansion unit 23 generates a sentence of pattern 1, "Pasta is one of the Italian dishes," and a sentence of pattern 2, "Pasta is one of the desserts." The sentences of pattern 1 and pattern 2 are as described in step S241A. In this way, the expansion unit 23 generates a sentence that assumes a relationship with the new phrase "Pasta" for each of the existing phrases included in the taxonomy T1.

[0083] (Step S243B) In step S243B, the expansion unit 23 inputs the generated sentence to the discrimination model M20, thereby obtaining a discrimination result output from the discrimination model M20.

[0084] The processing of this step will be described using a specific example shown in Fig. 10. Here, when a sentence of pattern 1 is input, the discrimination model M20 outputs information that "they are parent and child." Also, when a sentence of pattern 2 is input, the discrimination model M20 outputs information that "they are not parent and child." In this way, the expansion unit 23 obtains a discrimination result as to whether or not each of the existing phrases included in the taxonomy T1 has a relationship with the new phrase "pasta."

[0085] (Step S244B) In step S244B, the expansion unit 23 refers to the determination result and associates the new phrase with any one of a plurality of existing phrases.

[0086] The processing of this step will be described using a specific example shown in FIG. 10. For example, the expansion unit 23 associates the phrase "Italian cuisine", which has been determined to be "parent and child" of the new phrase "pasta" among the existing phrases included in the taxonomy T1, with the new phrase "pasta". If there are multiple existing phrases which have been determined to be "parent and child" of the new phrase "pasta", the expansion unit 23 associates any one of the existing phrases with the new phrase. "As a result, a node N8 and an edge E7 are added to the taxonomy T1, and the taxonomy T1 is expanded. Details of the expanded taxonomy T1 are as described with reference to FIG. 9.

[0087] In addition, the discrimination model M20 generated in step S241B may output the probability of a relationship as information indicating the presence or absence of a relationship. In this case, in step S244B, the extension unit 23 may associate the new phrase with the existing phrase with the highest probability of a relationship.

[0088] (An example of an extension process that does not use the language model M1) An example of an extension process that can be executed in step S24 without using the language model M1 will be described.

[0089] For example, the extension unit 23 may calculate the similarity between a new phrase and any one of a number of existing phrases included in the taxonomy T1, and associate the new phrase with any one of the existing phrases based on the calculated similarity.

[0090] For example, the extension unit 23 calculates the similarity between an existing phrase and a new phrase using one or both of string similarity and semantic similarity. For example, the extension unit 23 may calculate an index such as edit distance, end_with, or jaccard similarity as the string similarity. In addition, the extension unit 23 may calculate the cosine similarity or Euclidean distance between a semantic vector indicating the existing phrase and a semantic vector indicating the new phrase as the semantic similarity. In addition, the extension unit 23 may calculate such a semantic vector using word2vec or the like.

[0091] For example, the expansion unit 23 may associate a new phrase with an existing phrase for which one or both of the character string similarity and the semantic similarity are equal to or greater than a threshold value.

[0092] (Another example of expansion processing that does not use language model M1) Another example of the expansion process that can be executed in step S24 and does not use the language model M1 will be described.

[0093] For example, the extension unit 23 may generate a classifier by machine learning that receives one or both of the character string similarity between two phrases and the semantic vector of each phrase as input, and outputs information indicating the presence or absence of a relationship. In this case, the extension unit 23 uses the generated classifier to associate the new phrase with an existing phrase that has been determined to have a relationship with the new phrase. If there are multiple existing phrases that have been determined to have a relationship, the extension unit 23 associates any one of the existing phrases with the new phrase. Note that such a classifier may output the degree of certainty that there is a relationship as information indicating the presence or absence of a relationship. In this case, the extension unit 23 may associate the new phrase with the existing phrase that has the highest degree of certainty that there is a relationship.

[0094] <Advantages of this exemplary embodiment> In this exemplary embodiment, in order to extend a taxonomy T1 relating to a target domain, a language model M1 generated from a general sentence set D2 is used in at least one of the following processes: (i) generating new phrases by referring to a sentence set D1 relating to the target domain; and (ii) associating the new phrases with any of a number of existing phrases included in the taxonomy T1.

[0095] Here, new phrases related to the target domain may be explained by a combination of general phrases. Therefore, even if the amount of information contained in the sentence set D1 is small, new phrases in the target domain to be added to the taxonomy T1 can be generated from the sentence set D1 with high accuracy by using information about general phrases contained in the language model M1.

[0096] Furthermore, the language model M1 represents the relationship between general phrases. Therefore, the relationship between the general phrases represented by the language model M1 can be used to correct the relationship between the new phrase and the existing phrases. As a result, even if the amount of information contained in the sentence set D1 is small, the new phrase can be associated with the existing phrases with higher accuracy.

[0097] For example, the effect of this exemplary embodiment will be described when a taxonomy T1 for the domain "dish name" is expanded using a language model M1 constructed from a general sentence set D2 and a sentence set D1 collected from an online recipe site. When a generation process S23A using the language model M1 is executed in step S23, dish names and dish categories included in the online recipe site can be extracted with higher accuracy as new phrases. When a generation process S23B using the language model M1 is executed in step S23, dish names or dish categories not included in the online recipe site can be predicted as new phrases. When an expansion process S24A or S24B using the language model M1 is executed in step S24, a new dish name or dish category can be associated with an existing dish name or dish category with higher accuracy.

[0098] Exemplary embodiment 3 The third exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the second exemplary embodiment are given the same reference numerals, and the description thereof will be omitted as appropriate.

[0099] <Configuration of information processing device 3> The configuration of the information processing device 3 according to this exemplary embodiment will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of the information processing device 3.

[0100] 11, the information processing device 3 is configured in a manner similar to that of the information processing device 2 according to the exemplary embodiment 2, but differs in that it includes an acquisition unit 31 instead of the acquisition unit 21 and an adjustment unit 35 instead of the adjustment unit 25. It also differs in that it does not include a construction unit 24. The acquisition unit 31 is an example of a configuration that realizes the acquisition means recited in the claims. The adjustment unit 35 is an example of a configuration that realizes the adjustment means recited in the claims.

[0101] (Acquisition part 31) The acquisition unit 31 is configured in a manner similar to that of the acquisition unit 21 in the second exemplary embodiment, except that the acquisition unit 31 acquires a generated language model M4 instead of acquiring a general sentence set D2.

[0102] (Generated language model M4) The generated language model M4 is a model that outputs the accuracy for an input word string, and the details thereof are as described in the embodiment 1. The generated language model M4 is a model generated by a device different from the information processing device 3. For example, a publicly available language model may be applied as the generated language model M4.

[0103] (Construction Section 32) The construction unit 32 constructs the language model M5 by adjusting the generated language model M4 using the sentence set D1. The technology applicable to the process of adjusting the language model M4 using the sentence set D1 is as described for the adjustment unit 25 in the second exemplary embodiment.

[0104] <Flow of information processing method S3> The flow of the information processing method S3 executed by the information processing device 3 configured as above will be described with reference to Fig. 12. Fig. 12 is a flow diagram showing the flow of the information processing method S3. As shown in Fig. 13, the information processing method S3 includes steps S31 to S34.

[0105] (Step S31) In step S31, the acquisition unit 31 acquires the taxonomy T1, the sentence set D1, and the generated language model M4. For example, the acquisition unit 31 may acquire the taxonomy T1, the sentence set D1, or the generated language model M4 stored in a memory (not shown) of the information processing device 3, or may acquire the taxonomy T1, the sentence set D1, or the generated language model M4 from another device connected via a network.

[0106] (Step S32) In step S32, the construction unit 32 generates a language model M5 by adjusting the generated language model M4 using the sentence set D1.

[0107] (Step S33) In step S33, the generation unit 22 executes one of the generation processes S23A and S23B using the language model M5 to generate a new phrase by referring to the sentence set D1. Alternatively, the generation unit 22 may execute a generation process that does not use the language model M5, instead of executing one of the generation processes S23A and S23B. Details of these generation processes are similarly described in the detailed description of step S23 in the exemplary embodiment 2, by replacing the language model M1 with the language model M5.

[0108] (Step S34) In step S34, the extension unit 23 executes one of the extension processes S24A and S24B using the language model M5 to extend the taxonomy T1. Alternatively, the extension unit 23 may execute an extension process that does not use the language model M5 instead of executing one of the extension processes S24A and S24B. If a generation process that does not use the language model M5 is executed in step S33, one of the extension processes S24A and S24B using the language model M5 is executed in that step. Details of these extension processes are similarly described in the detailed description of step S24 in the exemplary embodiment 2 by replacing the language model M1 with the language model M5.

[0109] <Advantages of this exemplary embodiment> In this exemplary embodiment, a language model M5 obtained by adjusting a generated language model M4 is used as a language model for extending a taxonomy T1 related to a target domain. This makes it possible to achieve the same effect as in the exemplary embodiment 2 without requiring a process for constructing a language model.

[0110] [Variation 1] In the exemplary embodiments 2 and 3, the expansion unit 23 may generate a sentence including one of a plurality of existing phrases and a new phrase, on the assumption that there is one of a plurality of types of relationships between the two phrases. Specific examples of the plurality of types of relationships include, for example, affiliation relationships, and relationships between countries and capital cities. An affiliation relationship is, for example, a relationship between a sports team name and the names of players belonging to the sports team. Also, a relationship between a country and a capital city is, for example, a relationship between a country name and the name of the capital city of the country.

[0111] For example, the expansion unit 23 generates sentence a, "<new phrase> belongs to <existing phrase>," and sentence b, "<existing phrase> belongs to <new phrase>," as sentences assuming a relationship between a country and a capital city. The expansion unit 23 also generates sentence c, "<new phrase> is the center of <existing phrase>," and sentence d, "<existing phrase> is the center of <new phrase>," as sentences assuming a relationship between a country and a capital city.

[0112] When executing the extension process S24A, the extension unit 23 calculates the accuracy of the generated sentences a to d by using the language model M1 (or M5). Furthermore, the extension unit 23 refers to the calculated accuracy and associates the new phrase with the existing phrase.

[0113] Moreover, when executing the expansion process S24B, the expansion unit 23 inputs each of the generated sentences a to d into the discrimination model M20, and refers to the discrimination results to associate the new phrase with an existing phrase.

[0114] By making such modifications, the illustrative embodiments are able to associate new phrases with existing phrases that have a more appropriate type of relationship to the new phrase.

[0115] [Modification 2] Note that the exemplary embodiments 2 and 3 can be modified so as not to include the adjustment units 25 and 35. In other words, in each exemplary embodiment, the process of adjusting the language model M1 or M4 is not essential. In this case, in the exemplary embodiment 2, at least one of the generation unit 22 and the extension unit 23 uses the unadjusted language model M1. Also, in this case, in the exemplary embodiment 3, the generation unit 22 and the extension unit 23 use the generated language model M4. Even in this case, each exemplary embodiment can accurately generate a new phrase by referring to the sentence set D1, and can accurately associate the new phrase with an existing phrase.

[0116] However, when the adjusted language models M1 and M5 are used, the relationship between phrases or words in the target domain can be corrected, so that the accuracy of phrase generation and association can be improved. Therefore, it is preferable that each of the exemplary embodiments includes the adjustment units 25 and 35.

[0117] [Other Modifications] In addition, in the exemplary embodiments 2 and 3, in step S23 or S33, new phrases may be generated from the sentence set D1 using other methods using the language model M1 (or M5) instead of the generation process S23A or S23B. In the exemplary embodiments 2 and 3, in step S24 or S34, new phrases may be associated with existing phrases using other methods using the language model M1 (or M5) instead of the expansion process S24A or S24B.

[0118] [Software implementation example] Some or all of the functions of the information processing devices 1 to 3 may be realized by hardware such as an integrated circuit (IC chip), or may be realized by software.

[0119] In the latter case, the information processing devices 1 to 3 are realized, for example, by a computer that executes instructions of a program, which is software that realizes each function. An example of such a computer (hereinafter, referred to as computer C) is shown in FIG. 13. The computer C includes at least one processor C1 and at least one memory C2. The memory C2 stores a program P for operating the computer C as the information processing devices 1 to 3. In the computer C, the processor C1 reads and executes the program P from the memory C2, thereby realizing each function of the information processing devices 1 to 3.

[0120] The processor C1 may be, for example, a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination of these. The memory C2 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination of these.

[0121] The computer C may further include a RAM (Random Access Memory) for expanding the program P during execution and for temporarily storing various data. The computer C may further include a communication interface for transmitting and receiving data to and from other devices. The computer C may further include an input / output interface for connecting input / output devices such as a keyboard, a mouse, a display, and a printer.

[0122] Furthermore, the program P can be recorded on a non-transitory tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can obtain the program P via such a recording medium M. Furthermore, the program P can be transmitted via a transmission medium. Such a transmission medium can be, for example, a communication network or broadcast waves. The computer C can also obtain the program P via such a transmission medium.

[0123] [Additional Note 1] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiment are also included in the technical scope of the present invention.

[0124] [Additional Note 2] Some or all of the above-described embodiments can be described as follows. However, the present invention is not limited to the following described aspects.

[0125] (Appendix 1) A means for acquiring a taxonomy representing relationships between a plurality of phrases; a generating means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and an extension means for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; using a language model in one or both of the generating means and the expanding means; Information processing device.

[0126] With the above configuration, when a language model is used in the generating means, the information represented by the language model can be used in addition to the information contained in the first sentence set, so that new phrases to be added to the taxonomy can be generated with higher accuracy. Also, when a language model is used in the expanding means, the relationship between the phrases represented by the language model can be used to correct the relationship between the new phrase and the existing phrases, so that the new phrase and the existing phrase can be associated with each other with higher accuracy. Therefore, this exemplary embodiment can expand the taxonomy with higher accuracy.

[0127] (Appendix 2) An information processing device as described in Appendix 1, further comprising a construction means for constructing the language model referenced in one or both of the generation means and the expansion means based on a second sentence set including sentences not included in the first sentence set.

[0128] With the above configuration, when a language model is used in the generating means, information not included in the first sentence set that is represented by the language model can be used, so new phrases can be generated with higher accuracy. Also, when a language model is used in the expanding means, relationships between phrases not included in the first sentence set that are represented by the language model can be used, so new phrases can be associated with existing phrases with higher accuracy.

[0129] (Appendix 3) 3. The information processing device according to claim 1, further comprising an adjustment means for adjusting the language model referred to in one or both of the generation means and the extension means based on the first sentence set.

[0130] With the above configuration, the generation means uses the adjusted language model, so that new phrases can be generated with higher accuracy. Also, the expansion means uses the adjusted language model, so that new phrases can be associated with existing phrases with higher accuracy.

[0131] (Appendix 4) The generating means includes: generating the new phrases by extracting them from the first set of sentences using an extraction model; The extraction model is the language model; and a classifier to which an output from the language model is input; When a sentence included in the first sentence set is input to the language model, the classifier classifies and outputs the new phrase. generated by machine learning using training data in which the plurality of phrases appearing in the first set of sentences are regarded as correct answers; 4. An information processing device according to any one of claims 1 to 3.

[0132] With the above configuration, by using the extraction model generated using the language model, new phrases can be extracted with high accuracy from the first sentence collection.

[0133] (Appendix 5) The generating means includes: generating the new phrase that matches a location where any of the plurality of phrases appears in a sentence included in the first sentence set by predicting the new phrase using the language model; 4. An information processing device according to any one of claims 1 to 3.

[0134] With the above configuration, it is also possible to generate new phrases that are not included in the first sentence set by predicting new phrases using the language model.

[0135] (Appendix 6) The expansion means is calculating a likelihood of a sentence including any one of the plurality of phrases and the new phrase using the language model, and associating any one of the plurality of phrases with the new phrase by referring to the calculated likelihood; 6. An information processing device according to any one of appendix 1 to 5.

[0136] With the above configuration, the relationship between the phrases already included in the taxonomy and the new phrase can be determined based on the accuracy calculated by the language model. As a result, the phrases already included in the taxonomy and the new phrase can be associated with each other with higher accuracy.

[0137] (Appendix 7) The expansion means is using a discriminant model to associate one of the plurality of phrases with the new phrase; The discrimination model is a language model and a classifier to which an output from the language model is input; When a sentence including any one of the plurality of phrases and the new phrase is input to the language model, the classifier outputs information indicating the presence or absence of a relationship between the plurality of phrases and the new phrase. An information processing device according to any one of appendices 1 to 5, wherein the taxonomy is generated by machine learning using training data in which the correct answer is whether or not there is a relationship between two of the multiple phrases indicated by the taxonomy.

[0138] With the above configuration, the relationship between the phrases already included in the taxonomy and the new phrase can be determined by a determination model that uses the relationship represented by the language model. As a result, the phrases already included in the taxonomy and the new phrase can be associated with each other with higher accuracy.

[0139] (Appendix 8) The expansion means is generating a sentence including any one of the plurality of phrases and the new phrase, on the assumption that any one of a plurality of types of relationships exists between the two phrases; 8. The information processing device according to claim 6 or 7.

[0140] With the above configuration, it is possible to associate a new phrase with a phrase already included in the taxonomy, taking into consideration the type of relationship between these phrases, thereby enabling more accurate association.

[0141] (Appendix 9) Obtaining a taxonomy that represents the relationships between multiple phrases; generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and extending the taxonomy by associating any of the plurality of phrases with the new phrase; using a language model in generating the new phrases and / or expanding the taxonomy; Information processing methods.

[0142] The above configuration provides the same effects as those of Supplementary Note 1.

[0143] (Appendix 10) A program for causing a computer to function as an information processing device, the program comprising: A means for acquiring a taxonomy representing relationships between a plurality of phrases; a generating means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and functioning as an extension means for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; A program using a language model in one or both of the generating means and the expanding means.

[0144] The above configuration provides the same effects as those of Supplementary Note 1.

[0145] [Additional Note 3] A part or all of the above-described embodiments can be further expressed as follows.

[0146] at least one processor; The processor, An acquisition process for acquiring a taxonomy that represents relationships between multiple phrases; a generation process of generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and executing an extension process for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; An information processing device that uses a language model in one or both of the generation process and the expansion process.

[0147] The information processing device may further include a memory that stores a program for causing the processor to execute the acquisition process, the generation process, and the extension process. The program may be recorded on a computer-readable, non-transitory, tangible recording medium. [Explanation of symbols]

[0148] 1, 2, 3 Information processing device 11, 21, 31 Acquisition part 12, 22 Generation part 13, 23 Extension 24 Construction Department 25, 35 Adjustment part

Claims

1. A means for acquiring a taxonomy representing relationships between a plurality of phrases; a generating means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and an extension means for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; using a language model in one or both of said generating means and said expanding means; The generating means includes: generating the new phrases by extracting them from the first set of sentences using an extraction model; The extraction model is the language model; and a classifier to which an output from the language model is input; When a sentence included in the first sentence set is input to the language model, the classifier classifies and outputs the new phrase. generated by machine learning using training data in which the plurality of phrases appearing in the first set of sentences are regarded as correct answers; Information processing device.

2. a constructing means for constructing the language model referred to in one or both of the generating means and the expanding means, based on a second sentence set including sentences not included in the first sentence set; The information processing device according to claim 1 .

3. an adjustment unit that adjusts the language model referred to in one or both of the generation unit and the expansion unit based on the first sentence set; 3. The information processing device according to claim 1 or 2.

4. The expansion means is calculating a likelihood of a sentence including any one of the plurality of phrases and the new phrase using the language model, and associating any one of the plurality of phrases with the new phrase by referring to the calculated likelihood; The information processing device according to claim 1 .

5. The expansion means is using a discriminant model to associate one of the plurality of phrases with the new phrase; The discrimination model is a language model and a classifier to which an output from the language model is input; When a sentence including any one of the plurality of phrases and the new phrase is input to the language model, the classifier outputs information indicating the presence or absence of a relationship between the plurality of phrases and the new phrase. The information processing device according to claim 1 , wherein the taxonomy is generated by machine learning using training data in which the presence or absence of a relationship between two of the plurality of phrases indicated by the taxonomy is regarded as a correct answer.

6. The expansion means is generating a sentence including any one of the plurality of phrases and the new phrase, on the assumption that any one of a plurality of types of relationship exists between the two phrases; 6. The information processing device according to claim 4 or 5.

7. An acquisition means for acquiring a taxonomy that represents relationships between a plurality of phrases; a generating means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and an extension means for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; using a language model in one or both of said generating means and said expanding means; The generating means includes: generating the new phrase that matches a portion where any of the plurality of phrases appears in a sentence included in the first sentence set by predicting the new phrase using the language model; Information processing device.

8. An acquisition means for acquiring a taxonomy representing relationships between a plurality of phrases; a generating means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and an extension means for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; using a language model in one or both of said generating means and said expanding means; The expansion means is calculating a likelihood of a sentence including any one of the plurality of phrases and the new phrase using the language model, and associating any one of the plurality of phrases with the new phrase by referring to the calculated likelihood; Information processing device.

9. Obtaining a taxonomy that represents the relationships between multiple phrases; generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; and extending the taxonomy by associating any of the plurality of phrases with the new phrase; using a language model in generating the new phrases and / or expanding the taxonomy; In the generating, generating the new phrases by extracting them from the first set of sentences using an extraction model; The extraction model is the language model; and a classifier to which an output from the language model is input; When a sentence included in the first sentence set is input to the language model, the classifier classifies and outputs the new phrase. generated by machine learning using training data in which the plurality of phrases appearing in the first set of sentences are regarded as correct answers; Information processing methods.

10. A program for causing a computer to function as an information processing device, the program comprising: A means for acquiring a taxonomy representing relationships between a plurality of phrases; a generating means for generating a new phrase different from any of the plurality of phrases by referring to a first set of sentences; an extension means for extending the taxonomy by associating any one of the plurality of phrases with the new phrase; using a language model in one or both of said generating means and said expanding means; The generating means includes: generating the new phrases by extracting them from the first set of sentences using an extraction model; The extraction model is the language model; and a classifier to which an output from the language model is input; When a sentence included in the first sentence set is input to the language model, the classifier classifies and outputs the new phrase. generated by machine learning using training data in which the plurality of phrases appearing in the first set of sentences are regarded as correct answers; program.

Images