ANSWER CANDIDATE PROPOSAL SYSTEM AND ANSWER CANDIDATE PROPOSAL METHOD
Patent Information
- Application Number
- JP2021206569
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-21
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2041-12-21
AI Technical Summary
【0010】 本発明によれば、新規質問文章に対して好適な回答候補文章を出力できる。
Smart Images

Figure 0007629844000001 
Figure 0007629844000002 
Figure 0007629844000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an answer candidate suggestion system and an answer candidate suggestion method for generating answer candidate sentences that are candidates for answers to a new question sentence. [Background technology]
[0002] There is a technology that generates candidate answer sentences to be candidates for answer sentences to new question sentences of users obtained via the Internet or public communication networks. For example, Patent Document 1 discloses a technology that breaks down a question string into a plurality of morphemes (words), and selects and outputs an answer string from a group of accumulated past answer strings based on the obtained plurality of morphemes.
[0003] Furthermore, Patent Document 2 discloses a technology that performs morphological analysis on a question sentence, breaks it down into multiple morphemes, performs a search process using a search query generated from the obtained multiple morphemes, extracts a set of candidate answer sentences from the search results, and ranks the candidate answer sentences included in the extracted set of candidate answer sentences. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2018-181033 A [Patent Document 2] JP 2013-254420 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, when a new question sentence contains many words unrelated to the intent of the question, the multiple morphemes obtained by morphological analysis of the question document contain many words unrelated to the intent of the question. In this case, the technology described in Patent Document 1 selects and outputs an answer string from a group of past answer strings based on the multiple morphemes containing many words unrelated to the intent of the question, which are obtained by morphological analysis of the question string. Therefore, the answer string to be output is an answer string related to many words unrelated to the intent of the question. Therefore, with the technology described in Patent Document 1, there is a risk that the answer string to be output will be an inappropriate answer string that does not match the intent of the user's question.
[0006] In the above case, the technology described in Patent Document 2 generates a search query from a plurality of morphemes containing many words unrelated to the intent of the question, which are obtained by morphological analysis of the question sentence, and performs a search process using the search query. The search results are influenced by the words unrelated to the intent of the question that are contained in many morphemes included in the search query. For this reason, the contents of the answer candidate sentences extracted from the search results may have a weak relationship to the intent of the question. Therefore, the technology described in Patent Document 2 may result in the answer candidate sentences being inappropriate.
[0007] SUMMARY OF THE PRESENT DISCLOSURE An object of the present invention is to provide an answer candidate suggestion system and an answer candidate suggestion method that output suitable answer candidate sentences for a new question sentence. [Means for solving the problem]
[0008] In order to achieve the above object, one aspect of the answer candidate suggestion system of the present invention is an answer candidate suggestion system that generates answer candidate sentences that are candidates for answer sentences to a new question sentence, the system comprising: a processor; and a storage device. The storage device stores a question and answer database that stores past question sentences and past answer sentences to the past question sentences in association with each other. When the new question sentence is input, the processor generates a group of item candidate words based on the past question sentence and the new question sentence stored in the question and answer database. When an item word group selected by a user from the generated item candidate word group is input, the processor generates question information including the item word group based on the item word group and the new question sentence. For each of the past question sentences stored in the question and answer database, the processor calculates a similarity between the past question sentences stored in the question and answer database and the question information. The processor extracts past question sentences similar to the question information from the question and answer database based on the similarity with the question information. The processor extracts past answer sentences associated with the extracted past question sentences similar to the question information from the question and answer database to set them as first answer candidate sentences.
[0009] Furthermore, one aspect of the answer candidate suggestion method for the answer candidate suggestion system of the present invention is an answer candidate suggestion method in the answer candidate suggestion system which generates answer candidate sentences that are candidates for answer sentences to a new question sentence, wherein a storage device of the answer candidate suggestion system stores a question and answer database in which past question sentences and past answer sentences to the past question sentences are stored in association with each other, when the new question sentence is input, a group of item candidate words is generated based on the past question sentence and the new question sentence stored in the question and answer database, and when an item word group selected by a user from the generated item candidate word group is input, question information including the item word group is generated based on the item word group and the new question sentence, a similarity between each of the past question sentences stored in the question and answer database and the question information is calculated, past question sentences similar to the question information are extracted from the question and answer database based on the similarity with the question information, and past answer sentences associated with the extracted past question sentences similar to the question information are extracted from the question and answer database to be set as first answer candidate sentences. Effect of the Invention
[0010] According to the present invention, suitable answer candidate sentences can be output for a new question sentence. [Brief description of the drawings]
[0011] [Figure 1] FIG. 2 is a diagram illustrating an example of a functional block diagram of the answer candidate suggestion system in the embodiment. [Diagram 2] 1 is a block diagram showing an example of a hardware configuration of an answer candidate suggestion system according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a question and answer database. [Figure 4] FIG. 13 is a diagram showing an example of a question word request word list. [Diagram 5] FIG. 13 is a diagram showing an example of a personal information word list. [Figure 6] FIG. 13 is a diagram showing an example of a supplementary word list. [Figure 7]FIG. 13 is a diagram showing an example of an item candidate word table. [Figure 8] 11 is a flowchart illustrating an example of a process for generating a group of candidate item words according to an embodiment. [Figure 9] FIG. 13 is an explanatory diagram showing an example of a new question sentence input screen displayed on a user terminal. [Figure 10] FIG. 13 is an explanatory diagram showing an example of an item word group selection screen displayed on a user terminal. [Figure 11] FIG. 13 is an explanatory diagram showing an example of an answer candidate generation and selection screen displayed on an operator terminal. [Figure 12] 13 is a flowchart showing an example of an answer candidate sentence generation process of the answer candidate suggestion system 1. [Figure 13] FIG. 13 is an explanatory diagram showing an example of an answer candidate display screen displayed on an operator terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The examples are illustrative for explaining the present invention, and are omitted and simplified as appropriate for clarity of explanation. The present invention can be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.
[0013] In order to facilitate understanding of the invention, the position, size, shape, range, etc. of each component shown in the drawings may not represent the actual position, size, shape, range, etc. Therefore, the present invention is not necessarily limited to the position, size, shape, range, etc. disclosed in the drawings.
[0014] As examples of various information, the various information may be described using expressions such as "table," "list," and "queue," but the various information may be expressed using data structures other than these. For example, various information such as "XX table," "XX list," and "XX queue" may be expressed as "XX information." When describing identification information, expressions such as "identification information," "identifier," "name," "ID," and "number" are used, but these are mutually interchangeable.
[0015] When there are multiple components having the same or similar functions, they may be described by using the same reference numerals with different subscripts, or when there is no need to distinguish between these multiple components, the subscripts may be omitted.
[0016] In the embodiments, a process performed by executing a program may be described. Here, a computer executes the program using a processor (e.g., CPU, GPU), and performs the process defined by the program while using a storage resource (e.g., memory) and an interface device (e.g., communication port), etc. Therefore, the subject of the process performed by executing the program may be the processor. Similarly, the subject of the process performed by executing the program may be a controller, device, system, computer, or node having a processor. The subject of the process performed by executing the program may be a calculation unit, and may include a dedicated circuit that performs specific processing. Here, the dedicated circuit is, for example, an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), or a CPLD (Complex Programmable Logic Device), etc.
[0017] The program may be installed in the computer from a program source. The program source may be, for example, a program distribution server or a computer-readable storage medium. When the program source is a program distribution server, the program distribution server may include a processor and a storage resource that stores the program to be distributed, and the processor of the program distribution server may distribute the program to be distributed to other computers. In addition, in the embodiment, two or more programs may be realized as one program, and one program may be realized as two or more programs. EXAMPLES
[0018] When a new question sentence and a group of item words are input, the answer candidate suggestion system 1 of the embodiment generates answer candidate sentences (first answer candidate sentence and second answer candidate sentence described below) that are candidates for answer sentences to the new question sentence based on the new question sentence and the group of item words. The item word group is words related to the new question sentence, selected from the item candidate word group. The item candidate word group is a plurality of words (item candidate words) related to a new question sentence that are generated based on past question sentences and new question sentences stored in the question and answer database 21 (described later). Note that the expression "~ word group" means at least one "~ word."
[0019] <System configuration> 1 is a diagram showing an example of a functional block diagram of an answer candidate suggestion system 1 in an embodiment. As shown in FIG. 1, the answer candidate suggestion system 1 is connected to a user terminal 2, an operator terminal 3, and a web search engine 4 via a network NW.
[0020] The user terminal 2 is operated by a user who inputs a question sentence. The user terminal 2 includes an input device that accepts input from the user, and an output device such as a display or a touch panel that displays information. The user terminal 2 can transmit and receive information to and from the answer candidate suggestion system 1 and the operator terminal 3 via the network NW. The user terminal 2 can also display information received from the answer candidate suggestion system 1 and the operator terminal 3. The user terminal 2 can also transmit information input by the user to the answer candidate suggestion system 1 and the operator terminal 3.
[0021] The operator terminal 3 is operated by an operator and includes an input device that receives input from the operator, and an output device such as a display or a touch panel that displays information. The operator terminal 3 can transmit and receive information to and from the answer candidate suggestion system 1 and the user terminal 2 via the network NW. The operator terminal 3 is installed in a help desk that uses the answer candidate suggestion system 1, and may also be owned by, for example, a contractor of the help desk. As the operator terminal 3, for example, an electronic device such as a personal computer is used.
[0022] When the web search engine 4 receives at least one word via the network NW, it returns search results including information on websites related to the received word. The website information included in the search results includes a summary and URL of the website. Here, the summary is a summary sentence (e.g., about 100 characters) of each website generated by a web search engine or the like, and may also be called a snippet.
[0023] The network NW may be a wired network or a wireless network. The network NW may be a global network such as the Internet or a local area network (LAN).
[0024] The answer candidate suggestion system 1 includes an item candidate word group generation unit 11 and an answer candidate sentence generation unit 12. The answer candidate suggestion system 1 also stores a question and answer database 21, an interrogative word / request word list 22, a personal information word list 23, a supplementary word list 24, and an item candidate word table 25.
[0025] 8, the item candidate word group generation unit 11 generates an item candidate word group related to a new question sentence when a new question sentence input by a user of the user terminal 2 is input to the answer candidate suggestion system 1. Furthermore, the item candidate word group generation unit 11 outputs the generated item candidate word group to a network I / F 36 (transmitting / receiving device) described later, and causes the network I / F 36 to transmit the item candidate word group to the user terminal 2 via the network NW.
[0026] 12, the answer candidate sentence generating unit 12 generates answer candidate sentences (first answer candidate sentence, second answer candidate sentence) when a group of item words and a new question sentence are input to the answer candidate suggestion system 1. Then, the answer candidate sentence generating unit 12 outputs the generated answer candidate sentences to a network I / F 36 (transmitting / receiving device) described later, and causes the network I / F 36 to transmit the answer candidate sentences to the operator terminal 3 via the network NW.
[0027] The question and answer database 21, the details of which will be described later with reference to FIG. 3, stores past question sentences, past answer sentences to the past question sentences, and tfidf vectors of the past question sentences in association with each other.
[0028] The interrogative word and request word list 22, the details of which will be described later with reference to FIG. 4, is a database that stores interrogative words that express doubts and request words that express requests.
[0029] The personal information word list 23, the details of which will be described later with reference to FIG. 5, is a database that stores a plurality of personal information words that represent personal information.
[0030] The supplemental word list 24, the details of which will be described later with reference to FIG. 6, is a database that stores supplemental words.
[0031] The item candidate word table 25, the details of which will be described later with reference to FIG. 7, is a database that stores words (particularly verbs) contained in past question sentences in association with item candidate word groups.
[0032] Fig. 2 is a block diagram showing an example of the hardware configuration of the answer candidate suggestion system 1. As shown in Fig. 2, the answer candidate suggestion system 1 has a processor 31, a main memory device 32, a sub-memory device 33, an input device 34, an output device 35, a network I / F 36, and a bus 37 connecting these. The answer candidate suggestion system 1 can be realized by a general information processing device such as a PC or a server computer.
[0033] The processor 31 reads data and programs stored in the secondary storage device 33 into the main storage device 32, and executes the processing defined by the programs.
[0034] The main memory device 32 includes a volatile memory element such as a RAM, and stores the programs executed by the processor 31 and data.
[0035] The secondary storage device 33 is a device having a non-volatile storage element such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores programs, data, etc. The secondary storage device 33 stores the above-mentioned question and answer database 21, interrogative word and request word list 22, personal information word list 23, supplementary word list 24, and item candidate word table 25.
[0036] In addition, an item candidate word group generation program 11a and an answer candidate sentence generation program 12a are installed in the sub-storage device 33. The item candidate word group generation unit 11 and the answer candidate sentence generation unit 12 described above with reference to Fig. 1 are realized by the processor 31 reading the item candidate word group generation program 11a and the answer candidate sentence generation program 12a stored in the sub-storage device 33 into the main storage device 32 and executing them.
[0037] The input device 34 is a device such as a keyboard or a mouse that accepts user operations and acquires information input by the user's operations. The output device 35 is a device such as a display that outputs information and presents information to the user by displaying it on a screen, for example.
[0038] The network I / F 36 is an interface for transmitting and receiving data to and from devices such as the user terminal 2, the operator terminal 3, and the web search engine 4 via the network NW. In other words, the network I / F 36 is a transmitting / receiving device capable of transmitting and receiving information to and from the user terminal 2, the operator terminal 3, and the web search engine 4 via the network NW. The answer candidate proposal system 1 can use the network I / F 36 to transmit and receive data to and from devices such as the user terminal 2, the operator terminal 3, and the web search engine 4 that are connected to the network NW.
[0039] The user terminal 2 and the operator terminal 3 can be configured using the same hardware resources as those of the answer candidate suggestion system 1.
[0040] <Various data structures> FIG. 3 is a diagram showing an example of the question and answer database 21. In the question and answer database 21 shown in FIG. 3, a question and answer ID 301 is an ID for identifying a past question sentence 302. An answer sentence 303 and a tfidf vector 304 (described in detail later) are associated with the past question sentence 302. In this manner, the question and answer database 21 stores the past question sentence 302 and the past answer sentence 303 to the past question sentence 302 in association with each other. The tfidf vector 304 may be generated for all past question sentences stored in the question and answer database 21 every time a new pair of a past question sentence and a past answer sentence is stored in the question and answer database 21. The tfidf vector 304 may also be regenerated at a preset timing, for example, every time a predetermined number of pairs of a past question sentence and a past answer sentence are stored in the question and answer database 21.
[0041] FIG. 4 is a diagram showing an example of the interrogative word request word list 22. In the interrogative word request word list 22 shown in FIG. 4, an interrogative word request word ID 401 is an ID for identifying an interrogative word request word 402. The interrogative word request word 402 is an interrogative word expressing a doubt or a request word expressing a request. In FIG. 4, "shouka" and "kudasai" are shown as examples of the interrogative word request word 402. Other examples of the interrogative word request word 402 include "suka", "noka", "nka", "nano", "dare", "nani", "what", "where", "when", "how many", "how much", "how", "why", "ika", "do", "who", "who", "who", "what", "which", "what", "what kind", "any", "want", "want", "want", "want", "want", "request", and "?".
[0042] FIG. 5 is a diagram showing an example of personal information word list 23. In personal information word list 23 shown in FIG. 5, personal information word ID 501 is an ID that identifies personal information word 502. Personal information word 502 is a plurality of personal information words that represent personal information. FIG. 5 shows, as examples of personal information word 502, "***-****" as a postal code and "***-****-****" as a telephone number. Other examples of personal information word 502 include "*******" as a postal code, "***********" as a telephone number, "card number," "date of birth," "email address," "personal name," and "address." Note that in the above, "*" represents a single numeric character.
[0043] FIG. 6 is a diagram showing an example of the supplementary word list 24. In the supplementary word list 24 shown in FIG. 6, a supplementary word ID 601 is an ID for identifying a supplementary word 602. A supplementary word 602 is a word that is considered to often have an important meaning with respect to the intent of a question included in a new question sentence. Furthermore, the supplementary word 602 is a word (morpheme) that is considered to often be calculated to have a low importance and is not extracted as an important word in "(A) An important word extraction method for calculating the importance of words included in a sentence and extracting important words included in the sentence" of the TF-IDF method described later. In FIG. 6, "not" is shown as an example of the supplementary word 602.
[0044] FIG. 7 is a diagram showing an example of the item candidate word table 25. In the item candidate word table 25 shown in FIG. 7, the item candidate word ID 701 is an ID for identifying the word 702. The item candidate word group 703 is associated with the word 702. The item candidate word table 25 is generated based on, for example, the past question texts stored in the question-answer database 21 as follows. First, for each of the past question texts stored in the question-answer database 21, a question desire text including at least one of the interrogative words and desire words stored in the interrogative word desire list 22 is extracted. Next, each of the extracted question desire texts is morphologically analyzed, and the verb included in the question desire text is set as the word 702 in the item candidate word table 25, and at least one noun included in the question desire text is set as the item candidate word group 703 and stored in the item candidate word table 25. In this way, the item candidate word group 703 in the item candidate word table 25 is generated based on the past question texts stored in the question-answer database 21.
[0045] <tf-idf method> The answer candidate proposal system 1 calculates the importance of the tf-idf method (term frequency-inverse document frequency method) and the cosine similarity in the process of generating an item candidate word group, a first answer candidate text, and a second answer candidate text based on a new question text. The importance is the importance of the words included in the text. On the other hand, the cosine similarity is the similarity between texts. Hereinafter, in the tf-idf method, an overview of (A) an important word extraction method for calculating the importance of the words included in a text and extracting important words included in the text, and (B) a similar document extraction method for calculating the cosine similarity between texts and extracting similar texts similar to the target text will be described below. In the calculation of the importance in (A) and the calculation of the cosine similarity in (B), a database (question-answer database 21 in this embodiment) in which a plurality of texts are stored is used.
[0046] In the important word extraction method for calculating the importance of the words included in a text and extracting important words included in the text in (A), the importance is calculated for all the words in the target text.
[0047] The importance of a word (referred to as the tfidf value) is the product of tf and idf. First, the sentence is subjected to morphological analysis to break the sentence down into morphemes (words). Then, tf is calculated. If the total number of words in the sentence is N, and the number of times the word for which importance is to be calculated appears in the sentence is n, then tf can be expressed, for example, as tf=n / N. tf represents the number of times a word appears in a sentence. In addition, with tf, the more times a word appears in a sentence, n, the more important it is considered to be.
[0048] Next, idf is calculated. The number of sentences stored in the database is D, and the number of sentences containing the word for which importance is to be calculated is d. idf is expressed, for example, as idf=-log(d / D). This can also be expressed as idf=log(D / d). The smaller the number of sentences d containing the word for which importance is to be calculated, the larger idf=log(D / d). idf indicates how few the number of sentences d containing the word for which importance is to be calculated is among all the sentences stored in the database. With idf, the smaller the number of sentences d containing the target word, the more important the word is considered to be.
[0049] The importance of a word is tfidf value = tf·idf = n / N·(-log(d / D)). Then, the tfidf value (importance) is calculated for every word in the text. Then, among the words with high tfidf values, a certain percentage (or a certain number) of the top words are determined to be important words.
[0050] (B) In a similar document extraction method that calculates the cosine similarity between sentences and extracts similar sentences to a target sentence, as described below, a tfidf vector is calculated between each sentence stored in a database and the target sentence, and the cosine similarity is calculated.
[0051] First, all sentences stored in the database and the target sentence are subjected to morphological analysis to break the sentences down into words (morphemes). Next, duplicated words are removed from the multiple words obtained by the break-down to generate word vectors with each word as a component. Next, tfidf vectors are calculated for each sentence stored in the database and the target sentence. A tfidf vector is a vector whose components are the tfidf values for the words that are components of the word vector.
[0052] As an example of a word vector and a tfidf vector, a word vector generated by morphological analysis of the sentence "Smartphones are light" is, for example, (smartphone, is, light,.). The corresponding tfidf vector is, for example, (tfidf value of "smartphone", tfidf value of "wa", tfidf value of "light", tfidf value of ".").
[0053] Next, calculate the cosine similarity (the cosine value of the angle between two tfidf vectors) between each tfidf vector of the sentence stored in the database and the tfidf vector of the target sentence. The cosine similarity of two tfidf vectors A and B is cosine similarity = A·B / (|A||B|). A sentence with a larger cosine similarity value with the target sentence (a sentence with higher cosine similarity) is considered to be more similar.
[0054] Then, among the sentences included in the database, a certain percentage (or a certain number) of sentences ranked from the top in terms of cosine similarity are determined to be similar sentences with high similarity. Here, instead of the cosine similarity, the inner product of the tfidf vector of a sentence stored in the database and the tfidf vector of the target sentence may be used.
[0055] The above explanation is an overview of the tf-idf method, and the algorithm of the tf-idf method when using the tf-idf method can be changed as appropriate from the method explained above. Also, instead of the "(B) similar document extraction method that calculates the cosine similarity between sentences and extracts similar sentences that are similar to the target sentence" of the tf-idf method, similar sentences may be extracted using other methods that calculate the similarity of sentences, such as the Doc2Vec method.
[0056] <Processing Procedure> Next, a processing procedure of the answer candidate suggestion system 1 will be described. A user operates the user terminal 2 to have the user terminal 2 access the answer candidate suggestion system 1. When the answer candidate suggestion system 1 is accessed from the user terminal 2, it starts an item candidate word group generation process executed by the item candidate word group generation unit 11. Below, the item candidate word group generation process will be described using FIG. 8 with reference to FIG. 9 and FIG. 10.
[0057] FIG. 8 is a flowchart showing an example of an item candidate word group generation process of the answer candidate suggestion system 1. As shown in FIG.
[0058] The answer candidate suggestion system 1 transmits new question text input screen information to the user terminal 2 (step S101). The new question text input screen information includes information on the configuration of the new question text input screen and information to display the new question text input screen on the user terminal 2. The new question text input screen is configured to be able to accept input of a new question text and input to transmit the input new question text to the answer candidate suggestion system 1.
[0059] FIG. 9 is an explanatory diagram showing an example of a new question sentence input screen displayed on the user terminal 2. The new question sentence input screen 900 shown in FIG. 9 includes a new question sentence input field 901 and an item selection button 902. The new question sentence input field 901 is a field in which the user inputs a new question sentence. The item selection button 902 is a button for inputting that the input new question sentence is to be transmitted to the answer candidate proposal system 1. When the user inputs a new question sentence in the new question sentence input field 901 and further presses the item selection button 902, the user terminal 2 transmits the new question sentence input in the new question sentence input field 901 to the answer candidate proposal system 1. In FIG. 9, a new question sentence is input in the new question sentence input field 901, saying, "I can't connect, so please help me. I, Hitachi Hanako, live in C-chome, B-city, A-prefecture, and discovered this when I was sitting in a chair at home reading a book." When the item selection button 902 is pressed, the input new question sentence is transmitted to the answer candidate proposal system 1.
[0060] Returning to FIG. 8, next, the answer candidate suggestion system 1 waits for a predetermined time (step S102).
[0061] Next, the answer candidate suggestion system 1 judges whether or not a new question sentence has been received from the user terminal 2 (step S103). If it is judged that a new question sentence has been received from the user terminal 2 (step S103: YES), the process proceeds to step S104, and if it is judged that a new question sentence has not been received from the user terminal 2 (step S103: NO), the process returns to step S102. Thus, the answer candidate suggestion system 1 waits for a new question sentence by repeating the processes of steps S102 and S103 until a new question sentence is received from the user terminal 2.
[0062] Next, the answer candidate proposal system 1 saves the new question text received from the user terminal 2 (step S104). Here, when the network I / F 36 (transmitting / receiving device) of the answer candidate proposal system 1 receives (inputs) the new question text from the user terminal 2, the processor 31 receives a notification that the new question text has been received from the network I / F 36, and stores the received new question text in the main memory device 32. In this manner, the new question text is input to the answer candidate proposal system 1.
[0063] Next, the answer candidate proposal system 1 calculates the cosine similarity by the tf-idf method using the question and answer database 21, extracts past question sentences similar to the new question sentence, and saves the extracted past question sentences similar to the new question sentence (step S105). Here, the answer candidate proposal system 1 uses the question and answer database 21 to calculate the cosine similarity by the tf-idf method described above with the question information for each past question sentence stored in the question and answer database 21. Then, a predetermined percentage (e.g., 20%) or a predetermined number (e.g., 3) of sentences with the highest cosine similarity are extracted from the past question sentences stored in the question and answer database 21, and saved as past question sentences similar to the new question sentence.
[0064] Next, the answer candidate proposal system 1 calculates the importance of the above-mentioned tf-idf method using the question and answer database 21, generates a group of high importance words from the past question sentence similar to the new question sentence extracted in step S105, and saves it (step S106). Here, the answer candidate proposal system 1 performs morphological analysis on the past question sentence similar to the new question sentence extracted in step S105 to generate multiple past question sentence morphemes. The past question sentence morphemes are morphemes (words) obtained by morphological analysis of the past question sentence similar to the new question sentence. Then, the answer candidate proposal system 1 calculates the importance of the above-mentioned tf-idf method for each of the multiple past question sentence morphemes using the question and answer database 21. Then, among the multiple past question sentence morphemes, nouns among a predetermined percentage (e.g., 20%) or a predetermined number (e.g., 10) of past question sentence morphemes ranked from the top in terms of importance by the tf-idf method are saved as a group of high importance words.
[0065] Next, the answer candidate suggestion system 1 sets a word group, excluding the words contained in the new question sentence from the high importance word group, as an item candidate word group and stores it (step S107). Here, the answer candidate suggestion system 1 performs morphological analysis on the new question sentence to generate new question sentence morphemes (words), and stores them. New question sentence morphemes are morphemes obtained by morphological analysis of the new question sentence. In addition, the new question sentence morphemes are set as "words contained in the new question sentence". Then, the high importance word group is set as an item candidate word group, excluding "words contained in the new question sentence" (new question sentence morphemes). Note that step S107 may be omitted, and the item importance word group may be set as the item candidate word group.
[0066] Next, the answer candidate suggestion system 1 outputs the item candidate word group and the item word group selection screen information to the network I / F 36 (transmitting / receiving device), causes the network I / F 36 to transmit the item candidate word group and the item word group selection screen information to the user terminal 2 via the network NW, and ends the process (step S108). The item word group selection screen information includes information on the configuration of the item word group selection screen and information to display the item word group selection screen on the user terminal 2. The item word group selection screen, which will be described later with reference to FIG. 10, is configured to be able to display the item candidate word group and to be able to accept input of an item word group selected from the item candidate word group and input to transmit the input item word group and new question sentence to the operator terminal 3.
[0067] Fig. 10 is an explanatory diagram showing an example of an item word group selection screen displayed on the user terminal 2. The item word group selection screen 1000 shown in Fig. 10 includes item word selection buttons 1001-1004 and an item word submission button 1005. The item word selection buttons 1001-1004 are buttons on which item candidate words are drawn. When the item word selection buttons 1001-1004 are pressed by a user, the type of line indicating the frame is switched. In the item word selection buttons 1001-1004, a frame drawn with a solid line indicates that the user has selected the item candidate word written in the item word selection button as an item word, and a frame drawn with a dashed line indicates that the user has not selected the item candidate word written in the item word selection button as an item word.
[0068] 10, the frames of the item word selection buttons 1001 and 1002 are solid lines, and the item word selection button 1001's "smartphone" and the item word selection button 1002's "radio waves" are selected as item words. The frames of the item word selection buttons 1003 and 1004 are dashed lines, and the item word selection button 1003's "code" and the item word selection button 1004's "electronic book" are not selected as item words.
[0069] The item word submission button 1005 is a button for inputting an instruction to transmit the input item word group to the answer candidate suggestion system 1. When the user presses the item word selection buttons 1001 to 1004 to select an item word and then presses the item word submission button 1005, the user terminal 2 transmits the item word (item word group) selected by the item word selection buttons 1001 to 1004, the new question sentence, and answer candidate generation selection screen information to the operator terminal 3.
[0070] The answer candidate generation selection screen information includes information on the configuration of the answer candidate generation selection screen and information on displaying the answer candidate generation selection screen on the operator terminal 3. The answer candidate generation selection screen, which will be described later with reference to Fig. 11, is configured to be able to display a new question sentence and a group of item words, and to be able to accept input of information on whether or not to cause the answer candidate proposal system 1 to generate an answer candidate sentence, and input of WEB search setting information, which is information on whether or not to collect second answer candidate sentences by a WEB search.
[0071] The user terminal 2 may transmit the item word group and the new question sentence to the answer candidate suggestion system 1, instead of transmitting the item word group, the new question sentence, and the answer candidate generation selection screen information to the operator terminal 3. Here, when the answer candidate suggestion system 1 receives the item word group and the new question sentence from the user terminal 2, it may appropriately set whether or not to acquire a second answer candidate sentence from the WEB (details will be described later), and execute an answer candidate sentence generation process, an example of which is shown in the flowchart of FIG.
[0072] 8, similarity (cosine similarity) between each past question sentence stored in the question and answer database 21 and the new question sentence is calculated, and past question sentences similar to the new question sentence are extracted based on the similarity with the new question sentence (step S105). Importance of each of a plurality of past question sentence morphemes generated from past question sentences similar to the extracted new question sentence is calculated, and past question sentence morphemes with high importance are extracted from the plurality of past question sentence morphemes to form an item candidate word group (steps S106 to S107). As a result, the item candidate word group becomes words (past question sentence morphemes) with high importance and relatively important meanings in past question sentences similar to the new question sentence.
[0073] Furthermore, the answer candidate sentences (first answer candidate sentence, second answer candidate sentence) are generated based on the item candidate words selected from the item candidate word group and the new question sentence. For this reason, it is desirable that the item candidate word group has an important meaning with respect to the question of the new question sentence. In contrast, as described above, the item candidate word group is words that have a relatively important meaning in past question sentences similar to the new question sentence. Therefore, the answer candidate suggestion system 1 can generate a more appropriate item candidate word group by generating the item candidate word group as described above.
[0074] Alternatively, instead of steps S105 to S107 in FIG. 8, an item candidate word group may be generated from a new question sentence using the item candidate word table 25 as follows. First, the answer candidate proposal system 1 extracts an interrogative request sentence including at least one interrogative word and request word stored in the interrogative word and request word list 22 from a sentence included in the new question sentence. Next, the answer candidate proposal system 1 performs morphological analysis on the extracted interrogative request sentence to obtain a plurality of words (morphemes) included in the interrogative request sentence. Next, the answer candidate proposal system 1 extracts verbs from a plurality of words included in the interrogative request sentence. Next, the answer candidate proposal system 1 refers to the item candidate word table 25 (see FIG. 7), extracts an item candidate word group corresponding to the extracted verb from the item candidate word table 25, and obtains an item candidate word group.
[0075] 7, the item candidate word group stored in the item candidate word table 25 is generated based on past question sentences stored in the question and answer database 21. Therefore, in the above-described method of generating an item candidate word group using the item candidate word table 25, the item candidate word group is also generated based on past question sentences and new question sentences stored in the question and answer database 21. This allows the answer candidate suggestion system 1 to generate a more appropriate item candidate word group.
[0076] FIG. 11 is an explanatory diagram showing an example of an answer candidate generation selection screen displayed on the operator terminal 3. The answer candidate generation selection screen 1100 shown in FIG. 11 includes a new question sentence display frame 1101, an item word group display frame 1102, a web search selection button 1103, a send button 1104, and an answer button 1105. The new question sentence display frame 1101 is a frame for displaying a new question sentence. The item word group display frame 1102 is a frame for displaying an item word group. When an operator who operates the operator terminal 3 presses (clicks, etc.) inside the new question sentence display frame 1101, the operator terminal 3 accepts an input from the operator and allows the operator to edit the new question sentence in the new question sentence display frame 1101. This allows the operator terminal 3 to transmit the new question sentence edited by the operator, such as correcting typos, to the answer candidate proposal system 1. As a result, the answer candidate proposal system 1 generates an answer candidate sentence by regarding the edited new question sentence as a new question sentence. This allows the answer candidate suggestion system 1 to generate a more suitable first answer candidate sentence.
[0077] The web search selection button 1103 is a button for inputting web search setting information, which is information on whether the answer candidate proposal system 1 collects second answer candidate sentences by web search. The web search selection button 1103 is filled in black as shown in Fig. 11 when the answer candidate proposal system 1 collects second answer candidate sentences by web search, and is filled in white when the answer candidate proposal system 1 does not collect second answer candidate sentences by web search. Here, whether it is filled in black or white is switched every time the operator presses the web search selection button 1103.
[0078] When the operator presses the send button 1104, the operator terminal 3 transmits to the answer candidate proposal system 1 the generation start information including the new question sentence in the new question sentence display frame 1101, the item word group, the WEB search setting information, and the answer candidate sentence generation start information which is information for instructing the answer candidate proposal system 1 to generate the answer candidate sentence. Here, the new question sentence included in the generation start information is the new question sentence in the new question sentence display frame 1101 at the time when the operator presses the send button 1104. Therefore, if the operator edits the new question sentence in the new question sentence display frame 1101 before pressing the send button 1104, the edited new question sentence is included in the start information as the new question sentence. As described above, when the operator edits the new question sentence in the new question sentence display frame 1101, the operator can add a modification such as an underline or a bold font to a part of the new question sentence (for example, a part that the operator thinks is important in the question), and further, the character information of the part modified by the operator may be included in the generation disclosure information as important character information. Then, as described later, the answer candidate suggestion system 1 may generate answer candidate sentences (first answer candidate sentence, second answer candidate sentence) by using the important character information.
[0079] The answer button 1105 is configured so that when pressed, the screen displayed on the operator terminal 3 is switched from the answer candidate generation and selection screen to a screen where the operator inputs an answer sentence to the new question sentence.
[0080] The answer candidate suggestion system 1 receives generation start information from the operator terminal 3 via the network I / F 36 (which causes a new question sentence included in the generation start information to be input, and further inputs a group of item words selected by the user from the group of item candidate words), and then starts the answer candidate sentence generation process executed by the answer candidate sentence generation unit 12.
[0081] FIG. 12 is a flowchart showing an example of an answer candidate sentence generation process of the answer candidate suggestion system 1. As shown in FIG.
[0082] The answer candidate suggestion system 1 saves the Web search setting information, the new question sentence, and the category word group, which are included in the generation start information received from the operator terminal 3 (step S201).
[0083] Next, the answer candidate suggestion system 1 uses the interrogative word request word list 22 to extract an interrogative request sentence from the new question sentence, and generates question information by adding the item word group to the extracted interrogative request sentence (step S202). Here, the answer candidate suggestion system 1 extracts an interrogative request sentence that includes at least one interrogative word or request word stored in the interrogative word request word list 22 from the new question sentence. Then, the answer candidate suggestion system 1 adds the item word group to the end or beginning of the extracted interrogative request sentence to generate question information. For example, if the interrogative request sentence is "I can't connect, so please help me." and the item word group is "smartphone" and "radio waves," the question information is, for example, "I can't connect, so please help me. Smartphone, radio waves" or "Smartphone, radio waves, I can't connect, so please help me." Note that, as described above, when the generation start information includes important character information, the interrogative request sentence, the item word group, and characters included in the important character information (parts that overlap with the interrogative request sentence may be deleted) may be added to generate question information. As a result, the operator can add the characters of the part of the new question sentence that has been modified by underlining, etc., to the question information. This allows the answer candidate suggestion system 1 to generate a more suitable first answer candidate sentence.
[0084] Next, the answer candidate suggestion system 1 uses the question and answer database 21 to calculate the cosine similarity by the tf-idf method, extracts past question sentences similar to the question information, and saves the past answer sentences associated with the extracted past question sentences as first answer candidate sentences (step S203). Here, the answer candidate suggestion system 1 uses the question and answer database 21 to calculate the cosine similarity by the tf-idf method described above with the question information for each past question sentence stored in the question and answer database 21. Also, among the past question sentences stored in the question and answer database 21, a predetermined percentage (e.g., 20%) or a predetermined number (e.g., 3) of past question sentences are extracted from the top in terms of cosine similarity. Then, past answer sentences associated with the extracted past question sentences are extracted from the question and answer database 21, and the extracted past answer sentences are saved as first answer candidate sentences.
[0085] Next, the answer candidate suggestion system 1 determines whether or not to collect second answer candidate sentences by web search based on the web search setting information saved in step S201 (step S204). If it is determined that second answer candidate sentences are to be collected by web search (step S204: YES), the process proceeds to step S205, and if it is determined that second answer candidate sentences are not to be collected by web search (step S204: NO), the process proceeds to step S208. Here, as described above, the web search information is information on whether or not to collect second answer candidate sentences by web search, and the answer candidate suggestion system 1 can determine whether or not to collect second answer candidate sentences by web search based on the web search information.
[0086] Next, the answer candidate suggestion system 1 performs morphological analysis on the question information to obtain multiple question information morphemes, calculates the importance of each question information morpheme in the TF-IDF method using the question and answer database 21, extracts multiple question information morphemes with high importance in the TF-IDF method from the multiple question information morphemes, and further, stores the question information morphemes obtained by excluding the personal information words stored in the personal information word list 23 as a search word group (step S205). Here, the question information morphemes are morphemes obtained by performing morphological analysis on the question information. The method of calculating the importance of the TF-IDF method has been described above. The multiple question information morphemes with high importance in the TF-IDF method are a predetermined percentage (e.g., 20%) or a predetermined number (e.g., 3) of question information morphemes that are ranked from the top in terms of importance among the question information morphemes.
[0087] In addition, in step S205, if a supplementary word (e.g., "not") stored in the supplementary word list 24 is present in the question information, the answer candidate suggestion system 1 may add the supplementary word in the question information to the search word group. This may result in a more desirable second answer candidate being obtained.
[0088] Furthermore, among the words (morphemes) included in the search word group, it is preferable that the words to be inflected are in a form that retains the inflected form (for example, "tsunagara" (connect), "tasuku" (help)), but they may also be in their basic form with the inflected form information removed (for example, "tsunagara" (connect), "tasuku" (help)).
[0089] Next, the answer candidate proposal system 1 transmits the search words to the web search engine, obtains search results related to the search words returned from the web search engine, and collects summaries of WEB sites included in the search results (step S206). Here, the answer candidate proposal system 1 (processor 31) outputs the search words to the network I / F 36 (transmission / reception device) together with a message indicating that the network I / F 36 (transmission / reception device) will transmit the search words to the web search engine 4 so that the network I / F 36 (transmission / reception device) transmits the search words to the web search engine. As a result, the network I / F 36 transmits the search words to the web search engine 4 via the network NW. The web search engine 4 that receives the search words returns the search results related to the search words to the answer candidate proposal system 1. The search results related to the search words include summaries of WEB sites related to the search words.
[0090] The answer candidate suggestion system 1 may store in advance at least one web page that describes a pair of a past question sentence and its answer sentence, and set the stored web page as a target web site to be searched by a web search engine in the process of step S206. This makes it easier to collect summary sentences of web sites, and therefore easier to collect second answer candidate sentences (described later).
[0091] Also, instead of using a web search engine in the process of step S206, a search device may be used that searches for pre-registered and stored data in a specific device (e.g., data pairs of past question sentences and their answers). Here, the search device may, for example, generate and store a summary similar to that of the website, and use this summary instead of the above-mentioned website summary. This makes it possible to collect summaries more efficiently, and thus to collect second answer candidate sentences (described later) more efficiently.
[0092] Next, the answer candidate suggestion system 1 ranks the summaries of the WEB sites obtained in step S206 using a predetermined ranking method, and saves a predetermined number (or a predetermined ratio) of the top ranked summaries of the WEB sites as second answer candidate sentences (step S207). Here, the ranking method may be, for example, the cosine similarity between each of the summaries of the WEB sites and the new question sentence by the tf-idf method. The ranking method may be ranking using the ranking model described in Patent Document 2, or other known techniques. Instead of ranking in step S207, the search summaries of the top search results ranked by the web search engine in step S206 may be set as the second answer candidate sentence. Furthermore, the second answer candidate sentence may include the URL of the WEB site. In this way, when reading the second answer candidate sentence, the operator of the operator terminal 3 can access the WEB site using the URL to obtain information about the summaries of the WEB sites included in the second answer candidate sentence.
[0093] Next, the answer candidate suggestion system 1 outputs the answer candidate sentence and the answer candidate sentence display screen information to the output device (network I / F 36), causes the output device (network I / F 36) to transmit the answer candidate sentence and the answer candidate sentence display screen information to the operator terminal 3, and ends the process (step S208). Here, the answer candidate sentence includes the first answer candidate sentence and the second answer candidate sentence. Needless to say, in the process of step S204, if it is determined that the second answer candidate sentence is not to be collected by the web search (step S204: NO), the answer candidate sentence will be only the first answer candidate sentence. In addition, the answer candidate sentence display screen information includes information on the configuration of the answer candidate sentence display screen and information to the effect that the answer candidate sentence display screen is to be displayed on the operator terminal 3. The answer candidate sentence display screen is configured to be able to display the answer candidate sentence.
[0094] Fig. 13 is an explanatory diagram showing an example of an answer candidate sentence display screen displayed on the operator terminal 3. The answer candidate sentence display screen 1300 shown in Fig. 13 includes a first frame 1301, first answer candidate sentence fields 1302 and 1303, a second frame 1304, and second answer candidate sentence fields 1305 and 1306. To the right of the first frame 1301, which is written as "Past Answer" indicating the first answer candidate sentence, the first answer candidate sentence fields 1302 and 1303 which display the first answer candidate sentence are shown. Similarly, to the right of the second frame 1304, which is written as "Web Search" indicating the second answer candidate sentence, the second answer candidate sentence fields 1305 and 1306 which display the second answer candidate sentence are shown.
[0095] By displaying the answer candidate sentences on the answer candidate sentence display screen on the operator terminal 3, the operator can generate an answer sentence to the new question sentence by referring to the displayed answer candidate sentences. This allows the operator to generate an answer sentence more easily. In addition, the energy required for the operator to generate the answer sentence and the amount of carbon dioxide emissions generated can be reduced, thereby suppressing global warming.
[0096] In this way, in the embodiment, the answer candidate suggestion system 1 generates answer candidate sentences (first answer candidate sentence and second answer candidate sentence) based not only on the new question sentence but also on a group of item words selected by the user from a group of item candidate words generated based on the new question sentence and the past question sentence stored in the question and answer database 21. In this way, the answer candidate suggestion system 1 can generate and output suitable answer candidate sentences that are more in line with the intent of the question of the new question sentence compared to the case where answer candidate sentences are generated based only on the new question sentence.
[0097] In addition, answer candidate sentences (first answer candidate sentences and second answer candidate sentences) are generated using past question sentences and past answer sentences stored in the question and answer database 21. This allows the answer candidate suggestion system 1 to generate answer candidate sentences more easily.
[0098] In addition, the answer candidate suggestion system 1 extracts a question / request sentence including at least one interrogative word and a request word from the new question sentence, and generates question information by adding a group of item words to the extracted question / request sentence (step S202 in FIG. 12). This allows the answer candidate suggestion system 1 to generate a first answer candidate sentence based on a question / request sentence that is highly related to the intent of the question, excluding parts of the new question sentence that are less related to the intent of the question. Therefore, the answer candidate suggestion system 1 can generate a suitable first answer candidate sentence that is more in line with the intent of the user's question.
[0099] 12, the similarity between each of the past question sentences stored in the question and answer database 21 and the question information, which is calculated by the answer candidate suggestion system 1, is the cosine similarity by the tf-idf method calculated using the question and answer database 21. This allows the answer candidate suggestion system 1 to easily calculate the similarity, and therefore to more easily generate the first answer candidate sentence.
[0100] In addition, the answer candidate suggestion system 1 outputs the answer candidate sentences (the first answer candidate sentence and the second answer candidate sentence) to the network I / F 36 (transmission / reception device), and causes the network I / F 36 (transmission / reception device) to transmit the answer candidate sentences to the operator terminal 3 via the network NW. This allows the operator operating the operator terminal 3 to easily read the answer candidate sentences (the first answer candidate sentence and the second answer candidate sentence).
[0101] In addition, the answer candidate suggestion system 1 transmits the search words to the web search engine 4, and generates the second answer candidate sentence based on the search results related to the search words returned from the web search engine 4. This allows the answer candidate suggestion system 1 to more easily generate the second answer candidate sentence.
[0102] In addition, the answer candidate suggestion system 1 extracts a question request sentence from the new question sentence, generates question information by adding a group of item words to the question request sentence (step S202 in FIG. 12), and generates a search word group from a plurality of question information morphemes (morphemes of question information) of the question information based on the importance of the tf-idf method (step S205 in FIG. 12). As a result, the answer candidate suggestion system 1 can generate a search word group based on the question request sentence that is highly related to the intention of the question, excluding parts that are less related to the intention of the question from the new question sentence, and can generate a more appropriate second answer candidate sentence. In addition, the search word group is generated based on the importance of the tf-idf method, so that a search word group that is more in line with the intention of the question can be generated. Therefore, the answer candidate suggestion system 1 can generate a suitable second answer candidate sentence that is more in line with the intention of the user's question.
[0103] Furthermore, the answer candidate suggestion system 1 generates a search word group from multiple question information morphemes (question information morphemes) with high importance in the TF-IDF method, excluding personal information words stored in the personal information word list (step S205 in FIG. 12). The search word group is transmitted to the web search engine 4, which transmits search results searched for using the search word group to the answer candidate suggestion system 1. Since personal information words related to the user's privacy are excluded from the search word group, the answer candidate suggestion system 1 can obtain search results while protecting the user's privacy, and can generate a second answer candidate sentence while protecting the user's privacy.
[0104] In addition, the answer candidate suggestion system 1 generates second answer candidate sentences based on the summaries of the WEB sites included in the search results related to the search word group (steps S206 and S207 in FIG. 12). This adjusts the length of the second answer candidate sentences to a degree that makes it easy to understand the contents of the second answer candidate sentences. Therefore, it becomes easy for the operator to understand the contents of the second answer candidate sentences.
[0105] In addition, the answer candidate suggestion system 1 ranks the summaries of the WEB sites using a predetermined ranking method, and sets the summaries of the WEB sites with higher rankings as the second answer candidate sentences (step S207 in FIG. 12). This allows the answer candidate suggestion system 1 to generate more appropriate second answer candidate sentences.
[0106] Furthermore, the answer candidate suggestion system 1 calculates the similarity (cosine similarity) between each past question sentence stored in the question and answer database 21 and the new question sentence, and extracts past question sentences similar to the new question sentence (step S105 in FIG. 8). The importance of each of the past question sentence morphemes generated from the past question sentences similar to the extracted new question sentence is calculated, and past question sentence morphemes with high importance are extracted and set as an item candidate word group (steps S106 to S107 in FIG. 8). As a result, the item candidate word group becomes words (past question sentence morphemes) with high importance and relatively important meanings in past question sentences similar to the new question sentence. Furthermore, since the item candidate word group is used to generate answer candidate sentences (first answer candidate sentence, second answer candidate sentence), it is preferable that the item candidate word group is words with important meanings to the question of the new question sentence. Therefore, the answer candidate suggestion system 1 can generate a more appropriate item candidate word group.
[0107] In addition, in the item candidate word group generation process, an example of which is shown in the flowchart of Fig. 8, the similarity between a new question sentence and each of the past question sentences stored in the question and answer database 21 is the cosine similarity by the tf-idf method calculated using the question and answer database 21 (step S105 in Fig. 8). Also, the importance of each of the multiple past question sentence morphemes is the importance by the tf-idf method calculated using the question and answer database 21 (step S106 in Fig. 8). In this way, by using the cosine similarity and importance by the tf-idf method, the answer candidate suggestion system 1 can generate item candidate words more easily.
[0108] The present invention is not limited to the above-described embodiment, but includes various modifications and equivalent configurations within the spirit of the appended claims. For example, the above-described embodiment has been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to having all of the described configurations. In addition, other configurations may be added, deleted, or replaced with part of the configuration of the embodiment. [Explanation of symbols]
[0109] 1: Answer candidate suggestion system 2: User terminal 3: Operator terminal 4: Web search engines 11: Item candidate word group generation unit 11a: Program for generating candidate word groups 12: Answer candidate sentence generation section 12a: Program for generating answer candidates 21: Question and Answer Database 22: List of interrogative words 23:Personal Information Word List 24: Supplementary word list 25: Item candidate word table 31: Processor 32: Main memory 33: Secondary storage device 34: Input device 35: Output device 36: Network I / F 37: Bus
Claims
1. An answer candidate suggestion system that generates answer candidate sentences that are candidates for answer sentences to a new question sentence, A processor and a storage device, The storage device includes: storing a question and answer database that stores past question sentences and past answer sentences to the past question sentences in association with each other; The processor, When the new question text is input, calculating a similarity between the new question sentence and each of the past question sentences stored in the question and answer database; extracting the past question sentences similar to the new question sentence based on the calculated similarity with the new question sentence; performing morphological analysis on the extracted past question sentences to generate a plurality of past question sentence morphemes; Calculate the importance of each of the multiple past question sentence morphemes, extracting the past question sentence morphemes having high importance from the plurality of past question sentence morphemes, and setting the extracted morphemes as a group of candidate words for an item; When the item word group selected by the user from the item candidate word group and the new question sentence are input, generating question information including the item word group based on the item word group and the new question sentence; calculating a similarity between the question information and each of the past question sentences stored in the question and answer database; extracting past question sentences similar to the question information from the question and answer database based on the similarity with the question information; extracting from the question and answer database a past answer sentence associated with a past question sentence similar to the extracted question information, and setting the extracted answer sentence as a first answer candidate sentence; Answer candidate suggestion system.
2. The answer candidate suggestion system according to claim 1, The storage device further stores an interrogative word and a request word list for storing interrogative words expressing doubt and request words expressing requests, The processor, extracting an interrogative sentence including at least one of the interrogative words and the desired words stored in the interrogative word desired word list from the new question sentence; generating the question information by adding the item word group to the extracted question / request sentence; Answer candidate suggestion system.
3. The answer candidate suggestion system according to claim 1, The similarity to the question information is a cosine similarity calculated by a tf-idf method using the question and answer database. Answer candidate suggestion system.
4. The answer candidate suggestion system according to claim 1, Further, a transmitting / receiving device is provided which is connected to the network and capable of transmitting and receiving information via the network, The processor outputs the first answer candidate sentence to the transmitting / receiving device. Answer candidate suggestion system.
5. The answer candidate suggestion system according to claim 1, Further, a transmitting / receiving device is connected to a network connected to a web search engine that, upon receiving at least one word, returns search results including information on a web site related to the received word, and is capable of transmitting and receiving information to and from the web search engine via the network, The storage device further stores an interrogative word and a request word list for storing interrogative words expressing doubt and request words expressing requests, The processor, Extracting an interrogative sentence including at least one of the interrogative words or the desired words stored in the interrogative word desired word list from the new question sentence; generating the question information by adding the item word group to the question request sentence; morphologically analyzing the question information to generate a plurality of question information morphemes; calculating a TF-IDF importance for each of the plurality of question information morphemes using a question and answer database; generating a search word group from the plurality of question information morphemes based on the importance of each of the plurality of question information morphemes in the TF-IDF method; outputting the generated search word group to the transmitting / receiving device so that the transmitting / receiving device transmits the generated search word group to the web search engine; obtaining a search result relating to the group of search words received by the transmitting / receiving device from the web search engine; The answer candidate suggestion system generates a second answer candidate sentence based on the search results related to the acquired group of search words.
6. The answer candidate suggestion system according to claim 5, The storage device further stores a personal information word list storing a plurality of personal information words representing personal information; The processor, extracting a plurality of question information morphemes having a high importance in the TF-IDF method from the plurality of question information morphemes, and generating the search word group by excluding at least one of the personal information words stored in the personal information word list; Answer candidate suggestion system.
7. The answer candidate suggestion system according to claim 5, the search results returned by the web search engine include a summary of the web site; The processor generates a second answer candidate sentence based on an outline of a website included in a search result related to the group of search words. Answer candidate suggestion system.
8. The answer candidate suggestion system according to claim 7, the processor ranks abstracts of the websites included in the search results related to the search word group using a predetermined ranking method, and sets the abstracts of the websites ranked higher as second answer candidate sentences. Answer candidate suggestion system.
9. The answer candidate suggestion system according to claim 1, the similarity with the new question sentence is a cosine similarity calculated by the tf-idf method using the question and answer database, the importance of each of the plurality of past question sentence morphemes is an importance calculated by a TF-IDF method using the question and answer database; Answer candidate suggestion system.
10. An answer candidate suggestion method in an answer candidate suggestion system that generates answer candidate sentences that are candidates for answer sentences to a new question sentence, comprising: The answer candidate suggestion system includes a processor and a storage device, The storage device includes: storing a question and answer database that stores past question sentences and past answer sentences to the past question sentences in association with each other; The processor, When the new question text is input, calculating a similarity between the new question sentence and each of the past question sentences stored in the question and answer database; extracting the past question sentences similar to the new question sentence based on the calculated similarity with the new question sentence; performing morphological analysis on the extracted past question sentences to generate a plurality of past question sentence morphemes; Calculate the importance of each of the multiple past question sentence morphemes, extracting the past question sentence morphemes having high importance from the plurality of past question sentence morphemes, and setting the extracted morphemes as a group of candidate words for an item; When the item word group selected by the user from the item candidate word group and the new question sentence are input, generating question information including the item word group based on the item word group and the new question sentence; calculating a similarity between the question information and each of the past question sentences stored in the question and answer database; extracting past question sentences similar to the question information from the question and answer database based on the similarity with the question information; extracting from the question and answer database a past answer sentence associated with a past question sentence similar to the extracted question information, and setting the extracted answer sentence as a first answer candidate sentence; Answer candidate suggestion method.
Citation Information
Patent Citations
Method and system for replying inquiry by the internet using agent
JP2004102494A
Question answering device, model learning device, method and program
JP2013254420A
Inquiry responding support apparatus and inquiry responding support system
JP2018181033A
Interactive server, interactive method and interactive program
JP2019219737A
Question-answering system and program
JP2021144397A