Conversation support method using computer

Abstract

To provide a conversation support method, device, and program for evaluating a conversation in real time.SOLUTION: Provided is a conversation support method using a computer, in which the computer executes: a voice analysis step for analyzing a voice concerning a conversation and obtaining a voice word which is a word included in the conversation; a word group analysis step for analyzing which of a plurality of term groups the voice word corresponds to, the term groups including either or both of words and phrases; and an utterance evaluation step for evaluating an utterance based on the term groups analyzed in the word group analysis step. The utterance evaluation step evaluates an utterance concerning the conversation each time the utterance is input to the computer, and furthermore, obtains an evaluation point up to a time point when the utterance is made in the conversation.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a conversation support method using a computer. [Background technology]

[0002] Japanese Patent No. 6739811 describes a presentation support device that draws attention to prohibited words. This device outputs keywords related to prohibited words and an alert. This device also adds up evaluation points for the keywords, related words, and prohibited words included in the presentation to obtain an evaluation point for the entire presentation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6739811 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned device is excellent for evaluating presentations. However, the device evaluates the entire presentation, and does not evaluate the conversation in real time. Therefore, an object of the present invention is to provide a conversation support method that can evaluate the conversation in real time. [Means for solving the problem]

[0005] The first invention of this specification relates to a conversation support method using a computer. This method includes a speech analysis step, a word group analysis step, and a utterance evaluation step. The speech analysis step is a step in which a computer analyzes speech related to a conversation to obtain spoken words that are words included in the conversation. The word group analysis step is a step in which the computer analyzes the spoken words to determine which of a plurality of term groups the spoken words belong to. The term groups include either words or phrases, or both. The utterance evaluation step is a step in which the computer evaluates the utterance each time a utterance related to the conversation is input, based on the term groups analyzed in the word group analysis step. This step may evaluate the utterance each time a utterance related to the conversation is input to the computer, and may also obtain an evaluation score up to the point in time when the utterance was made in the conversation.

[0006] The plurality of groups of terms may include, for example, one or more of a group of terms related to greetings, a group of terms related to objections, a group of terms related to explanations, a group of terms related to questions, a group of terms related to excuses, a group of terms related to agreements, a group of terms related to promises, and a group of terms related to affirmations.

[0007] Preferably, the above method further includes a recommended term group display step in which the computer uses the term group analyzed in the word group analysis step to display a recommended term group, which is a term group that is desirable to use next.

[0008] The method further includes inputting a scheduled time for the conversation into the computer; Preferably, the recommended term group display step further uses the estimated time of the conversation to display the recommended term group.

[0009] Preferably, the above method further comprises an image display step for displaying an image relating to the term group analyzed in the word group analyzing step by the computer.

[0010] The next invention of this specification relates to a program and a computer-readable information recording medium storing the program, which causes a computer to implement each of the above-mentioned methods. [Effects of the Invention]

[0011] According to the present invention, it is possible to provide a conversation support method that can evaluate a conversation in real time. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a flowchart illustrating a conversation support method using a computer. [Figure 2] FIG. 2 is a block diagram of a conversation support device for implementing the conversation support method. [Figure 3] FIG. 3 is a conceptual diagram showing an example of voice analysis. [Figure 4] FIG. 4 is a table in place of a drawing showing examples of term groups. [Figure 5] FIG. 5 is a conceptual diagram showing an example of analyzing a group of words. [Figure 6] FIG. 6 is a conceptual diagram showing an example of the evaluation of a comment. [Figure 7] FIG. 7 is a conceptual diagram showing an example of evaluating statements and conversations in real time. [Figure 8] FIG. 8 is a conceptual diagram showing an example of a recommended term group. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The present invention is not limited to the embodiments described below, but also includes appropriate modifications of the embodiments below within the scope obvious to those skilled in the art.

[0014] A conversation support method using a computer will now be described. Fig. 1 is a flowchart for explaining the conversation support method using a computer. This method includes a speech analysis step (S101), a word group analysis step (S102), and a utterance evaluation step (S103). As shown in Fig. 1, this method may further include either or both of a recommended term group display step (S104) and an image display step (S105).

[0015] FIG. 2 is a block diagram of a conversation support device for implementing the conversation support method. As shown in FIG. 2, the device 1 includes a speech analysis unit 3, a word group analysis unit 5, and a utterance evaluation unit 7. As shown in FIG. 2, the device 1 may further include one or both of a recommended term group display unit 9 and an image display unit 11. The conversation support device is a computer-based system, and each unit is basically an element for implementing each of the above-mentioned processes. For example, the speech analysis unit 3 is an element for analyzing speech related to a conversation and obtaining spoken words, which are words contained in the conversation. The word group analysis unit 5 is an element for analyzing spoken words to determine which of multiple term groups the spoken words belong to. The utterance evaluation unit 7 is an element for evaluating each utterance related to a conversation based on the analyzed term groups. The recommended term group display unit 9 is an element for displaying a recommended term group, which is a term group that is recommended to be used next, using the term group analyzed in the word group analysis step. The image display unit 11 is an element for displaying images related to the term group.

[0016] A computer has an input unit, an output unit, a control unit, a calculation unit, and a memory unit, and each element is connected by a bus or the like so as to be able to exchange information. For example, a control program may be stored in the memory unit, or various information may be stored. When predetermined information is input from the input unit, the control unit reads out the control program stored in the memory unit. Then, the control unit reads out the information stored in the memory unit as appropriate and transmits it to the calculation unit. The control unit also transmits the input information to the calculation unit as appropriate. The calculation unit performs calculation processing using the various received information and stores it in the memory unit. The control unit reads out the calculation results stored in the memory unit and outputs them from the output unit. In this way, various processing and steps are performed. The various processing is performed by each unit and each means.

[0017] The device of the present invention may include a terminal connected to a network such as the Internet or an intranet, and a server connected to the network. Of course, a single computer or mobile terminal may function as the device of the present invention, or multiple servers may exist.

[0018] Voice analysis process (S101) The voice analysis process is a process in which a computer analyzes voice related to a conversation and obtains voice words, which are words contained in the conversation. The conversation may be between people talking to each other, a speaker explaining to an audience or giving a presentation, a salesperson and a customer, or a telephone conversation between a person answering the phone and asking a question or inquiry. The voice is usually a human voice. However, voice may also include computer-generated pseudo-voice. FIG. 3 is a conceptual diagram showing an example of speech analysis. In the example shown in FIG. 3, a conversation between an MR and a doctor (Dr. A) is input to the device. This device may be a device connected to the MR's terminal and the doctor's terminal, or may be one of the terminals. Speech related to the conversation may be input to each terminal through a microphone on the MR's terminal and a microphone on the doctor's terminal, and the speech related to the conversation may be input to the device through each terminal. Alternatively, the microphone on the device may directly input speech related to the conversation between the MR and the doctor (Dr. A) into the device. The control unit of the device reads out speech as appropriate from the memory unit and causes the calculation unit to analyze the speech input. In this way, the device obtains words (speech words) included in the conversation. Such speech analysis devices are known. The device may store the obtained speech words in the memory unit.

[0019] An example of analysis of the spoken words shown in FIG. 3 is as follows: MR: Thank you for your continued support, Professor. Today, I'm here to introduce the newly released DPP4 inhibitor, Aipro Tablets. Doctor: (But) there are so many, why are they being released again? I don't plan on using any of the newer DPP4 inhibitors. MR: Doctor, it is true that several DPP4 inhibitors have already been released. Our Aipro tablets have some advantages over other drugs. Which DPP4 inhibitor are you currently using? Doctor: There are many options, so I use different ones depending on the patient's lifestyle. Recently, I've been prescribing Putin tablets more often because they have a strong effect after just one dose.

[0020] Word group analysis process (S102) The word group analysis step is a step in which a computer analyzes a spoken word to determine which of a plurality of term groups the spoken word belongs to. The term groups include either words or phrases, or both. The storage unit of the device stores the words and phrases included in each term group. The control unit of the device causes the calculation unit to perform a calculation to match the spoken word with the words and phrases included in each term group. In this way, it is analyzed to determine which term group the spoken word belongs to. The analysis result may be stored in the storage unit.

[0021] FIG. 4 is a table, instead of a drawing, showing examples of term groups. A term group may be a combination of words or phrases grouped into various elements. A term group may also be one or more of must-speak terms, keywords, and prohibited terms (NG terms). The multiple term groups may be divided into term groups whose presence is favorable and term groups whose presence is unfavorable. The multiple term groups may include, for example, one or more of the following: a greeting term group, a counterargument term group, an explanation term group, a question term group, an excuse term group, an agreement term group, a promise term group, and a commitment term group. These term groups do not need to be stored in a computer as a "greeting term group," for example.

[0022] FIG. 5 is a conceptual diagram showing an example of analyzing a word group. As shown in FIG. 5, for example, the phrase "Thank you for your continued support" is included in the term group "greetings." Therefore, when an MR utters "Thank you for your continued support, teacher," this utterance is analyzed as a "greeting." Then, the fact that a "greeting" was used in this conversation is stored in the memory unit. Next, the doctor says, "(But) there are plenty already, and yet another one has been released? I don't intend to use any new DPP4 inhibitors." The combination of the words "but" and "I don't intend to" contained in the doctor's statement is analyzed as a "rebuttal." The memory then stores in memory the fact that this conversation was preceded by the "greeting" mentioned above and followed by a "rebuttal."

[0023] Comment evaluation process (S103) The utterance evaluation step is a step in which the computer evaluates a utterance related to a conversation each time it is input, based on the term groups analyzed in the word group analysis step. This step may be a step in which the computer evaluates the utterance each time a utterance related to a conversation is input to the computer, and also obtains an evaluation score up to the point in time at which the utterance was made in the conversation. For example, an evaluation score is assigned to each term group in the storage unit. The control unit of the device may then read out the evaluation score stored in association with the term group from the storage unit and evaluate the utterance. Note that the device may also simultaneously evaluate the entire conversation, which is a collection of utterances. Furthermore, the storage unit may store evaluation scores in association with the relationship between the term groups of one utterance and the term groups of another utterance.

[0024] For example, the memory unit stores 0 points for the term group: "greetings." The memory unit also stores -1 point for the term group: "counterargument" in one utterance that follows the term group: "greetings" in the other utterance. The memory unit may store +1 point for the term group: "counterargument" in the other utterance that follows the term group: "counterargument" in one utterance. The device may analyze terms included in conversational text to determine coefficients. In this case, for example, if a term related to coefficient 3 (DDP4 inhibitor) is included in the conversation after the first "counterargument," processing may be performed to add 3 points to the term group: "counterargument" in the next other utterance, calculated as 3 × (+1). In this case, the device stores point-adding terms and point-adding coefficients, analyzes conversational text, and when it is determined that a point-adding term is included, temporarily stores the point-adding coefficient, and multiplies this point-adding coefficient by the evaluation score when evaluating the utterance. For example, the point-adding terms and point-adding coefficients may be stored in a memory unit in association with a document (e.g., a presentation document), and when a conversation about the document takes place, the point-adding terms and point-adding coefficients related to the document may be read out as appropriate.

[0025] FIG. 6 is a conceptual diagram showing an example of the evaluation of a comment. MR: Thank you for your continued support, Professor. "Today, I'm here to introduce the newly released DPP4 inhibitor, Aipro tablets." The device stores the term "greetings" in relation to this statement. Therefore, the device's control unit reads out the evaluation score of 0 associated with the term "greetings" from the memory unit. This statement is then evaluated as 0 points.

[0026] Next, the doctor Doctor: (But) there are so many, why are they being released again? "I don't plan on using any more new DPP4 inhibitors," he said. In relation to this utterance, the term group: "counterargument" is stored in the device. Then, the control unit of the device reads out from the memory unit the evaluation score of -1 point associated with the term group: "counterargument" of the utterance that follows the term group: "greeting" of one utterance. In this way, the utterances are evaluated in real time.

[0027] The device also stores the evaluation values ​​included in the conversation up to this utterance. Then, the device performs a calculation to add up the evaluation values ​​for this utterance. In this way, the device can obtain evaluation points up to the point at which a certain utterance is made in the conversation. The obtained evaluation points for the conversation up to the point at which a certain utterance is made may then be stored in a storage unit as appropriate and output.

[0028] Figure 7 is a conceptual diagram showing an example of evaluating statements and conversations in real time. As shown in Figure 7, in this example, each time a statement is made, the statement and the conversation leading up to that statement are evaluated, and the evaluation content, such as ↑↑↓↓, is displayed in real time on the display unit of the terminal of the explainer, speaker, or presenter.

[0029] Preferably, the above method further includes a recommended term group display step in which the computer uses the term groups analyzed in the word group analysis step to display a recommended term group, which is a term group that is desirable to use next. The device stores a term group that is desirable to be uttered after a certain term group, or a third term group that is desirable to be uttered next when a second term group comes after a first term group. The device then analyzes the utterance and reads out a term group that is desirable to be uttered next from the storage unit using information about the utterance, the previous utterance, and the term group to which the previous utterance belongs. The device then outputs the terms included in the read term group that is desirable to be uttered next. The terms are then displayed on an output unit (e.g., a monitor) of the speaker's terminal. In this way, the device can support the speaker in conversation.

[0030] 8 is a conceptual diagram showing an example of recommended term groups. For example, when a term group A1 is used after a certain term group, the term groups B1, B2, and B3 (or terms selected from or included in these term groups) may be displayed as recommended term groups on the speaker's output unit, or the term groups B1 and C1 may be displayed as the best recommended term groups.

[0031] The above method may further include a step of inputting a planned duration of the conversation into the computer. Preferably, the recommended term group display step further uses the planned duration of the conversation to display the recommended term group. The planned duration of the conversation may be the start time of the conversation or the end time of the conversation, or the duration of the conversation (for example, within one hour). Preferably, the device has a clock unit that measures time and hours. The storage unit divides the conversation into conversation time regions such as an early stage, a middle stage, and a final stage. The storage unit then assigns identification information corresponding to the conversation time region to the terms included in the term group and stores them. Then, when reading out terms included in the term group, the device can read out and output terms corresponding to the conversation time region of the conversation. For example, when a predetermined time has passed or when the conversation is nearing its end, a memory unit stores a group of recommended words for ending a conversation, and the words can be read out and displayed as appropriate. This allows a lecture or presentation to be completed within the predetermined time. Examples of words for ending a conversation are "to sum up" and "to briefly explain the rest."

[0032] Preferably, the above method further includes an image display step in which the computer displays an image related to the term group analyzed in the word group analysis step. An example of an image related to the term group is an evaluation score related to the term group or an arrow symbol (e.g., ↑↓) representing the evaluation score. The memory unit stores images related to these term groups. The device then identifies a term group related to expression. The device then reads out an image related to the term group from the memory unit using information related to the identified term group. The device then outputs the read out image. For example, if the image is related to an evaluation score, the user can instantly know whether their own comment was positive or negative.

[0033] The next invention of this specification relates to a program or a computer-readable information recording medium storing the program. This program is a program for causing a computer to implement each of the above-mentioned methods. For example, this program causes a computer to analyze speech related to a conversation, obtain spoken words that are words included in the conversation, analyze the spoken words to determine which of multiple term groups the spoken words belong to, and evaluate each input utterance related to the conversation based on the analyzed term group. [Industrial Applicability]

[0034] The present invention can be used in the information industry. [Explanation of symbols]

[0035] 1. Conversation support device 3. Audio analysis section 5. Word Group Analysis 7. Speech Evaluation Section 9 Recommended term group display section 11 Image display section

Claims

1. A computer-assisted conversation support method, comprising: a step of inputting a scheduled time for the conversation into said computer; the computer dividing the conversation into conversation time regions; a step of reading and outputting terms corresponding to the conversation time domain of the conversation from a storage unit by the computer; Including, the conversation time region includes a conversation end; The term output by the computer at the end of the conversation includes a conversation ending term, which is a term for ending the conversation. method.

2. 10. The method of claim 1, a speech analysis step in which the computer analyzes speech related to a conversation to obtain speech words that are words included in the conversation; a word group analysis step in which the computer analyzes the spoken words to determine which of a plurality of term groups the spoken words belong to, the term groups including either words or phrases, or both; The computer, based on the term group analyzed in the word group analysis step, a statement evaluation step of evaluating a statement related to the conversation each time the statement is input to the computer; The method further comprises:

3. A conversation support device 1, a conversation scheduled time input unit for inputting a scheduled conversation time; a conversation time segmentation unit for segmenting the conversation into conversation time regions; a term output unit for reading out a term corresponding to a conversation time region of the conversation from a storage unit and outputting the term; Including, the conversation time region includes a conversation end; The term corresponding to the conversation time domain of the conversation at the end of the conversation includes a conversation end term that is a term for ending the conversation. Conversation support device.

4. inputting into a computer a planned duration of the conversation; the computer dividing the conversation into conversation time regions; a step of reading and outputting terms corresponding to the conversation time domain of the conversation from a storage unit by the computer; Including, the conversation time region includes a conversation end; The term output by the computer at the end of the conversation includes a conversation ending term, which is a term for ending the conversation. A program for implementing the conversation support method in the computer.

5. 5. A computer-readable information recording medium storing the program according to claim 4.

Images