Computer systems, methods, and programs for improving how individuals interact in two-person communication.

Abstract

To improve the quality of two-way communication, we provide computer systems, methods, and programs to support two-way communication. [Solution] A computer system for supporting communication between two parties is configured to receive information indicating the response that the first person of the two parties expects from the second person of the two parties in the communication, receive audio and / or video during the communication, derive advice for the communication based on the information and the audio and / or video, and provide the derived advice during the communication.

Description

Technical Field

[0001] The present invention relates to a computer system, method, and program for assisting communication, and more particularly, to a computer system, method, and program for assisting communication between two parties (between a first person and a second person).

Background Art

[0002] In an organization, interviews between subordinates and superiors are often conducted. This is done for purposes such as setting goals for subordinates, progress management, and result reporting. A system for assisting such interviews is known (Patent Document 1).

[0003] Among such interviews, there is an interview called a "1on1 meeting" (or "1on1") in which a superior and a subordinate conduct a one-on-one interview. The purpose of "1on1" is to promote the growth of the subordinate by allowing the subordinate to take the initiative in interacting with the superior.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The inventor of the present invention considered that if one of the two parties can be prompted to have an appropriate way of interacting with the other party in the communication between the two parties, including "1on1", the quality of the communication between the two parties should be improved.

[0006] An object of the present invention is to provide a computer system, method, and program for assisting communication between two parties in order to improve the quality of communication between the two parties. [Means for solving the problem]

[0007] The present invention provides, for example, the following items: (Item 1) A computer system for supporting communication between two parties, A first receiving means for receiving information indicating the response that the first of the two persons expects from the second of the two persons in the communication, A second receiving means for receiving audio and / or video during the aforementioned communication, A derivation means for deriving advice in the communication based on the aforementioned information and the aforementioned audio and / or video, A means for providing the derived advice during the communication. A computer system equipped with the following features. (Item 2) The computer system according to item 1, wherein the derivation means derives the advice associated with at least one criterion when the audio and / or video satisfy at least one criterion associated with the expected response. (Item 3) The computer system according to item 2, further comprising a means for modifying the at least one criterion based on the results of the aforementioned communication. (Item 4) The aforementioned modification means is, (i) If advice is not provided during the communication, modify the at least one criterion to relax the at least one criterion, (ii) If advice was given during the communication but the evaluation of the communication was low, modify the at least one criterion to strengthen the at least one criterion. The computer system described in item 3. (Item 5) The second receiving means receives at least the sound, The derivation means extracts the voice characteristics of the first person and / or the second person from the voice, At a minimum, the advice is derived based on the input and the characteristics of the voice. A computer system as described in any one of items 1 through 4. (Item 6) The computer system according to item 5, wherein the characteristics of the voice of the first person include at least one of the pitch of the voice when the first person utters a predetermined phrase, the speed of the voice when the first person utters a predetermined phrase, the volume of the voice when the first person utters a predetermined phrase, and the number of times the first person utters a predetermined phrase. (Item 7) The voice characteristics of the second person include the words contained in the utterances of the second person, as described in item 5 or 6 of the computer system. (Item 8) A computer system according to any one of items 5 to 7, wherein the vocal characteristics of the first person and the second person include the ratio of the speech duration of the first person to the speech duration of the second person. (Item 9) The second receiving means receives at least the video, The derivation means is, From the aforementioned video, the characteristics of the movements of the first person and / or the second person are extracted. A computer system according to any one of items 1 to 8, which derives the advice based on at least the input and the characteristics of the motion. (Item 10) The computer system according to item 9, wherein the aforementioned movement includes at least one of facial movement, arm movement, and head movement. (Item 11) The computer system according to item 9, wherein the characteristics of the movement include at least one of the following: size of nod, speed of nod, frequency of nod, frown lines, and facial expression. (Item 12) The providing means displays the advice on the video displayed to the first person and / or the second person during the communication, the computer system according to any one of items 1 to 11. (Item 13) The advice is provided to the second person, The advice includes what the second person should pay attention to in the communication, the computer system according to any one of items 1 to 12. (Item 14) The first person is a member in an organization, and the second person is the supervisor of the member, the computer system according to any one of items 1 to 13. (Item 15) A method for assisting communication between two parties, Receiving an input indicating a response expected by the first person of the two parties from the second person of the two parties in the communication, Receiving the voice and / or video during the communication, Deriving advice in the communication based on the input and the voice and / or the video, Providing the derived advice during the communication and including the method. (Item 15A) The method according to item 15, having one or more features described in the above items. (Item 16) A program for assisting communication between two parties, the program is executed in a computer system including a processor unit, and the program receives an input indicating a response expected by the first person of the two parties from the second person of the two parties in the communication, receives the voice and / or video during the communication, Deriving advice in the communication based on the input, the voice and / or the video; Providing the derived advice during the communication; A program that causes the processor unit to perform a process including the above. (Item 16A) A program according to Item 16, having one or more features described in the above item. (Item 17) A computer-readable storage medium storing a program for supporting communication between two parties, the program being executed in a computer system including a processor unit, the program comprising: Receiving an input indicating a response expected by a first person of the two parties from a second person of the two parties in the communication; Receiving voice and / or video during the communication; Deriving advice in the communication based on the input, the voice and / or the video; Providing the derived advice during the communication; A computer-readable storage medium that causes the processor unit to perform a process including the above. (Item 17A) A computer-readable storage medium according to Item 17, having one or more features described in the above item. [Advantages of the Invention]

[0008] According to the present invention, a computer system, a method, and a program for supporting communication between two parties can be provided, thereby improving the quality of communication between the two parties. [Brief Description of the Drawings]

[0009] [Figure 1A] A diagram showing an example of a screen displayed on a display unit of an information terminal used by a subordinate [Figure 1B] This diagram shows an example of a screen displayed on the information terminal used by a subordinate. [Figure 1C] This diagram shows an example of a screen displayed on the information terminal used by a subordinate. [Figure 2] This diagram shows an example of a screen displayed on the information terminal used by a supervisor. [Figure 3] A diagram showing an example configuration of a computer system 100 for supporting communication between two parties. [Figure 4A] This diagram shows an example of the data structure of advice that can be provided to support communication between two parties, stored in the database unit 200. [Figure 4B] This diagram shows another example of the data structure of advice that may be provided to support communication between two parties, stored in the database unit 200. [Figure 5] A diagram showing an example of the configuration of terminal device 300. [Figure 6A] A diagram showing an example of the configuration of the processor unit 120. [Figure 6B] This figure shows an example of the configuration of processor unit 120', which is an alternative embodiment of processor unit 120. [Figure 7A] A flowchart illustrating an example of processing 700 by a computer system 100 to support communication between two parties. [Figure 7B] A flowchart showing an example of processing by the derivation means 123 in step S703. [Figure 8A] A flowchart illustrating an example of another process 800 performed by a computer system 100 to support communication between two parties. [Figure 8B] A flowchart showing an example of processing by the modification means 126 in step S802. [Modes for carrying out the invention]

[0010] 1.Definition In this specification, "two persons" means any two individuals. In one embodiment, "two persons" means two individuals who have some kind of hierarchical relationship. Here, any hierarchical relationship may be, for example, a hierarchical relationship based on status (e.g., boss-subordinate relationship, teacher-student relationship, etc.), a hierarchical relationship based on age (e.g., older-younger relationship, etc.), or a hierarchical relationship based on experience or knowledge (e.g., expert-amateur relationship, etc.). In the case of a hierarchical relationship based on experience or knowledge, the hierarchy may change depending on the standard experience or knowledge. For example, if two persons A and B have more knowledge than B in a certain field, A may be higher in rank than B, and if B has more knowledge than A in another field, B may be higher in rank than A.

[0011] In this specification, “the first of two persons” means one of any two persons. In one embodiment, “the first of two persons” means the subordinate of two persons who have some kind of hierarchical relationship. For example, “the first of two persons” includes the subordinate in a superior-subordinate relationship, the student in a teacher-student relationship, the younger person in an older-younger relationship, and the amateur in an expert-amateur relationship.

[0012] In this specification, “the second person among two” means the other of any two persons. In one embodiment, “the second person among two” means the superior person among two persons who have some kind of hierarchical relationship. For example, “the second person among two” includes a superior in a superior-subordinate relationship, a teacher in a teacher-student relationship, an older person in an older-younger relationship, and an expert in an expert-amateur relationship.

[0013] In this specification, "two-person communication" refers to communication between two individuals on a one-on-one basis. "Two-person communication" includes communication in any field, such as communication at work, communication in school life, communication in family life, communication in hobby activities, etc.

[0014] Embodiments of the present invention will be described below with reference to the drawings.

[0015] 2. Applications to support communication between two parties The inventors of this invention have developed an application to support communication between two parties. This application can improve the way individuals interact in two-party communication. By using this application, each party engaging in communication can improve the quality of their communication.

[0016] In the following example, we will explain how an application designed to support communication between two individuals can assist in a "1-on-1 meeting." The first person is the subordinate (referred to as "AAAAA" in Figures 1 and 2), and the second person is the superior (referred to as "Section Chief Taro" in Figures 1 and 2).

[0017] Subordinates and supervisors can use information terminals (e.g., smartphones, tablets, personal computers, etc.) to conduct one-on-one meetings and utilize applications to support these meetings. These applications may be web applications accessible via a web browser or applications installed on the terminal device. One-on-one meetings can be conducted via video call using these applications.

[0018] An application designed to support 1-on-1 meetings has features to manage these meetings between managers and subordinates. For example, by entering the date of the 1-on-1 meeting, both the manager and subordinate can receive a reminder before the scheduled date. For example, by entering the outcome of the 1-on-1 meeting afterward, the outcome of each meeting is accumulated, allowing both the manager and subordinate to refer to past results.

[0019] Figures 1A to 1C show examples of screens displayed on the information terminal used by subordinates.

[0020] Figure 1A shows an example of screen 10, which is a notification requesting agenda setting for a 1-on-1 meeting.

[0021] On screen 10, the agenda setting request display section 12 for the 1on1 meeting is displayed above the 1on1 meeting details display section 11.

[0022] The 1on1 meeting details display section 11 shows the details of the next 1on1 meeting. For example, the 1on1 meeting details display section 11 shows the date and time of the next 1on1 meeting, homework assigned from the previous 1on1 meeting, topics to discuss and expected responses in the next 1on1 meeting, and notes for the next 1on1 meeting. Subordinates can look at the 1on1 meeting details display section 11 to prepare for the next 1on1 meeting.

[0023] The agenda setting request display unit 12 will notify you of agenda setting requests for 1-on-1 meetings in the future that do not yet have an agenda set. The agenda setting request will be notified, for example, at any time before the next 1-on-1 meeting. For example, the agenda setting request may be notified 1 hour, 3 hours, 6 hours, 12 hours, 1 day, 3 days, or 1 week before the next 1-on-1 meeting. The agenda setting request display unit 12 may display all 1-on-1 meetings for which an agenda has not yet been set, or it may display only some of the 1-on-1 meetings for which an agenda has not yet been set, for example, the most recent 1, 2, or 3. In the example shown in Figure 1A, you are notified to set an agenda for one 1-on-1 meeting in the future (a 1-on-1 meeting with your supervisor, Section Chief Taro).

[0024] The agenda setting request display unit 12 includes a "Set" button 13. Selecting the "Set" button transitions to the screen 20 shown in Figure 1B.

[0025] Figure 1B shows an example of screen 20 for setting the agenda for a one-on-one meeting. In the example shown in Figure 1B, screen 20 is the screen for setting the agenda for a one-on-one meeting with supervisor, Section Chief Taro.

[0026] Screen 20 includes a homework display section 21, a topic input section 22, and a memo field 25.

[0027] The homework display unit 21 shows the homework assigned to the subordinate since the last meeting. For example, homework such as "Think of ways to improve business processes" and "Request interviews with relevant departments" may be displayed.

[0028] The topic input section 22 allows you to input a topic (or theme) that you would like to discuss in a one-on-one meeting with your supervisor, Section Chief Taro. In this specification, "topic" and "theme" are used synonymously. Topics may be entered in a multiple-choice format, as shown in Figure 1B, or in a free-form format. Once a topic is entered, the corresponding input section 23 for discussion on that topic will be displayed. Topics may be related to work, interpersonal relationships, or the subordinate themselves. Topics can be any matter that can be discussed in communication between two people. For example, in a one-on-one meeting in school life, topics may include academic matters, career paths, friendships, family matters, etc.

[0029] The response input section 23 allows you to input the response (or action and / or attitude) you expect from your superior, Section Chief Taro, regarding the discussion in each topic. The expected response may be entered in a multiple-choice format, as shown in Figure 1B, or in a free-form format. Examples of expected responses may include "I want specific advice," "I want you to think it through with me," "I want you to listen to me," "I want to hear your opinion," or "I want to report." The expected response may be a specific action or a specific attitude.

[0030] In memo field 25, you can freely enter notes. For example, you can enter your own notes for a 1-on-1 meeting. The entered notes can be displayed during the 1-on-1 meeting, so you can refer to them while conducting the meeting.

[0031] Enter the topic and expected response to complete the agenda setup.

[0032] Figure 1C shows an example of screen 30 displayed during a one-on-one meeting between a supervisor and a subordinate. The one-on-one meeting between the supervisor and the subordinate is conducted via video call.

[0033] The screen 30 includes a video display unit 31 and an advice display unit 32.

[0034] The video display unit 31 displays the video of the other person during the 1-on-1 meeting. In addition, the user's own video during the 1-on-1 meeting may also be displayed. In this example, the video of the supervisor, Section Chief Taro, during the 1-on-1 meeting is displayed, and the user's own video is also displayed in a smaller size.

[0035] The advice display unit 32 displays advice for subordinates during 1-on-1 meetings. The advice displayed in the advice display unit 32 includes advice messages indicating what to keep in mind during the ongoing 1-on-1 meeting. For example, based on the information provided, subordinates can realize what to keep in mind during the ongoing 1-on-1 meeting and strive to improve the quality of the meeting.

[0036] The advice display unit 32 is not displayed when advice to the subordinate is not needed, and can be displayed when it is determined that advice to the subordinate is needed. The advice display unit 32 may be displayed as an overlay on the video display unit 31, that is, on the video displayed on the video display unit 31, or it may be displayed outside the video display unit 31.

[0037] In this example, the advice message, "Ask more in-depth questions," is displayed during an ongoing one-on-one meeting. The advice message may be uniform advice for all subordinates, or it may be individualized advice determined based on each subordinate's characteristics. Furthermore, the advice is not limited to advice messages or sentences; it may also consist of words, phrases, clauses, or diagrams. For example, a diagram may be used to advise on an action.

[0038] Figure 2 shows an example of a screen displayed on the information terminal used by a supervisor.

[0039] Figure 2 shows an example of screen 40 displayed during a one-on-one meeting between a supervisor and a subordinate. As mentioned above, one-on-one meetings between supervisors and subordinates are conducted via video call.

[0040] Screen 40 includes a video display unit 41, an expected corresponding display unit 42, and an advice display unit 43.

[0041] The video display unit 41 displays the video of the other person during the 1-on-1 meeting. In addition, the user's own video during the 1-on-1 meeting may also be displayed. In this example, the video of subordinate AAAAA during the 1-on-1 meeting is displayed, and the user's own video is also displayed in a smaller size.

[0042] The expected response display unit 42 shows the response that the subordinate expects from their supervisor, Section Chief Taro, during a one-on-one meeting. The expected response may be what was entered in the response input unit 23 on screen 20 in Figure 1B. For example, the supervisor can understand what the subordinate wants from the information displayed in the expected response display unit 42. This allows the supervisor to communicate with the subordinate in the one-on-one meeting in a way that aligns with the subordinate's wishes and expectations, which in turn leads to high-quality two-way communication.

[0043] The expected corresponding display unit 42 may be displayed at all times during a 1-on-1 meeting, or it may be displayed temporarily during a 1-on-1 meeting (for example, during a predetermined period at the beginning of a 1-on-1 meeting when the supervisor operates it, or when the advice display unit 43 described later is displayed). The expected corresponding display unit 42 may be displayed as an overlay on the video display unit 41, that is, it may be displayed on the video displayed on the video display unit 41, or it may be displayed outside the video display unit 41.

[0044] The advice display unit 43 displays advice for the supervisor during the 1-on-1 meeting. The advice displayed in the advice display unit 43 includes advice messages indicating what to keep in mind during the ongoing 1-on-1 meeting. For example, the supervisor can use the information provided to realize what to keep in mind during the ongoing 1-on-1 meeting and strive to improve the quality of the meeting.

[0045] The advice display unit 43 is not displayed when advice to the supervisor is not needed, and can be displayed when it is determined that advice to the supervisor is needed. The advice display unit 43 may be displayed as an overlay on the video display unit 41, that is, on the video displayed on the video display unit 41, or it may be displayed outside the video display unit 41.

[0046] In this example, the advice message, "Try to be more specific," is displayed during an ongoing one-on-one meeting. The advice message may be a uniform message for all supervisors, or it may be individualized advice tailored to each supervisor's specific characteristics. Furthermore, the advice is not limited to advice messages or sentences; it may also consist of words, phrases, clauses, or diagrams. For example, a diagram could be used to advise on an action.

[0047] After the 1-on-1 meeting ends, the subordinate can evaluate the meeting with their supervisor, Section Chief Taro. The evaluation can be performed, for example, after screen 30 transitions to the evaluation screen (not shown).

[0048] For example, a subordinate can input an overall evaluation of their 1-on-1 meeting with their superior, Section Chief Taro. The overall evaluation could be a two-level rating, such as whether or not they were satisfied with the 1-on-1 meeting, or a multi-level rating indicating the degree of satisfaction with the meeting.

[0049] For example, subordinates can input individual evaluations of their supervisor's handling of 1-on-1 meetings, in addition to or instead of an overall evaluation. Individual evaluations may be two-level ratings, such as whether the expected response was given or whether the response was satisfactory for each topic discussed, or they may be multi-level ratings indicating the degree of satisfaction with the response.

[0050] After the 1-on-1 meeting has ended, the supervisor can evaluate the meeting with subordinate AAAAA. The evaluation can be performed, for example, after screen 40 transitions to the evaluation screen (not shown).

[0051] For example, a supervisor can input an overall evaluation of the 1-on-1 meeting with their subordinate, AAAAA. The overall evaluation could be a two-level rating, such as whether or not the supervisor was able to conduct a 1-on-1 meeting that satisfied the subordinate, or a multi-level rating indicating the degree to which the 1-on-1 meeting was satisfactory.

[0052] For example, a supervisor can input an individual evaluation of whether they were able to meet the subordinate's expectations during a one-on-one meeting, in addition to or instead of an overall evaluation. The individual evaluation could be a two-level rating, for example, indicating whether or not the expected response was given for each topic discussed, or a multi-level rating indicating the degree to which the expected response was given.

[0053] The information entered on screens 20, 30, and 40 is stored in an application to support 1-on-1 meetings and used for subsequent 1-on-1 meetings. These subsequent 1-on-1 meetings may be between subordinate "AAAAA" and superior "Section Chief Taro," between subordinate "AAAAA" and another superior, between another subordinate and superior "Section Chief Taro," or between another subordinate and yet another superior.

[0054] The above example illustrates a 1-on-1 meeting conducted via video call, but the communication supported by this invention is not limited to 1-on-1 meetings via video call. This invention can support any form of communication between two parties, as long as the audio and / or video of at least one of the parties can be obtained. Such communication may include, for example,

[0055] The above example illustrates the support for 1-on-1 meetings between a superior and a subordinate, but the communication supported by this invention is not limited to 1-on-1 meetings between superiors and subordinates. This invention can support any 1-on-1 communication between any two parties, as long as the expected response from one party to the other is predetermined. Such communication includes, but is not limited to, the following: communication between manager A (superior) of one company to learn how to effectively draw out the potential of his subordinates from manager B (superior) of another company; communication between member C (subordinate) of one company to learn how to conduct smooth meetings and how to build a future career from manager D (superior) of another company; communication between high school student E to learn how to study for exams effectively from university student F; and communication between person G and expert H or person I with knowledge and experience to improve skills or as a hobby.

[0056] The application described above for supporting two-person communication may be implemented, for example, by a computer system for supporting two-person communication, as described later. A computer system for supporting two-person communication can improve how individuals are interacted with in two-person communication.

[0057] 3. Configuration of a computer system to support communication between two parties Figure 3 shows an example of the configuration of a computer system 100 for supporting communication between two parties.

[0058] The computer system 100 is connected to the database unit 200. The computer system 100 is also connected to at least one terminal device 300 via a network 400.

[0059] Although Figure 3 shows three terminal devices 300, the number of terminal devices 300 is not limited to these. Any number of terminal devices 300 can be connected to the system 100 via the network 400.

[0060] Network 400 can be any type of network. Network 400 may be, for example, the Internet or a LAN. Network 400 may be a wired network or a wireless network.

[0061] The computer system 100 may be a computer (e.g., a server) installed by a service provider that provides applications to support communication between two parties. The terminal device 300 may be a computer (e.g., a terminal device) used by the two parties in the communication between them. For example, in the above example, one of the terminal devices 300 may be the computer used by the supervisor, and the other terminal device 300 may be the computer used by the subordinate. Here, the computer (server device or terminal device) can be any type of computer. For example, the terminal device can be any type of terminal device such as a smartphone, tablet, personal computer, smart glasses, or smartwatch.

[0062] The computer system 100 comprises an interface unit 110, a processor unit 120, and a memory unit 130. The computer system 100 is connected to a database unit 200.

[0063] The interface unit 110 exchanges information with the outside of the computer system 100. The processor unit 120 of the computer system 100 can receive information from the outside of the computer system 100 and can transmit information to the outside of the computer system 100 via the interface unit 110. The interface unit 110 can exchange information in any format. An information terminal used by a first person and an information terminal used by a second person can communicate with the computer system 100 via the interface unit 110.

[0064] The interface unit 110 includes, for example, an input unit that enables information to be input to the computer system 100. The manner in which the input unit enables information to be input to the computer system 100 is irrelevant. For example, if the input unit is a receiver, the receiver may receive information from outside the computer system 100 via a network. In this case, the type of network is irrelevant. For example, the receiver may receive information via the Internet or via a LAN.

[0065] The interface unit 110 includes, for example, an output unit that enables the output of information from the computer system 100. The mode by which the output unit enables the output of information from the computer system 100 is irrelevant. For example, if the output unit is a transmitter, the transmitter may output information by sending it to the outside of the computer system 100 via a network. In this case, the type of network is irrelevant. For example, the transmitter may send information via the Internet or via a LAN.

[0066] The processor unit 120 executes the processing of the computer system 100 and controls the operation of the entire computer system 100. The processor unit 120 reads the program stored in the memory unit 130 and executes the program. This makes it possible to make the computer system 100 function as a system that executes desired steps. The processor unit 120 may be implemented by a single processor or by multiple processors.

[0067] The memory unit 130 stores programs necessary for executing the processing of the computer system 100, as well as data necessary for executing those programs. The memory unit 130 may also store programs that cause the processor unit 120 to perform processing to support communication between two parties (for example, programs that implement the processing shown in Figures 7 and 8, which will be described later). Here, it is not relevant how the programs are stored in the memory unit 130. For example, the programs may be pre-installed in the memory unit 130. Alternatively, the programs may be installed in the memory unit 130 by being downloaded via a network. In this case, the type of network is not relevant. The memory unit 130 can be implemented by any storage means. Alternatively, the programs may be stored in a computer-readable storage medium and installed in the memory unit 130 by reading the computer-readable storage medium.

[0068] The database unit 200 stores various types of information that can be used to support communication between two parties.

[0069] The database unit 200 stores advice that may be provided to support bilateral communication. The advice that may be provided may be stored in association with, for example, expected responses in bilateral communication and features extracted from audio and / or video that may be obtained in bilateral communication. In one embodiment, the advice that may be provided may be stored in association with criteria corresponding to expected responses in bilateral communication. The criteria may be criteria for features extracted from audio and / or criteria for features extracted from video.

[0070] Figure 4A shows an example of the data structure of advice that may be provided to support communication between two parties, stored in the database unit 200. In the example shown in Figure 4A, advice is given to a second person.

[0071] Advice that may be provided to support two-person communication is stored in association with the responses that a second person expects from a first person in that communication, and with criteria. The criteria are based on features extracted from the audio and / or video captured in the two-person communication. Each criterion is associated with a specific response, and the criteria differ for each response.

[0072] The criteria for features extracted from speech include criteria for features extracted from the speech of the first person, criteria for features extracted from the speech of the second person, and criteria for the speech duration of the first person and the speech duration of the second person.

[0073] The criteria for features extracted from the voice of the first person relate, for example, to the excess or deficiency of specific words in the voice of the first person. For example, this criterion may be met if the specific word is not included in the voice of the first person during a predetermined period of communication between the two parties, or if the specific word is included in the voice of the first person during a predetermined period of communication between the two parties less than a predetermined number of times, or if the specific word is included in the voice of the first person during a predetermined period of communication between the two parties more than a predetermined number of times. The predetermined period could be any period, for example, the first 5 minutes, the first 10 minutes, the first 30 minutes, or the 10 minutes after the first 5 minutes have elapsed. The predetermined number of times could be any number, for example, 2 times, 3 times, 5 times, 10 times, etc.

[0074] Specific phrases include, but are not limited to, phrases such as "specifically," "first," "next," "understood," "that's tough," "what should we do?", and "do you have any ideas?". Any phrase can be set as a specific phrase.

[0075] Criteria for features extracted from the voice of a second person may relate, for example, to the pitch, speed, volume, and / or frequency of a specific word in the voice of the second person. For example, this criterion may be met if the pitch of a specific word included in the voice of the second person during a predetermined period of communication between the two parties is above or below a predetermined pitch (Hz); for example, if the speed of a specific word included in the voice of the second person during a predetermined period of communication between the two parties is above or below a predetermined speed (the number of seconds it takes to utter the entire word); for example, if the volume of a specific word included in the voice of the second person during a predetermined period of communication between the two parties is above or below a predetermined volume (dB); for example, if the number of times a specific word is included in the voice of the second person during a predetermined period of communication between the two parties is above or below a predetermined number of times. The specified period could be any period, such as the first 5 minutes, 10 minutes, 30 minutes, or 10 minutes after the first 5 minutes have elapsed.

[0076] Preferably, the criterion for features extracted from the voice of the second person relates to the pitch of a particular word in the voice of the second person. This is because pitch tends to reveal the speaker's feelings, and using pitch as a criterion allows for a more accurate estimation of the second person's feelings, which in turn leads to an improvement in the accuracy of advice. In other preferred examples, the criterion for features extracted from the voice of the second person relates to, for example, the pitch and speed of a particular word in the voice of the second person; in yet another preferred example, the criterion for features extracted from the voice of the second person relates to the pitch, speed, and volume of a particular word in the voice of the second person; and in yet another preferred example, the criterion for features extracted from the voice of the second person relates to the pitch, speed, volume, and frequency of a particular word in the voice of the second person. The speaker's emotions are most easily revealed in the pitch of their voice, followed by speed, volume, and frequency. By using these as criteria, it becomes possible to estimate the emotions of a second person more accurately, which in turn leads to a further improvement in the accuracy of advice.

[0077] Specific phrases include, but are not limited to, phrases such as "yes," "I understand," "but," "however," "I'll try," and "certainly." Any phrase can be set as a specific phrase.

[0078] The criteria regarding the speaking time of the first person and the speaking time of the second person may relate, for example, to the ratio of the speaking time of the first person to the speaking time of the second person. For example, this criterion may be met if the ratio of the speaking time of the first person to the speaking time of the second person during a predetermined period of communication between the two persons is greater than or less than a predetermined ratio. The predetermined period may be any period, such as the first 5 minutes, the first 10 minutes, the first 30 minutes, or the 10 minutes after the first 5 minutes have elapsed.

[0079] The criteria for features extracted from the video include the criteria for features extracted from the video of the second person. Furthermore, the criteria for features extracted from the video may include, in addition to or instead of, the criteria for features extracted from the video of the second person, the criteria for features extracted from the video of the first person.

[0080] The criteria for features extracted from the video of the second person may relate, for example, to the presence, magnitude, speed, and frequency of the second person's movements. For example, this criterion may be met if the video of the second person during a predetermined period of communication between the two parties includes or does not include facial movements (e.g., changes in expression, frown lines), or if the magnitude of the movements included in the video of the second person during a predetermined period of communication between the two parties is greater than or less than a predetermined magnitude (distance of movement), or if the speed of the movements included in the video of the second person during a predetermined period of communication between the two parties is greater than or less than a predetermined speed (speed of movement), or if the frequency of the movements included in the video of the second person during a predetermined period of communication between the two parties is greater than or less than a predetermined frequency (number of times per predetermined period). The predetermined period may be any period, such as the first 5 minutes, the first 10 minutes, the first 30 minutes, or 10 minutes after the first 5 minutes have elapsed.

[0081] The movements of the second person include, but are not limited to, facial movements, arm movements, and head movements. The movements of the second person can be any movement that can be extracted from the video in the communication between the two individuals. More specifically, the movements of the second person could be nodding.

[0082] For example, in the example shown in Figure 4A, the expected response, "I want specific advice," is stored in association with the following criteria: a criterion for features extracted from the first person's voice, namely the absence of the phrase "specifically"; a criterion for features extracted from the second person's voice, namely the speed and volume of the phrases "yes" and "I understand" being below a threshold; a criterion for the speech duration of the first and second person being greater than 3:7; and the advice, "Let's try to be a little more specific!" For example, the expected response, "I'd like you to think about it with me," is stored in association with the following criteria: a criterion related to a feature extracted from the second person's voice, "the volume of the 'certain' voice is below a threshold"; a criterion related to the speech duration of the first person and the second person, "the ratio of the first person's speech duration to the second person's speech duration is greater than 5:5"; a criterion related to the second person's video, "the size of the hand gestures is above a predetermined value"; and the advice, "You're talking too much."

[0083] Thus, a response can be stored in association with advice, along with at least one of the following criteria: criteria for features extracted from the voice of the first person, criteria for features extracted from the voice of the second person, criteria for the speech duration of the first and second person, and criteria for the video of both people. This allows for the deriving of associated advice when a response is specified and the criteria associated with that response are met.

[0084] Figure 4B shows another example of the data structure of advice that may be provided to support communication between two parties, stored in the database unit 200. In the example shown in Figure 4B, advice is given to the first person.

[0085] The advice shown in Figure 4B is stored in the database unit 200 in the same manner as the advice shown in Figure 4A. The advice for the first person shown in Figure 4B may be the same advice as the advice for the second person shown in Figure 4A.

[0086] The advice stored in the database unit 200 may be stored in association with organizational attributes, for example. For instance, advice for companies stored in the database unit 200 may be categorized and stored as advice for primary industry organizations, secondary industry organizations, and tertiary industry organizations. For instance, advice for students stored in the database unit 200 may be categorized and stored as advice for elementary school student organizations, middle school student organizations, high school student organizations, and university student organizations. This makes it possible to provide different advice for each organization with different attributes.

[0087] In this invention, the timing of storing advice in the database unit 200 is not specified. The advice may be pre-stored in the database unit 200 by a service provider that provides services to support communication between two parties. Alternatively, the advice may be entered and stored by a user corresponding to a second person while the service is being operated using the computer system 100.

[0088] Furthermore, in the present invention, the criteria associated with the advice may be fixed or changeable. Preferably, the criteria associated with the advice may be changed based on an evaluation from one or both parties of the communication between the two parties to which the advice was given. The criteria associated with the advice may be changed, for example, by the process described later with reference to Figures 8A and 8B.

[0089] In the example shown in Figure 3, the database unit 200 is located outside the computer system 100, but the present invention is not limited to this. The database unit 200 can also be located inside the computer system 100. In this case, the database unit 200 may be implemented by the same storage means as the storage means that implements the memory unit 130, or it may be implemented by storage means different from the storage means that implements the memory unit 130. In any case, the database unit 200 is configured as a storage unit for the computer system 100. The configuration of the database unit 200 is not limited to a specific hardware configuration. For example, the database unit 200 may be composed of a single hardware component or of multiple hardware components. For example, the database unit 200 may be configured as an external hard disk drive for the computer system 100, or as cloud storage connected via a network.

[0090] Figure 5 shows an example of the configuration of the terminal device 300.

[0091] The terminal device 300 includes an interface unit 310, an input unit 320, a display unit 330, a memory unit 340, a processor unit 350, an imaging unit 360, and an audio output unit 370.

[0092] The interface unit 310 controls communication via the network 400. The processor unit 350 of the terminal device 300 can receive information from outside the terminal device 300 via the interface unit 310 and can transmit information to outside the terminal device 300. The interface unit 310 can control communication in any manner.

[0093] The input unit 320 enables the user to input information into the terminal device 300. The manner in which the input unit 320 enables the user to input information into the terminal device 300 is not limited. For example, if the input unit 320 is a touch panel, the user may input information by touching the touch panel. Alternatively, if the input unit 320 is a mouse, the user may input information by operating the mouse. Alternatively, if the input unit 320 is a keyboard, the user may input information by pressing keys on the keyboard. Alternatively, if the input unit is a microphone, the user may input information by inputting voice into the microphone. Alternatively, if the input unit is a data reading device, the user may input information by reading information from a storage medium connected to the computer system 100.

[0094] The display unit 330 can be any display for displaying information. For example, the screens shown in Figures 1 and 2 may be displayed on the display unit 330.

[0095] The memory unit 340 stores programs for executing processes in the terminal device 300, as well as data necessary for the execution of those programs. For example, the memory unit 340 may store applications for supporting communication between two parties. The memory unit 340 may also store applications that implement arbitrary functions. The method by which the programs are stored in the memory unit 340 is not relevant. For example, the programs may be pre-installed in the memory unit 340. Alternatively, the programs may be installed in the memory unit 340 by being downloaded via the network 400. The memory unit 340 can be implemented using any storage means.

[0096] The processor unit 350 controls the operation of the entire terminal device 300. The processor unit 350 reads the program stored in the memory unit 340 and executes the program. This makes it possible to make the terminal device 300 function as a device that executes desired steps. The processor unit 350 may be implemented by a single processor or by multiple processors.

[0097] The imaging unit 360 is any means capable of capturing still images or videos. The audio input unit 360 is, for example, a camera. The camera may be a camera built into the terminal device 300, or an external camera attached to the terminal device 300.

[0098] The audio output unit 370 is any means for outputting sound. The audio output unit 370 is, for example, a speaker.

[0099] In the example shown in Figure 4A, each component of the terminal device 300 is provided within the terminal device 300, but the present invention is not limited to this. It is also possible for any of the components of the terminal device 300 to be provided outside the terminal device 300. For example, if the input unit 320, display unit 330, memory unit 340, processor unit 350, imaging unit 360, and audio output unit 370 are each composed of separate hardware components, each hardware component may be connected via any network. In this case, the type of network is not limited. Each hardware component may be connected, for example, via a LAN, wirelessly, or via a wired connection. The terminal device 300 is not limited to a specific hardware configuration. For example, configuring the processor unit 350 with an analog circuit instead of a digital circuit is also within the scope of the present invention. The configuration of the terminal device 300 is not limited to those described above insofar as it can realize its function.

[0100] Figure 6A shows an example of the configuration of the processor unit 120.

[0101] The processor unit 120 includes a first receiving means 121, a second receiving means 122, a derivation means 123, and a providing means 124.

[0102] The first receiving means 121 is configured to receive information indicating the response that the first person expects from the second person in a two-person communication. The first receiving means 121 can receive information from outside the computer system 100, for example, via the interface unit 110.

[0103] The response that the first person expects from the second person in a two-person communication can be input to the terminal device 300 used by the first person via the input unit 320 (e.g., keyboard or touch panel), and the input information can be input from the terminal device 300 to the computer system 100 via the interface unit 110. For example, if the first person inputs the expected response to the corresponding input unit 23 of the screen 20 shown in Figure 1B before two-person communication with the second person, the information indicating the input expected response is input to the computer system 100 via the interface unit 110, and the first receiving means 121 receives that information from the interface unit 110.

[0104] The second receiving means 122 is configured to receive audio and / or video during communication between two parties. The second receiving means 122 can receive audio and / or video during communication between two parties from outside the computer system 100, for example, via the interface unit 110.

[0105] The audio and / or video during communication between two parties may be the audio and / or video of the first person, the audio and / or video of the second person, or both. Preferably, the second receiving means 122 can receive the audio and / or video of the first person and the audio and / or video of the second person.

[0106] The voice of the first person can be input to the terminal device 300 used by the first person via the input unit 320 (e.g., a microphone), and the inputted voice can be input from the terminal device 300 to the computer system 100 via the interface unit 110. The video of the first person can be input to the terminal device 300 used by the first person via the imaging unit 360 (e.g., a camera), and the inputted video can be input from the terminal device 300 to the computer system 100 via the interface unit 110.

[0107] The voice of the second person can be input to the terminal device 300 used by the second person via the input unit 320 (e.g., a microphone), and the inputted voice can be input from the terminal device 300 to the computer system 100 via the interface unit 110. The video of the second person can be input to the terminal device 300 used by the second person via the imaging unit 360 (e.g., a camera), and the inputted video can be input from the terminal device 300 to the computer system 100 via the interface unit 110.

[0108] The derivation means 123 is configured to derive advice for communication between two parties based on information received by the first receiving means 121 and audio and / or video received by the second receiving means 122. For example, the derivation means 123 can derive advice from among the advice stored in the database unit 200 that is associated with both the expected response indicated by the received information and the audio and / or video. More specifically, the derivation means 123 can derive advice associated with the expected response indicated by the received information and the criteria when the audio and / or video meet those criteria. For example, if the audio and / or video do not meet the criteria, the derivation means 123 may choose not to derive any advice. The criteria may be stored in the database unit 200 in association with the response and advice.

[0109] The derivation means 123 can, for example, extract voice characteristics of a first person and / or a second person from the audio received by the second receiving means 122, and compare the extracted voice characteristics to a reference. The voice characteristics of the first person include at least one of the following: the pitch of the voice when the first person utters a predetermined phrase, the speed of the voice when the first person utters a predetermined phrase, the volume of the voice when the first person utters a predetermined phrase, and the number of times the first person utters a predetermined phrase. The derivation means 123 can identify the voice of the predetermined phrase and measure the pitch, speed, volume, and number of times the identified voice is uttered using means that are publicly known or may be publicly known in the field of speech recognition.

[0110] The vocal characteristics of the second person may be predetermined words included in the second person's speech. The derivation means 123 can identify the voice of the predetermined words using means that are publicly known or may become publicly known in the field of speech recognition, determine whether the predetermined words are present or not, or measure the number of times the predetermined words appear.

[0111] The vocal characteristics of the first person and the vocal characteristics of the second person may be the speech duration of the first person and the speech duration of the second person. The derivation means 123 can identify the voices of the first person and the second person and measure the speech duration of the first person and the speech duration of the second person using means that are publicly known or may become publicly known in the field of speech recognition.

[0112] The derivation means 123 can, for example, extract motion features of a first person and / or a second person from the video received by the second receiving means 122, and compare the extracted motion features with a reference. The motion includes at least one of the following: facial movements (e.g., changes in expression, furrowing of the eyebrows), arm movements, and head movements (e.g., nodding). The motion features include at least one of the following: presence or absence, magnitude, speed, and frequency of these movements. The derivation means 123 can identify a predetermined motion using means known or to be known in the field of motion recognition, determine the presence or absence of the identified motion, or measure the magnitude, speed, and frequency of the identified motion.

[0113] For example, let's consider the case shown in Figure 4A, where advice is stored in the database unit 200 in association with responses and criteria. If the information received by the first receiving means 121 indicates that it is the response that "I want specific advice" expects, the derivation means 123 identifies the words "specifically," "first," and "next" from the voice of the first person received by the second receiving means 122, and determines whether the words "specifically" and "first" and "next" are present. Furthermore, the derivation means 123 measures the pitch of the word "yes" and the pitch and volume of the words "I understand" from the voice received by the second receiving means 122, and determines whether the pitch of the word "yes" is below a threshold (e.g., 320 Hz), and whether the pitch of the word "I understand" is below a threshold (e.g., 300 Hz) and the volume is below a threshold (e.g., 60 dB). Furthermore, the derivation means 123 measures the speech duration of the first person and the speech duration of the second person from the audio received by the second receiving means 122, and determines whether the ratio of the speech duration of the first person to the speech duration of the second person is greater than 3:7. The derivation means 123 may derive advice when at least some of the criteria associated with the advice are met, or it may derive advice when all of the criteria associated with the advice are met.

[0114] For example, the advice "Let's try to be more specific!" is associated with the following criteria: (1) the phrase "specifically" is not present; (2) the pitch of the phrase "yes" is below a threshold, and the pitch of the phrase "I understand" is below a threshold; and (3) the ratio of the speaking time of the first person to the speaking time of the second person is greater than 3:7. For example, the derivation means 123 may derive the advice "Let's try to be more specific!" when at least one of (1) to (3) is satisfied, or the derivation means 123 may derive the advice "Let's try to be more specific!" when all of (1) to (3) are satisfied.

[0115] For example, the advice "The other person may not be convinced!" is associated with the following criteria: (1) the words "first" and "next" are absent, (2) the pitch of the word "I understand" is below a threshold, and the volume of the word "I understand" is below a threshold, and (3) the ratio of the speaking time of the first person to the speaking time of the second person is greater than 3:7. For example, the derivation means 123 may derive the advice "The other person may not be convinced!" when at least one of (1) to (3) is satisfied, or the derivation means 123 may derive the advice "The other person may not be convinced!" when all of (1) to (3) are satisfied.

[0116] When the criteria associated with multiple pieces of advice are met, the derivation means 123 may derive all of the multiple pieces of advice, or it may derive some of the multiple pieces of advice.

[0117] In this way, the derivation means 123 can determine whether the audio and / or video meet the criteria associated with the correspondence, and if the criteria are met, it can derive the corresponding advice.

[0118] The providing means 124 is configured to provide the advice derived by the derivation means 123 during communication between two parties. The providing means 124 may provide the advice to a first person, to a second person, or to both the first and second persons. For example, if the advice derived by the derivation means 123 is directed to a first person, the providing means 124 can provide the advice to the first person. For example, if the advice derived by the derivation means 123 is directed to a second person, the providing means 124 can provide the advice to the second person. The providing means 124 can provide the advice via the interface unit 110. The method of providing the advice is not specified. For example, the advice can be transmitted via the interface unit 110 to a terminal device 300 used by the first person, and the advice can be displayed on the display unit 330 of the terminal device 300. The advice is displayed on the image of the screen 30, for example, as shown in Figure 1C. For example, advice can be sent via the interface unit 110 to a terminal device 300 used by a second person, and the advice can be displayed on the display unit 330 of the terminal device 300. The advice can be displayed on the image on the screen 40, for example, as shown in Figure 2.

[0119] If the providing means 124 provides advice to both the first person and the second person, it is preferable that the advice provided is paired advice.

[0120] For example, the first person can learn from the advice provided how to get the second person to respond in the way they expect, what to keep in mind to get the second person to respond in the way they expect, and then take actions or attitudes to get the second person to respond in the way they expect. This can improve the quality of communication between the two parties.

[0121] For example, a second person can learn from the advice provided how to respond to or satisfy the first person's expectations, what to keep in mind, and how to take actions or attitudes that will meet the first person's expectations and satisfy them. This can improve the quality of communication between the two parties.

[0122] Furthermore, because these pieces of advice are based on audio and / or video footage obtained during communication—that is, recent audio and / or video—they are highly accurate and can effectively improve the quality of communication between two parties.

[0123] Figure 6B shows an example of the configuration of a processor unit 120', which is an alternative embodiment of the processor unit 120. The processor unit 120' has the same configuration as the processor unit 120, except that it includes an acquisition means 125 and a modification means 126. The processor unit 120' can change the criteria for deriving advice, and the processor unit 120' can derive advice based on the changed criteria. In Figure 6B, components identical to those shown in Figure 6A are given the same reference numerals, and detailed explanations are omitted here.

[0124] The processor unit 120' includes a first receiving means 121, a second receiving means 122, a derivation means 123, a providing means 124, an acquisition means 125, and a modification means 126.

[0125] The acquisition means 125 is configured to acquire the results of a two-party communication that has already taken place. The acquisition means 125 may acquire the results from outside the computer system 100, for example, via the interface unit 110, or it may acquire the results from inside the computer system 100 (for example, from a storage means). The results of a two-party communication that has already taken place may be, for example, whether or not the computer system 100 provided advice in that communication, and / or an evaluation of that communication.

[0126] The evaluation is an evaluation by a first person. The evaluation can be input to a terminal device 300 used by the first person via an input unit 320 (e.g., a keyboard or touch panel), and the input information can be input from the terminal device 300 to the computer system 100 via the interface unit 110. For example, if the first person inputs an evaluation of a communication with a second person on an evaluation input screen (not shown) after the communication, the input evaluation is input to the computer system 100 via the interface unit 110, and the acquisition means 125 receives the evaluation from the interface unit 110.

[0127] The evaluation could be, for example, a two-level rating indicating whether or not the participant was satisfied with the communication with the second person, or a multi-level rating indicating the degree of satisfaction with the communication with the second person.

[0128] The evaluation may be conducted by a second person. The evaluation can be input to a terminal device 300 used by the second person via an input unit 320 (e.g., a keyboard or touch panel), and the input information can be input from the terminal device 300 to the computer system 100 via the interface unit 110. For example, if the second person inputs an evaluation of the communication with the first person on an evaluation input screen (not shown) after the two-person communication, the input evaluation is input to the computer system 100 via the interface unit 110, and the acquisition means 125 receives the evaluation from the interface unit 110.

[0129] The modification means 126 is configured to change the criteria on which the derivation means 123 derives advice, based on the results of past two-party communication acquired by the acquisition means 125. The results of past two-party communication may be, for example, whether or not the computer system 100 provided advice in that communication, and / or the evaluation of that communication. For example, if the computer system 100 provided advice in a past two-party communication, but the evaluation of that communication was worse than average, that is, if the advice from the computer system 100 was not effective, the modification means 126 can change the criteria in order to change the advice derivation logic. Alternatively, for example, if the computer system 100 did not provide advice in a past two-party communication, the modification means 126 can change the criteria in order to change the advice derivation logic. This is based on the idea that the quality of communication improves if the computer system 100 provides advice rather than not.

[0130] The modification means 126 can, for example, modify the criteria to strengthen them if the computer system 100 has provided advice but the evaluation of that communication is below average. This makes it less likely for the computer system 100 to provide advice. For example, the modification means 126 can strengthen the criteria by raising at least one criterion and / or adding a new criterion. The new criterion may, for example, be a criterion associated with a different response, or preferably a criterion used in a different communication that received a higher evaluation.

[0131] The modification means 126 can, for example, modify the criteria to relax if the computer system 100 fails to provide advice. This makes it easier for the computer system 100 to provide advice. For example, the modification means 126 can relax the criteria by lowering at least one criterion and / or removing at least one criterion. For example, the modification means 126 can compare the criteria used in past bilateral communication with the audio and / or video acquired in that communication and identify any discrepancies. The modification means 126 can then modify the criteria with respect to the discrepancies. For example, the modification means 126 can remove the discrepancies from the criteria. Alternatively, for example, the modification means 126 can relax the discrepancies.

[0132] This allows the derivation means 123 to derive advice using the modified criteria.

[0133] In this way, by changing the criteria based on the evaluation of past communication, the logic for deriving advice can be refined, and the quality of advice derived by the derivation means 123 can be improved. This can enhance the quality of communication between two parties.

[0134] Furthermore, each component of the computer system 100 described above may consist of a single hardware component or multiple hardware components. If it consists of multiple hardware components, the manner in which each hardware component is connected is irrelevant. Each hardware component may be connected wirelessly or by wire. The computer system 100 of the present invention is not limited to a specific hardware configuration. Configuring the processor unit 120 with analog circuits instead of digital circuits is also within the scope of the present invention. The configuration of the computer system 100 of the present invention is not limited to those described above insofar as it can realize its functions.

[0135] 4. Processing by computer systems to support communication between two parties. Figure 7A is a flowchart illustrating an example of processing 700 performed by a computer system 100 to support communication between two parties. Processing 700 is executed in the processor unit 120 of the computer system 100.

[0136] In step S701, the first receiving means 121 of the processor unit 120 receives information indicating the response that the first person expects from the second person in their communication. The first receiving means 121 can receive information from outside the computer system 100, for example, via the interface unit 110.

[0137] In step S702, the second receiving means 122 of the processor unit 120 receives audio and / or video during the communication between the two parties. The second receiving means 122 can receive audio and / or video during the communication between the two parties from outside the computer system 100, for example, via the interface unit 110.

[0138] In step S703, the derivation means 123 of the processor unit 120 derives advice for communication between two parties based on the information received in step S701 and the audio and / or video received in step S702. The derivation means 123 can derive, for example, advice from among the advice stored in the database unit 200 that is associated with both the expected response indicated by the received information and the audio and / or video. More specifically, the derivation means 123 can derive advice associated with the response and criteria when the audio and / or video satisfy the criteria associated with the expected response indicated by the received information. For example, if the audio and / or video do not satisfy the criteria, the derivation means 123 may choose not to derive any advice.

[0139] The derivation means 123 can derive advice, for example, by a process described later with reference to Figure 7B.

[0140] In step S704, the providing means 124 of the processor unit 120 provides the advice derived in step S703 during the communication between the two parties. The providing means 124 may provide the advice to the first person, to the second person, or to both the first and second persons. For example, if the advice derived by the derivation means 123 is directed to the first person, the providing means 124 can provide the advice to the first person. For example, if the advice derived by the derivation means 123 is directed to the second person, the providing means 124 can provide the advice to the second person.

[0141] The providing means 124 can provide advice via the interface unit 110. For example, it can transmit advice via the interface unit 110 to a terminal device 300 used by a first person, and display the advice on the display unit 330 of the terminal device 300. The advice is displayed on the image on screen 30, for example, as shown in Figure 1C. For example, it can transmit advice via the interface unit 110 to a terminal device 300 used by a second person, and display the advice on the display unit 330 of the terminal device 300. The advice is displayed on the image on screen 40, for example, as shown in Figure 2.

[0142] Process 700 allows the first person and / or the second person to receive advice during their bipartisan communication and to strive to engage with the other person in the most appropriate way during their communication. This can improve the quality of communication.

[0143] Figure 7B is a flowchart showing an example of the processing performed by the derivation means 123 in step S703.

[0144] In step S7031, the derivation means 123 refers to criteria associated with the response that the first person expects from the second person, as indicated by the information received in step S701. The criteria are stored in the database unit 200, for example, associated with responses and advice. For example, if the information received in step S701 indicates multiple responses, the derivation means 123 can refer to the criteria associated with each of the multiple responses.

[0145] In step S7032, the derivation means 123 determines whether the audio and / or video received in step S702 meets the criteria referenced in step S7031. If it is determined that the criteria are met, the process proceeds to step S7033; otherwise, the process proceeds to step S7034.

[0146] The derivation means 123 can, for example, extract vocal characteristics of a first person and / or a second person from the audio received by the second receiving means 122, and compare the extracted vocal characteristics to a reference. In addition, or alternatively, the derivation means 123 can, for example, extract motion characteristics of a first person and / or a second person from the video received by the second receiving means 122, and compare the extracted motion characteristics to a reference.

[0147] For example, as shown in Figure 4A, when multiple criteria are associated with a single correspondence, the derivation means 123 determines, for each of the multiple criteria, whether the audio and / or video received in step S702 satisfies the criterion. For example, regarding the response "I would like specific advice," if the first criterion is that (1) the phrase "specifically" is not present, (2) the pitch of the phrase "yes" is below the threshold, and the pitch of the phrase "I understand" is below the threshold, and (3) the ratio of the speaking time of the first person to the speaking time of the second person is greater than 3:7, and the second criterion is that (1) the phrases "first" and "next" are not present, (2) the pitch of the phrase "I understand" is below the threshold, and the volume of the phrase "I understand" is below the threshold, and (3) the ratio of the speaking time of the first person to the speaking time of the second person is greater than 3:7, then it is determined whether the first criterion and the second criterion are met.

[0148] For example, if a criterion is subdivided into multiple parts, as in the first and second criteria above, the system may proceed to step S7033 if at least a part of the subdivided parts is met, or it may proceed to step S7033 if all of the subdivided parts are met. In other words, taking the first criterion above as an example, the system may proceed to step S7033 if at least a part of (1) to (3) is met, or it may proceed to step S7033 if all of (1) to (3) are met.

[0149] In step S7033, the derivation means 123 derives advice associated with the criteria that have been determined to be met. Specifically, the derivation means 123 derives advice stored in the database unit 200 in association with the criteria. If multiple criteria are determined to be met, the derivation means derives the associated advice for each of the multiple criteria.

[0150] In step S7034, the derivation means 123 decides not to derive any advice. The process can end here without proceeding to step S704.

[0151] The advice derived in step S7033 will be provided in step S704.

[0152] Figure 8A is a flowchart illustrating an example of another process 800 performed by the computer system 100 to support communication between two parties. Process 800 is performed in the processor unit 120' of the computer system 100. Process 800 is a process for changing the criteria used by the derivation means 123 to derive advice.

[0153] In step S801, the acquisition means 125 of the processor unit 120' acquires the results of the communication that has already taken place between the two parties. The acquisition means 125 may, for example, receive the results from outside the computer system 100 via the interface unit 110, or it may acquire the results from inside the computer system 100 (for example, from a storage means). The results of the communication that has already taken place between the two parties may, for example, whether or not the computer system 100 provided advice in the communication, and / or an evaluation of the communication. The evaluation may be an evaluation by a first person, or an evaluation by a second person. Preferably, the evaluation may be an evaluation by a first person.

[0154] In step S802, the modification means 126 of the processor unit 120' modifies at least one criterion for deriving advice based on the results obtained in step S801.

[0155] The modification means 126 can change the criteria for deriving advice by, for example, a process described later with reference to Figure 8B.

[0156] Process 800 enables the derivation means 123 to derive advice using the modified criteria. In this way, by modifying the criteria based on an evaluation of past communication, the logic for deriving advice is refined, and the quality of the advice derived by the derivation means 12 can be improved. This can enhance the quality of communication between the two parties.

[0157] Figure 8B is a flowchart showing an example of processing by the modification means 126 in step S802.

[0158] In step S8021, the modification means 126 determines, based on the results obtained in step S801, whether or not the computer system 100 provided advice in past communication between the two parties. If it is determined that the computer system 100 provided advice in past communication between the two parties, the process proceeds to step S8022. If it is determined that the computer system 100 did not provide advice, the process proceeds to step S8023.

[0159] In step S8022, the modification means 126 determines, based on the results obtained in step S801, whether the evaluation of past bipartisan communication is high or low (for example, whether it is high on a binary evaluation scale, or whether it is higher than the average). If the evaluation is determined to be low, the process proceeds to step S8024; if the evaluation is determined to be high, the process proceeds to step S8025.

[0160] In step S8023, the modification means 126 modifies the criteria in such a way that the criteria are relaxed. This makes it easier for the computer system 100 to provide advice. For example, the modification means 126 may relax the criteria by lowering at least one criterion and / or removing at least one criterion. For example, the modification means 126 compares the audio and / or video acquired in the past communication with the criteria used in the past communication and identifies any differences. The modification means 126 then modifies the criteria with respect to the differences. For example, the modification means 126 may remove the differences from the criteria. Alternatively, for example, the modification means 126 may relax or strengthen the differences.

[0161] In step S8024, the modification means 126 modifies the criteria to strengthen them, making it more difficult for the computer system 100 to provide advice. For example, the modification means 126 can strengthen the criteria by raising at least one criterion and / or adding a new criterion. For example, the modification means 126 compares the audio and / or video acquired in the past communication with the criteria used in the past communication and identifies areas where the difference from the criteria is relatively small (i.e., areas where the audio and / or video acquired in the past communication barely meets the criteria). Then, the modification means 126 modifies the criteria in areas where the difference from the criteria is relatively small. For example, the modification means 126 can raise the criteria so that the audio and / or video acquired in the past communication no longer meets the criteria.

[0162] In step S8025, the modification means 126 decides not to change the criteria because it can determine that the logic used in past communications is sufficient. This allows the process to be terminated.

[0163] In this way, the modification means 126 can change the criteria for deriving advice.

[0164] Process 800 will be explained using a concrete example.

[0165] Let's assume that the following logic was derived from the advice "Let's think about it together with the other person!" that was presented to supervisor X during a one-on-one meeting at a certain point in time. If the following criteria are met, the advice "Let's think about it together!" will be given within the first 30 minutes. ●Within 30 minutes of the start of the conversation, the following must have been said by your supervisor, Mr. / Ms. X: "What's bothering you?" "That sounds tough." ●Within the first 30 minutes of the conversation, the pitch, volume, speed, and frequency of subordinate A's voice must meet the following criteria. "Yes": 320Hz or higher, 64dB or higher, 0.21 seconds or less, 2.1 times or more "I see": 290Hz or higher, 61dB or higher, 0.35 seconds or less, 3.2 times or more. ● The ratio of speaking time of subordinate A to speaking time of superior X during the first 30 minutes. Subordinate A: 45%, Supervisor X: 55%

[0166] In contrast, during the "first 30 minutes," the above criteria were not met during the dialogue, so the computer system 100 did not provide the advice, "Let's think together with the other person!"

[0167] In step S801, acquisition means 125 acquires the results of the 1on1 meeting.

[0168] In step S802, the modification means 126 modifies the above criteria.

[0169] Since no advice was given in the 1-on-1 meeting (No in S8021), in step S8023, modification method 126 is changed to relax the criteria.

[0170] The modification method 126, for example, compares the audio obtained in the 1-on-1 meeting with the standard. As a result of comparing the audio obtained in the 1-on-1 meeting with the standard, the following differences were found. Within the first 30 minutes of the conversation, none of the words spoken by my superior, Mr. X, included "That's terrible." ○Within the first 30 minutes of the conversation, subordinate A's "That's right" was heard at 62 dB.

[0171] Modification method 126 allows you to change the criteria for future 1-on-1 meetings as follows: ●Within 30 minutes of the start of the conversation, the following must have been said by your supervisor, Mr. / Ms. X: "What's bothering you?" ●Within the first 30 minutes of the conversation, the pitch, volume, speed, and frequency of subordinate A's voice must meet the following criteria. "Yes": 320Hz or higher, 62dB or higher, 0.21 seconds or less, 2.1 times or more "I see": 290Hz or higher, 61dB or higher, 0.35 seconds or less, 3.2 times or more. ● The ratio of speaking time of subordinate A to speaking time of superior X during the first 30 minutes. Subordinate A: 45%, Supervisor X: 55%

[0172] By relaxing the requirements in this way, the computer system 100 becomes more likely to provide advice. For example, if the same communication takes place in a subsequent one-on-one meeting as in the previous one-on-one meeting, the criteria will be met and advice will be provided.

[0173] In this way, the logic for deriving advice is refined, allowing for more accurate advice to be provided in subsequent one-on-one meetings.

[0174] Let's explain process 800 using another specific example.

[0175] Let's assume that the following logic was derived from the advice "Let's think about it together with the other person!" that was presented to supervisor X during a one-on-one meeting at a certain point in time. If the following criteria are met, the advice "Let's think about it together!" will be given within the first 30 minutes. ●Within 30 minutes of the start of the conversation, the following must have been said by your supervisor, Mr. / Ms. X: "What's bothering you?" "That sounds tough." ●Within the first 30 minutes of the conversation, the pitch, volume, speed, and frequency of subordinate A's voice must meet the following criteria. "Yes": 320Hz or higher, 64dB or higher, 0.21 seconds or less, 2.1 times or more "I see": 290Hz or higher, 61dB or higher, 0.35 seconds or less, 3.2 times or more. ● The ratio of speaking time of subordinate A to speaking time of superior X during the first 30 minutes. Subordinate A: 45%, Supervisor X: 55%

[0176] In contrast, during the "first 30 minutes," the above criteria were met during the dialogue, and therefore, the computer system 100 provided the advice, "Let's think together with the other person!"

[0177] In step S801, the acquisition means 125 receives the results of the 1on1 meeting.

[0178] Subordinate A's satisfaction rating for the 1-on-1 meeting was 1 out of 6, which was significantly lower than the average satisfaction rating for past 1-on-1 meetings between Subordinate A and Supervisor X.

[0179] In step S802, the modification means 126 modifies the above criteria.

[0180] Since advice was provided in the 1-on-1 meeting (Yes in S8021) and the evaluation was low (in S8022), in step S8024, modification method 126 is modified to strengthen the criteria.

[0181] The modification method 126, for example, compares the audio obtained in the 1-on-1 meeting with the standard. As a result of comparing the audio obtained in the 1-on-1 meeting with the standard, there was a part where the difference from the standard was smallest, as shown below. ○Within the first 30 minutes of the conversation, subordinate A's voice saying "That's right" was at 325Hz.

[0182] Modification method 126 allows you to change the criteria for future 1-on-1 meetings as follows: ●Within 30 minutes of the start of the conversation, the following must have been said by your supervisor, Mr. / Ms. X: "What's bothering you?" "That sounds tough." ●Within the first 30 minutes of the conversation, the pitch, volume, speed, and frequency of subordinate A's voice must meet the following criteria. "Yes, that's right": 330Hz or higher, 64dB or higher, 0.21 seconds or less, 2.1 times or more "I see": 290Hz or higher, 61dB or higher, 0.35 seconds or less, 3.2 times or more. ● The ratio of speaking time of subordinate A to speaking time of superior X during the first 30 minutes. Subordinate A: 45%, Supervisor X: 55%

[0183] By relaxing the criteria in this way, the computer system 100 becomes less able to provide advice. For example, if the same communication takes place in a subsequent one-on-one meeting as in the previous one-on-one meeting, the criteria will not be met, and advice will not be provided.

[0184] In this way, by repeatedly relaxing and strengthening the criteria for providing advice, it is possible to derive the optimal criteria (i.e., criteria that enable the provision of advice while also achieving a high level of evaluation for communication).

[0185] While the above example illustrates that each step is performed in a specific order, the order in which each step is performed is not limited to that shown. Each step can be performed in any logically possible order.

[0186] In the examples described above with reference to Figures 7A, 7B, 8A, and 8B, the processing of each step shown in Figures 7A, 7B, 8A, and 8B was explained to be realized by the processor unit 120 or the processor unit 120' and a program stored in the memory unit 130, but the present invention is not limited thereto. At least one of the processing steps shown in Figures 7A, 7B, 8A, and 8B may be realized by a hardware configuration such as a control circuit.

[0187] In the example described above, the computer system 100 was implemented as a server device, but the present invention is not limited to this. The computer system 100 can also be implemented by any information terminal device (for example, terminal device 300).

[0188] The present invention is not limited to the embodiments described above. It is understood that the scope of the present invention should be interpreted solely by the claims. Those skilled in the art will understand that, based on the description of specific preferred embodiments of the present invention and common technical knowledge, an equivalent scope can be practiced. [Industrial applicability]

[0189] This invention is useful as it provides a computer system, method, and program for supporting communication between two parties. [Explanation of symbols]

[0190] 100 Computer Systems 110 Interface section 120, 120' Processor section 130 Memory section

Claims

[Claim 1] A computer system, method, or program, etc., for supporting communication between two parties.

Images