Information processing apparatus

Abstract

To provide an information processing apparatus, a method, and a program that have an increased effect for supporting a communication capability.SOLUTION: In an information processing apparatus 1, an information analysis device 2 comprises a display control unit 26 displays an evaluation item obtained by evaluating a certain utterance of a user in terms of at least one of an approval capability, a listening capability, and a questioning capability, which are items related to a capability of communication with the other person, including character strings of the other utterances of the user before and after the certain utterance, on a display of a terminal device in time series in association with character strings of the certain utterance.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device that evaluates communication. [Background technology]

[0002] Patent document 1 discloses a computer system for supporting communication between two people, the computer system having a processor unit that includes a receiving means for receiving at least one topic that a first person of the two people wants to talk about in communication and a response that the first person expects from a second person of the two people in communication under at least one topic, and a providing means for providing advice in communication to the second person based on the at least one topic and the response. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-163454 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention aims to provide an information processing device that is highly effective in supporting communication skills. [Means for solving the problem]

[0005] The information processing device according to the present invention is characterized by comprising a display control unit that causes a display unit to display evaluation items for evaluating comments made by users in association with character strings of the comments. Effect of the Invention

[0006] It is possible to provide an information processing device that is highly effective in supporting communication skills. [Brief description of the drawings]

[0007] [Figure 1] 1 is a diagram illustrating an example of an overall configuration of an information processing apparatus according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information analyzing device and a terminal device according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing device according to an embodiment. [Figure 4] FIG. 4 is an example of a sequence diagram illustrating each process of the first embodiment. [Diagram 5] FIG. 4 is an example of a sequence diagram illustrating each process of the first embodiment. [Figure 6] 4 is an example of a table included in an evaluation result DB according to the embodiment. [Figure 7] 13 is another example of a table included in the evaluation result DB according to the embodiment. [Figure 8] 4 is an example of a display screen according to the embodiment. [Figure 9] 4 is an example of an evaluation index and an icon according to the embodiment. [Figure 10] 13 is a modified example (character string marking) of the display screen according to the embodiment. [Figure 11] FIG. 4 is an example of a sequence diagram illustrating each process of the first embodiment. [Figure 12] 4 is an example of a table included in a model DB according to the embodiment. [Figure 13] 13 is a modified example (moving image playback) of a display screen according to the embodiment. [Figure 14] 13 is a modified example (character string marking) of the display screen according to the embodiment. [Figure 15] 13 is a modified example (reproduction of an exemplary example) of a display screen according to the embodiment. [Figure 16] 13 is a modified example of a display screen according to the embodiment (understanding the other party's situation). [Figure 17] FIG. 11 is an example of a sequence diagram illustrating each process of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated description will be omitted.

[0009] [First embodiment] [Overall configuration of the information analysis system] FIG. 1 is a diagram showing an example of the overall configuration of an information processing device 1. As shown in FIG. 1, the information processing device 1 has each device and terminal including an information analysis device 2, a terminal device 3, and a terminal device 4. In this embodiment, the configuration is not limited to this. For example, the information processing device 1 may input conversation information only with the information analysis device 2 and execute the learning model DB 2003, etc. Also, it is possible to use the terminal device 3 that can handle the input of conversation information between the two devices by itself, by executing the information analysis device 2 and the terminal device 3. Also, the number of terminal devices is not limited to two, and multiple terminal devices may be connected to a communication network and executed.

[0010] The communication network 100 is a communication network in which an unspecified number of communications are carried out, and is constructed by the Internet, an intranet, a LAN (Local Area Network), etc. The communication network 100 may include not only wired communication but also communication networks using wireless communication such as 4G (4th Generation), 5G (5th Generation), WiMAX (Worldwide Interoperability for Microwave Access), and LTE (Long Term Evolution).

[0011] The information analysis device 2 is responsible for information analysis and storage in the information processing device 1. It has a function of evaluating the user's behavior in a one-on-one meeting. The behavior is evaluated by, for example, judging whether the tone of the user's voice and the content of the remarks are appropriate. It also judges whether the facial expression and timing of nodding are appropriate. It has a function of storing information on learned models and model examples for this purpose, as well as conversation information. The information analysis device 2 may be a commonly used PC (Personal Computer) or a portable notebook PC.

[0012] The terminal device 3 and the terminal device 4 are communication terminals that are used by users who use the information processing device 1 and can acquire information related to the users. They are responsible for inputting information required for the information processing device 1. The input means is a device such as input from a keyboard of a computer terminal, a microphone, or a camera. The terminal device 3 also serves as a means for providing information to the user, and is composed of a visualization means for outputting the results of the calculation unit and information accumulated in the storage unit, and displays the calculation results and accumulated information to the user on a display. The terminal device 3 is also realized by an information processing device (computer system) for communication equipped with a general OS, etc., and is one of the components that configure the information processing device 1.

[0013] The terminal device 3 and the terminal device 4 may be a commonly used PC (Personal Computer), a portable notebook PC, a mobile phone, a smartphone, a tablet terminal, or a communication terminal. The terminal device 3 may further be a communication device or a communication terminal capable of operating browser software and various application software. [Hardware configuration] Next, the hardware configurations of the information analysis device 2, the terminal device 3, and the terminal device 4 constituting the information processing device 1 according to the embodiment will be described with reference to Fig. 2. Note that components may be added or deleted from the hardware configuration of the terminal device or the information analysis device shown in Fig. 2 as necessary.

[0014] FIG. 2 is a diagram showing an example of the hardware configuration of the information analysis device 2. Since the terminal device 3 and the terminal device 4 have roughly the same configuration, the following description will focus on the information analysis device 2, and the terminal device 3 and the terminal device 4 follow suit. As shown in FIG. 2, the information analysis device 2 is constructed, for example, by a computer, and includes a CPU 201 (301, 401), a ROM 202 (302, 402), a RAM 203 (303, 403), and a display 208 (308, 408). It also includes a network I / F 209 (309, 409), a keyboard 211 (311, 411), a mouse 212 (312, 412), a microphone 215 (315, 415), and a camera 216 (316, 416). Here, the reference characters in parentheses refer to the reference characters of the terminal device 3 and the terminal device 4, respectively.

[0015] Of these, the CPU 201 (301, 401) controls the overall operation of the information analyzing device 2 (terminal device 3, terminal device 4). The ROM 202 (302, 402) stores programs and the like used to drive the CPU 201 (301, 401). The RAM 203 (303, 403) is used as a work area for the CPU 201 (301, 401). The display 208 (308, 408) displays various types of information such as a cursor, menu, window, text, or image. In this embodiment, the display 208 (308, 408) functions as an example of a display means.

[0016] Here, the HD 204 (304, 404) stores various data such as programs. The HDD controller 205 (305, 405) controls reading and writing of various data from and to the HD 204 (304, 404) under the control of the CPU 201 (301, 401). Here, the information analyzing device 2 (terminal device 3, terminal device 4) may have a hardware configuration equipped with an SSD (Solid State Drive) instead of the HD 204 (304, 404) and the HDD controller 205 (305, 405).

[0017] The microphone 215 (315, 415) and the camera 216 (316, 416) are devices for acquiring the user's speech and facial expressions for one-on-one meetings at the terminal device 4 and the terminal device 3. These devices are managed and controlled by the CPU 201 (301, 401). The input voice information and image information are recorded in the ROM 202 (302, 402) and the HD 204 (304, 404).

[0018] The network I / F 209 (309, 409) is an interface for data communication using the communication network 100. The keyboard 211 (311, 411) and the mouse 212 (312, 412) are a type of input means for operating the information analysis device 2 (terminal device 3, terminal device 4) by a user pressing, clicking, tapping, or the like on a predetermined button, icon, or the like arranged on the display 208 (308, 408). The media I / F 207 (307, 407) controls reading or writing (storing) data from or to a recording medium 206 (306, 406) such as a flash memory. The bus line 210 (310, 410) is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 201 (301, 401).

[0019] The above program may be recorded in a computer-readable recording medium as an installable or executable file, or may be downloaded and distributed via a network. Examples of the recording medium include a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray Disc (Blu-ray is a registered trademark; omitted below), an SD card, and a USB memory. The recording medium may be provided domestically or internationally as a program product. For example, the information analysis device 2 (terminal device 3, terminal device 4) realizes the information analysis method according to the present invention by executing the program according to the present invention.

[0020] However, in this embodiment, the process is performed using three devices, the terminal device 3, the terminal device 4, and the information analyzing device 2, but the information analyzing device 2 can also perform the process alone. In that case, the process is performed by two users using the microphone 215 and the camera 216 of the information analyzing device 2.

[0021] [Function block configuration]

[0022] 3 shows a functional block diagram of this embodiment, which is made up of an information analysis device 2, a terminal device 3, and a terminal device 4. Each functional block will be described in turn.

[0023] <Functional configuration of information analysis device 2> First, the functional configuration of the information analyzing device 2 will be described. As shown in FIG. 3, the information analyzing device 2 has a storage / readout unit 21, a setting unit 22, an evaluation unit 23, a generation unit 24, a playback unit 25, a display control unit 26, and a transmission / reception unit 27. Each of these functional units is a function or means realized by operating any of the hardware resources shown in FIG. 2 by an instruction from the CPU 201 according to a program for the information analyzing device 2 that is expanded from at least one of the ROM 202, the HD 204, and the recording medium 206 to the RAM 203. The information analyzing device 2 also has a storage unit 2000 constructed by at least one of the ROM 202, the HD 204, and the recording medium 206 shown in FIG. 2. Furthermore, a communication program (communication application), a browser application, and the like for communicating with the terminal device 3 via the communication network 100 are installed and stored in the storage unit 2000.

[0024] Next, a detailed description will be given of each functional configuration of the information analyzing device 2. The transmitting / receiving unit 27 of the information analyzing device 2 shown in Fig. 3 is mainly realized by processing of the CPU 201 for the network I / F 209, and transmits and receives various data (or information) to and from the terminal device 3 and the terminal device 4 via the communication network 100.

[0025] The display control unit 26 is mainly realized by the processing of the CPU 201 on the display 308 of the terminal device 3, and controls the display of various screens and information (data) on the terminal device 3. The display control unit 26 also uses, for example, a browser to display a display screen generated by HTML or the like on the display 308 of the terminal device 3. In this embodiment, the display control unit 26 functions as an example of a display control means.

[0026] The evaluation unit 23 is realized mainly by the processing of the CPU 201, and performs various determination processes in the entire information analyzing device 2. In this embodiment, the evaluation unit 23 functions as an example of an evaluation means.

[0027] The generation unit 24 is mainly realized by the processing of the CPU 201, and generates various information (data) in the information analysis device 2.

[0028] The playback unit 25 is mainly realized by the processing of the CPU 201, and plays back audio data (information) such as conversation information and model examples, or video data (information). In this embodiment, the playback unit 25 functions as an example of a playback processing means.

[0029] The setting unit 22 is mainly realized by the processing of the CPU 201, and performs user settings managed by the information analyzing device 2 and settings of information for display.

[0030] The storage / reading unit 21 is mainly realized by the processing of the CPU 201 on at least one of the ROM 202, the RAM 203, the HD 204, and the recording medium 206, and stores various data (or information) in the storage unit 2000. It also reads out various data (or information) from the storage unit 2000. In this embodiment, the storage / reading unit 21 functions as an example of a storage / reading means.

[0031] Next, a description will be given of the storage unit 2000 included in the information analyzing device 2. A setting information DB (database) 2001 accumulates user setting information input by the user via the keyboard 311 of the terminal device 3 or the like.

[0032] The conversation information DB 2002 accumulates, in file format, voice information, image information, video information, and the like generated by the microphones (315, 415) and cameras (315, 415) of the terminal device 3 and the terminal device 4 during a one-on-one meeting.

[0033] The evaluation result DB2004 stores a list of file names stored in the conversation information DB2002 and character strings generated from voice information. It stores the evaluation results of the final evaluation items and intermediate evaluation items for the one-on-one meetings as a table. For the voice information and video information, the time at which the information was generated is listed and stored. In addition, timestamps corresponding to the character strings and evaluation items are generated and stored in the corresponding table format. Using this table, the display control unit can arrange the character strings, evaluation items, etc. in the order of the time at which the user uttered the voice (chronological order).

[0034] The learning model DB2003 accumulates learning models for evaluating user behavior from voice information, image information, video information, character strings, etc. It is constructed from a learning data set and a learning algorithm that show the relationship between the corresponding behavior and the voice information, image information, video information, and character strings.

[0035] The model DB 2005 stores model file names in a table format for each evaluation item. The model files store model audio information, image information, video information, character strings, and the like.

[0036] In the above system, the functions of the storage unit may be implemented on a cloud server, which is a server that provides resources for cloud computing.

[0037] <Functional configuration of terminal device 3 and terminal device 4> Next, the functional configuration of the terminal device 3 and the terminal device 4 will be described. As shown in Fig. 3, the terminal device 3 and the terminal device 4 have a transmission / reception unit 31 (41), a storage / readout unit 32 (42), a storage unit 33 (43), an input reception unit 34 (34), a playback unit 35 (45), and a display control unit 36 ​​(46). Each of these functional units is a function or means realized by operating any of the hardware resources shown in Fig. 2 in response to an instruction from the CPU 301 (401) in accordance with a program for the terminal device 3 and the terminal device 4 that is loaded from at least one of the ROM 302 (402), the HD 304 (404), and the recording medium 306 (406) to the RAM 303 (403).

[0038] The terminal device 3 and the terminal device 4 may be constructed by a single computer such as a commonly used PC (Personal Computer) or a portable notebook PC, or may be constructed by multiple computers to which each section (function or means) such as storage is divided and arbitrarily assigned. In addition, all or part of the functions of the terminal device 3 and the terminal device 4 may be a server computer existing in a cloud environment or a server computer existing in an on-premise environment. The terminal device 3 and the terminal device 4 may further use a communication device or a communication terminal capable of operating software such as browser software.

[0039] Next, the operation of this system will be described with reference to the sequence diagrams shown in Figures 4 and 5. This embodiment records a one-on-one meeting between a superior and a subordinate. It is characterized in that an evaluation means evaluates whether the behavior of the superior in the one-on-one meeting is appropriate or not, and the evaluation results are displayed as a string of characters arranged in chronological order.

[0040] First, FIG. 4 shows a sequence diagram for recording a one-on-one meeting between a superior and a subordinate. The superior and subordinate log in to the terminal device 3 and the terminal device 4, respectively. In this embodiment, the terminal device 4 is the superior, and the terminal device 3 is the subordinate. Each terminal has an authentication system, and the identity of each user is guaranteed by identity verification such as a password. Next, the user who plays the superior inputs user information using the keyboard 411, which is accepted by the input acceptance unit 44 (step S1). This input information is used to set information about the superior user and the current one-on-one meeting. The setting items include user information about the subordinate and the date and time setting of the one-on-one meeting. Evaluation items to be evaluated in this one-on-one meeting can also be selected. File names of audio and video may be set automatically. These setting items are transmitted to the information analysis device 2 (step S2) and recorded in the setting information DB 2001.

[0041] The subordinate logs in to the terminal device 3 where the user has registered. This authentication system guarantees that the user is the subordinate who is the previously set target of the 1-on-1 meeting. The user playing the subordinate inputs user information for this 1-on-1 meeting (step S3). This input information makes it possible to leave a record that the subordinate has agreed to the 1-on-1 meeting. This input information is sent to the terminal device 4 and the information analysis device 2 (steps S4 and S5). This advance approval process makes it possible to share the settings for this 1-on-1 meeting. The user playing the subordinate needs to consider topics for the 1-on-1 meeting in advance, so needs to agree to the settings for the 1-on-1 meeting one to two weeks in advance.

[0042] The one-on-one meeting is carried out between the terminal device 3 and the terminal device 4 by transmitting and receiving data via the communication network 100. The information analyzing device 2 records the transmission and reception data carried out on this communication network as the conversation information DB 2002. The one-on-one meeting is automatically started when the user playing the role of the superior calls the user playing the role of the subordinate at a set time.

[0043] When the subordinate and superior roles start a one-on-one meeting, their voices, images, and videos are input by the terminal devices 3 and 4, respectively. The terminal devices 3 and 4 are equipped with microphones 315 (415) and cameras 316 (416), and receive information by the input receiving unit 34 (44). The microphone 315 (415) can input the user's remarks as voice information. The camera 316 (416) adjusts the angle of view, number of pixels, and exposure so that the user's facial expressions (corners of the mouth, eyes, etc.) and head movements (nodding, shaking of the head, etc.) can be clearly recorded. If the adjustments are not sufficient, the information analysis device 2 issues an alarm and warns the user to make appropriate settings.

[0044] The subordinate role voice information and video information input from the input receiving unit 34 (step S6) are stored in the memory unit 33 and simultaneously transmitted to the terminal device 4 (step S7). At the same time, they are also transmitted to the information analyzing device 2 (step S8). The information analyzing device 2 records the voice and video in the conversation information DB 2002 via the storage / reading unit 21.

[0045] The voice information and video information of the superior role input from the input receiving unit 44 (step S9) are stored in the storage unit 43 and simultaneously transmitted to the terminal device 3 (step S10). At the same time, they are also transmitted to the information analyzing device 2 (step S11). The information analyzing device 2 records the voice information and video information in the conversation information DB 2002 via the storage / reading unit 21.

[0046] In the case of general conversation information, two to three conversations are treated as one segment and stored as one data file. Each of the conversations is several tens of seconds of audio information and video information. The terminal device 3 and the terminal device 4 each have a synchronized and accurate timer. This timer accurately records the time when the user playing the role of the superior and the user playing the role of the subordinate generated the audio information and video information. The exact start and end times of the audio information and video information are stored as separate files together with the file names of the audio and video files. Accurate information can be obtained by setting the time information to 0.1 second units. The time stamp is accurately synchronized with the terminal device 3, the terminal device 4, and the information analysis device 2. This time information may be stored in the same file as the header of each file, or may be included in the file name. The audio information and video information are also time stamped at the same time, and the start and end times are recorded. The start and end times of the audio information and video information are called the first period, and are later recorded in a table in the evaluation result DB 2004.

[0047] In one one-on-one meeting, the above-mentioned audio information and video information are repeatedly recorded. This generates a file recording each time period. When the one-on-one meeting ends, communication between the terminal device 4 of the superior and the terminal device 3 of the subordinate ends. This end is detected and stored in the conversation information DB 2002 as a series of conversation information. The entire meeting may be stored in one video and audio file without dividing it into conversation units, and may be divided later. In this case, the file may be transmitted at the end of the meeting rather than during it. A method may be used in which image information and video information including audio recorded with a general conference tool is transmitted to the information analysis device 2 of the information processing device 1 and analyzed without using the terminal device 3.

[0048] Next, a method for generating an evaluation of the behavior of the person playing the role of the superior in a one-on-one meeting will be described. FIG. 5 is a sequence diagram for generating evaluation information. A request for screen display is made from the keyboard 411 or mouse 412 of the terminal device 4 used by the user playing the role of the superior, and is received by the input receiving unit 44 (step S21). The received display request information is sent to the information analyzing device 2 (step S22). This screen display request may be made at any time as long as the information is stored in the conversation information DB 2002. In general, a screen request is often made after the end of a one-on-one meeting, when the user wants to take time to improve their one-on-one meeting skills, also as a way of looking back on the experience.

[0049] Furthermore, since data is stored in the conversation information DB 2002 even during a conversation, it is possible to execute the conversation almost in real time. In this case, the user's own behavior can be evaluated almost in real time, and feedback can be given on the spot. For example, if a smile is not detected, the user can correct the behavior on the spot by intentionally raising the corners of the mouth. This allows the user to improve their one-on-one meeting skills in real time.

[0050] The generating unit 24 generates a character string from the previously recorded voice information. In order to generate a character string from a voice, the generating unit 24 has a learning model DB2003 in which voice has been learned. Using this learning model DB2003, the matching rate between the recorded voice and the character string of the learning model is calculated to generate the most appropriate character string (step S23). The generated character string is recorded using a time stamp so that the voice information and the character string can be linked. The time information to be added to the character string is recorded as a character string, and one piece of time information is recorded for about one line of words. To detect a break, the meaning of the character string and the time of unvoiced sounds are detected and generated as appropriate. This time is stored as a second period. An example of a table in which the character string and the second period are recorded is shown in FIG. 6.

[0051] In the table of Fig. 6, the date and time when the file was generated is recorded as a first period 51. The file names (52 and 53) of the video information and audio information are stored in association with each other. A character string 54 generated from this audio file is written down. A second period 55 corresponding to this character string is recorded in association with each other. In addition, a final evaluation item 56 for the behavior of the superior and the period during which the evaluation was performed are recorded as a third period 57.

[0052] In this embodiment, the behavior of the person playing the role of the superior is evaluated based on the audio information and video information (step S24). The behavior of the superior in a one-on-one meeting is a very important factor in improving the quality of the one-on-one meeting. The method of judging the behavior will be described below.

[0053] In this embodiment, the evaluation unit 23 can evaluate behavior by making a comparison with the learning model DB 2003. From the voice information, the tone of the user's voice, the timing of speaking, and the like can be judged. From the character string, the content of the statement can be judged and whether it is appropriate or not. From the facial information, it can be judged whether the facial expression at that time is appropriate. From the movement of the head, it can be judged whether the nodding, etc. was appropriate or not. A specific judgment method will be described below.

[0054] The conversation information DB2002 stores the user's facial expressions and behaviors as image and video information. The user's facial expressions calculated based on the feature values ​​extracted from the user's face area included in the image information are counted at a predetermined cycle to determine which facial expression parameter corresponds to the user's facial expressions. The facial expression parameters included in the facial expressions include anger, contempt, disgust, anxiety, joy, sadness, surprise, and neutrality. The behaviors are calculated by calculating the amount of movement of each part of the user included in the video information and the calculation results are recorded. The behavior parameters included in the behaviors include head movement, body movement, lip movement, and eye movement. For example, the head movement is calculated by detecting the position of the user's head from the video information, and the average amount of movement for each predetermined time is recorded. The user's posture and gestures are analyzed based on the behavior results.

[0055] The microphone 315 (415) serves as a means for inputting voice information and acquires voice information such as the user's tone, the number of times the user speaks / the length of time the user speaks, the number of times silences / the length of time the silences are used, and the content of the speech. The tone is recorded as a feature obtained by performing language analysis on the voice information and calculating the pitch pattern used to distinguish meanings in language. The number of times the user speaks during training or the length of time the user speaks is calculated and recorded as the number of times the user speaks during training or the length of time the other user (interviewee) is silent is calculated and recorded as the number of times silences / the length of time the silences are used during training. The content of the speech is recorded by transcribing the content of the speech made by the user during training into text. The dialogue skill analysis means is composed of an image analysis unit and a voice analysis unit, and the image analysis unit counts the number of nods and the number of smiles made by the user. The voice analysis unit counts the number of positive responses, the number of considerations, the number of back-channels, and the ratio of speech made by the user.

[0056] The final evaluation item 56 shown in Fig. 6 indicates the evaluation results of such facial expressions, etc. One example of an evaluation item is a smile, which can be read from the angle of the corners of the mouth recorded in the image, as described above.

[0057] As shown in FIG. 6, the period during which it is determined that a smile is present is recorded as the third period. The third period is the period during which the evaluation is judged, and for example, the start time when the corners of the mouth turn up and exceed a certain threshold, and the end time when the corners of the mouth turn down and fall below the threshold are stored as the end time. The third period 57 and the second period 55 are synchronized in terms of time, but the start time and end time recorded do not need to match. The third period 57 may span the second period 55, or may match it.

[0058] 6, the final evaluation items 56 may have blank time periods with no evaluation items. In this manner, the final evaluation items 56 are evaluated for the entire time of the one-on-one meeting.

[0059] FIG. 7 shows another example of evaluating a one-on-one meeting. Here, not only the final evaluation item 61 but also the evaluation index 62 is recorded. The final evaluation item 61 and the intermediate evaluation item 56 are explicitly described as final and intermediate when performing a two-stage evaluation. Since there is no strict distinction between final and intermediate, they may be interchanged. The intermediate evaluation item 56 lists not only smiles but also nodding and disorganized facial expressions that can be judged from images and videos. If the content of a remark is undesirable, it may be evaluated as an NG remark. In addition, the tone of voice and the rhythm of the conversation, such as the boss talking too much, are also evaluation items. Seven items are listed as intermediate evaluation items in FIG. 7, but they are not limited to these items. It is possible to increase the number of evaluation items as appropriate by including evaluation items that the user thinks are necessary in the learning model DB2003.

[0060] The intermediate evaluation items 56 are important reference information for evaluating the final evaluation items 61. In this embodiment, the three most important elements of communication skills, particularly in one-on-one meetings, namely, questioning, listening, and approval, are extracted as the final evaluation items 61. It is evaluated whether the superior behaves appropriately for each final evaluation item 61. However, the intermediate evaluation items are not only used as materials for judging the final evaluation items, but may also be displayed for the user to recognize. If displaying them would result in an excessive amount of information, they may not be displayed.

[0061] There is an appropriate way to behave for each of questioning, listening, and acknowledging. These are sometimes expressed as questioning ability, listening ability, and acknowledging ability, in the sense of judging whether the appropriate way of behaving is expressed and whether the ability or skill is possessed. Each appropriate behavior is evaluated using a learning model, and the generator generates an evaluation index. The basic idea behind judging the index is described below.

[0062] Attentive listening is a fundamental skill for proper communication. Appropriate communication is also called dialogue skill, and is judged based on the number of extracted nods, smiles, and responses, as well as the ratio of speech.

[0063] In addition to the above criteria, attentive listening ability is also evaluated from the perspective of empathy. The user's emotions are analyzed from facial expression and voice information, and if the emotions of the subordinate user and the superior user match highly, it is determined that empathy has been achieved. For example, when the subordinate user expresses joy, the superior user's emotions also respond with joy. Empathy is one of the most important factors in attentive listening.

[0064] Approval power is judged from the number of positive responses and the number of considerations. These can basically be quantified by taking into account the content expressed by the string of characters and counting the number of positive words. For example, words with meanings such as "good work," "good," and "wonderful" can be listed, and the number of times a word with a matching meaning is uttered can be counted to determine approval power. In addition, facial expressions of positive acceptance, responses, and nodding from image information are also elements that determine approval power. By counting these behaviors, it is possible to accurately determine approval power.

[0065] Questioning ability is calculated from the number of open-ended questions. Open-ended questions give subordinates more freedom to speak and allow them to choose what they want to talk about. The test determines whether such open-ended questions are being used appropriately. However, there are also questions that may be asked in a way that may corner the other person, including by expressing anger, such as "Why can't you do it?". In this case, points are deducted from the questioning ability and the ability to accept. In other words, the number of open-ended questions is counted, and the quality of the open-ended questions can also be judged. The words in the open-ended questions are made into a list, and a coefficient is assigned to each word. If the word is used well, a positive coefficient is assigned, and if it is used poorly, a negative coefficient is assigned. This is how questioning ability is quantified.

[0066] The determined evaluation indexes 62 of listening ability, acceptance ability, and questioning ability are recorded on a five-level scale as shown in the table of FIG. 7 (step S25). The evaluation indexes are sometimes called scores.

[0067] The present invention is not limited to the configurations shown here, such as the configurations described in the above embodiments, and combinations with other elements. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form.

[0068] Next, a display screen is generated (step S26). An example of the display is shown in Fig. 8. The display example will be described in detail below.

[0069] The left side of the display screen is an evaluation screen based on an overall evaluation of the one-on-one meeting, and the right side shows a chronological list of characters and the individual evaluation items and indicators for each character.

[0070] As an overview of this 1on1 meeting, a general comment (advice) 101 that lists good and bad points is expressed in 2 to 3 lines. Expressing it in short sentences leaves a lasting impression on the user. The general comment (advice) 101 is generated by the sentence generation unit 24 from the average values ​​of final evaluation items such as listening ability, acknowledgment ability, and questioning ability, and intermediate evaluation items such as smiling and nodding, during the entire time of this 1on1 meeting.

[0071] Radar chart 102 shows listening skills, acknowledgment skills, and questioning skills. Each item is evaluated on a 5-point scale, and by visualizing it as a radar chart, you can see the balance of behavior in the corresponding 1-on-1 meeting.

[0072] Since the results are quantified in the laser chart, a screen change button 103 may be created so that the results can be compared with previous 1-on-1 records.

[0073] It also has a frame 104 in which a video (audio and image) recording of an exemplary exchange between the subordinate role and the superior role can be played.

[0074] The right screen displays character strings arranged in chronological order. Subordinate's utterances 105 and superior's utterances 106 are displayed side by side. To make it easier to visualize the utterances, speech bubbles may be used. Each utterance is arranged in chronological order based on the timestamps shown in FIG. 6 or FIG. 7. The subordinate's utterances are character strings generated from the voice input from terminal device 3. The superior's utterances are character strings generated from the voice input from terminal device 4. The subordinate's utterances include a face image and name so that the other person can be identified.

[0075] The remarks 106 made by the superior are written in a different color in the speech bubble so that the subordinate and superior can be distinguished. An icon 107 for the intermediate evaluation item is written next to the speech bubble made by the superior. The intermediate evaluation item, "smile," is written with a five-point scale. The five-point scale is created by writing an easy-to-understand icon 122 for the scale 121, as shown in FIG. 9. The five-point scale is written as a flower circle, a double circle, a round triangle, and a cross.

[0076] Next to the statement 106 made by the superior, an icon 107 of the intermediate evaluation item that evaluates the superior's behavior during the time period in which the statement was made is displayed. The display item is "smile," and the icon of a flower circle, which is the best evaluation, is displayed as the evaluation index. Also, a bar 109 is displayed to show how long the evaluation item of smile continued, indicating its length on the time axis. This length is determined by calculating from the third period 57 described in the table of FIG. 6.

[0077] This allows you to see at a glance what the evaluation items are and what level the evaluation indicators are. Also, by having it next to the text of the remarks, you can intuitively understand that they were made at the same time, making it easy to recall how you, the boss, felt at the time. This ease of recall is one of the most important factors for improving the 1-on-1 skills of this system. Reflecting on your own behavior objectively and understanding it with convincing facts can contribute to improving your skills.

[0078] The icon 107 of the evaluation item "smile" shown above is an intermediate evaluation item. The intermediate evaluation item is placed at a slight distance from the speech bubble 106 of the comment. In contrast, the final evaluation item "questioning ability" 110 is placed at a position where the speech bubble touches. The positions of the final evaluation item and the intermediate evaluation item are intentionally made different. By placing the final evaluation item close to the speech bubble of the comment, it is possible to make the user unconsciously understand that the comment content is being judged. In addition, when a time element is taken into consideration, such as "smile", it is placed on the outer periphery together with the bar 109 indicating the period. In contrast, when the comment itself is evaluated, it is displayed adjacent to the speech bubble. In this way, the placement of the evaluation items reminds the user of the degree of influence on the final evaluation item depending on the distance. In other words, it is possible to convey what is most important and what has the least influence on the final evaluation item that the user is most wanted to understand. Here, the final evaluation items are "questioning ability", "listening ability", and "approval ability", and the rest are intermediate evaluation items. However, the method of distinguishing between final evaluation items and intermediate evaluation items is not limited to this.

[0079] The final evaluation items are three types, "questioning ability" 110, "listening ability" 111, and "approval ability" 112, as shown in Fig. 8. Each is divided into five levels as an index, and is made intuitively easy to understand with icons as shown in Fig. 9. Depending on the speech bubble, there may be cases where none of the items apply, in which case it may be left blank without being displayed.

[0080] The information processing device 1 according to the present embodiment is characterized in that the evaluation items for evaluating the user's comments are displayed on the display unit 408 in association with the character string of the comment. The display control unit 26 is characterized in that the character string of the comment and the previous evaluation items are displayed in chronological order, and the character strings of comments made by other users before and after the comment made by the user are displayed on the display unit 408. The display control unit 26 is also characterized in that the evaluation index in the evaluation item is displayed in association with the evaluation item. This makes it easier to understand the comment and the evaluation item by associating them, and improves the sense of satisfaction. The support effect of communication skills is improved. In addition, the character strings of the comment arranged in chronological order make it easier to recall one's own behavior, and improves the sense of satisfaction of the evaluation item. The dialogue with other users makes it easier to recall one's own behavior, and improves the sense of satisfaction of the evaluation item.

[0081] The information processing device 1 according to the present embodiment is characterized in that the evaluation items include at least one of the following items related to communication skills with the other party: ability to accept, ability to listen, and ability to ask questions. The evaluation items also include at least one of the following items related to the impression of the user: facial expression, tone of voice, and behavior. This makes it possible to evaluate the main items necessary for a one-on-one meeting, improve the impression given to other users such as subordinates, and increase the support effect for communication skills necessary for a one-on-one meeting.

[0082] The above-mentioned notation can be used to improve the problem of "the boss talking too much." As a means of encouraging bosses to improve their communication skills, it can help them realize how to improve their behavior by nodding and smiling at the appropriate time in response to each statement made by their subordinates, and by listening carefully, acknowledging, and asking questions depending on the content of the statement.

[0083] By conducting one-on-one meetings appropriately, it is possible to prevent the creation of an atmosphere in the company where hard work is not rewarded, and to improve engagement in the workplace. Each employee will be able to set goals and carry out their work autonomously, and it is also expected that each employee will proactively reexamine the meaning of their work and the scope of their responsibilities, and take an autonomous stance in designing their careers.

[0084] As a first modified example, the positional relationship between the speech bubble, which is a statement, and the evaluation item may be in a form as shown in FIG. 10. In the example of FIG. 10, an icon 125 of the final evaluation item is arranged in the speech bubble 106 of the superior. In addition, a marker 123 or the like is applied to a character string that plays an important role as the evaluation item, and the relationship between the evaluation item and the character string is explicitly visualized. This allows the user to clearly recognize the relationship between his / her own statement and the evaluation item. Making this relationship clear has the effect of improving the skill of the user who plays the superior role. Unlike knowledge, the goal of skills is to be able to take action unconsciously. For this reason, it is important to repeatedly list statements and evaluation items and acquire them as latent memories. In addition, two icons of the final evaluation item may be arranged. An icon 126 of listening ability and an icon 125 of acceptance ability are arranged in parallel as the final evaluation items. In addition, a marker 124 of a different color is written on a character string that played an important role in this evaluation, so that it can be distinguished. By using a fixed color scheme, such as blue for listening ability and red for approval ability, it is not necessary to show the icon 125 for the final evaluation item.

[0085] The above display method makes it easy to recall which communication moment the participants are referring to from their comments, which are arranged in chronological order, and allows the user to confirm the specific behavior he or she exhibited in that moment, making it easy to reflect on his or her own behavior and improve the quality of communication.

[0086] <Support through reflection> After the user who plays the role of the boss has had his / her one-on-one meeting skills evaluated, he / she can use the evaluation to improve his / her own skills. First of all, it is important for the user to objectively reflect on why he / she was evaluated in the way that he / she was. In this embodiment, a system that makes it easy to do so is provided.

[0087] FIG. 11 shows a sequence diagram when providing support by reflection. This sequence diagram may be a continuation of the sequence diagram of FIG. 5. The user browses the display screen shown in FIG. 8 and gets an overview. Usually, the user is interested in each evaluation item. Therefore, the user reads each of the multiple evaluation items one by one. It is considered that the user often recalls from character strings and so on why the evaluation was made. At that time, the user moves the cursor to the display button of the evaluation item of interest (e.g., question ability 110) and clicks it. This selects the target evaluation item (step S31). In addition, this selection information may include selection information for displaying a model example, which will be described later. If this information is present, model example information is displayed. These selection information are transmitted to the information analysis device 2 (step S32).

[0088] Upon receiving this selection information, the information analyzing device 2 refers to the corresponding table in the evaluation result DB 2004. For example, in the table of Fig. 7, when "question" of the final evaluation item 61 is selected, the corresponding data files of the image 52 and the sound 53 are selected. From this data, the display image and sound information are reproduced by the reproduction unit 25 to generate reproduced video information (step S33).

[0089] Also, if there is an instruction from the user, it is possible to display a model example. The information analysis device 2 has a model example DB 2005, in which model images and model sounds corresponding to the evaluation items 65 are stored as files as shown in FIG. 12. The model images and model sounds may be one video file. Although only one file is listed for one evaluation item in the table of FIG. 12, multiple files may be prepared. The files may be selected in order according to the instruction, or the device may have a function of automatically selecting appropriate files by associating them. The selected files are played back by the playback unit 25 to generate model example video information (step S34).

[0090] A display screen is generated in a format in which the played video information and model video information are displayed on the terminal device 4 (step S35), and the video and screen information are transmitted to the terminal device 4 (step S36). The screen is displayed on the terminal device 4 (step S37). An example of the displayed display screen is shown in FIG. 13. This screen is a display screen generated when an evaluation item icon 501 is selected and clicked with the mouse 412. A screen having a video frame 502 in which the video is played is generated near the center in a pop-up format. Image files and audio files are embedded in the video, and it is played by pressing button 503. The model can also be played by clicking button 504 labeled model with the mouse 412.

[0091] As a second modified example, as shown in FIG. 14, a marker 505 may be placed on the corresponding character string, and the position of the corresponding character string in the reproduced audio information may be dynamically indicated by the marker 505. This allows the user who plays the role of the boss to simultaneously see the voice of his / her own remark and the character string. In addition, when a video is being reproduced, the icon 507 may have a function of explicitly flashing so that the judgment can be easily understood. For example, when a video of a smile judgment is being reproduced, the smile icon flashes. This can be managed by comparing the period of the third period 57 in FIG. 6 with the time played in the video. This allows the user to know the judgment criteria for what kind of facial expression is judged to be a smile while looking at his / her facial expression in the image. This allows the user to understand his / her own facial expression and the objective judgment criteria with a sense of conviction.

[0092] Also, as shown in FIG. 15, advice 520 for the selected evaluation item may be displayed. The advice is generated by the generating unit 24 of the information analyzing device 2. As a result, advice can be given for individual interactions in contrast to the overall overview 101 of the 1-on-1 meeting in FIG. 8, and the user's understanding is deepened as a point of reflection at that point, which leads to an improvement in the user's skills. Also, a model example for the same evaluation item may be played as a video. A button 504 called model example may be displayed to encourage playback, and the video may be played by clicking the button. By looking at the model example, the user can notice the differences between his or her own behavior and the model example, which leads to an improvement in the user's skills.

[0093] The model examples may be the learning model DB2003 used as an evaluation item. For example, a model character string stored in the learning model DB2003 may be presented. Also, a character string that is a variation of the model character string stored in the learning model DB2003 may be presented. Creating many variations may be generated by a generation AI. Also, not limited to character strings, image information, audio information, and video information may be created by the generation AI. By creating using the generation AI, a variety of model examples can be created, and by selecting and presenting the model example that is most suitable for the user from the many model examples, the efficiency of skill improvement is increased.

[0094] A third modified example is shown in FIG. 16. In this modified example, the video frame 522 of the subordinate role is arranged in parallel with the video frame 502 of the superior role. In addition, by playing the videos in synchronization, it is possible to express it with a more realistic feeling, which leads to recalling a one-on-one meeting. In addition, the evaluation may be performed from the voice information and image information of the subordinate role. This evaluation is the same as the method of the superior role described above. For example, an icon 508 of a smile or an icon 509 of a loud laugh are arranged. This makes it possible to judge the reaction of the subordinate role based on the behavior of the superior role. In other words, it is possible to read the emotions of the other party regarding the behavior indicated by the remarks 106 of the superior role and the icon 510 of the intermediate evaluation item. This reaction may also be used as an index of the evaluation item to judge the icon 511 of the final evaluation item. In fact, the emotions of the subordinate role play an important role in the final evaluation of a one-on-one meeting. If the user of the superior role can control this appropriately, the engagement of the subordinate role can be improved.

[0095] The information processing device 1 according to the present embodiment is characterized by including a playback unit 45 that plays back the voice of the utterance in association with the evaluation item. This allows the user to objectively understand his / her own behavior, improving the user's sense of satisfaction with the evaluation item. This enhances the support effect for communication skills necessary for one-on-one meetings.

[0096] The information processing device 1 according to the present embodiment is characterized in that the playback unit 45 plays back the audio of the utterances of other users. Also, the playback unit 45 further plays back images synchronized with the utterances in association with the evaluation items. This allows the user to objectively understand the interactions with other users who are subordinates and his / her own behavior.

[0097] The information processing device 1 according to the present embodiment is characterized in that the playback unit 45 plays back the voice of the model utterance, which is predetermined in correspondence with the evaluation item, in association with the evaluation item. This allows the user to understand the difference between the model example and his / her own behavior, and to objectively understand the shortcomings of his / her own behavior.

[0098] The information processing device 1 according to the present embodiment is characterized in that the display control unit 26 causes the display unit 408 to display model utterances, which are predetermined in correspondence with the evaluation items, in association with the evaluation items. This allows the user to understand model examples at his / her own pace by reading the model utterances displayed in a stationary state.

[0099] The information processing device 1 according to the present embodiment is characterized in that it judges the behavior of the other users and evaluates the user's comments. This allows the user to see and evaluate the reactions of other users to the content of the user's comments. This enhances the effect of supporting communication skills.

[0100] <Second embodiment> Next, an embodiment in which the subordinate role is replaced by a virtual person generated by AI will be described. In the case of a virtual person generated by AI, it is possible to have a conversation according to a scenario, and the one-on-one behavior of the superior role can be evaluated in a standardized manner. This improves the evaluation accuracy of the evaluation items. For example, when the subordinate role asks for advice such as "I'm worried because my evaluation hasn't improved," the correct facial expression and tone of voice are roughly determined as exemplary behavior. By quantifying the difference from the exemplary, the evaluation accuracy improves.

[0101] Fig. 17 is a sequence diagram when a virtual character is used. First, the virtual character is set by inputting user information (step S40). This setting information is transmitted to the information analysis device 2 (step S41) and recorded in the setting information DB2001. Voice information, image information, speech content, etc. of the virtual character are generated from the virtual character information DB2006. The attributes, personality model, conversation scenario pattern, etc. of the virtual character may be selected by the person playing the superior role.

[0102] When a question is input from the user's terminal device 4 to the virtual person (step S42), the input voice and image information is transmitted to the information analysis device 2 (step S43). When the user's image and voice are input from the terminal device 4, the information analysis device 2 acquires the user's image and voice information. Based on the image and voice information, the user's emotional information is analyzed, and the generation unit 24 generates a response text to the user's question based on the result of the analysis of the user's emotional information and the personality model of the virtual person (step S44). The generation unit 24 also generates a response voice that reproduces the response text in the voice of the virtual person. The response voice may be stored voice information of the target person, or may be an artificial voice that is artificially generated. Furthermore, the generation unit 24 generates a response video that is reproduced when the response voice is reproduced. The generated response voice and response video are transmitted to the user terminal as a video that responds (step S45). The response voice and response video may be integrated and transmitted to the user terminal as one data file, or each data file may be transmitted to the user terminal. Next, the video of the virtual person is displayed on the user terminal. That is, the virtual character responds to the question from the user, and a dialogue is established between the virtual character and the user. This process may be repeated multiple times. This configuration allows for natural dialogue with the virtual character. This conversation information is recorded in a file format in the conversation information DB 2002. Based on this stored information, the behavior of the superior character can be evaluated with high accuracy.

[0103] The information processing device 1 according to the present embodiment is characterized by having a generation unit that generates utterances of a virtual person. This makes it easy to standardize responses to utterances of a virtual person, and makes it possible to accurately evaluate the behavior of the superior. The highly accurate and precise evaluation enhances the support effect for communication skills.

[0104] As described above, one embodiment of the present invention is as follows.

[0105] <1> The information processing device 1 according to the present embodiment includes a display control unit 26 that displays the evaluation items that evaluate the user's comments on the display unit 408 in association with the character string of the comment. This makes it easier to understand the comments by associating them with the evaluation items, improving the sense of satisfaction. This enhances the effect of supporting communication skills.

[0106] <2> The display control unit 26 of the information processing device 1 according to this embodiment is characterized in that it displays the character strings of the comments and the evaluation items in chronological order. <1> This makes it easier to recall one's own behavior from the character strings of utterances arranged in chronological order, and improves the sense of satisfaction with the evaluation items. This enhances the effect of supporting communication skills.

[0107] <3> The display control unit 26 of the information processing device 1 according to this embodiment is characterized in that it displays character strings of comments by other users before and after the comment by the user on the display unit 408. <1> ~ <2> This makes it easier for the user to recall interactions with other users and their own behavior, improving the user's sense of satisfaction with the evaluation items. This improves the effectiveness of support for communication skills.

[0108] <4> The information processing device 1 according to the present embodiment includes an evaluation unit 23 that evaluates the user's comments and a learning model (stored in a learning model DB 2003) that includes audio information or video information, and is characterized in that the information processing device 1 evaluates the user's comments. <1> ~ <3> This makes it possible to perform accurate evaluation by comparison with a learning model. In particular, when the subordinate role is a virtual person model created by a generation AI or the like, it is possible to precisely evaluate the difference with the learning model. This allows for highly accurate evaluation.

[0109] <5> The information processing device 1 according to the present embodiment is characterized in that the evaluation items include intermediate evaluation items that are not displayed. <1> ~ <4> The information processing device according to the present invention is an information processing device according to the present invention. As a result, since there are many evaluation viewpoints by the intermediate evaluation items, accurate evaluation can be performed. Depending on the user, intermediate evaluation items that do not function as evaluation items may exist. Furthermore, the intermediate evaluation items can be displayed by narrowing down to the items that will most effectively support the user, without displaying all the evaluated items.

[0110] <6> The evaluation items of the information processing device 1 according to the present embodiment are characterized in that they include at least one of the following items related to communication skills with the other party: ability to accept, ability to listen, and ability to ask questions. <1> ~ <5> This makes it possible to evaluate key items necessary for one-on-one meetings, thereby enhancing the effect of supporting communication skills necessary for one-on-one meetings.

[0111] <7> The evaluation items of the information processing device 1 according to the present embodiment are characterized in that they include at least one of facial expression, tone of voice, and movement, which are items related to the impression of the user. <1> ~ <6> This makes it possible to improve the impression given to other users such as subordinates, and enhances the effect of supporting communication skills necessary for one-on-one meetings.

[0112] <8> The display control unit 26 of the information processing device 1 according to this embodiment is characterized in that the evaluation index for the evaluation item is displayed in association with the evaluation item. <1> ~ <7> This makes it possible to more accurately understand one's own behavior in terms of evaluation items. The effect of supporting communication skills required for one-on-one meetings is improved.

[0113] <9> The information processing device 1 according to the present embodiment is characterized by including a playback unit 45 that plays back the voice of the utterance or an image including the voice in association with the evaluation item. <1> ~ <8> This makes it possible to objectively understand one's own behavior with respect to the evaluation items. This enhances the support effect for communication skills required for one-on-one meetings.

[0114] <10> The playback unit 45 of the information processing device 1 according to this embodiment is characterized in that it plays back the voice of the other user or an image including the voice. <1> ~ <9> This makes it possible to objectively understand interactions with other users who play subordinate roles and one's own behavior, improving the sense of satisfaction with the evaluation items. The effect of supporting communication skills is improved.

[0115] <11> The playback unit 45 of the information processing device 1 according to the present embodiment is characterized in that it plays back the voice of a model speech or an image including the voice, which is predetermined in correspondence with the evaluation item, in association with the evaluation item. <1> ~ <10> This makes it possible to understand the difference between the model example and one's own behavior, and to objectively understand the shortcomings of one's behavior, while improving the sense of satisfaction with the evaluation index. The support effect of communication skills necessary for one-on-one meetings is improved.

[0116] <12> The information processing device 1 according to the present embodiment is characterized in that the display control unit 26 causes the display unit 408 to display model comments that are predetermined in accordance with the evaluation items in association with the evaluation items. <1> ~ <11> This allows the user to understand the model example at his / her own pace by reading the model utterance displayed in a stationary state. This allows the user to understand the difference between the model example and his / her own behavior, and allows the user to objectively understand the shortcomings of his / her own behavior, while improving the user's sense of satisfaction with the evaluation index. This increases the effectiveness of supporting communication skills necessary for one-on-one meetings.

[0117] <13> The information processing device 1 according to the present embodiment is an information processing device including a generating unit 24 that generates a display screen for displaying evaluation items for evaluating user comments on a display unit 408 in association with character strings of the comments. This makes it easier to understand the comments by associating them with the evaluation items, improving the sense of satisfaction. This enhances the effect of supporting communication skills.

[0118] <14> The program according to the present embodiment is characterized in that the evaluation items for evaluating the user's comments are displayed on the display unit in association with the character string of the comment. This makes it easier to understand the comments by associating them with the evaluation items, improving the sense of satisfaction. This enhances the effect of supporting communication skills.

[0119] <15> The information processing device 1 according to the present embodiment is characterized in that it judges the behavior of the other users and evaluates the comments of the users. <1> ~ <14> In this way, the user can see and evaluate the reactions of other users to the content of his / her speech, thereby improving the effect of supporting communication skills.

[0120] <16> The information processing device 1 according to the present embodiment has an authentication system and is characterized in that it identifies a user. <1> ~ <15> This provides an information processing device according to the present invention, which is capable of protecting security and eliminating the risk of information being viewed by an unspecified number of people.

[0121] <17> The information processing device 1 according to the present embodiment is characterized in that it displays advice 520 for the results of the evaluation items. <1> ~ <16> This enhances the effect of supporting communication skills.

[0122] <18> The information processing device 1 according to the present embodiment is characterized by having a generation unit that generates utterances of a virtual person. <1> ~ <17> This makes it easier to standardize responses to utterances by virtual characters, and makes it possible to accurately evaluate the behavior of the superior. The highly accurate and precise evaluation enhances the effect of supporting communication skills. [Explanation of symbols]

[0123] 1. Information processing device 2 Information analysis device 3 Terminal device (subordinate role) 4 Terminal device (boss role) 23 Evaluation section (an example of an evaluation means) 24 Generation unit (an example of a generation means) 25, 35, 45 Regeneration unit (an example of a regeneration means) 26, 36, 46 Display control unit (an example of a display control means) 208, 308, 408 Display (an example of a display unit or display means)

Claims

1. An information processing device comprising: a display control unit that causes a display unit to display evaluation items for evaluating user comments in association with character strings of the comments.

2. The information processing device according to claim 1 , wherein the display control unit displays the character strings of the comments and the evaluation items in chronological order.

3. The information processing device according to claim 1 , wherein the display control unit displays character strings of comments made by other users before and after the comment made by the user.

4. an evaluation unit for evaluating the comments of the users; A learning model including audio information or video information, The information processing apparatus according to claim 1 , wherein the user's comments are evaluated.

5. The evaluation items include intermediate evaluation items that are not displayed.

2. An information processing apparatus according to claim 1.

6. 2. The information processing apparatus according to claim 1, wherein the evaluation items include at least one of the following items related to communication skills with a partner: ability to accept, ability to listen, and ability to ask questions.

7. The information processing apparatus according to claim 1 , wherein the evaluation items include at least one of facial expression, tone of voice, and movement, which are items related to an impression of the user.

8. The information processing device according to claim 1 , wherein the display control unit displays an evaluation index for the evaluation item in association with the evaluation item.

9. 2. The information processing apparatus according to claim 1, further comprising a playback unit that plays back the voice of the utterance or an image including the voice in association with the evaluation item.

10. The information processing apparatus according to claim 7 , wherein the playback unit plays back audio of the other user's speech or an image including the audio.

11. The information processing device according to claim 7 , wherein the playback unit plays back a sound or an image including a sound of a model comment predetermined corresponding to the evaluation item in association with the evaluation item.

12. The information processing device according to claim 1 , wherein the display control unit causes the display unit to display model comments, which are predetermined to correspond to the evaluation items, in association with the evaluation items.

13. An information processing device comprising: a generating unit that generates a display screen for displaying evaluation items for evaluating user comments on a display unit in association with character strings of the comments.

14. A program that causes a computer to display evaluation items for evaluating a user's comments in association with the character string of the comment.

Images