Information processing device and program

Abstract

To provide an information processing device and a program that determine the psychological state of conference members according to a conference purpose.SOLUTION: In a psychological state evaluation unit 400 implemented by an information processing device, a voice processing unit 401 extracts a predetermined feature quantity from voice of part corresponding to a member's speech of voice data 50 collected during a conference by a microphone. A psychological state estimation unit 412 receives the extracted feature quantity, and estimates a possibility that the member is in a predetermined psychological state. A determination unit 414 determines the possibility that the member is in the predetermined psychological state during the conference based on the estimated possibility and an index value according to a purpose of the conference.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, and more particularly to an information processing device and a program for evaluating the psychological states of members of a meeting. [Background technology]

[0002] There is a demand for efficient meetings or discussions. For example, the meeting support system in Patent Document 1 (Japanese Patent Publication No. 2017-215931) evaluates the content of comments made by meeting participants. Furthermore, the system in Patent Document 2 (Japanese Patent Publication No. 2021-86385) determines the degree of achievement of meeting policies. The meeting support system in Patent Document 3 (Japanese Patent Publication No. 2020-154673) determines the reaction state of other comments to a comment and evaluates the comment based on the determination result. The meeting support system in Patent Document 4 (Japanese Patent Publication No. 2017-112545) determines the degree of convergence of the discussion from the voices of meeting participants. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-215931 [Patent Document 2] Patent Publication No. 2021-86385 [Patent Document 3] Japanese Patent Publication No. 2020-154673 [Patent Document 4] Japanese Patent Application Laid-Open No. 2017-112545 Summary of the Invention [Problem to be solved by the invention]

[0004] In order to efficiently manage a meeting, there is a demand for obtaining support information based on the psychological state of the members according to the purpose of the meeting in order to assist in the management of the meeting. However, the above patent documents do not propose a configuration that takes into account the psychological state of the meeting participants.

[0005] An object of the present disclosure is to provide an information processing device and a program that can determine the psychological states of meeting members according to the purpose of the meeting. [Means for solving the problem]

[0006] The information processing device disclosed herein for determining the psychological state of a member during a meeting includes an audio processing unit for extracting predetermined features from audio collected by a microphone during the meeting that corresponds to the member's remarks, an estimation unit that receives the input of the features and estimates the possibility that the member is in a predetermined psychological state, and a determination unit that determines the possibility that the member is in a predetermined psychological state during the meeting based on the possibility estimated by the estimation unit and an index value according to the purpose of the meeting.

[0007] The above-mentioned information processing device further includes an image analysis unit that extracts image features representing predetermined behaviors from images of members captured by a camera during a meeting, and the input of features received by the estimation unit further includes input of image features.

[0008] The estimation unit receives the feature amounts as input and estimates the possibility that the member is in a predetermined psychological state for each of a plurality of items.

[0009] The information processing device described above sets an index value for each of a plurality of items. The above-mentioned determination unit converts the magnitude of the determined possibility for each of the multiple items into a numerical value.

[0010] For one or more items among the above multiple items according to the purpose of the meeting, the converted numerical values ​​of the items are adjusted by addition or subtraction.

[0011] The above-mentioned information processing device further includes an output unit that outputs the possibility determined by the determination unit, an input interface that accepts user operations on the information processing device, and an index value change unit that changes the index value, and the index value change unit changes the index value based on the user operations accepted by the input interface.

[0012] When the index value change unit receives user operations from a plurality of users, it changes the index value based on the user operations.

[0013] The index value change unit further changes the index value in accordance with change rules, and the change rules include rules for change based on index values ​​for multiple conferences having the same purpose.

[0014] The output unit outputs the likelihood determined by the determination unit for each of a plurality of meetings that were held at different times and had the same purpose and in which the members participated.

[0015] The above-mentioned information processing device further includes a re-determination unit that determines, for at least one of the multiple meetings, the possibility that a member is in a predetermined psychological state during the meeting based on the possibility estimated by the estimation unit and a predetermined index value.

[0016] The above-mentioned predetermined index value includes the index value after being changed by the index value change unit.

[0017] The above-mentioned predetermined index values ​​include default values. The index value changing unit further changes the index value based on the attributes of the members of the conference.

[0018] The index value change unit further changes the index value based on a predetermined attribute when a predetermined number of members of the conference have the predetermined attribute.

[0019] The purpose of the meeting mentioned above is obtained from the information registered regarding the meeting. The information processing device described above acquires the purpose of the conference by performing recognition processing on the voices collected during the conference.

[0020] The output unit outputs information relating to the index value used by the determination unit to determine the possibility. The program of the present disclosure is a program for causing a computer to execute a method for determining the psychological state of members during a meeting, the method comprising the steps of: extracting predetermined features from a portion of audio collected by a microphone during the meeting that corresponds to what the members say; receiving the features as input, estimating the likelihood that the members are in a predetermined psychological state; and determining the likelihood that the members are in a predetermined psychological state during the meeting based on the estimated likelihood and an index value according to the purpose of the meeting. [Effects of the Invention]

[0021] According to the present disclosure, the psychological states of meeting members can be determined according to the purpose of the meeting. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a diagram showing a schematic configuration of a conference system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram illustrating a hardware configuration of a terminal 200 according to the present embodiment. [Figure 3] FIG. 2 is a diagram showing a hardware configuration of an information processing device 300 according to the present embodiment. [Figure 4] FIG. 2 is a diagram schematically illustrating a software configuration of a psychological state evaluation unit according to the present embodiment. [Figure 5] FIG. 3 is a diagram schematically illustrating an example of a decision index value DB 331 according to the present embodiment. [Figure 6] FIG. 4 is a diagram showing an example of an estimated value 42 according to the present embodiment. [Figure 7] FIG. 10 is a diagram illustrating a determination method of a determination unit 414 according to the present embodiment. [Figure 8]FIG. 2 is a diagram schematically illustrating an example of an important item management DB 332 according to the present embodiment. [Figure 9] 10 is a diagram illustrating an example of a determination result obtained by using a priority item management DB 332 of a determining unit 414 according to the present embodiment. FIG. [Figure 10] FIG. 2 is a diagram schematically illustrating an example of a report 60 according to the present embodiment. [Figure 11] FIG. 10 is a diagram showing another example of the configuration of the decision index value DB 331 according to the present embodiment. [Figure 12] FIG. 10 is a diagram illustrating an example of indices before and after a change in association with each other. [Figure 13] FIG. 10 is a diagram illustrating an example of indices before and after a change in association with each other. [Figure 14] 1 is a schematic flowchart of the overall process according to the present embodiment. [Figure 15] 15 is a flowchart of a routine R1 in FIG. 14. [Figure 16] 16 is a flowchart of a routine R14 in FIG. 15. [Figure 17] 16 is a flowchart of a routine R15 in FIG. 15. [Figure 18] 15 is a flowchart of a routine R2 in FIG. 14. [Figure 19] 19 is a flowchart of a routine R16 in FIG. 18. [Figure 20] 15 is a flowchart of a routine R3 in FIG. 14. [Figure 21] 21 is a flowchart of a feedback processing routine R17 in FIG. 20. [Figure 22] 21 is a flowchart of a comparison routine R18 of the conference result information of FIG. 20. [Figure 23] 23 is a flowchart of the recalculation processing routine R19 of FIG. 22. [Figure 24] FIG. 2 is a diagram showing an example of a display screen of a display according to the present embodiment. [Figure 25] FIG. 2 is a diagram showing an example of a display screen of a display according to the present embodiment. [Figure 26]This is a diagram showing an example of the display screen of the display according to the present embodiment. [Figure 27] This is a diagram showing an example of the display screen of the display according to the present embodiment. [Figure 28] This is a diagram showing an example of the display screen of the display according to the present embodiment. [Figure 29] This is a diagram for explaining the method of psychological state determination according to the present embodiment.

Mode for Carrying Out the Invention

[0023] Hereinafter, embodiments and modifications according to the present invention will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated. Note that the embodiments and modifications described below may be selectively combined as appropriate.

[0024] <A. Evaluation of Psychological State> In the present embodiment, a tool for evaluating the psychological state of members participating in a meeting according to the purpose of the meeting is provided. Here, as a method for reducing psychological barriers during meetings for the purpose of activating discussions and improving communication in a company, a method focusing on "psychological safety" among psychological states has been proposed. Here, psychological safety refers to a state in which psychological barriers of members in a meeting are reduced (for example, a state in which there is a certainty that other members will not reject one's speech or impose punishment). As items for measuring psychological safety, the "seven questions" of Professor Edmondson are well known. In the present embodiment as well, the following "seven questions" for evaluating psychological safety are used as items for evaluating the psychological state of meeting members, but the items for evaluating psychological safety are not limited to these. Also, the psychological state evaluated in the meeting is not limited to psychological safety.

[0025] (a) Experiment by the inventor The inventor conducted an experiment to measure the estimated value of the high (or low) probability corresponding to each of the seven questions. This "high or low probability" indicates whether a person's psychological state is likely to become the psychological state (predetermined state) indicated by the corresponding question (item). In the experiment, for example, a third party who is unaware of the purpose of the meeting measures the probability based on the observation of the statements made by the meeting members. Furthermore, the "estimated value" is a value that quantitatively indicates whether "low probability is good" or "high probability is good." Hereinafter, this "question" will also be referred to as an "item" for determining the psychological state. Note that "team" in the questions can be replaced with "meeting."

[0026] Question (1) If I make a mistake in the team, I often get criticized (it's good that it's unlikely); Question (2) Team members can discuss issues and negative things with each other (highly likely but good); Question (3) Team members tend not to accept anything different (the lower the chance, the better); Question (4) Do you feel comfortable taking actions that may be risky for your team (high probability is good); Question (5) It is difficult to ask for help from team members (it is better if it is less likely); Question (6) There is no one in the team who will deceive you (the higher the chance, the better); Question (7) When working in my current team, I feel like I am able to utilize my skills (high potential is good).

[0027] (a1. Evaluation of estimates based on the purpose of the meeting) The estimated probability values ​​mentioned above may differ depending on the purpose of the meeting, even for the same item. Specific examples are explained using the following experiments, Case 1 and Case 2.

[0028] (Case 1: Brainstorming meetings for idea development and new feature development) (a) If the meeting is a brainstorming session for developing ideas or new features, and members make productive comments without making negative comments in accordance with the purpose (rules) of the meeting, a third party other than the members will observe the comments made in the meeting and score the likelihood of each question based on the observations. In this case, the following estimated scores were obtained:

[0029] Question (1) If I make a mistake in the team, I often get criticized (it's good that it's unlikely) → 10 points; Question (2) Team members are able to discuss issues and negative thoughts with each other (highly likely but good) → 0 points; Question (3) Team members tend not to accept anything different (high possibility is good) → 10 points

[0030] In this meeting, members speak in line with the purpose of the meeting, so a third-party observation shows that there are no critical or negative comments and that there is a high tendency to accept different comments. Therefore, for question (2), it is observed that there were no negative comments at all, so the estimated score is 0 points. As a result, questions (1) to (3) have a total of 20 points.

[0031] (b) If the meeting is a brainstorming session for idea development or new feature development, and members make many negative comments and few productive comments, contrary to the purpose (rules) of the meeting, a third party other than the members can observe the comments made in the meeting regarding questions (1) to (3), and based on the observations, score the likelihood of each question. In this case, the following estimates were obtained:

[0032] Question (1) If I make a mistake in the team, I often get criticized (it's good that it's unlikely) → 10 points; Question (2) Team members can discuss issues and negative thoughts with each other (highly likely but good) → 10 points; Question (3) Team members tend not to accept anything different (high possibility is good) → 10 points

[0033] In this meeting, many comments were made that were contrary to the purpose of the meeting, so a third-party observer would see that many negative comments led to arguments between members, so question (1) would be given a score of 10. Also, since the negative comments were judged to be courageous and lively discussions, question (2) would be given a score of 10. Furthermore, since there were many comments, it would be judged that there was a high tendency to accept different comments, so question (3) would be given a score of 10. As a result, questions (1) to (3) would be given a total score of 30.

[0034] According to the experiment, members who participated in both case (i) and (ii) meetings were in a psychological state where they were dissatisfied with the fact that the observer's evaluation (total estimated value) was higher in case (ii), where comments were made that were contrary to the purpose of the meeting, than in case (i), where comments were made that were in line with the purpose of the meeting.Members who only participated in case (ii) meetings were in a psychological state where they found it difficult to speak up because their comments would be rejected.

[0035] These experiments showed that when the likelihood assessment of each item was quantitatively scored, the scores for the likelihood assessment deviated from the actual psychological state of the meeting members because the scores were not based on the purpose (rules) of the meeting.

[0036] (Case 2: Progress meetings and review meetings) We evaluated the feasibility of progress meetings where work progress is shared or review meetings where work is reviewed and verified. More specifically, if a member makes a simple mistake in their work and then says the same thing in a meeting with a different purpose, the meaning and interpretation of the statement will change depending on the purpose of the meeting.

[0037] In the experiment, the psychological state of other members was observed when one member in a meeting said, "That mistake is a problem. Why did you make that mistake at this time? Did you check it?"

[0038] For example, in a progress meeting, if one member makes the above statement, they will be in a psychological state of caution and criticism, while other members will be in a psychological state of "I was blamed for the mistake, so it will be difficult to report the next one," and will tend to speak less. In contrast, in a review meeting, if one member makes the above statement, they will be in a psychological state of checking and improving (productive steps) to try to prevent the mistake, while other members will be in a psychological state of reconfirming the mistake to prevent it from happening again.

[0039] Regarding comments made at progress meetings and review meetings, questions (1) to (3) were scored by a third party based on their observations of the content of comments made at the meetings. In this case, the following experimental results were obtained.

[0040] Question (1) If I make a mistake in the team, I often get criticized (it's good that it's unlikely) → 20 points; Question (2) Team members can discuss issues and negative thoughts with each other (highly likely but good) → 10 points; Question (3) Team members tend not to accept anything different (high possibility is good) → 5 points

[0041] In these two meetings, one member's comment was critical, so question (1) was worth 20 points, the above comment was negative, so question (2) was worth 20 points, and some opinions were expressed, so question (3) was worth 5 points.

[0042] However, one member of the review meeting, i.e., the reviewer, felt that there was a discrepancy between his own psychological state and the estimated likelihood of each item, because the score for question (1) was high even though the above comments were not critical.

[0043] Therefore, in this experiment as well, since the scoring of the judgment based on the purpose (rules) of the meeting could not be done, the result was that the estimated value deviated from the actual psychological state of the members of the meeting.

[0044] Based on the results of such an experiment, the inventor obtained the knowledge that when determining psychological safety by the system, when setting items (questions) and making a judgment about those items, in order to prevent the judgment from deviating from the psychological state of the members, the final determination of possibility should be made based on the purpose of the meeting.

[0045] Based on this knowledge, the inventor also obtained the knowledge that for each type of meeting, that is, for each purpose of the meeting, by setting a weight corresponding to the purpose for each item and evaluating the estimated value of the possibility of each item with the weight of the item, it becomes possible to determine the possibility of the psychological state corresponding to the purpose of the meeting. This weight is also referred to as an index value below. Hereinafter, a meeting support system based on these findings will be described.

[0046] In addition, in this embodiment, a meeting is exemplified as a scene where a plurality of members talk to each other. The meeting in this embodiment is a concept including meetings, gatherings, discussions, etc.

[0047] <B. Meeting Support System> FIG. 1 is a diagram showing a schematic configuration of a meeting system according to this embodiment. Referring to FIG. 1, the meeting system 1 is a system for providing an online meeting that exchanges images (videos) and voices via a network, and includes a plurality of terminals 200 operable by members (participants) participating in the meeting, and an information processing device 300 that communicates with the plurality of terminals 200 via the network 100. Hereinafter, the online meeting will be abbreviated as a "meeting".

[0048] The terminal 200 includes, for example, a general-purpose personal computer (PC), a smartphone, or a tablet. The information processing device 300, for example, serves as a cloud server with the terminal 200 as a client, and provides a platform for realizing a conference system. The network 100 may be, for example, a public network such as the Internet, a public line, or a public wireless local area network (LAN), or may be a private network such as a LAN or a virtual private network (VPN). The information processing device 300 has been exemplified as a cloud server, but is not limited to this and may also be an on-premise server.

[0049] The information processing device 300 supports online conferences among multiple terminals 200. For example, the information processing device 300 receives video data, audio data, etc. sent from one terminal 200 and transfers the received video data or audio data to another terminal 200. This allows members to share video and audio by operating the terminal 200.

[0050] The information processing device 300 also evaluates the psychological states of the members during the conference for each item according to the purpose of the conference from the voice data or image data exchanged between the terminals 200 during the conference, and outputs the evaluation results.

[0051] (b1. Hardware configuration) Fig. 2 is a diagram showing the hardware configuration of terminal 200 according to this embodiment. Fig. 3 is a diagram showing the hardware configuration of information processing device 300 according to this embodiment.

[0052] Referring to FIG. 2, terminal 200 includes processor 11, main memory 12 including volatile storage media such as read-only memory (ROM) and random-access memory (RAM), camera 13, microphone 14, and communication interface 15 including a communication circuit including a network interface card (NIC), input interface 16 connecting user-operable input devices 16A such as a keyboard and mouse, display interface 17 connecting display 17A, speaker 18, optical drive 19 to which an optical disk 19A, an example of a storage medium, is removably attached, and storage device 20 including a nonvolatile storage medium such as a hard disk drive (HDD) or solid-state drive (SSD). These components are communicatively connected to each other via internal bus 25. Input interface 16 accepts user operations on terminal 200 via input device 16A. Display interface 17 includes a driver circuit that drives display 17A based on image data to display an image. The storage device 20 stores a program 22 that, when read and executed by the processor 11, realizes various processes.

[0053] The processor 11 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one central processing unit (CPU), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA), or a combination thereof.

[0054] The processor 11 realizes various processes according to this embodiment by expanding the program 22 stored in the storage device 20 into the main memory 12 and executing it. The main memory 12 provides a work memory necessary for the processor 11 to execute the program.

[0055] The camera 13 is an imaging device having a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor. The imaging field of the camera 13 has a range in which it can capture an image of the member operating the terminal 200, and generates image data such as captured video (video) or still images. The microphone 14 is configured to collect sound around the terminal 200. The sound collected by the microphone 14 may include the voice of the member operating the terminal 200.

[0056] The communication interface 15 exchanges data and signals with the information processing device 300 via the network 100. As an example, the terminal 200 transmits and receives image data, audio data, and the like to and from the information processing device 300 via the communication interface 15. The image data includes image data based on an image captured by the camera 13 of the terminal 200, and the audio data includes audio data collected by the speaker 18 of the terminal 200.

[0057] During the conference, the information processing device 300 receives image data and audio data transmitted from the terminal 200, and transfers the received image data and audio data to the terminals 200 of the other members. The terminal 200 displays an image based on the image data received from the information processing device 300 on the display 17A, and outputs audio based on the audio data received from the information processing device 300 from the speaker 18. This allows the members to communicate with each other by exchanging images and audio via the terminals 200 during the conference.

[0058] The communication interface 15 can also receive screen data from the information processing device 300. More specifically, the information processing device 300, as a web server, transmits a web page to the terminal 200, and the web browser of the terminal 200 displays a screen based on the web page from the information processing device 300 on the display 17A via the display interface 17.

[0059] The optical drive 19 reads various programs (for example, program 22) stored in an external storage medium such as an optical disk 19A, and installs them in the storage device 20. While Fig. 2 shows an example of a configuration in which a required program is installed in the terminal 200 from an external storage medium, the present invention is not limited to this, and the program may be downloaded from another device on the network 100. Furthermore, the external storage medium is not limited to the optical disk 19A, and may be, for example, a Universal Serial Bus (USB) memory, a Secure Digital (SD) card, a Compact Flash (CF), or other storage medium.

[0060] The program 22 in the storage device 20 may be provided not as a standalone program but as part of an arbitrary program. In this case, the program 22 cooperates with the arbitrary program to realize the processing according to this embodiment. Even a program that does not include some of these modules does not deviate from the spirit of the terminal 200 according to this embodiment. Furthermore, some or all of the functions provided by the program 22 may be realized by dedicated hardware. Furthermore, the camera 13, microphone 14, and speaker 18 may be externally attached to the terminal 200, and not only one of these devices but multiple devices may be connected to the terminal 200.

[0061] Referring to FIG. 3, the information processing device 300 includes a processor 301, a main memory 302 including a volatile storage medium such as a ROM and a RAM, a communication interface 303 including a communication circuit including a NIC, an input interface 305 connecting an input device 305A such as a keyboard or a mouse that can be operated by a user, a display interface 306 connecting a display 306A, an optical drive 307 to which an optical disk 307A, an example of a storage medium, is removably attached, and a storage device 310 including a non-volatile storage medium such as an HDD or SSD. These components are communicatively connected to each other via an internal bus 319. The input interface 305 accepts user operations on the information processing device 300 via the input device 305A. The display interface 306 also includes a driver circuit that drives the display 306A based on image data to display an image. The storage device 310 stores firmware that is read and executed by the processor 11. This software includes a program 22 that realizes various processes and a database group 330 consisting of multiple databases (DBs).

[0062] The processor 301 is configured, for example, by at least one integrated circuit, which may be configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0063] The processor 301 realizes various processes according to this embodiment by loading the program 320 stored in the storage device 310 into the main memory 302 and executing it. The main memory 302 provides a work memory necessary for the processor 301 to execute the program.

[0064] The communication interface 303 exchanges data and signals with the terminal 200 via the network 100. As an example, the information processing device 300 exchanges image data, audio data, screen data, etc. with the terminal 200 via the communication interface 303.

[0065] The optical drive 307 reads various programs (e.g., program 320) and data such as DB stored therein from an external storage medium such as the optical disk 307A, and installs them in the storage device 310. FIG. 3 shows a configuration example in which a necessary program is installed in the information processing device 300 via the optical drive 307, but it is not limited thereto, and it may be downloaded from other devices on the network 100 or the like. Further, the external storage medium is not limited to the optical disk 307A, and may be a storage medium such as a USB memory, an SD card, or a CF card.

[0066] Note that the program 320 may be provided by being incorporated into a part of an arbitrary program instead of being a single program. In this case, the processing according to the present embodiment is realized in cooperation with an arbitrary program. Even a program that does not include such a partial module does not deviate from the gist of the information processing device 300 according to the present embodiment. Further, some or all of the functions provided by the program 320 may be realized by dedicated hardware.

[0067] <C. Software Configuration of Information Processing Device> FIG. 4 is a diagram schematically showing the software configuration of the mental state evaluation unit according to the present embodiment. FIGS. 24 to 28 are diagrams showing an example of the display screen of the display according to the present embodiment. The mental state evaluation unit according to the present embodiment is configured to include software having a program 320 and a DB group 330 included in the information processing device 300. The processing performed by the mental state evaluation unit will be described with appropriate reference to the screens of FIGS. 24 to 28.

[0068] 4, the psychological state evaluation unit 400 includes a psychological state measurement unit 413 that estimates the possibility that the psychological state of a meeting member is in a predetermined state, a determination unit 414 that determines the estimated possibility in accordance with the purpose of the meeting, and a processing unit that performs information processing related to the determination unit 414. The psychological state measurement unit 413 receives, from the terminal 200 during the meeting, audio data 50 of the voice collected by the microphone 14 and image data 51 of the image captured by the camera 13, and estimates the possibility that the psychological state of the member is in a predetermined state (a state of psychological safety) from the feature amounts related to the member's remarks contained in the received audio data 50 and the image feature amounts related to the member's behavior contained in the image data 51.

[0069] The psychological state evaluation unit 400 has an audio processing unit 401 and an image processing unit 402 in association with the psychological state measurement unit 413. Furthermore, as processing units in association with the determination unit 414, the psychological state evaluation unit 400 has an FB (short for feedback) input unit 403 that receives FB information 52, an FB processing unit 405 that processes the FB information 52, a result output processing unit 408, a comparison processing unit 406 that performs comparison processing on the evaluation results, and a comparison result output unit 404 that outputs the comparison results. The psychological state evaluation unit 400 uses various DBs of the DB group 330 for processing by the determination unit 414. More specifically, the DB group 330 has, for example, a determination index value DB 331, a priority item management DB 332, a member attribute DB 333, and a measurement result management DB 334.

[0070] (c1. Configuration of the psychological state measurement unit 413) The psychological state measurement unit 413 estimates the degree (possibility) of psychological safety of members during a conference. An example of this estimation method will be described. FIG. 29 is a diagram illustrating a method for psychological state determination according to this embodiment. The psychological state measurement unit 413 acquires an estimated value for each utterance for each item from the voice data 50 received from the terminal 200 during the conference, and acquires a representative value from the estimated values ​​acquired for each utterance for each item. This representative estimated value is output for each item. Hereinafter, the representative estimated value will be referred to as an estimated value 42. The representative value may be the average, mode, median, etc. of the estimated values ​​of multiple utterances detected in the conference.

[0071] A method for acquiring an estimated value 42 from speech made by members during a meeting will now be described. The speech processing unit 401 detects speech boundaries in the speech data 50 from the terminal 200, extracts speech data of speech from the speech data 50 based on the detected boundaries, and performs speech recognition processing on the extracted speech data to convert it into text data. The language analysis unit 410 of the psychological state measurement unit 413 performs natural language processing on the text data of speech. As a result, one or more words or phrases 291 constituting a sentence are recognized from the text data. The language analysis unit 410 searches dictionary data (not shown) based on each word or phrase 291 to identify a type 292. Furthermore, a tone 293 is detected for each word or phrase 291. More specifically, the speech data 50 includes data indicating the volume of a voice in chronological order from the start to the end of a speech. The speech processing unit 401 extracts, from the time-series data, the volume of the voice (loud, medium, soft) corresponding to the speech period in which each recognized word or phrase 291 was extracted from the speech data 50, as mood 293. An example of the analysis result of the language analysis unit 41 is shown in FIG. 29. In FIG. 29, for example, if the statement is "That mistake is a problem. Why did you make that mistake at this time? Did you check it?", the analysis result includes multiple words (phrases) 291, the word type 292 of each word (phrase) 291, and mood 293.

[0072] After analyzing the utterance, the psychological state estimation unit 412 determines an influence value 294 for each word (phrase) 291 in FIG. 29 based on its type 292 and tone 293, for example, in accordance with a rule base learned for item (1) "When I make a mistake in my team, I often get criticized." The influence value 294 is indicated by a value to be deducted from a predetermined score. The rule base for item (1) is learned so that the closer the utterance is determined to be to the content (word (phrase), tone) determined to be "being criticized for a mistake," the greater the deduction value for the influence value 294, and therefore the estimated value of item (1) for that utterance becomes smaller.

[0073] Here, the rule base for item (1) has been described as an example, but the psychological state measurement unit 413 also uses learned rule bases for the other items (2) to (7) by storing them, for example, in the storage device 310. The psychological state estimation unit 412 determines the influence value 294 of each word (phrase) in the utterance in accordance with the rule base for each of the other items (2) to (7), and can output an estimated value for the item from the determined influence value 294.

[0074] This allows us to obtain estimates for each of items (1) to (7) for the statement "That mistake is a problem. Why did you make that mistake at this time? Did you check?"

[0075] In a conference, multiple utterances are actually detected. The psychological state measurement unit 413 obtains an estimated value for each of items (1) to (7) for each detected utterance in the same manner as in the procedure described above. At a predetermined timing during the conference, for example, when the conference ends, the psychological state measurement unit 413 calculates a representative value (average, median, mode, etc.) for each item based on the estimated values ​​of the multiple utterances. The psychological state estimation unit 412 outputs the representative value for each item calculated in this manner as the estimated value 42.

[0076] In this embodiment, the data used to derive the estimated value 42 is not limited to the audio data 50, but may be any data observed of the members during the meeting. For example, image data 51 may be added as the observed data. More specifically, the image processing unit 402 extracts partial images of the members from each frame image of the image data 51. The behavior analysis unit 411 analyzes the extracted partial images of the members and extracts image features related to the people's behavior. Features based on the members' utterances (word (phrase) type 292 and tone 293) and image features related to the people's behavior may be input into a rule base as meeting information obtained by observing the members during the meeting, and the rule base as a trained estimation model may derive the likelihood that the members have psychological safety as the estimated value 42 of the estimation result. The image features related to the behavior may include image features representing people's behaviors that reflect their psychological states, such as eye movements and hand movements.

[0077] Although the psychological state measurement unit 413 is configured to have a learned rule base as a learning model for deriving the estimated value 42, the learning model for deriving the mental estimated value 42 is not limited to a learned rule base.

[0078] (c2-1. Configuration using the determination index value DB 331 of the determination unit 414) The determination unit 414 determines the possibility indicated by the estimated value 42 of each item output from the psychological state measurement unit 413 based on the index value corresponding to the item in the determination index value DB 331, and outputs a determination value 43 indicating the result. FIG. 5 is a diagram schematically illustrating an example of the determination index value DB 331 according to this embodiment. Referring to FIG. 5, the determination index value DB 331 can set default values ​​or the like in advance for the index values ​​of each item (the above questions (1) to (7)) for each purpose of the meeting (e.g., idea development meeting, progress meeting, apology meeting, etc.) by conducting the above-mentioned experiments, etc. The index value is a value used to determine the possibility (magnitude of possibility) that members in the meeting are experiencing psychological safety from the estimated value 42 of each item estimated for the meeting.

[0079] Fig. 24 shows an example of a UI (user interface) screen for setting an index in the determination index value DB 331. The determination index value setting unit 415 displays the UI screen of Fig. 24 on the display 306A of the information processing device 300 or the display 17A of the terminal 200. When displaying the UI screen on the display 17A, the determination index value setting unit 415 transmits a web page to the terminal 200, and the web browser of the terminal 200 displays a web screen based on the web page from the determination index value setting unit 415 on the display 17A.

[0080] 24, the user can specify and set index values ​​241 for each item for each purpose of the conference by operating cursor 244 from pull-down menu 245. When register button 242 is operated, judgment index value setting unit 415 registers the set index values ​​for each item in judgment index value DB 331. The user can cancel the registration operation by operating cancel button 243.

[0081] Fig. 6 is a diagram showing an example of estimated values ​​42 according to the present embodiment. The estimated values ​​42 in Fig. 6 indicate, for example, estimated values ​​for each item estimated for a progress meeting.

[0082] Fig. 7 is a diagram illustrating a determination method of determination unit 414 according to this embodiment. Referring to Fig. 7, determination unit 414 searches determination index value DB 331 for index values ​​of each item corresponding to the progress meeting in Fig. 7(A) based on the purpose of the meeting, i.e., the progress meeting. Determination unit 414 compares estimated value 42 of each item with the index value corresponding to the item, and outputs determination value 43 for the item based on the comparison result.

[0083] For example, when the determination unit 414 determines that the comparison result for each item satisfies the condition (estimated value 42 ≧ index value), it outputs "Good (indicated by ○ in the figure)" (10 points) as the estimated value 42 of that item indicates a high possibility of psychological safety, but when it determines that the condition is not satisfied, it outputs "NG (indicated by × in the figure)" (0 points) as the estimated value 42 is unlikely to be psychological safety. Furthermore, when the comparison result satisfies the condition (estimated value 42 ≦ (index value - 1)), the determination unit 414 may output an intermediate score of 5 points.

[0084] The judgment unit 414 sums the output values ​​of each item (either 10 points, 5 points, or 0 points), compares the sum with the sum of the judgment index value DB 331, and if it detects that the comparison result satisfies the condition (sum of the output values ​​of each item ≧ sum of the indexes), the judgment unit 414 outputs "Good" as the judgment value 43, which qualitatively indicates that the members of the meeting are likely to have psychological safety, as shown in Fig. 7(B). In this way, the judgment values ​​(the degree of likelihood that psychological safety is present) determined for each of the multiple items are converted into numerical values, but the converted values ​​are not limited to 10 points, 5 points, 0 points, etc.

[0085] The judgment unit 414 sums up the output values ​​of each item, compares the sum with the sum of the judgment index value DB331, and if it detects that the comparison result satisfies the condition (sum of the output values ​​of each item < sum of the indexes), it outputs "NG" as judgment value 43, a qualitative value indicating that the members of the meeting are unlikely to have psychological safety.

[0086] The judgment unit 414 may also display the judgment value 43 as a quantitative value. For example, if the total value of the index is a maximum of 100 points, the judgment unit 414 may calculate how many points out of 100 the total output value of each item accounts for, and if the calculation result exceeds a threshold, it may determine that there is a high possibility that psychological safety exists. Alternatively, the judgment unit 414 may calculate the percentage that the total output value of each item accounts for in the total index value, and output the calculated value as the judgment value 43. For example, in FIG. 7C, this percentage is calculated as "75," and the judgment unit 414 detects that "75" exceeds the threshold, and as a result, it determines that there is a high possibility that psychological safety exists ("Good"). The judgment unit 414 may also output, as the judgment value 43, both or either of a qualitative value such as "Good" or "NG" and a calculated quantitative value (such as "75").

[0087] (c2-2. Configuration using the priority item management DB 332 of the determination unit 414) Depending on the purpose of the meeting, there may be items that are particularly important in assessing whether psychological safety exists. The judgment unit 414 compares the estimated value 42 of the important item with the corresponding index value in the judgment index value DB 331, and if it detects that the comparison result does not satisfy the condition (estimated value ≧ index value), it outputs the judgment value 43 as “NG” even if the estimated values ​​42 of other items satisfy the condition.

[0088] The priority items for each purpose of the meeting are managed by the priority item management DB 332. Fig. 8 is a diagram schematically showing an example of the priority item management DB 332 according to this embodiment. Referring to Fig. 8, the priority item management DB 332 has preset priority items for each purpose of the meeting. In Fig. 8, for example, items (2) and (7) are set as priority items 81 for the progress meeting.

[0089] Item (2) indicates that "Members of the meeting can discuss issues and negative thoughts with each other." In progress meetings, item (2) is an important item for determining whether members have the psychological safety to actively speak up about delays in progress.

[0090] Additionally, item (7) indicates, "When working with current meeting members, I feel that my skills are being utilized." In progress meetings, item (7) is an important item for determining whether members have psychological safety, which means that they share the progress of their work and bring about positive thinking in working with other members.

[0091] Fig. 25 shows an example of a UI screen for setting priority items in priority item management DB 332. The UI screen of Fig. 25 is displayed by priority item setting unit 416 on display 306A of information processing device 300 or display 17A of terminal 200. When priority item setting unit 416 displays the UI screen on display 17A, it transmits a web page to terminal 200, and the web browser of terminal 200 displays a web screen based on the web page from priority item setting unit 416 on display 17A.

[0092] 25, the user can specify a desired item for each purpose of the conference by operating cursor 244, and set the item as a priority item 81. When register button 252 is operated, priority item setting unit 416 registers priority item 81 in priority item management DB 332. The user can cancel the registration operation by operating cancel button 253.

[0093] FIG. 9 is a diagram illustrating an example of a determination result obtained by the determination unit 414 using the priority item management DB 332 according to the present embodiment. (A) of FIG. 9 shows a determination value 43 obtained by the determination unit 414 determining the estimated value 42 of a progress meeting using only the index values ​​in the determination index value DB 331. In contrast, (B) of FIG. 9 shows a determination value 43 obtained by the determination unit 414 determining the same estimated value 42 based on the determination index value DB 331 and the priority items 81 in the priority item management DB 332. In (A) of FIG. 9, the determination value 43 indicates “Good” and 75 points, indicating that the progress meeting is highly likely to have members with psychological safety. However, in (B) of FIG. 9, the determination value 43 indicates “NG” and 55 points, indicating that the progress meeting is unlikely to have members with psychological safety and requires caution. This difference is due to an adjustment of the determination value 43. In other words, a detection 91 is made that the estimated value 42 of item (2) set in the priority item 81 satisfies the condition (estimated value ≧ index value), but a detection 92 is made that the estimated value 42 of item (7) does not satisfy the condition (estimated value ≧ index value), and an adjustment value 92a of −20 points is added to the judgment value 43.

[0094] As shown in FIG. 9, when the above conditions are not met for the priority item 81, a negative adjustment value 92a is applied to the judgment value 43, resulting in a judgment of (75-20) = 55 points. When the above conditions are met for the priority item 81, the negative adjustment value 92a is not applied to the judgment value 43. Note that the adjustment value 92a for the priority item 81 is not limited to -20 points and can be set by the user. For example, the adjustment value 92a may be set to a negative or positive value. In this way, the judgment value 43 of the priority item can be adjusted by increasing or decreasing the adjustment value 92a.

[0095] (c2-3. Output of results) 10 is a diagram schematically illustrating an example of a report 60 according to this embodiment. The judgment value 43 for the conference output by the judgment unit 414 is stored in the measurement result management DB 334. The result output processing unit 408 searches the measurement result management DB 334 for the judgment value 43 for the conference and outputs the searched judgment value 43. The result output processing unit 408 displays the judgment value 43, for example, on the display 306A of the information processing device 300. Alternatively, the result output processing unit 408 may transfer the judgment value 43 to the terminal 200 so that it is displayed on the display 17A. Note that the output device for the judgment value 43 is not limited to a display and may be a printer or the like.

[0096] The judgment value 43 is output in the form of a report 60 shown in Fig. 10, for example. Referring to Fig. 10, the report 60 includes the purpose of the meeting, the index values ​​of items (1) to (7), the estimated value 42, the judgment value (Good, NG), and a score that quantitatively judges the degree of psychological safety (75 / 100 points in Fig. 10).

[0097] The report 60 may include the date of the meeting, the purpose of the meeting, the number and identification information of the meeting members, and the index value used to derive the judgment value 43 (if it is a default value, a statement that it is the default index value).

[0098] (c3. Change of index value) In this embodiment, a user can set and change the index in the determination index DB 331. When a user sets an index using the input device 16A or 305A, the determination index setting unit 415 sets the index in the determination index DB 331 based on the user operation received by the input device 16A or 305A via the input interface. Note that users who are permitted to set or change indexes may include members of the conference. FIG. 11 is a diagram showing another example of the configuration of the determination index DB 331 according to this embodiment.

[0099] For example, the members of the progress meeting self-evaluate the report 60 and input feedback (abbreviated as “FB” in FIG. 4) information 52 that reflects the results of the self-evaluation in the determination index value DB 331 into the psychological state evaluation unit 400.

[0100] For example, if a member self-evaluates that "item (7) is always rated 'NG'" despite the high level of psychological safety they felt in progress meetings, the member may conclude that "maybe the index value for item (7) is high." In this case, the member inputs feedback information 52 for changing the index value for item (7) in the progress meeting. The feedback input unit 403 receives the feedback information 52 from the user and outputs it to the feedback processing unit 405. The feedback processing unit 405 extracts the purpose of the meeting for which the index value is to be changed, the identifier of the item to be changed, and the index value after the change from the user's feedback information 52, and outputs the extracted results to the index value change unit 418.

[0101] Based on the extraction result, the index value change unit 418 searches the determination index value DB 331 for the item to be changed for the meeting to be changed, and sets the changed index value indicated by the extraction result for the searched item. As a result, in the determination index value DB 331, for example, the index value of item (7) corresponding to the meeting whose purpose is a progress meeting is changed to the new index value specified by the member in the Facebook information 52. Referring to Figure 11, the index value of item (7) corresponding to the progress meeting meeting has been changed 111 from 4 to 3.5.

[0102] The FB processing unit 405 may change the index value as described above as follows: For example, when receiving FB information 52 for the same item in a conference with the same purpose from a predetermined number of members, the FB processing unit 405 may calculate a representative value (average, mode, median, etc.) from the index values ​​indicated in the FB information 52 received from each member, and output this representative value to the index value change unit 418 as the changed index value.

[0103] In this way, the index value change unit changes the index value based on a user operation received by the input interface, or when user operations are received from multiple users, changes the index value based on the user operations.

[0104] Furthermore, the method of changing the index value by the FB processing unit 405 is not limited to a change method using the FB information 52. For example, when it detects that there is a difference between the index value of an item of a conference with a certain purpose and the index value of the corresponding item of a conference with another purpose (for example, when it detects that this difference exceeds a threshold), the FB processing unit 405 calculates a median based on the difference. Then, it causes the index value change unit 418 to change (correct) the index value of the corresponding item to indicate the median. This median is the intermediate value between the index value of an item of a conference with a certain purpose and the index value of the corresponding item of a conference with another purpose.

[0105] Fig. 26 shows an example of a UI screen for accepting FB information 52. The UI screen of Fig. 26 is displayed by the FB input unit 403 on the display 306A of the information processing device 300 or the display 17A of the terminal 200. When the FB input unit 403 displays the UI screen on the display 17A, it transmits a web page to the terminal 200, and the web browser of the terminal 200 displays a web screen based on the web page from the FB input unit 403 on the display 17A.

[0106] The UI screen of FIG. 26 displays, for example, a report 60 of an idea development meeting and feedback information 52. The user can self-evaluate the report 60 and set a specified index value for a desired item by operating the cursor 264 to specify an index value from the pull-down menu. When the register button 262 is operated, the feedback input unit 403 inputs the feedback information 52 set on the UI screen of FIG. 26. The user can cancel the input of the feedback information 52 by operating the cancel button 263.

[0107] (c4. Comparison of the judgment value before and after changing the index value) In this embodiment, the comparison processing unit 406 searches the measurement result management DB 334 for the judgment value of each item of the conference for each purpose of the conference, compiles the searched judgment values ​​into comparison result data 271 having a format that allows comparison in the order of the dates on which the conferences were held, and outputs the data to the comparison result output unit 404. The comparison result output unit 404 outputs the comparison result data 271 from the comparison processing unit 406 to the information processing device 300 or the terminal 200. This makes it possible to output judgment values ​​43 judged by the judgment unit 441 for each of multiple conferences that were held at different times and had the same purpose and in which members participated.

[0108] 27 and 28 show examples of UI screens that display comparison result data 271. The UI screen in Fig. 27 is displayed by comparison result output unit 404 on display 306A of information processing device 300 or display 17A of terminal 200. When comparison result output unit 404 causes the UI screen to be displayed on display 17A, it transmits a web page to terminal 200, and the web browser of terminal 200 displays a web screen based on the web page from comparison result output unit 404 on display 17A.

[0109] The UI screen in Figure 27, for example, lists the judgment scores for each item in each of the four idea development meetings held between July 21 and July 30, 2021, in chronological order, in association with the index value for that item. From the list in Figure 27, users can check how much the degree of psychological safety experienced by members has changed over time as idea development meetings have been held multiple times, or can check when meetings with high or low levels of psychological safety were held.

[0110] When the user wants to display a UI screen of comparison result data 271 based on the index value changed by index value change unit 418, or when the user wants to instruct "re-evaluation" based on the changed index value, the user operates button 277. When comparison result output unit 404 receives a user operation of button 277, it outputs the received user operation to comparison processing unit 406. Comparison processing unit 406 outputs a re-evaluation instruction to recalculation processing unit 407 based on the user operation.

[0111] Upon receiving the re-evaluation instruction, the recalculation processing unit 407 recalculates the judgment value for each item of each of the four idea development meetings based on the index values ​​changed by the judgment index value setting unit 415. More specifically, the recalculation processing unit 407 searches the measurement result management DB 334 for the estimated value 42 of each item for each of the four idea development meetings, compares the retrieved estimated value 42 of each item with the changed index value, and calculates a judgment value (Good, NG, total score) based on whether the comparison result satisfies the condition (estimated value 42≧index value). The comparison result output unit 404 displays the comparison result data 271 including the judgment values ​​recalculated using the changed index values ​​for the four idea development meetings. An example of the display is shown on the UI screen of FIG. 28.

[0112] The UI screen in Figure 28 lists the judgment values ​​for each item in each of the four idea development meetings, in chronological order, in association with the index values ​​used in the calculation. On the UI screen in Figure 28, the index value for item (5) has been changed from the original 4.0 to a lower value of 3.5. The recalculated judgment value for item (5) in Figure 28 due to this change indicates a greater degree of psychological safety (an improvement) than the judgment value for item (5) in Figure 27.

[0113] When the user checks the improvement in the judgment value from each UI screen in Figure 28, even if the level of psychological safety in Figure 27 is low, the user can confirm that this is not due to the members themselves, but rather to the index values ​​used in the evaluation. In this way, the psychological state evaluation unit 400 can provide the user with the comparison result data 271 before and after the index value change in Figures 27 and 28 as support information for finding the cause of the loss of psychological safety among members in a meeting.

[0114] (c5. Change the index value depending on the attributes of the meeting members) In this embodiment, the index value change unit 418 changes (corrects) the index values ​​in the determination index value DB 331 in response to determining that a member exhibits a predetermined attribute or that a predetermined number of members have the predetermined attribute based on the attributes of the meeting members retrieved from the member attribute DB 333 in which the member attributes are registered. FIGS. 12 and 13 are diagrams each showing an example of an index before and after the change, in association with each other. FIG. 12 illustrates a case in which the index value change unit 418 changes the index values ​​of items (2) and (7) among the index values ​​for, for example, an idea development meeting in the determination index value DB 331 in response to the attributes of the members of the idea development meeting retrieved from the member attribute DB 333. FIG. 13 illustrates a case in which the index value change unit 418 changes the index values ​​of items (1), (2), and (7) among the index values ​​for, for example, a progress meeting in the determination index value DB 331 in response to the attributes of the members of the progress meeting meeting retrieved from the member attribute DB 333.

[0115] For example, in an idea development meeting held within an organization such as a company, members of the organization participate as participants. It is known that the degree of psychological safety experienced by members varies depending on the attributes of other members, such as their positions within the organization. For example, an idea development meeting is designed to create an atmosphere in which members can speak freely. However, if the other members include a certain number of high-ranking members, such as department heads or directors, this atmosphere is impaired. Therefore, it is expected that members will make more inoffensive comments. Therefore, the index value of item (2) in Figure 12, "Members of the meeting can discuss issues and negative comments with each other," is lowered. Furthermore, because it is expected that other members (e.g., department heads or directors) will make negative or intimidating comments, the index value of item (7) "I feel that my skills are being utilized when working on the current meeting" is lowered.

[0116] For example, if a project progress meeting includes a new employee, other members will likely provide guidance or warnings to the new employee in order to efficiently progress the project. Since the number of guidance and warnings is expected to increase in this progress meeting, the index value for item (2) "Meeting members can discuss issues and negative comments with each other" shown in Figure 13 is changed to a higher value. Furthermore, to ensure that guidance and warnings are not intimidating to new employees, i.e., that they are not lowering the level of psychological safety they have, the index value for item (7) "I feel that my skills are being utilized when working in the current meeting" is changed to a lower value.

[0117] In this embodiment, the attribute registration unit 417 acquires the attributes of the members of the conference based on user operation of the input device 16A or 305A via the input interface, and registers the acquired attributes of each member in the member attribute DB 333. When the estimated value 42 of the conference is evaluated, the index value change unit 418 identifies items to be changed in the index values ​​of each item of the conference in the determination index value DB 331 according to predetermined rules based on the attributes of each member searched for in the member attribute DB 333 and the purpose of the conference, as described above, and changes the identified items to predetermined index values. The determination unit 414 determines the estimated value 42 of each item of the conference based on the changed index values. This makes it possible to determine the degree to which members have psychological safety in the conference based on their attributes. The above rules used by the index value change unit 418 are acquired in advance through experiments or the like.

[0118] <D.フローチャート> The processing according to this embodiment will be described with reference to the flowcharts of FIGS. 14 to 23. The processing of these flowcharts is realized by the processor 301 executing the program 320. FIG. 14 is a schematic flowchart of the overall processing according to this embodiment. Referring to FIG. 14, the processor 301 executes routines R1, R2, and R3. In routine R1, the processor 301, acting as the determination index value setting unit 415, sets an index value for each item in the determination index value DB 331 for each meeting, i.e., for each purpose of the meeting. In routine R2, the processor 301, acting as the psychological state measurement unit 413, measures the degree to which members feel psychological safety in the meeting and outputs the measurement results as the estimated value 42 for each item. In routine R3, the processor 301, acting as the judgment unit 414, judges the estimated value 42 measured and output for the meeting and outputs the judgment value 43.

[0119] (d1. Routine for setting judgment index values ​​for each meeting: R1) Fig. 15 is a flowchart of routine R1 of Fig. 14. Referring to Fig. 15, processor 301 determines whether or not to change the conference index value from a default value (for example, an initial value) based on a user operation (step S1). If it is determined not to change the index value (NO in step S1), the processing ends. However, if it is determined to change the index value (YES in step S1), the screen of Fig. 24 for setting the index value is displayed on the display (step S2). Processor 301 determines whether or not to import (read) the conference judgment index value from an external file based on a user operation (step S3).

[0120] When the processor 301 determines that the index value is to be imported from an external file (YES in step S3), it executes a routine R14 to automatically set the judgment index value for the conference from the external file, but when it determines that the index value is not to be imported from an external file (NO in step S3), it executes a routine R15 to set the manually set index value as the judgment index value for the conference.

[0121] (d1-1. Routine for setting judgment index values ​​for each meeting in an external file: R14) Fig. 16 is a flowchart of routine R14 in Fig. 15. Referring to Fig. 16, processor 301 displays a list of candidate external files on a display, accepts an operation from the user to specify a desired file (step S10), reads out the index values ​​of each item for each conference from the specified external file, and reflects (sets) the index values ​​as the index values ​​of each item for the conference in determination index value DB 331 (step S11).

[0122] Fig. 17 is a flowchart of routine R15 of Fig. 15. Referring to Fig. 17, processor 301 displays the UI screen of Fig. 24 on the display in order to manually set index values ​​(step S12), inputs index values ​​for each item for each conference based on a received user operation via the UI screen (step S13), and reflects (sets) the input index values ​​for each item for each conference as index values ​​for each item of the conference in determination index value DB 331 (step S14).

[0123] The external file includes, for example, a file storing index values ​​of meetings of other project teams in the judgment index value DB 331. More specifically, when a user of a certain department or team wants to change the index values ​​applied to a meeting for a certain purpose, the user can use, as an external file, a file having index values ​​applied to each item of a meeting for the same purpose in another department or team.

[0124] Furthermore, when changing an index value, the index value change unit 418 may change the original index value in accordance with a change rule. The change rule may include, for example, a rule for change based on index values ​​for multiple conferences with the same purpose. The change rule may also include a rule for change of the index value of the target conference based on index values ​​for multiple conferences with the same purpose but with different members. For example, the change rule may include a rule that, if the difference between the original index value and the new index value exceeds a threshold, the original index value is rewritten (changed) to a value intermediate between the two. The change rule may be a combination of these rules, and is not limited to these rules.

[0125] (d2-1. Mental state estimation routine during a meeting: R2) Fig. 18 is a flowchart of routine R2 of Fig. 14. Referring to Fig. 18, processor 301 searches conference schedule data (not shown) based on the current time, and determines whether the conference to be estimated has started based on the search results (step S21). If it is determined that the conference to be estimated has not started (NO in step S21), processor 301 repeats the process of step S21. However, if it is determined that the conference to be estimated has started (YES in step S21), processor 301, as audio processing unit 401, detects and starts collecting text data of utterances from audio data 50 transferred and received from terminal 200, and also, as image processing unit 402, detects and starts collecting image features indicative of the actions of members from image data 51 transferred and received from terminal 200 (step S22).

[0126] Processor 301 analyzes meeting information, which is information observed by members in a meeting, including text data of utterances from audio processing unit 401 and image features of actions from image processing unit 402 (step S23). More specifically, processor 301, as language analysis unit 410, analyzes the text data of utterances and outputs, for example, type 292 and tone 293 corresponding to each word (phrase) 291 shown in Fig. 29 as analysis result data. Furthermore, processor 301, as image processing unit 402, outputs features representing the actions (e.g., eye movements, hand movements) of members in image data 51 as meeting information, which is information observed by members.

[0127] While executing the routine R16 for estimating and evaluating psychological states in a meeting, the processor 301 determines whether the target meeting has ended (step S24). If it is determined that the target meeting has not ended (NO in step S24), the routine R16 is repeated. However, if it is determined that the target meeting has ended (YES in step S24), the processing ends. The end of the meeting is determined based on whether a speech indicating the end of the meeting is detected by speech recognition processing based on the voice data 50, or whether a member has performed a logout operation.

[0128] (d2-2. Routine for Estimating and Evaluating Psychological Conditions: R16) FIG. 19 is a flowchart of the routine R16 of FIG. 18. Referring to FIG. 19, processor 301 searches, for example, conference schedule data, which is information registered regarding the conference (purpose, member identification information, etc.), and determines whether the purpose of the target conference is registered based on the search results (step S31). If processor 301 determines that the purpose is registered (YES in step S31), it proceeds to step S32. However, if processor 301 determines that the purpose is not registered (NO in step S31), it determines whether the purpose of the conference was uttered at the beginning of the conference based on utterance data derived by speech recognition processing of speech data 50 (step S34). If processor 301 determines that the purpose of the conference was uttered (YES in step S34), it proceeds to step S32. For example, the purpose of the conference is acquired by performing recognition processing on speech collected during the conference (e.g., at the beginning). If processor 301 determines that the purpose of the conference was not uttered (NO in step S34), it determines whether the purpose of the conference can be identified from the behavioral data (step S35). If the purpose of the meeting can be identified (YES in step S35), the process proceeds to step S32. If the purpose of the meeting cannot be identified (NO in step S35), the processor 301 functions as the psychological state measurement unit 413 to output an estimated psychological state value 42 for each item of the target meeting based on the analysis results of the meeting information, and functions as the determination unit 414 to output a determination value 43 using a default index value (step S37), and the process ends.

[0129] If the purpose of the meeting has been determined, the processor 301, as the psychological state measurement unit 413, outputs an estimated value 42 for each item of the target meeting based on the meeting information (step S32). The processor 301, as the judgment unit 414, compares the estimated value 42 for each item output in step S32 with the index value for each item corresponding to the target meeting searched for in the judgment index value DB 331, and calculates a judgment value 43 (Good, NG) for each item based on whether the comparison result satisfies the above condition (step S33). The estimated value 42 and judgment value 43 for each item of the target meeting are stored in the measurement result management DB 334. Then, the processing ends.

[0130] (d3-1. Judgment result processing routine: R3) Fig. 20 is a flowchart of routine R3 of Fig. 14. Referring to Fig. 20, processor 301, functioning as determination unit 414, calculates a score based on determination value 43 of each item of the target conference, and stores the score in measurement result management DB 334 (step S41).

[0131] Processor 301, as result output processing unit 408, searches measurement result management DB 334 for estimated values ​​42 and judged values ​​43 for each item of the target conference, as well as the scores, and displays information based on the search results as report 60 on the display (step S42).

[0132] Processor 301 determines whether there is a request for feedback on the self-evaluation based on a user operation (step S43). If it is determined that there is a feedback request (YES in step S43), processor 301 executes a feedback processing routine R17.

[0133] If it is determined that there is no feedback request (NO in step S43), processor 301 determines whether a comparison of the judgment value 43 between the target conference and a conference held in the past is requested based on a user operation (step S44). If it is determined that the comparison is not requested (NO in step S44), the processing ends, but if it is determined that the comparison is requested (YES in step S44), processor 301 executes a comparison routine R18 of the conference result information and then ends the processing.

[0134] If it is determined that there is a feedback request (YES in step S43), processor 301 executes a feedback processing routine R17, and then ends the processing.

[0135] (d3-2. Feedback processing routine: R17) Fig. 21 is a flowchart of the feedback processing routine R17 of Fig. 20. Referring to Fig. 21, the processor 301, as the FB input unit 403, causes the UI screen of Fig. 26 to be displayed on the display in order to accept the FB information 52 of the report 60 of the target conference from the user (step S51). The processor 301, as the FB processing unit 405, accepts the FB information 52 based on a user operation on the UI screen (step S52), and the processor 301, as the index value changing unit 418, sets an index value corresponding to each item indicated by the FB information 52 for the target conference in the determination index value DB 331 (step S53).

[0136] (d3-3. Routine for comparing meeting results: R18) Fig. 22 is a flowchart of the conference result information comparison routine R18 of Fig. 20. Referring to Fig. 22, the processor 301 displays on the display a UI screen that allows the user to select a comparison method (step S55). The comparison method options include: 0: compare using recorded results; 1: recalculate and compare using the current judgment index values; 2: recalculate and compare using all judgment index values ​​from the initial setup; and 3: compare using all default values.

[0137] Processor 301 determines the option selected based on the user operation (step S56). If it is determined that option 0 has been selected (YES in step S56), processor 301 functions as comparison processing unit 406 and comparison result output unit 404 to display a screen of comparison result data 271 in FIG. 27 on the display (step S70).

[0138] On the other hand, if it is determined that an option other than 0 has been selected (NO in step S56), processor 301 executes recalculation processing routine R19. Then, in step S70, a screen of comparison result data 271 based on the result of the recalculation processing is displayed on the display (step S70).

[0139] (Recalculation processing routine: R19) Fig. 23 is a flowchart of the recalculation processing routine R19 of Fig. 22. Referring to Fig. 23, processor 301 determines whether the option selected by the user is 1, 2, or 3 (steps S60 and S63).

[0140] If it is determined that the option is 1 (YES in step S60), processor 301, as recalculation processing unit 407, searches measurement result management DB 334 for estimated values ​​42 of each item for the target conference and for all conferences held this time and in the past, recalculates judgment value 43 based on the retrieved estimated values ​​42 of each item and the current index value of the item, and outputs comparison result data 271 based on the recalculation results (step S61). For example, if the target conference is an idea development meeting and the current index value of item (5) has been changed to 3.5 using index value change unit 418, comparison result data 271, which is the result of recalculation in step S61, is displayed, for example, as shown on the UI screen in FIG.

[0141] If it is determined that the option is 2 (NO in step S60 and YES in step S63), the processor 301, as the recalculation processing unit 407, recalculates the judgment value 43 for each of the above meetings based on the estimated value 42 of each item and the index value used in the initial evaluation of the item, and outputs the comparison result data 271 based on the results of the recalculation (step S64).

[0142] If it is determined that the option is 3 (NO in step S60 and NO in step S63), the processor 301, as the recalculation processing unit 407, recalculates the judgment value 43 for each of the above meetings based on the estimated value 42 of each item and the default index value of the item, and outputs the comparison result data 271 based on the results of the recalculation (step S65).

[0143] Thus, in the recalculation processing routine: R19, the recalculation processing unit 407 constitutes a re-determination unit that derives the determination value 43 using a new index value. More specifically, for at least one of multiple meetings held at different times (the meetings have the same purpose of idea development and are attended by approximately the same members) as shown in Fig. 27, the recalculation processing unit 407 determines the likelihood that members experienced psychological safety during the meeting based on the likelihood indicated by the estimated value 42 estimated by the psychological state measurement unit 413 and a predetermined index value. The predetermined index value includes the index value changed by the index value change unit 418, the default index value, or the like.

[0144] The above-described embodiment is not limited to application to online conferences, but may also be applied to, for example, face-to-face conferences, in which case the camera 13 and microphone 14 may be installed indoors.

[0145] <E.プログラム> In this embodiment, a program is provided to cause processor 301 to execute the above-described processes. Such a program includes at least a program for performing the processes according to the flowcharts of FIGS. 14 to 23. Such a program can be provided as a program product by being recorded on a computer-readable storage medium such as an optical disk 307A, a flexible disk, a CD-ROM (Compact Disk-Read Only Memory), a ROM, RAM, or a memory card that is attached to the computer of information processing device 300. Alternatively, the program can be provided by being recorded as a program on storage device 310 built into the computer. The program can also be provided by downloading via network 100. The program can be executed by one or more processors, such as processor 301, or by a combination of a processor and a circuit such as an ASIC or FPGA.

[0146] The program may call necessary modules from among program modules provided as part of a computer's OS in a predetermined sequence at a predetermined timing to cause a processor to execute processing. In this case, the program itself does not include the modules, and executes processing in cooperation with the OS. Such a program that does not include modules may also be included in the program of each embodiment.

[0147] Furthermore, the program according to the present embodiment may be provided by being incorporated into a part of another program. In this case, the program itself does not include the modules included in the other program, but cooperates with the other program to cause a processor to execute processing. Such a program incorporated into another program may also be included in the program according to the present embodiment.

[0148] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0149] 1 Conference system, 16A, 305A Input device, 200 Terminal, 11, 301 Processor, 12, 302 Main memory, 13 Camera, 14 Microphone, 15, 303 Communication interface, 16, 305 Input interface, 17, 306 Display interface, 17A, 306A Display, 18 Speaker, 19, 307 Optical drive, 19A, 307A Optical disk, 20, 310 Storage device, 22, 320 Program, 25, 319 Internal bus, 402 Image processing unit, 42 Estimated value, 43 Judgment value, 50 Audio data, 51 Image data, 52 FB information, 60 Report, 81 Priority item, 91, 92 Detection, 92a Adjustment value, 100 Network, 111 Change, 241 Index value, 242, 252, 262 Registration button, 243, 253, 263 Cancel button, 244, 264 Cursor, 245 Pull-down menu, 271 Comparison result data, 277 Button, 291 Phrase, 292 Type, 293 Speech tone, 294 Influence value, 300 Information processing device, 330 DB group, 400 Psychological state evaluation unit, 401 Speech processing unit, 403 Feedback input unit, 404 Comparison result output unit, 405 Feedback processing unit, 406 Comparison processing unit, 407 Recalculation processing unit, 408 Result output processing unit, 410 Language analysis unit, 411 Behavior analysis unit, 412 Psychological state estimation unit, 413 Psychological state measurement unit, 414 Judgment unit, 415 Judgment index value setting unit, 416 Priority item setting unit, 417 Attribute registration unit, 418 Index value change unit, 332 Priority item management DB, 333 Member attribute DB, 334 measurement result management DB, R1, R2, R3, R14, R15, R16 routines, R17 feedback processing routine, R18 comparison routine, R19 recalculation processing routine.

Claims

1. An information processing device for determining the psychological state of members in a meeting, a voice processing unit for extracting features from a portion of the voice corresponding to the speech of the member among the voices collected by a microphone during the conference; an estimation unit that receives the extracted feature amount as an input and estimates the possibility that the member is in a predetermined psychological state in accordance with a trained model; a determination unit that determines a possibility that the member is in the predetermined psychological state during the meeting based on the possibility estimated by the estimation unit and an index value according to the purpose of the meeting, the trained model is a model trained to input features extracted from an utterance and estimate the likelihood that the speaker is in the predetermined psychological state, An information processing device, wherein the features extracted from the speech or utterance include, for each word or phrase constituting a sentence represented by the speech, the type of the word or phrase and the tone of the word or phrase.

2. An information processing device for determining the psychological state of members in a meeting, a voice processing unit for extracting features from a portion of the voice corresponding to the speech of the member among the voices collected by a microphone during the conference; an image analysis unit that extracts image features representing predetermined actions from images of the members captured by a camera during the meeting; an estimation unit that receives the feature amount extracted by the voice processing unit and the feature amount of the image extracted by the image analysis unit, and estimates the possibility that the member is in a predetermined psychological state according to a trained model; a determination unit that determines a possibility that the member is in the predetermined psychological state during the meeting based on the possibility estimated by the estimation unit and an index value according to the purpose of the meeting, the trained model is a model trained to estimate the possibility that the speaker is in the predetermined psychological state by inputting features extracted from the voice of the utterance and features of an image representing the predetermined behavior extracted from an image of the speaker, An information processing device, wherein the features extracted from the speech or utterance include, for each word or phrase constituting a sentence represented by the speech, the type of the word or phrase and the tone of the word or phrase.

3. The information processing device according to claim 1 , wherein the estimation unit receives the input of the feature amount and estimates the possibility that the member is in the predetermined psychological state for each of a plurality of items in accordance with the learned model.

4. The information processing apparatus according to claim 3 , wherein the index value is set for each of the plurality of items.

5. The information processing device according to claim 3 , wherein the determining unit converts the magnitude of the likelihood determined for each of the plurality of items into a numerical value.

6. The information processing device according to claim 5 , wherein the converted numerical value of one or more items corresponding to the purpose of the meeting among the plurality of items is adjusted by addition or subtraction.

7. an output unit that outputs the possibility determined by the determination unit; an input interface that accepts user operations on the information processing device; an index value changing unit that changes the index value; The information processing device according to claim 1 , wherein the index value change unit changes the index value based on the user operation received by the input interface.

8. The information processing apparatus according to claim 7 , wherein the index value change unit, when receiving the user operations from a plurality of users, changes the index value based on the user operations.

9. The index value change unit further changes the index value in accordance with a change rule; The information processing device according to claim 7 , wherein the change rule includes a rule for change based on index values ​​for a plurality of meetings having the same purpose.

10. The output unit 10. The information processing device according to claim 7, wherein the possibility determined by the determination unit is output for each of a plurality of meetings held at different times and having the same purpose in which the member participates.

11. 11. The information processing device according to claim 10, further comprising a re-determination unit that determines, for at least one of the plurality of meetings, a possibility that the member is in the predetermined psychological state during the meeting based on the possibility estimated by the estimation unit and a predetermined index value.

12. The information processing device according to claim 11 , wherein the predetermined index value includes a changed index value changed by the index value changing unit.

13. The information processing device according to claim 11 , wherein the predetermined index value includes a default value.

14. The members of the organization participate in the meeting as the members, 8. The information processing device according to claim 7, wherein the index value change unit further changes the index value according to the purpose of the conference in accordance with a predetermined rule based on the position of each member participating in the conference in the organization and the purpose of the conference.

15. The information processing device according to claim 14 , wherein the predetermined rule includes a rule that a predetermined number of members who participate in the meeting have a predetermined position in the organization.

16. The information processing device according to claim 1 , wherein the purpose of the conference is acquired from information registered regarding the conference.

17. The information processing device according to claim 1 , wherein the purpose of the meeting is acquired by performing a recognition process on speech collected during the meeting.

18. The information processing device according to claim 7 , wherein the output unit outputs information about the index value used by the determination unit to determine the possibility.

19. A program for causing a computer to execute a method for determining the psychological states of members during a meeting, The method comprises: extracting features from a portion of the speech corresponding to the speech of the member among the speeches collected by a microphone during the meeting; receiving the extracted feature amount as an input and estimating the possibility that the member is in a predetermined psychological state according to the trained model; determining a possibility that the member is in the predetermined psychological state during the meeting based on the estimated possibility and an index value according to the purpose of the meeting; the trained model is a model trained to input features extracted from an utterance and estimate the likelihood that the speaker is in the predetermined psychological state, The features extracted from the speech or utterance include, for each word or phrase that constitutes a sentence represented by the speech, the type and tone of the word or phrase.

20. A program for causing a computer to execute a method for determining the psychological states of members during a meeting, The method comprises: extracting features from a portion of speech corresponding to a speech made by the member among speeches collected by a microphone during the meeting; extracting image features representing predetermined actions from images of the members captured by a camera during the meeting; receiving the feature extracted from the voice and the feature of the image as input, and estimating the likelihood that the member is in a predetermined psychological state according to a trained model; determining a possibility that the member is in the predetermined psychological state during the meeting based on the estimated possibility and an index value according to the purpose of the meeting; the trained model is a model trained to estimate the possibility that the speaker is in the predetermined psychological state by inputting features extracted from the voice of the utterance and features of an image representing the predetermined behavior extracted from an image of the speaker, The features extracted from the speech or utterance include, for each word or phrase that constitutes a sentence represented by the speech, the type and tone of the word or phrase.

Images