Information processing device and program

Abstract

To properly give an utterance opportunity in a WEB conference.SOLUTION: An information processing device comprises: a speech detection unit which detects speeches in a WEB conference of participants participating in the WEB conference and detects a participant who does not speak much in the WEB conference; and a display control unit which on the basis of a result of the detection by the speech detection unit, makes the priority of information indicating the participant who does not speak much in the WEB conference higher than that of information indicating the other participants, and displays the information on information terminals of the participants participating in the WEB conference.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] Due to the widespread use of web conferences, various conferences are held in the form of web conferences. The remarks made by participants in a conference vary depending on the purpose of the conference, but for example, in a conference such as a brainstorming session, active remarks from participants are encouraged. For example, Patent Document 1 discloses a technology that displays a message encouraging users who make remarks less than a certain frequency to speak up. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-113066 A Summary of the Invention [Problem to be solved by the invention]

[0004] When the technology described in Patent Document 1 is used, a message encouraging participants who do not speak much to speak is displayed, but since the message is not displayed to other participants, participants who do not speak much may not know the right timing to speak and may miss the opportunity to speak.

[0005] An object of the present invention is to provide an information processing device and an information processing method that can provide appropriate speaking opportunities in a web conference. [Means for solving the problem]

[0006] The information processing device of the present invention comprises a speech detection unit that detects speech during a WEB conference by participants in the WEB conference and detects participants who speak little during the WEB conference, and a display control unit that displays information indicating participants who speak little during the WEB conference on the information terminal of the participants participating in the WEB conference based on the results detected by the speech detection unit, in priority to information indicating other participants.

[0007] The information processing method of the present invention includes an information processing device which executes an utterance detection step of detecting utterances in a WEB conference by participants at information terminals participating in the WEB conference and detecting participants who speak little in the WEB conference, and a display control step of displaying information indicating participants who speak little in the WEB conference on the information terminals of the participants participating in the WEB conference based on the results detected in the utterance detection step, in priority to information indicating other participants. Effect of the Invention

[0008] According to the present invention, it is possible to provide appropriate speaking opportunities in a web conference. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of the configuration of an information terminal according to the first embodiment. [Diagram 3] FIG. 3 is a block diagram illustrating an example of the configuration of a server device according to the first embodiment. [Figure 4] FIG. 4 is a block diagram illustrating an example of the configuration of the information processing device according to the first embodiment. [Diagram 5] FIG. 5 is a flowchart showing the information processing method according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a default screen of a Web conference according to an embodiment. [Figure 7]FIG. 7 is a diagram for explaining the speech history according to the first embodiment. [Figure 8] FIG. 8 is a diagram for explaining a first method for increasing the display priority of participants who speak less according to the first embodiment. [Figure 9] FIG. 9 is a diagram for explaining a second method for increasing the display priority of participants who speak less according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing an information processing method according to the second embodiment. [Figure 11] FIG. 11 is a diagram for explaining a method for explicitly displaying a speaker according to the second embodiment. [Figure 12] FIG. 12 is a diagram for explaining a first method for increasing the display priority of participants who speak less according to the second embodiment. [Figure 13] FIG. 13 is a diagram for explaining a second method for increasing the display priority of participants who speak less according to the second embodiment. [Figure 14] FIG. 14 is a flowchart showing an information processing method according to the third embodiment. [Figure 15] FIG. 15 is a flowchart showing an information processing method according to the fourth embodiment. [Figure 16] FIG. 16 is a diagram for explaining the speech history according to the fourth embodiment. [Figure 17] FIG. 17 is a diagram for explaining a method for lowering the display priority of a participant who speaks a lot according to the fourth embodiment. [Figure 18] FIG. 18 is a flowchart showing an information processing method according to the fifth embodiment. [Figure 19] FIG. 19 is a diagram for explaining a first method for explicitly displaying a participant who speaks a lot by lowering the display priority according to the fifth embodiment. [Figure 20] FIG. 20 is a diagram for explaining a second method for explicitly displaying a participant who speaks a lot by lowering the display priority according to the fifth embodiment. [Figure 21]FIG. 21 is a diagram for explaining a first method for explicitly displaying participants who talk a lot according to the fifth embodiment. [Figure 22] FIG. 22 is a diagram for explaining a second method for explicitly displaying an utterance according to the fifth embodiment. [Figure 23] FIG. 23 is a flowchart showing an information processing method according to the sixth embodiment. [Figure 24] FIG. 24 is a flowchart showing an information processing method according to the seventh embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to this embodiment, and in the following embodiments, the same components are designated by the same reference numerals, and duplicated explanations will be omitted.

[0011] [First embodiment] (Information Processing System) An example of the configuration of an information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an information processing system according to the first embodiment.

[0012] 1, an information processing system 1 includes a plurality of information terminals 10 and a server device 12. Each information terminal 10 can hold a WEB conference with the other information terminals 10 via the server device 12 by starting a WEB conference application.

[0013] (Information terminal) An example of the configuration of an information terminal according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of an information terminal according to the first embodiment.

[0014] 2, the information terminal 10 includes a camera 20, a microphone 22, an operation unit 24, a communication unit 26, a display unit 28, and a terminal control device 30. Examples of the information terminal 10 include information terminals such as a desktop PC (Personal Computer), a notebook PC, and a tablet terminal.

[0015] The camera 20 captures an image of a user standing in front of the information terminal 10. The camera 20 captures an image of a user using the information terminal 10. The camera 20 is, for example, an in-camera provided on the display unit 28 side. The camera 20 may be an external camera connected to the information terminal 10.

[0016] The microphone 22 picks up a voice spoken by a user of the information terminal 10. The microphone 22 outputs voice information relating to the picked up voice to the voice acquisition unit 44 of the terminal control device 30.

[0017] The operation unit 24 accepts various input operations for the information terminal 10. The operation unit 24 outputs an operation signal corresponding to the accepted input operation to the terminal control device 30. The operation unit 24 includes, for example, a keyboard, a mouse, a touch panel, buttons, switches, etc. When a touch panel is used as the operation unit 24, the operation unit 24 is disposed on the display unit 28.

[0018] The communication unit 26 communicates with an external device via a wired or wireless network. The communication unit 26 communicates with the server device 12, for example, via a wired or wireless network.

[0019] The display unit 28 displays various types of video including characters and images. The display unit 28 is, for example, a display including a liquid crystal display (LCD) or an organic electro-luminescence (EL) display.

[0020] The terminal control device 30 controls each part of the information terminal 10. The terminal control device 30 has, for example, an information processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The terminal control device 30 executes a program that controls the operation of the information terminal 10 according to the present invention. The terminal control device 30 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The terminal control device 30 may be realized by a combination of hardware and software.

[0021] The terminal control device 30 has functional blocks realized by circuits or executed programs, including a shooting control unit 40, a communication control unit 42, an audio acquisition unit 44, a display control unit 46, an operation control unit 48, an application control unit 50, and a memory unit 52.

[0022] The photographing control unit 40 controls the camera 20 to photograph an image. The photographing control unit 40 acquires image data relating to the image photographed by the camera 20. Specifically, the photographing control unit 40 acquires image data photographed by the camera 20 of a user using the information terminal 10. The image data acquired by photographing with the camera 20 is image data of a moving image.

[0023] The communication control unit 42 controls the communication unit 26 to execute communication between the information terminal 10 and an external device. Specifically, the communication control unit 42 controls, for example, the communication unit 26 to control communication between the information terminal 10 and the server device 12. The communication control unit 42 controls, for example, the communication unit 26 to transmit and receive information about a WEB conference with another information terminal 10 to and from the server device 12. The communication control unit 42 controls, for example, the communication unit 26 to transmit to the server device 12 voice information about the speech of a user using the information terminal 10 acquired by the voice acquisition unit 44 and image data of a user using the information terminal 10 acquired by the image capture control unit 40. The communication control unit 42 controls, for example, the communication unit 26 to receive information necessary for a WEB conference, such as speech and image data of a user of another information terminal 10, from the server device 12.

[0024] The voice acquisition unit 44 acquires voice information related to the voice detected by the microphone 22. The voice acquisition unit 44 acquires voice information related to the speech of the user who uses the information terminal 10.

[0025] The display control unit 46 controls the display unit 28 to display various videos including characters and images. For example, the display control unit 46 controls the display unit 28 to display information obtained by executing a WEB conference application (hereinafter, a WEB conference screen). The display control unit 46 may generate a WEB conference screen and display it on the display unit 28, or the display control unit 46 may display a WEB conference screen generated by the server device 12 on the display unit 28.

[0026] The operation control unit 48 acquires an operation signal corresponding to an operation accepted by the operation unit 24 from the operation unit 24. The operation control unit 48 outputs a control signal corresponding to the acquired operation signal to each unit.

[0027] The application control unit 50 controls the operation of various applications that run on the information terminal 10. The application control unit 50 controls the operation of applications such as a WEB conference tool and a chat tool. Instead of a configuration in which an application such as a WEB conference tool runs on the information terminal 10, the application control unit 50 may be configured to run an application such as a WEB conference tool on the server device 12. The application control unit 50 may also run an application such as a WEB conference tool in a distributed manner on the information terminal 10 and the server device 12. In other words, the application control unit 50 may be a functional block realized only on the information terminal 10, as well as a functional block realized on the server device 12, or a functional block realized on the information terminal 10 and the server device 12.

[0028] The storage unit 52 stores information such as the contents of calculations and programs of the terminal control device 30. The storage unit 52 is composed of, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD (Solid State Drive).

[0029] (Server device) An example of the configuration of the server device according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the server device according to the first embodiment.

[0030] 3, the server device 12 includes a communication unit 60 and a server control device 62. The server device 12 is a general-purpose server device realized by a computer. The server device 12 is a server of a company that provides a web conference tool, etc.

[0031] The communication unit 60 communicates with an external device via a wired or wireless network. The communication unit 60 communicates with the information terminal 10, for example, via a wired or wireless network.

[0032] The server control device 62 controls each unit of the server device 12. The server control device 62 has, for example, an information processing device such as a CPU or an MPU, and a storage device such as a RAM or a ROM. The server control device 62 executes a program that controls the operation of the server device 12 according to the present invention. The server control device 62 may be realized by an integrated circuit such as an ASIC or an FPGA. The server control device 62 may be realized by a combination of hardware and software.

[0033] The server control device 62 includes, as functional blocks realized by circuits or programs executed, a connection control unit 70, a communication control unit 72, and a storage unit 74. As described above, the server control device 62 may include an application control unit that operates an application such as a web conference tool.

[0034] The connection control unit 70 controls the connection between the server device 12 and the information terminal 10. The connection control unit 70 causes the connection between the server device 12 and the information terminal 10 to be established.

[0035] The communication control unit 72 controls the communication unit 60 to execute communication between the server device 12 and an external device. Specifically, the communication control unit 72 controls, for example, the communication unit 60 to control communication between the server device 12 and the information terminal 10. The communication control unit 72 controls, for example, the communication unit 60 to acquire information indicating the detection result of the speech of the user using the information terminal 10 from the information terminal 10. The communication control unit 72 transmits, for example, information indicating the detection result of the speech of the user using the information terminal 10 to another information terminal 10.

[0036] The storage unit 74 stores information such as programs and the contents of calculations performed by the connection control unit 70 and the communication control unit 72. The storage unit 74 is composed of a main storage device such as a RAM and a ROM, and a storage device such as an SSD or a hard disk drive (HDD).

[0037] (Information processing device) An example of the configuration of the information processing device according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the information processing device according to the first embodiment.

[0038] 4, the information processing device 80 includes an utterance detection unit 82 and a display control unit 84. The information processing device 80 is a conceptual device realized by the cooperation of either or both of the terminal control device 30 and the server control device 62. Therefore, either the information terminal 10 or the server device 12 may be referred to as the information processing device 80, and the information processing system 1 consisting of the information terminal 10 and the server device 12 may be referred to as the information processing device 80. Therefore, the utterance detection unit 82 and the display control unit 84 included in the information processing device 80 are realized by either or both of the terminal control device 30 and the server control device 62.

[0039] The speech detection unit 82 detects speech in the WEB conference of each participant who participates in the WEB conference using the information terminal 10, and detects participants who speak little or a lot in the WEB conference. The speech detection unit 82 detects speech of each user who uses the information terminal 10, for example, based on voice information acquired by the voice acquisition unit 44 of each information terminal 10. The speech detection unit 82 detects speech of the user who uses the information terminal 10, for example, by performing voice recognition processing on the voice information acquired by the voice acquisition unit 44 of each information terminal 10. When detecting speech by performing voice recognition processing on the voice information acquired by the voice acquisition unit 44 of each information terminal 10, for example, the speech detection unit 82 may detect speech of the user who uses each information terminal 10 by receiving a detection result of the speech from each information terminal 10.

[0040] The speech detection unit 82 may detect a participant who speaks less among the participants participating in the WEB conference as a participant whose speech rate is less than a predetermined rate, or may detect a participant whose speech rate, speech volume, or speech time is the smallest. The speech detection unit 82 may detect a participant who speaks more among the participants participating in the WEB conference as a participant whose speech rate is equal to or greater than a predetermined rate, or may detect a participant whose speech rate, speech volume, or speech time is the largest.

[0041] The display control unit 84 causes the display unit 28 of the information terminal 10 to display various information such as a WEB conference screen. For example, based on the result detected by the speech detection unit 82, the display control unit 84 causes the display unit 28 of each information terminal 10 of the participants participating in the WEB conference to display information indicating participants who speak less in the WEB conference preferentially over information indicating other participants. In other words, the display control unit 84 causes the display unit 28 of each information terminal 10 of the participants participating in the WEB conference to prominently display information indicating participants who speak less in the WEB conference. For example, the display control unit 84 may transmit instruction information indicating a display form of information to each information terminal 10, and the display control unit 46 of each information terminal 10 may display information indicating participants who speak less on the display unit 28 according to the instruction information. For example, the detection result indicating the result detected by the speech detection unit 82 may be transmitted to each information terminal 10, and the display control unit 46 of each information terminal 10 may configure a display form to display information indicating participants who speak less on the display unit 28.

[0042] The speech detection unit 82 may further detect, for example, a participant who is speaking in the WEB conference. In this case, the display control unit 84 may, for example, display information indicating a participant who is speaking in the WEB conference on each information terminal 10 participating in the WEB conference so that it is clear that the participant is speaking. For example, based on the result detected by the speech detection unit 82, the display control unit 84 may display information indicating a participant who speaks little in the WEB conference on each information terminal 10 participating in the WEB conference with priority over information indicating other participants who are not speaking. When a participant who is speaking is a participant who speaks more than a predetermined amount, the display control unit 84 may display the information on the information terminal 10 of the participant participating in the WEB conference with lower priority than information indicating other participants when the other participants are speaking. Lower priority means lower priority.

[0043] The speech detection unit 82 may further detect, for example, that speech stagnates in the WEB conference. In this case, when speech stagnates in the WEB conference, the display control unit 84 may display, on each information terminal 10 participating in the WEB conference, information indicating a participant who speaks little in the WEB conference, in preference to information indicating other participants, based on the result detected by the speech detection unit 82.

[0044] For example, the display control unit 84 may cause information indicating participants who are not speaking much in the WEB conference to be displayed on each information terminal participating in the WEB conference in a larger size than information indicating other participants who are not speaking.

[0045] For example, the display control unit 84 may cause information indicating a participant who speaks more than a predetermined amount in the WEB conference to be displayed on the information terminal 10 of the participant participating in the WEB conference in a non-priority manner over information indicating other participants based on the result detected by the speech detection unit 82. In other words, the display control unit 84 may cause information indicating a participant who speaks more than a predetermined amount to be displayed in an unobtrusive manner on the display unit 28 of the information terminal 10 of the participant participating in the WEB conference.

[0046] The speech detection unit 82 may further detect a state of a pause in speech as a speech style of a participant who is speaking in the WEB conference. In this case, the display control unit 84 may cause each information terminal 10 participating in the WEB conference to display information indicating a participant who is speaking in the WEB conference so that it is clear that the participant is speaking. When a participant who is speaking speaks more than a predetermined amount and has a speech style with few pauses in speech, the display control unit 84 may cause the information terminal 10 of the participant participating in the WEB conference to display the information on the participant in the WEB conference with lower priority than information indicating other participants when the other participants are speaking.

[0047] The speech detection unit 82 may further detect the volume of speech as the speech style of the participant who is speaking in the WEB conference. In this case, the display control unit 84 may cause each information terminal 10 participating in the WEB conference to display information indicating the participant who is speaking in the WEB conference so that it is clearly indicated that the participant is speaking. When the participant who is speaking is a participant who speaks more than a predetermined amount and has a speech style with a speech volume that is more than a predetermined amount, the display control unit 84 may cause the information terminal 10 of the participant participating in the WEB conference to display the information on the participant in the WEB conference in a lower priority than information indicating other participants when the other participants are speaking.

[0048] (Information processing method) The information processing method according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the information processing method executed by the information processing device 80 according to the first embodiment.

[0049] The process shown in FIG. 5 is started when a Web conference in which multiple participants participate is started.

[0050] When the WEB conference is started, the display control unit 84 starts displaying information indicating each participant of the WEB conference, that is, displaying a WEB conference screen (step S10). Specifically, the display control unit 84 causes each information terminal 10 to display information of each participant. FIG. 6 is a diagram showing an example of a default screen of the WEB conference according to the first embodiment. FIG. 6 shows an example of a screen displayed on the display unit 28 of the information terminal 10 of each participant participating in the WEB conference. As shown in FIG. 6, for example, when 12 people, participants P1 to P12, are participating in the WEB conference, a window W is displayed for each participant. In each window W, information indicating each participant, such as the camera image of each participant and the initials of each participant, is randomly displayed. In other words, regardless of the speech ratio of each participant, a display in which a large window such as the window of participant P1 or a small window such as the window of participant P7 is displayed in an arbitrary order, or a display order based on other conditions is performed. Then, the process proceeds to step S12. Depending on the number of participants in the WEB conference, there may be a participant for whom the window W is not displayed.

[0051] After step S10, a process may be added to determine whether the started WEB conference is a conference in which all participants are requested to speak, and if it is a conference in which all participants are requested to speak, the process shown in Fig. 5 may be executed. Alternatively, the organizer or participants of the WEB conference may perform an operation to select that it is a conference in which all participants are requested to speak, or an operation to selectively set participants who are requested to speak. When participants who are requested to speak are set, participants who speak little and participants who speak a lot are detected from participants who are set as participants who are requested to speak.

[0052] The speech detection unit 82 judges whether or not a participant who speaks little has been detected (step S12). Specifically, the speech detection unit 82 detects a participant who speaks little based on the speech history of each participant after a predetermined time has elapsed since the start of the WEB conference. The predetermined time is, for example, 10 minutes after the WEB conference is scheduled for 60 minutes, but is not limited to this. The predetermined time may be set arbitrarily. The speech detection unit 82 may judge based on the speech ratio from the start of the WEB conference, or may judge based on the speech ratio for each time interval, for example, every 10 minutes. FIG. 7 is a diagram for explaining the speech history according to the first embodiment. As shown in FIG. 7, the speech detection unit 82 records the speech ratio (%) for each participant when the WEB conference starts. The speech ratio is, for example, the ratio of speech for each participant when the speech of the entire WEB conference is 100%. The speech detection unit 82 detects, for example, a participant whose speech ratio is less than 5% as a participant who speaks little. In this case, the speech detection unit 82 detects participant P11 as a participant who speaks little because the speech rate of participant P11 is 3.2%. The speech rate at which participant P11 is determined to speak little may be set arbitrarily. If a participant who speaks little is detected (step S12; Yes), proceed to step S14. If a participant who speaks little is not detected (step S12; No), proceed to step S20.

[0053] If the answer to step S12 is Yes, the display control unit 84 increases the display priority of the participant who speaks little (step S14). Specifically, the display control unit 84 displays the participant who speaks little in a more prominent position. FIG. 8 is a diagram for explaining a first method for increasing the display priority of the participant who speaks little according to the first embodiment. As shown in FIG. 8, the display control unit 84 displays, for example, the window W of the participant P11 in the upper left corner so that the participant P11 stands out. The window W of the participant P11 is a small window in FIG. 6, but is displayed large in FIG. 8. Since the positions of the windows that indicate each participant are random, the windows of participants who are not determined to speak little are displayed as small or large windows at any timing, like the participant P8 in FIG. 6 and FIG. 8. In contrast, the windows of participants who are determined to speak little are displayed as large windows during the period in which they are determined to speak little, like the participant P11 in FIG. 8.

[0054] Fig. 9 is a diagram for explaining a second method for increasing the display priority of a participant who speaks little according to the first embodiment. As shown in Fig. 9, the display control unit 84 makes the participant P11 stand out by, for example, displaying the window W of the participant P11 larger than the windows W of the other participants. Then, the process proceeds to step S16.

[0055] The speech detection unit 82 determines whether the speech rate of the participant who was determined to speak little has increased (step S16). If it is determined that the speech rate of the participant who was determined to speak little has increased (step S16; Yes), the process proceeds to step S18. If it is not determined that the speech rate of the participant who was determined to speak little has increased (step S16; No), the process proceeds to step S20.

[0056] If it is determined as Yes in step S16, the display control unit 84 returns the display priority of the participants who speak less to the original priority (step S18). Specifically, the display control unit 84 returns the display screen shown in Fig. 8 or Fig. 9 to the default screen shown in Fig. 6. Then, the process proceeds to step S20.

[0057] The information processing device 80 judges whether the WEB conference has ended (step S20). If it is judged that the WEB conference has ended (step S20; Yes), the process in FIG. 5 ends. If it is not judged that the WEB conference has ended (step S20; No), the process proceeds to step S12.

[0058] Furthermore, in the process of step S14, if the transition occurs from No in step S16 via No in step S20 and Yes in step S12, the state in which the display priority is increased is maintained.

[0059] In the above-described embodiment, a case was described in which one participant was determined to speak little, but when there are multiple participants who were determined to speak little, similar processing is performed for each participant.

[0060] As described above, in the first embodiment, in a Web conference in which multiple participants participate, a participant who speaks little can be displayed in a prominent position. This allows the first embodiment to appropriately give speaking opportunities to participants who speak little.

[0061] [Second embodiment] The information processing method according to the second embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the information processing method according to the second embodiment.

[0062] The process of step S30 shown in FIG. 10 is the same as the process of step S10 shown in FIG. 5, and therefore a description thereof will be omitted.

[0063] The speech detection unit 82 determines whether or not there is a speaker (step S32). If it is determined that there is a speaker (step S32; Yes), the process proceeds to step S34. If it is not determined that there is a speaker (step S32; No), the process proceeds to step S46. In other words, if it is not determined that there is a speaker, the same process as that shown in FIG. 5 is performed.

[0064] The display control unit 84 explicitly displays the speaker (step S34). FIG. 11 is a diagram for explaining a method for explicitly displaying a speaker according to the second embodiment. As shown in FIG. 11, for example, it is assumed that the speech detection unit 82 has determined that the participant P6 is the speaker. In this case, the display control unit 84 explicitly displays the participant P6 by, for example, enlarging the window W of the participant P6 more than the windows W of the other participants and changing the state of the border of the window W. Then, the process proceeds to step S36.

[0065] The speech detection unit 82 detects whether or not a participant other than the speaker who speaks little has been detected (step S36). If it is determined that a participant other than the speaker who speaks little has been detected (step S36; Yes), the process proceeds to step S38. If it is not determined that a participant other than the speaker who speaks little has been detected (step S36; No), the process proceeds to step S44.

[0066] If the answer to step S36 is Yes, the display control unit 84 increases the display priority of the participant who speaks little (step S38). Specifically, the display control unit 84 displays the participant who speaks little together with the speaker in a more prominent position. FIG. 12 is a diagram for explaining a first method for increasing the display priority of the participant who speaks little according to the second embodiment. As shown in FIG. 12, for example, it is assumed that the speech detection unit 82 has determined that the participant P11 is a participant who speaks little. In this case, the display control unit 84 displays, for example, the window W of the participant P11 large side by side with the window W of the participant P6 who is the speaker. FIG. 13 is a diagram for explaining a second method for increasing the display priority of the participant who speaks little according to the second embodiment. As shown in FIG. 13, for example, it is assumed that the participant P6 is sharing a document and speaking. In this case, the display control unit 84 moves the window W of the participant P11 upwards and displays it below the participant P6.

[0067] The processes from step S40 to step S44 and from step S46 to step S48 shown in FIG. 10 are the same as the processes from step S16 to step S20 and from step S12 to step S14 shown in FIG. 5, respectively, and therefore will not be described.

[0068] As described above, in the second embodiment, when a speaker is speaking in a Web conference in which multiple participants participate, other participants who speak less can be displayed in prominent positions. This allows the second embodiment to provide more appropriate speaking opportunities to participants who speak less.

[0069] [Third embodiment] The information processing method according to the third embodiment will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the information processing method according to the third embodiment.

[0070] The process of step S50 shown in FIG. 14 is the same as the process of step S10 shown in FIG. 5, and therefore a description thereof will be omitted.

[0071] The speech detection unit 82 determines whether or not speech is stalled (step S52). Speech stalling refers to, for example, a state in which no speech is detected from any participant continuing for 30 seconds or more. If it is determined that speech is stalled (step S52; Yes), the process proceeds to step S54. If it is not determined that speech is stalled (step S52; No), the process proceeds to step S62.

[0072] The processes in steps S54 and S56 shown in FIG. 14 are the same as those in steps S12 and S14 shown in FIG. 5, respectively, and therefore will not be described.

[0073] The speech detection unit 82 determines whether the speech stagnation has been resolved (step S58). Specifically, the speech detection unit 82 determines that the speech stagnation has been resolved when speech from any participant is detected after the speech stagnation. If it is determined that the speech stagnation has been resolved (step S58; Yes), the process proceeds to step S60. If it is not determined that the speech stagnation has been resolved (step S58; No), the process proceeds to step S62.

[0074] The processes in steps S60 and S62 are the same as those in steps S18 and S20 shown in FIG. 5, respectively, and therefore will not be described.

[0075] As described above, in the third embodiment, when speech is stagnant in a Web conference in which multiple participants participate, a participant other than the speaker who speaks little can be displayed in a prominent position. This allows the third embodiment to provide a more appropriate opportunity to the participant who speaks little.

[0076] [Fourth embodiment] The information processing method according to the fourth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the information processing method according to the fourth embodiment.

[0077] In the fourth embodiment, among a plurality of participants participating in a Web conference, participants with a speech rate equal to or higher than a predetermined level are displayed in an inconspicuous manner.

[0078] The process of step S70 shown in FIG. 15 is the same as the process of step S10 shown in FIG. 5, and therefore a description thereof will be omitted.

[0079] The speech detection unit 82 judges whether or not a participant who speaks a lot has been detected (step S72). Specifically, the speech detection unit 82 detects a participant who speaks a lot based on the speech history of each participant after a predetermined time has elapsed since the start of the WEB conference. FIG. 16 is a diagram for explaining the speech history according to the fourth embodiment. For example, the speech detection unit 82 detects a participant whose speech ratio is 20% or more as a participant who speaks a lot. In this case, the speech detection unit 82 detects the participant P6 as a participant who speaks a lot because the speech ratio of the participant P6 is 22.4%. The speech ratio at which it is determined that a participant speaks a lot may be set arbitrarily. If a participant who speaks a lot is detected (step S72; Yes), the process proceeds to step S74. If a participant who speaks a lot is not detected (step S72; No), the process proceeds to step S80.

[0080] If the answer to step S72 is Yes, the display control unit 84 lowers the display priority of the participant who speaks a lot (step S74). Specifically, the display control unit 84 displays the participant who speaks a lot in a less conspicuous position. FIG. 17 is a diagram for explaining a method of lowering the display priority of the participant who speaks a lot according to the fourth embodiment. As shown in FIG. 17, the display control unit 84 displays the window W of the participant P6 in a small size at the bottom right, for example, so that the participant P6 does not stand out. The window W of the participant P6 is a large window in FIG. 6, but is displayed small in FIG. 17. Since the positions of the windows that indicate each participant are random, the windows of participants who are not determined to speak a lot are displayed in small or large windows at any timing, like the participant P8 in FIG. 6 and FIG. 17. In contrast, the windows of participants who are determined to speak a lot are displayed in small windows during the period when they are determined to speak a lot, like the participant P6 in FIG. 17. Then, the process proceeds to step S76.

[0081] The speech detection unit 82 determines whether the speech rate of the participant determined to be a frequent speaker has decreased (step S76). If it is determined that the speech rate of the participant determined to be a frequent speaker has decreased (step S76; Yes), the process proceeds to step S78. If it is not determined that the speech rate of the participant determined to be a frequent speaker has decreased (step S76; No), the process proceeds to step S80.

[0082] If it is determined as Yes in step S76, the display control unit 84 returns the display priority of the participant who speaks a lot to the original priority (step S78). Specifically, the display control unit 84 returns the display screen shown in Fig. 17 to the default screen shown in Fig. 6. Then, the process proceeds to step S80.

[0083] The process of step S80 shown in FIG. 15 is the same as the process of step S20 shown in FIG. 5, and therefore a description thereof will be omitted.

[0084] As described above, the fourth embodiment can display a participant who speaks a lot in an inconspicuous position in a Web conference in which multiple participants participate. This makes it easier for other participants, including a participant who does not speak much, to speak, and provides them with appropriate speaking opportunities.

[0085] [Fifth embodiment] The information processing method according to the fifth embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the information processing method according to the fifth embodiment.

[0086] The processing of step S90 shown in FIG. 18 is the same as the processing of step S30 shown in FIG. 10, and the processing of steps S72 to S78 shown in FIG. 18 is the same as the processing of steps S72 to S78 shown in FIG. 15, so the description will be omitted.

[0087] The speech detection unit 82 determines whether or not there is a speaker (step S92). If it is determined that there is a speaker (step S92; Yes), the process proceeds to step S94. If it is not determined that there is a speaker (step S92; No), the process proceeds to step S72. In other words, if it is not determined that there is a speaker, the same process as that shown in FIG. 15 is performed.

[0088] If the answer is Yes in step S92, the speech detection unit 82 determines whether the speaker is a participant who speaks a lot (step S94). Specifically, the speech detection unit 82 determines whether the speaker is a participant who speaks a lot, for example, based on the speech rate of each participant shown in FIG. 16. If the speaker is determined to be a participant who speaks a lot (step S94; Yes), the process proceeds to step S96. If the speaker is not determined to be a participant who speaks a lot (step S94; No), the process proceeds to step S98.

[0089] If the answer to step S94 is Yes, the display control unit 84 lowers the display priority of the speaker and explicitly displays the speaker (step S96). FIG. 19 is a diagram for explaining a first method for explicitly displaying a speaker by lowering the display priority of a speaker according to the fifth embodiment. As shown in FIG. 19, for example, the speech detection unit 82 determines that the participant P6 with a high speech rate is the speaker. In this case, the display control unit 84, for example, does not enlarge the window W of the participant P6 and positions it at the upper left, and changes the state of the frame of the window W, thereby explicitly displaying the participant P6. The display control unit 84, for example, doubles the frame of the window W of the participant P6 or makes it emit light. FIG. 20 is a diagram for explaining a second method for explicitly displaying a speaker by lowering the display priority of a speaker according to the fifth embodiment. As shown in FIG. 20, for example, the participant P6 is sharing a document and speaking. In this case, the display control unit 84 also positions the window W of the participant P6 at the upper right without enlarging it, and changes the state of the frame of the window W, thereby explicitly displaying the participant P6. Then, proceed to step S100.

[0090] If the result of the determination in step S94 is No, the speaker is explicitly displayed (step S98). FIG. 21 is a diagram for explaining a first method for explicitly displaying a participant who is not determined to speak a lot according to the fifth embodiment. As shown in FIG. 19, for example, it is assumed that the speech detection unit 82 has determined that the participant P11 who is not determined to have a high speech rate is a speaker. In this case, the display control unit 84, for example, enlarges the window W of the participant P11 and positions it at the upper left, and changes the state of the frame of the window W to explicitly display the participant P11. FIG. 22 is a diagram for explaining a second method for explicitly displaying a speaker who is not determined to speak a lot according to the fifth embodiment. As shown in FIG. 22, for example, it is assumed that the participant P11 is sharing a document and speaking. In this case as well, the display control unit 84 enlarges the window W of the participant P11 and positions it at the upper right, and changes the state of the frame of the window W to explicitly display the participant P11. Then, the process proceeds to step S100.

[0091] When the display control unit 84 performs a display as shown in Fig. 21 in step S98, it performs a display as shown in Fig. 19 in step S96. When the display control unit 84 performs a display as shown in Fig. 22 in step S98, it performs a display as shown in Fig. 20 in step S96.

[0092] The speech detection unit 82 determines whether the speaker has finished speaking (step S100). Specifically, the speech detection unit 82 determines that the speaker has finished speaking, for example, when the speaker's speech is not detected for a predetermined period of time or longer. If it is determined that the speaker has finished speaking (step S100; Yes), the process proceeds to step S102. If it is not determined that the speaker has finished speaking (step S100; No), the process proceeds to step S104.

[0093] If it is determined as Yes in step S100, the display control unit 84 ends the explicit display of the speaker (step S102). Specifically, the display control unit 84 returns the display screens shown in Fig. 19 to Fig. 22 to the default screen shown in Fig. 6. Then, the process proceeds to step S104.

[0094] The process in step S104 is the same as the process in step S20 shown in FIG. 5, and therefore a description thereof will be omitted.

[0095] As described above, in the fifth embodiment, in a Web conference in which multiple participants participate, if the speaker's speech rate is high, the speaker's speech rate is displayed less conspicuously than if the speaker's speech rate is not high. This makes it easier for other participants, including a participant who does not speak much, to speak, and allows them to be given appropriate speaking opportunities.

[0096] [Sixth embodiment] An information processing method according to the sixth embodiment will be described with reference to Fig. 23. Fig. 23 is a flowchart showing the information processing method according to the sixth embodiment.

[0097] The processes of steps S110 to S114 shown in FIG. 23 are the same as the processes of steps S90 to S94 shown in FIG. 18, respectively, and the processes of steps S72 to S78 shown in FIG. 23 are the same as the processes of steps S72 to S78 shown in FIG. 15, so their explanations are omitted.

[0098] If the answer is Yes in step S114, the speech detection unit 82 determines whether the speaker is a participant with few speech pauses (step S116). Few speech pauses refers to a continuous speech pattern that makes it difficult for other speakers to interrupt during speech. A continuous speech pattern refers to, for example, a pattern of speaking without leaving a pause of 0.5 seconds or more between phrases. If the speaker is determined to be a participant with few speech pauses (step S116; Yes), the process proceeds to step S118. If the speaker is not determined to be a participant with few speech pauses (step S116; No), the process proceeds to step S120.

[0099] The processes from step S118 to step S126 are the same as the processes from step S96 to step S104 shown in FIG. 18, respectively, and therefore will not be described.

[0100] As described above, in the sixth embodiment, in a Web conference in which multiple participants participate, when a speaker has a high speech rate and few pauses in speech, the speaker is not displayed prominently. This makes it easier for other participants, including a participant who does not speak much, to speak, and allows them to be given appropriate speaking opportunities.

[0101] [Seventh embodiment] An information processing method according to the seventh embodiment will be described with reference to Fig. 24. Fig. 24 is a flowchart showing the information processing method according to the seventh embodiment.

[0102] The processes from step S130 to step S134 shown in FIG. 24 are the same as the processes from step S90 to step S94 shown in FIG. 18, respectively, and the processes from step S72 to step S78 shown in FIG. 24 are the same as the processes from step S72 to step S78 shown in FIG. 15, so their explanations are omitted.

[0103] If the answer is Yes in step S134, the speech detection unit 82 determines whether the speaker is a participant with a loud speech volume (step S136). A loud speech volume refers to a speech style with a volume that makes it difficult for other participants to join in on the speech. An example of a volume that makes it difficult for other participants to join in on the speech is a volume that is on average 2 dB or more louder than the speech volumes of the other participants. If the speaker is determined to be a participant with a loud speech volume (step S136; Yes), the process proceeds to step S138. If the speaker is not determined to be a participant with a loud speech volume (step S136; No), the process proceeds to step S140.

[0104] The processes from step S138 to step S146 are the same as the processes from step S96 to step S104 shown in FIG. 18, respectively, and therefore will not be described.

[0105] As described above, in the seventh embodiment, in a Web conference in which multiple participants participate, if a speaker has a high speech rate and a loud speech volume, the speaker is displayed in an inconspicuous manner. As a result, the seventh embodiment makes it easier for other participants, including a participant who does not speak much, to speak, and provides them with appropriate speaking opportunities.

[0106] Each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various additions and usage conditions. This distribution and integration configuration may be performed dynamically.

[0107] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. The above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0108] 1. Information Processing Systems 10 Information terminals 12 Server equipment 20 Camera 22 Microphone 24 Control section 26,60 Communications Department 28 Display section 30 Terminal control device 40 Shooting control section 44 Voice Acquisition Unit 48 Operation control section 50 Application control section 52 Storage section 62 Server control device 70 Connection control section 72 Communication control section 74 Memory section 80 Information processing device 82 Speech detection unit 84 Display control section

Claims

1. a speech detection unit that detects speeches made by participants in a web conference and detects participants who make little speeches in the web conference; a display control unit that displays information indicating a participant who has made a small number of utterances in the web conference on the information terminals of the participants participating in the web conference, in preference to information indicating other participants, based on the results detected by the utterance detection unit; An information processing device comprising:

2. The speech detection unit further detects a participant who is speaking in the web conference, The display control unit displays information indicating participants who are speaking in the web conference on each information terminal participating in the web conference so that it is clear that they are speaking, and based on the result detected by the speech detection unit, displays information indicating participants who are not speaking much in the web conference on each information terminal participating in the web conference in priority to information indicating other participants who are not speaking. The information processing device according to claim 1 .

3. The speech detection unit further detects that speech has stalled in the web conference; When speech stagnates in the web conference, the display control unit causes each information terminal participating in the web conference to display information indicating a participant who has made little speech in the web conference, in preference to information indicating other participants, based on the result detected by the speech detection unit. The information processing device according to claim 1 .

4. the display control unit displays information indicating participants who are not speaking much in the web conference in a larger size than information indicating other participants who are not speaking on each information terminal participating in the web conference. The information processing device according to claim 1 .

5. A speech detection unit that detects speeches made by participants in a web conference during the web conference and detects participants who speak more than a predetermined amount during the web conference; a display control unit that displays information indicating a participant who has spoken more than a predetermined number of times in the web conference based on the result detected by the speech detection unit, on the information terminals of the participants participating in the web conference, with the information indicating the participant having a lower priority than information indicating other participants; An information processing device comprising:

6. The speech detection unit further detects a participant who is speaking in the web conference, The display control unit displays information indicating the participant currently speaking in the web conference on each information terminal participating in the web conference so that it is clearly indicated that the participant is currently speaking, and when the currently speaking participant is a participant who speaks more than a predetermined amount, displays the information on the information terminal of the participant participating in the web conference with a lower priority than information indicating other participants when other participants are currently speaking. The information processing device according to claim 5 .

7. A speech detection step of detecting speeches made by participants using information terminals participating in a web conference during the web conference and detecting participants who make little speech during the web conference; a display control step of displaying information indicating a participant who has made few utterances in the web conference on the information terminals of the participants participating in the web conference, in preference to information indicating other participants, based on the results detected in the utterance detection step; A program that causes an information processing device to execute the above.

8. A speech detection step of detecting speeches made by participants in a web conference during the web conference and detecting participants who speak more than a predetermined number of times during the web conference; a display control step of displaying information indicating a participant who has spoken more than a predetermined number of times in the web conference based on the result detected in the speech detection step, on the information terminals of the participants participating in the web conference, with the information indicating the participant having a lower priority than information indicating other participants; A program that causes an information processing device to execute the above.

Images