Information processing device, information processing method, and information processing program

Abstract

To provide an information processor, an information processing method, and an information processing program that can appropriately support utterance of a participant.SOLUTION: An information processor includes an acquisition section, a detection section, and an utterance support section. The acquisition section acquires participant information detected by a sensor from a participant participating in a meeting online. The detection section detects a participant's intention of utterance in the meeting on the basis of the participant information. The utterance support section performs utterance support processing for supporting the utterance of the participant on the basis of the detected intention of utterance.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] In recent years, techniques for holding meetings such as conferences online have been proposed (see, for example, Patent Document 1). In these types of meetings, conversations are realized by sharing video and audio with remote parties. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-150561 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional technology has room for improvement in supporting speech to ensure smooth meetings. In particular, when video of the other party is not provided, it is difficult to know when the other party will speak, and there is a risk that one's speech will overlap (clash) with the other party's, making it difficult to have a smooth conversation.

[0005] The present application has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can appropriately support participants' speech. [Means for solving the problem]

[0006] The information processing device according to the present application includes an acquisition unit, a detection unit, and a speech support unit. The acquisition unit acquires participant information detected by a sensor from participants participating in an online meeting. The detection unit detects the intention of the participants to speak in the meeting based on the participant information. The speech support unit performs speech support processing to support the speech of the participants based on the detected intention to speak. [Effects of the Invention]

[0007] According to one aspect of the embodiment, it is possible to provide an effect of appropriately supporting the speech of participants. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a first information processing according to the embodiment. [Figure 2] FIG. 2 is a diagram illustrating a second information processing according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of participant information. [Figure 6] FIG. 6 is a flowchart showing the processing procedure of information processing 1 executed by the information processing apparatus according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing the processing procedure of the second information processing executed by the information processing apparatus according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an information processing device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the same components in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0010] (Embodiment) First, information processing 1 executed by an information processing device according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing information processing 1 according to an embodiment. Fig. 1 also shows an example of the operation of an information processing system S including an information processing device 1 according to an embodiment. As shown in Fig. 1, the information processing system S according to an embodiment includes an information processing device 1 and a plurality of participant terminals 50.

[0011] In the first information processing according to the embodiment, the intention of a participant taking part in a meeting to speak is detected based on participant information detected by a sensor, and processing is performed to support the participant in speaking based on the intention to speak.

[0012] Specifically, first, the information processing device 1 according to the embodiment acquires participant information detected by a sensor from each participant participating in an online meeting (step S1). The participant information is, for example, information detected by a sensor provided in the participant terminal 50. The sensor is, for example, a camera, an acceleration sensor, a biosensor (a pulse sensor, a body temperature sensor, etc.), a touch sensor (in the case of a touch panel), a microphone, etc.

[0013] Next, the information processing device 1 according to the embodiment detects the participant's intention to speak in the meeting based on the participant information for each participant (step S2). Based on the participant information, the information processing device 1 identifies the participant's level of concentration in the meeting, whether or not they are about to speak, and facial movements (movement of the mouth, etc.), and detects the participant's intention to speak based on the identified information.

[0014] The intention to speak is detected by detecting whether the person is about to speak, how many minutes later the person is about to speak, and whether there is a possibility that the person will speak throughout the entire meeting. The information processing device 1 can detect the intention to speak by using, for example, a model generated by machine learning.

[0015] For example, the information processing device 1 detects the presence or absence of an intention to speak using a model generated using features extracted from the participant information as explanatory variables and the presence or absence of an intention to speak as a response variable.

[0016] Next, the information processing device 1 according to the embodiment performs speech support processing to support the speech of the participants based on the detected intention to speak (step S3). In the example shown in Fig. 1, it is assumed that the intention of participant C to speak is detected. In this case, the information processing device 1 notifies participant C via the participant terminal 50 to encourage him or her to speak.

[0017] Furthermore, the information processing device 1 may perform speech support processing based on the situation of the meeting. For example, when another participant A or B is speaking, the information processing device 1 may notify participant C to prompt him or her to speak after the other participant A or B has finished speaking.

[0018] Furthermore, the information processing device 1 may perform speech support processing to prohibit participants A and B from speaking when participant C starts speaking. The speech support processing to prohibit participants A and B from speaking is, for example, processing to mute the speech of participants A and B.

[0019] In this way, the information processing device 1 of the embodiment detects a participant's intention to speak based on the participant information and performs processing to support the speech based on the intention to speak, thereby appropriately supporting the speech of participants who intend to speak.

[0020] Next, information processing part 2 executed by the information processing device 1 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing information processing part 2 according to the embodiment. In Fig. 2, it is assumed that among the participants participating in the meeting, there is a person who promotes the progress of the meeting, a so-called facilitator. In Fig. 2, it is assumed that participant A is the facilitator. The facilitator is responsible for drawing a conclusion on the agenda set in advance for the meeting within a predetermined time.

[0021] In the second information processing embodiment, the intention of participants in a meeting to speak and the situation of the meeting are detected based on participant information detected by a sensor, and support information is provided to the facilitator to assist in the progress of the meeting.

[0022] Specifically, first, the information processing device 1 according to the embodiment acquires participant information detected by a sensor from each participant participating in the online meeting (step S11). Note that since the acquisition of participant information is the same process as in step S1 described above, a description thereof will be omitted.

[0023] Next, the information processing device 1 according to the embodiment detects the intention to speak of each participant in the meeting and the situation of the meeting based on the participant information (step S12). Note that the detection of the intention to speak is the same process as in step S2 described above, and therefore will not be described again.

[0024] The status of the meeting may include, for example, the progress of the meeting (progress of the agenda), the time remaining until the end of the meeting (or the end of each agenda item), the speech history during the meeting, and the overall status of the meeting (whether the conversation is lively or not, whether everyone is speaking or not).

[0025] Next, the information processing device 1 according to the embodiment provides the facilitator with support information for supporting the progress of the meeting based on the detected intention to speak and the situation of the meeting (step S13). For example, the information processing device 1 according to the embodiment provides the facilitator with information about participant C who intends to speak and the remaining time of the meeting (or each agenda item). This allows the facilitator to easily determine whether to allow participant C to speak based on the remaining time, thereby allowing the meeting to proceed appropriately.

[0026] Furthermore, the information processing device 1 may provide information on how much time the participant C is allowed to speak based on the remaining time, for example. Furthermore, the information processing device 1 may provide display information indicating the degree of willingness to speak (the degree to which the participant wants to speak) for each participant.

[0027] Next, a configuration example of an information processing system S according to an embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing a configuration example of an information processing system S according to an embodiment. As shown in Fig. 3, in the information processing system S according to an embodiment, an information processing device 1 and a plurality of participant terminals 50 are connected to a network N by wire or wirelessly. The network N is, for example, a network such as the Internet, a WAN (Wide Area Network), or a LAN (Local Area Network).

[0028] The information processing device 1 is a server device that executes an information processing method. The information processing device 1 acquires participant information and detects the participants' intention to speak and the meeting situation, thereby performing speech support processing for the participants and providing support information to the facilitator.

[0029] The information processing device 1 is an information processing device that works in conjunction with each participant's participant terminal 50 and provides each participant's participant terminal 50 with API (Application Programming Interface) services for applications (hereinafter referred to as apps) that hold online meetings, as well as various data, and is realized by a server device, a cloud system, etc.

[0030] The information processing device 1 may also be an information processing device that provides a Web service for holding an online meeting to the participant terminal 50 of each user.

[0031] The participant terminal 50 is a terminal device carried by a participant. The participant terminal 50 can be any type of terminal device, such as a smartphone, a desktop PC, a notebook PC, or a tablet PC. The participant terminal 50 is equipped with various sensors that detect participant information, and transmits the detected participant information to the information processing device 1 and receives information provided by the information processing device 1.

[0032] Next, an example of the configuration of the information processing device 1 will be described with reference to FIG.

[0033] Fig. 4 is a diagram showing an example of the configuration of an information processing device 1 according to an embodiment. As shown in Fig. 4, the information processing device 1 has a communication unit 2, a control unit 3, and a storage unit 4. The control unit 3 includes an acquisition unit 31, a detection unit 32, and an MT control unit 33. The storage unit 4 stores participant information 41.

[0034] The communication unit 2 is realized by, for example, a network interface card (NIC), etc. The communication unit 2 is connected to a network by wire or wirelessly.

[0035] The control unit 3 is a controller, and is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the information processing device 1 using a RAM or the like as a work area. The control unit 3 is also a controller, and may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a GPGPU (General Purpose Graphic Processing Unit).

[0036] The storage unit 4 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0037] The participant information 41 is information about participants. Fig. 5 is a diagram showing an example of the participant information 41. As shown in Fig. 5, the participant information 41 includes items such as "participant ID," "attribute information," and "MT history information."

[0038] "Participant ID" is identification information that identifies a participant. "Attribute information" is information about the attributes of a participant, including psychographic attributes and demographic attributes. "MT history information" is information about the history of speech situations in meetings that a participant has previously attended, including, for example, the frequency of speech, the length of each speech, and the activeness of speech.

[0039] Next, the functions of the control unit 3 of the information processing device 1 (the acquisition unit 31, the detection unit 32, and the MT control unit 33) will be described.

[0040] The acquisition unit 31 acquires participant information. For example, the acquisition unit 31 acquires, as the participant information, an image captured by a camera provided in the participant terminal 50. The acquisition unit 31 also acquires, as the participant information, a detection value of an acceleration sensor provided in the participant terminal 50. The acquisition unit 31 also acquires, as the participant information, a detection value of a biosensor (such as a pulse sensor or a body temperature sensor) provided in the participant terminal 50 (or connected to the participant terminal 50 via a wired or wireless connection). The acquisition unit 31 also acquires, as the participant information, a detection value (touch status) of a touch sensor (in the case of a touch panel) provided in the participant terminal 50. The acquisition unit 31 also acquires, as the participant information, audio information (including whether or not there is speech) collected by a microphone provided in the participant terminal 50.

[0041] The detection unit 32 detects the intention to speak of each participant. For example, the detection unit 32 detects the intention to speak from the movement of the participant detected based on the image of the camera. For example, the detection unit 32 detects the intention to speak by determining whether or not the participant is about to speak from the movement of their mouth.

[0042] The detection unit 32 also detects an intention to speak when a participant approaches a microphone or clears their throat to adjust their vocal cords. The detection unit 32 also detects the participant's level of concentration on the meeting based on the camera image, and detects the intention to speak based on the level of concentration.

[0043] For example, if a participant is not looking at materials shared in a meeting or is performing a search or the like using another screen, the detection unit 32 determines that the participant has a low level of concentration and has no intention of speaking.

[0044] In addition, the detection unit 32 may detect whether or not there is an intention to speak using a model generated using the above features (movements of participants, etc.) detected (extracted) from the participant information as explanatory variables and the presence or absence of an intention to speak as a target variable.

[0045] Furthermore, the explanatory variables may further take into account, for example, silent periods in which none of the participants are speaking in the meeting, or MT history information of the participants.

[0046] Furthermore, the detection unit 32 may detect not only the presence or absence of an intention to speak but also the degree of intention to speak (how much one wants to speak). The degree of intention to speak can be detected using a model generated using, for example, the above-mentioned participant information, silent period, and MT history information as explanatory variables and the degree of intention to speak as a target variable.

[0047] The detection unit 32 also detects the status of the meeting. For example, the detection unit 32 detects the progress of the meeting (progress of the agenda), the remaining time until the end of the meeting (or the end of each agenda), the speech history of the meeting, the overall status of the meeting (whether the conversation is lively or not, whether everyone is speaking or not), etc.

[0048] For example, the detection unit 32 may detect the remaining time until the end of the meeting based on the schedule information of the participants, or may analyze the content of the participants' speech to detect the current agenda or the progress of the meeting. The detection unit 32 may also receive an operation from a participant (facilitator) indicating that the agenda has changed.

[0049] The MT control unit 33 performs various controls related to the meeting. As shown in FIG.

[0050] The speech support unit 331 performs speech support processing to support the speech of the participants based on the detected intention to speak. For example, the speech support unit 331 notifies the participants who intend to speak to encourage them to speak. For example, the speech support unit 331 predicts the speech time of other participants who are currently speaking, and notifies them that they will be able to speak after the predicted speech time. The speech time can be predicted based on, for example, MT history information of the other participants.

[0051] Furthermore, the speech support unit 331 may perform a process of prohibiting other participants from speaking when a participant who intends to speak starts speaking. The process of prohibiting speech is, for example, a muting process or a process of notifying other participants that speech is prohibited.

[0052] Furthermore, when multiple participants intend to speak, the speech support unit 331 may determine the order of notifications to prompt participants to speak based on, for example, the participant's attribute information or the meeting situation. For example, the speech support unit 331 may send notifications to prompt participants to speak in descending order of their job titles, or, when there is little time left in the meeting, may send notifications to prompt participants who are closely involved in the meeting agenda (e.g., participants whose job duties are related to the agenda). The speech support unit 331 may also determine the order of notifications to prompt participants to speak based on the participants' activeness in speaking in past meetings. For example, when both an active participant and a passive participant express their intention to speak, the speech support unit 331 may send notifications to prompt the passive participant preferentially. The speech support unit 331 may also lower the priority of notifications to prompt participants who speak near the end of the meeting based on MT history information. The speech support unit 331 may also assign priorities to each participant according to their level of intention to speak.

[0053] The providing unit 332 provides the facilitator with support information for supporting the progress of the meeting based on the detected intention to speak and the status of the meeting. For example, the providing unit 332 provides the facilitator with information about participant C who intends to speak and the remaining time of the meeting (or each agenda item). This allows the facilitator to easily determine whether to allow participant C to speak based on the remaining time, thereby allowing the meeting to proceed appropriately.

[0054] Furthermore, the providing unit 332 may provide information on how much time participant C is permitted to speak (allowed speaking time), for example, based on the remaining time. That is, the providing unit 332 provides permission information regarding speaking permission based on the progress of the meeting. The providing unit 332 may also provide display information indicating the degree of willingness to speak (the degree to which the participant wants to speak) for each participant. For example, the providing unit 332 displays support information in a display mode according to the degree of willingness to speak. This allows the facilitator to easily determine the degree to which the participants intend to speak.

[0055] Furthermore, the providing unit 332 provides support information for each agenda item based on the status of each agenda item detected by the detecting unit 32. This allows for appropriate progress to be made for each agenda item.

[0056] Next, the processing procedures of information processing part 1 and part 2 executed by the information processing device 1 according to the embodiment will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is a flowchart showing the processing procedures of information processing part 1 executed by the information processing device 1 according to the embodiment. Fig. 7 is a flowchart showing the processing procedures of information processing part 2 executed by the information processing device 1 according to the embodiment.

[0057] 6, in information processing 1, the control unit 3 first acquires participant information via the participant terminal 50 (step S101). Next, the control unit 3 detects the participant's intention to speak based on the participant information (step S102). Next, the control unit 3 performs speech support processing to support the participant's speech based on the detected intention to speak (step S103), and then ends the processing.

[0058] 7, in information processing 2, the control unit 3 first acquires participant information via the participant terminal 50 (step S201). Next, the control unit 3 detects the participants' intention to speak and the meeting situation based on the participant information (step S202). Next, the control unit 3 provides support information to the facilitator to support the progress of the meeting based on the detected intention to speak and the meeting situation (step S203), and then ends the processing.

[0059] 〔others〕 Furthermore, among the processes described in the above embodiments, some of the processes described as being performed automatically can also be performed manually. Alternatively, all or some of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0060] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0061] 4 may be held in a storage server or the like, rather than being held by each device. In this case, each device obtains various pieces of information by accessing the storage server.

[0062] [Hardware configuration] The information processing device 1 according to the embodiment described above is realized by, for example, a computer 1000 configured as shown in Fig. 8. Fig. 8 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which an arithmetic unit 1030, a primary storage device 1040, a secondary storage device 1050, an output IF (Interface) 1060, an input IF 1070, and a network IF 1080 are connected via a bus 1090.

[0063] The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and secondary storage device 1050, programs read from the input device 1020, and the like, and executes various processes. The primary storage device 1040 is a memory device, such as a RAM, that temporarily stores data used by the arithmetic device 1030 for various calculations. The secondary storage device 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), an HDD (Hard Disk Drive), a flash memory, or the like.

[0064] The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information, such as a monitor or a printer, and is realized by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (High Definition Multimedia Interface), etc. The input IF 1070 is an interface for receiving information from various input devices 1020, such as a mouse, keyboard, scanner, etc., and is realized by a USB, etc.

[0065] The input device 1020 may be a device that reads information from, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. The input device 1020 may also be an external storage medium such as a USB memory.

[0066] The network IF 1080 receives data from other devices via the network N and sends it to the arithmetic device 1030, and also transmits data generated by the arithmetic device 1030 to other devices via the network N.

[0067] The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

[0068] For example, when the computer 1000 functions as the information processing device 1, the arithmetic unit 1030 of the computer 1000 executes a program loaded onto the primary storage device 1040, thereby realizing the functions of the control unit 3.

[0069] 〔effect〕 As described above, the information processing device 1 according to the embodiment includes an acquisition unit 31, a detection unit 32, and a speech support unit 331. The acquisition unit 31 acquires participant information detected by a sensor from participants participating in an online meeting. The detection unit 32 detects the participants' intention to speak in the meeting based on the participant information. The speech support unit 331 performs speech support processing to support the participants' speech based on the detected intention to speak. The acquisition unit 31 acquires, as participant information, images captured by a camera provided in the participant terminal 50 carried by the participant. The detection unit 32 detects the participants' intention to speak based on the movements of the participants detected based on the camera images. The detection unit 32 detects the participants' mouth movements as the movements of the participants. The detection unit 32 detects the participants' intention to speak based on the participants' levels of concentration on the meeting detected based on the camera images. The acquisition unit 31 acquires, as participant information, whether or not the participants are currently speaking. The detection unit 32 detects silent periods in the meeting in which none of the participants are speaking, and detects the participants' intention to speak based on the silent periods. The acquisition unit 31 acquires information about the speech situations of participants in past meetings. The detection unit 32 detects an intention to speak based on the speech situations in past meetings. The speech support unit 331 notifies participants who are detected as intending to speak to encourage them to speak. When a participant who is detected as intending to speak starts speaking, the speech support unit 331 performs processing to prohibit other participants from speaking. The processing to prohibit speaking is muting processing. With this configuration, it is possible to appropriately support participants' speech.

[0070] As described above, the information processing device 1 according to the embodiment includes an acquisition unit 31, a detection unit 32, and a provision unit 332. The acquisition unit 31 acquires participant information detected by a sensor from each participant participating in an online meeting. The detection unit 32 detects the participant's intention to speak in the meeting and the meeting status based on the participant information. The provision unit 332 provides support information to the meeting facilitator to support the progress of the meeting based on the detected intention to speak and the meeting status. The detection unit 32 detects the progress of the meeting. The provision unit 332 provides the facilitator with permission information regarding speech permission for participants who intend to speak based on the progress status. The permission information includes information on the permitted speaking time based on the remaining time of the meeting. The detection unit 32 detects the status for each agenda item in the meeting. The provision unit 332 provides the facilitator with support information for each agenda item. The detection unit 32 detects the degree of intention to speak. The provision unit 332 provides support information according to the degree of intention to speak. The providing unit 332 provides information on the display mode according to the degree of intention to speak. The acquiring unit 31 acquires, as participant information, images from a camera provided on the participant terminal 50 carried by the participant. The detecting unit 32 detects the intention to speak based on the movement of the participant detected based on the camera image. The detecting unit 32 detects the movement of the participant's mouth as the movement of the participant. The detecting unit 32 detects the intention to speak based on the participant's level of concentration on the meeting detected based on the camera image. The acquiring unit 31 acquires information on the participant's speech situation in past meetings. The detecting unit 32 detects the intention to speak based on the speech situation in past meetings. With this configuration, the meeting can be conducted appropriately.

[0071] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have undergone various modifications and improvements based on the knowledge of those skilled in the art.

[0072] 〔others〕 Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0073] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0074] Furthermore, the processes described in the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the process contents.

[0075] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, the control unit 3 can be read as control means or a control circuit. [Explanation of symbols]

[0076] 1. Information processing equipment 2. Communications Department 3. Control Unit 4 Storage section 31 Acquisition Department 32 Detection unit 33 MT control unit 41 Participant information 50 participant terminals 331 Speech Support Department 332 Providing Department S Information Processing System

Claims

1. an acquisition unit that acquires participant information detected by a sensor from participants participating in an online meeting; a detection unit that detects, based on the participant information, an intention to speak, which indicates that the participant in the meeting is about to speak; a speech support unit that performs speech support processing to support the speech of the participant based on the detected intention to speak; Equipped with The acquisition unit Acquire information about the participants' speech situations in the past meetings; The detection unit Detecting the intention to speak based on the speech situations in the past meetings. An information processing device characterized by:

2. The acquisition unit Acquires an image from a camera equipped on a participant terminal carried by the participant as the participant information; The detection unit Detecting the intention to speak based on the movements of the participants detected based on the image of the camera.

2. The information processing device according to claim 1,

3. The detection unit Detecting the movement of the participant's mouth as the movement of the participant.

3. The information processing device according to claim 2, wherein:

4. The detection unit Detecting the intention to speak based on the degree of concentration of the participants in the meeting detected based on the image from the camera.

4. The information processing device according to claim 2 or 3,

5. The acquisition unit acquiring, as the participant information, whether or not the participant is currently speaking; The detection unit detecting a silent period in which none of the participants is speaking in the meeting, and detecting the intention to speak based on the silent period; 5. The information processing device according to claim 1, wherein:

6. The speech support unit To notify the participant who is detected as having the intention to speak, to encourage the participant to speak.

6. The information processing device according to claim 1, wherein:

7. The speech support unit When the participant who is detected as having the intention to speak starts speaking, a process of prohibiting other participants from speaking is performed.

7. The information processing device according to claim 1, wherein:

8. The process of prohibiting speech includes: Mute processing 8. The information processing device according to claim 7,

9. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring participant information detected by a sensor from participants participating in an online meeting; a detecting step of detecting an intention to speak based on the participant information, the intention indicating that the participant in the meeting is about to speak; a speech support step of performing a speech support process to support the speech of the participant based on the detected intention to speak; Including, The obtaining step includes: Acquire information about the participants' speech situations in the past meetings; The detecting step Detecting the intention to speak based on the speech situations in the past meetings. An information processing method comprising:

10. An acquisition step of acquiring participant information detected by a sensor from participants participating in an online meeting; a detection step of detecting an intention to speak, which indicates that the participant in the meeting is about to speak, based on the participant information; a speech support procedure for performing a speech support process to support the speech of the participant based on the detected intention to speak; on the computer, The acquisition procedure includes: Acquire information about the participants' speech situations in the past meetings; The detection procedure comprises: Detecting the intention to speak based on the speech situations in the past meetings. An information processing program characterized by:

Images