Information processing device, program, mute function providing method, information processing system, and manufacturing method for information processing system

Abstract

To provide an information processing device, a program, a mute function providing method, an information processing system, and a manufacturing method for the information processing system that allow participants to recognize when a mute function is in progress and reduces the likelihood of continuing to talk compared to a conventional technology.SOLUTION: An information processing device according to the present invention provides a web conference via the Internet from a participant to a fellow participant, and the information processing device 1 includes a sound muting function unit 18 that executes a sound muting function to prevent the remote participant B from hearing the sound from the participant A side, and a muted-time speech suppression function unit 19 that has a function of suppressing the participant from continuing to talk without realizing that the sound muting function is being executed when there is sound input from the participant side while the sound muting function unit is executing the sound muting function.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a program, a mute function providing method, an information processing system, and a manufacturing method for manufacturing an information processing system. [Background technology]

[0002] As shown in Patent Document 1, a speech control device is known that has a function to mute speech from participants other than specific participants. When conference participants A and B speak at the same time and their voices overlap, the speech control device as shown in Patent Document 1 compares the speech priorities of A and B, and prioritizes the voice of A, who has a higher speech priority, thereby muting the voice of B. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2022-136589 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-220558 [Patent Document 3] WO2019-026318 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in a speech control device such as that shown in Patent Document 1, the muted message remains displayed on the side of the participants whose speech is muted while speech is being controlled. This causes a problem in that participants cannot see the conference information on the screen while muted, which causes disruption to the conference.

[0005] Furthermore, Patent Document 2 discloses a portable terminal device that mutes the voice transmitted to the other terminal in video conference communication. When muting the voice signal picked up by the microphone, this portable terminal device notifies the user that the voice signal muting function is being executed by lighting up an LED light-emitting unit, vibrating, or the like. However, the LED light-emitting unit as shown in Patent Document 2 is located on the back of the mobile terminal, and the audio signal muting function is executed when the mobile terminal device is placed in a specific position, face down so that the screen cannot be seen. Therefore, if such technology is applied to the muting function during a conference, there is a problem that the conference information cannot be seen, causing disruption to the conference. Furthermore, even if LED lighting were used to notify the mute function, there is a risk that even if the LED lights up when a participant is about to speak, the participant may not be fully aware that the mute function is in operation and may continue talking.

[0006] Furthermore, as shown in Patent Document 3, a digital camera has been proposed that displays a message to notify the user that the mute function is turned on. When the mute function is turned on against the user's will, the user can be made aware of it by viewing the level meter and the word "MUTE." However, such a display of the mute function can cause a problem in that the user may not be fully aware that the mute function is in operation. In this regard, even current features such as Zoom (registered trademark), Teams (registered trademark), and Meet (registered trademark) are not sufficient to make the user aware that the mute function is in operation, resulting in frequent incidents of users continuing to talk while the device is muted.

[0007] Therefore, the present invention aims to provide an information processing device, a program, a method for providing a mute function, an information processing system, and a manufacturing method for an information processing system that allow participants to be aware that the mute function is being executed and reduce the number of accidents in which they continue talking compared to conventional technology. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, one embodiment of the present invention is an information processing device that can be used for web conferences via the Internet from a participant to an opposing participant, and is characterized by comprising: a sound muting function unit that executes a sound muting function that prevents the opposing participant from hearing the sounds from the participant's side; and a muted speech suppression function unit that has a function to prevent the participant from continuing to talk without realizing that the sound muting function is being executed when there is sound input from the participant's side while the sound muting function unit is executing the sound muting function. According to one embodiment of the present invention configured as described above, when a participant inputs sound while the sound muting function unit is executing the sound muting function, the function of the muting speech suppression function unit can make the participant more aware that the sound muting function is being executed, thereby reducing the occurrence of accidents in which a participant continues talking despite the sound muting function being executed compared to the prior art.

[0009] In one embodiment of the present invention, the mute speech suppression function unit preferably includes a sound mute warning unit that issues a warning to make the participants more aware that the sound mute function is being executed. According to one embodiment of the present invention configured as described above, when a participant inputs sound while the sound mute function unit is executing the sound mute function, the sound mute warning unit issues a warning to make the participant more aware that the sound mute function is being executed, thereby reducing the occurrence of accidents in which a participant continues talking despite the sound mute function being executed compared to the prior art.

[0010] In one embodiment of the present invention, the sound mute warning unit preferably issues a warning by visual communication means to make it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, a visual communication means that is easily noticeable to participants can make them more aware that the sound mute function is being executed.

[0011] In one embodiment of the present invention, the sound mute warning unit preferably issues a warning by an auditory communication means to make the participants more aware that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, auditory communication means using the five senses other than sight can make it easier for the participants to notice that the sound mute function is being executed.

[0012] In one embodiment of the present invention, the sound mute warning unit preferably issues a warning by tactile communication means to make the participants more aware that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, tactile communication means using the five senses other than sight can make it easier for participants to notice that the sound mute function is being executed.

[0013] In one embodiment of the present invention, the sound mute warning unit preferably issues a warning that makes it easier for the participant to visually notice that the sound mute function is being executed by displaying a warning image indicating that the sound mute function is being executed in at least 5% of the screen area on the participant's side. According to one embodiment of the present invention configured in this manner, when there is sound input from the participant while the sound mute function is being executed by the sound mute function unit, a warning image indicating that the sound mute function is being executed is displayed in more than 5% of the screen area of ​​the information processing device on the participant's side, and the sound mute warning unit issues a warning, making it easier for the participant to visually notice that the sound mute function is being executed.

[0014] In one embodiment of the present invention, the sound mute warning unit preferably displays a warning image having a height of 10% or more of the height of the screen area within the web conference on the participant's side, thereby providing a visual warning to make it easier for the participant to notice that the sound mute function is in operation. According to one embodiment of the present invention configured as described above, the warning image can be made more noticeable by displaying the warning image at a height equal to or greater than a predetermined height on the web conference screen, thereby making it easier for the participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit.

[0015] In one embodiment of the present invention, the sound mute warning unit preferably displays a warning image having a width of 10% or more of the width of the screen area on the participant's side, thereby providing a visual warning that makes it easier for the participant to notice that the sound mute function is being executed. According to one embodiment of the present invention, by displaying a warning image having a width equal to or greater than a predetermined width on the web conference screen, the warning image can be made more visible in the horizontal direction, thereby making it easier for participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit.

[0016] In one embodiment of the present invention, preferably, the sound mute warning section issues a sound warning that makes it easier for the participants to audibly notice that the sound mute function is being executed. According to one embodiment of the present invention configured as described above, the auditory communication means can easily make the participants aware that the sound muting function is being executed.

[0017] In one embodiment of the present invention, preferably, the sound mute warning unit issues a warning by vibration to make it easier for the participants to tactilely notice that the sound mute function is being executed. According to one embodiment of the present invention configured as described above, the participants can be made more aware that the sound muting function is being executed by using a tactile transmission means that uses vibration.

[0018] In one embodiment of the present invention, the sound muting function unit preferably comprises a first muting function unit that starts the sound muting function in response to a start operation on the part of the participant and ends the sound muting function in response to a stop operation on the part of the participant, and a second muting function unit that starts the sound muting function in response to a start operation on the part of the participant and may cause the muted speech suppression function unit to issue a warning to make the participant more aware of the sound when a predetermined condition is met, even if a stop operation on the part of the participant has not been performed. According to one embodiment of the present invention configured as described above, the information processing device can start the mute function by a first mute function unit in response to a start operation by the participant and end the mute function by a termination operation by the participant. The second mute function unit can start the mute function by a start operation by the participant, and can cause the mute-time speech suppression function unit to issue a warning to make the participant more aware of the mute function when a predetermined condition is met, even if the participant has not performed a termination operation. This allows the mute-time speech suppression function unit to issue a warning to make the participant more aware of the mute function based on a predetermined condition, even if the participant has not performed a termination operation, thereby preventing participants from continuing to talk even when the mute function is active. For example, in a web conference, if a participant uses the mute function but is likely to start speaking again, the mute-time speech suppression function unit can help prevent participants from continuing to talk even when the mute function is active.

[0019] In one embodiment of the present invention, the sound muting function unit preferably comprises a first muting function unit that starts the sound muting function in response to a start operation on the participant's side and ends the sound muting function in response to a stop operation on the participant's side, and a second muting function unit that starts the sound muting function in response to a start operation on the participant's side and may end the sound muting function using the muted speech suppression function unit when a predetermined condition is met even when a stop operation on the participant's side has not been performed. According to one embodiment of the present invention, the information processing device has a first mute function unit that can start the mute function in response to a start operation by the participant and can end the mute function in response to a termination operation by the participant. The second mute function unit can start the mute function in response to a start operation by the participant, and can end the mute function in response to a predetermined condition even if the participant has not performed a termination operation. This allows the mute function to be ended by the mute speech suppression function unit based on a predetermined condition even if the participant has not performed a termination operation. This allows the participant to recognize that the mute function has been activated by terminating the mute function, and prevents the participant from continuing to speak even while the mute function is active. For example, in a web conference where a participant uses the mute function but is likely to start speaking again, the mute speech suppression function unit can more easily prevent the participant from continuing to speak even while the mute function is active.

[0020] In one embodiment of the present invention, preferably, the second mute function unit determines whether a predetermined condition is met based on the audio input from the participant side even when an end operation has not been performed on the participant side. According to one embodiment of the present invention configured as described above, the second mute function unit determines whether a predetermined condition is met based on the audio input from the participant even when the participant has not performed an end operation. As a result, even when the participant has not performed an end operation, if it determines that the participant has started speaking based on the audio input from the participant, the function of the muted speech suppression function unit is executed. This further reduces the occurrence of accidents in which a participant continues talking despite the mute function being activated.

[0021] In one embodiment of the present invention, the second mute function unit preferably determines whether or not a predetermined condition is met based on the duration of the sound input from the participant side. According to one embodiment of the present invention configured as described above, the second mute function unit determines whether a participant has started speaking based on the duration of the participant's sound input. This allows the second mute function unit to make a determination based on the length of the participant's speech, thereby improving the accuracy of determining the participant's speech state.

[0022] In one embodiment of the present invention, the second mute function unit preferably determines whether or not a predetermined condition is satisfied based on the frequency band of the sound input from the participant side. According to one embodiment of the present invention configured as described above, the second muting function unit determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. This allows the second muting function unit to determine whether the sound is a participant's speech or other environmental noise based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0023] In one embodiment of the present invention, the second mute function unit preferably determines whether or not a predetermined condition is met based on the tone of the voice being input from the participant side. According to one embodiment of the present invention configured in this manner, the second mute function unit can determine what a participant is saying, for example, based on the participant's tone of voice, thereby improving the accuracy of determining the participant's speaking state.

[0024] In one embodiment of the present invention, the second mute function unit preferably determines whether or not a predetermined condition is met based on a voiceprint of a voice being input on the participant side. According to one embodiment of the present invention configured in this manner, the second mute function unit can determine what a participant is saying, for example, based on the voiceprint of the participant's voice, thereby improving the accuracy of determining the participant's speaking state.

[0025] In one embodiment of the present invention, the program preferably functions to cause an information processing device to be used for a web conference via the Internet from a participant to an opposing participant, and executes a sound mute function unit that prevents the opposing participant from hearing the sounds from the participant's side, and executes a muted speech suppression function unit that prevents the participant from continuing to talk without realizing that the sound mute function is being executed when there is sound input from the participant's side while the sound mute function unit is executing the sound mute function. According to one embodiment of the present invention configured as described above, when a participant inputs sound while the mute function unit is executing the mute function, the program can execute a mute-time speech suppression function unit that suppresses the participant from continuing to talk without realizing that the mute function is being executed, making it easier for the participant to notice that the mute function is being executed. This can prevent the participant from continuing to talk even when the mute function is being executed. This can reduce the effort and time wasted when a participant continues to talk without realizing that the mute function is being executed, resulting in the participant having to repeat the same content.

[0026] In one embodiment of the present invention, the program preferably executes a sound mute warning section in the muted speech suppression function section, thereby executing a warning that makes it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured as described above, when a sound is input from a participant while the sound muting function unit is executing the sound muting function, the program can cause the information processing device to issue a warning that makes it easier for the participant to notice that the sound muting function is being executed, thereby making it easier for the participant to notice that the sound muting function is being executed. Thus, it is possible to prevent the participant from continuing to talk even when the sound muting function is being executed.

[0027] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to issue a warning by visual communication means that makes it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, a visual communication means that is easily noticeable to participants can make them more aware that the sound mute function is being executed.

[0028] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to issue a warning by auditory transmission means that makes it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, auditory communication means using the five senses other than sight can make it easier for the participants to notice that the sound mute function is being executed.

[0029] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to issue a warning, such as by a tactile transmission means, that makes it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, tactile communication means using the five senses other than sight can make it easier for participants to notice that the sound mute function is being executed.

[0030] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to display a warning image indicating that the sound mute function is in operation in 5% or more of the screen area within the web conference on the participant's side, thereby executing a warning that makes it easier for the participant to visually notice that the sound mute function is in operation. According to one embodiment of the present invention configured in this manner, when there is sound input from the participant while the sound mute function is being executed by the sound mute function unit, a warning image indicating that the sound mute function is being executed can be displayed in 5% or more of the screen area within the web conference of the participant's information processing device, making it easier for the participant to visually notice that the sound mute function is being executed.

[0031] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to display a warning image having a height of 10% or more of the height of the screen area within the web conference on the participant's side, thereby providing a visual warning that makes it easier for the participant to notice that the sound mute function is in operation. According to one embodiment of the present invention configured as described above, the warning image can be made more noticeable by displaying the warning image at a height equal to or greater than a predetermined height on the web conference screen, thereby making it easier for the participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit.

[0032] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to display a warning image having a width of 10% or more of the width of the screen area on the participant's side, thereby providing a visual warning that makes it easier for the participant to notice that the sound mute function is being executed. According to one embodiment of the present invention, by displaying a warning image having a width equal to or greater than a predetermined width on the web conference screen, the warning image can be made more visible in the horizontal direction, thereby making it easier for participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit.

[0033] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to issue a warning that the sound mute function is being executed, making it easier for the participants to audibly notice the warning. According to one embodiment of the present invention configured as described above, the auditory communication means can easily make the participants aware that the sound muting function is being executed.

[0034] In one embodiment of the present invention, the program preferably executes the sound mute warning unit to issue a tactile warning that the sound mute function is being executed, by vibrating the sound to make it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured as described above, the participants can be made more aware that the sound muting function is being executed by using a tactile transmission means that uses vibration.

[0035] In one embodiment of the present invention, preferably, the sound muting function unit comprises a first muting function unit that starts the sound muting function in response to a start operation on the part of the participant and ends the sound muting function in response to a stop operation on the part of the participant, and a second muting function unit that starts the sound muting function in response to a start operation on the part of the participant and may cause the muted speech suppression function unit to issue a warning to make the participant more aware of the sound when a predetermined condition is met, even if a stop operation on the part of the participant has not been performed, and the program is configured to be able to execute each of the first muting function unit and the second muting function unit. According to one embodiment of the present invention configured as described above, even if a participant has not performed an end operation on the participant's side, the muting speech suppression function unit can issue a warning based on a predetermined condition to make the participant more aware of the situation, thereby preventing accidents in which a participant continues to talk despite the sound muting function being activated. For example, in a case where a participant uses the sound muting function in a web conference but is likely to start speaking again, the muting speech suppression function unit can easily prevent accidents in which a participant continues to talk despite the sound muting function being activated.

[0036] In one embodiment of the present invention, preferably, the sound muting function unit comprises a first muting function unit that starts the sound muting function in response to a start operation on the participant's side and ends the sound muting function in response to a stop operation on the participant's side, and a second muting function unit that starts the sound muting function in response to a start operation on the participant's side and may end the sound muting function using the muted speech suppression function unit when a predetermined condition is met even when no stop operation has been performed on the participant's side, and the program is configured to be able to execute each of the first muting function unit and the second muting function unit. According to one embodiment of the present invention configured in this manner, the mute function can be terminated by the mute speech suppression function unit based on predetermined conditions even if the participant has not performed an operation to terminate the function on their side. This allows the participant to recognize that the mute function has been executed when the mute function is terminated, and it is possible to prevent accidents in which participants continue talking even though the mute function is being executed.

[0037] In one embodiment of the present invention, preferably, the program executes the second mute function unit to determine whether a predetermined condition is met based on the audio input from the participant side, even when no termination operation has been performed on the participant side. According to one embodiment of the present invention configured as described above, the function of the muted speech suppression function unit is executed when it is determined that a participant has started speaking based on the participant's audio input, even if the participant has not performed an end operation on the participant side. This makes it possible to further prevent accidents in which a participant continues speaking despite the mute function being activated.

[0038] In one embodiment of the present invention, preferably, the program executes the second mute function unit to determine whether a predetermined condition is met based on the duration of the sound input from the participant side. According to one embodiment of the present invention configured as described above, the second mute function unit determines whether a participant has started speaking based on the duration of the participant's sound input. This allows the second mute function unit to make a determination based on the length of the participant's speech, thereby improving the accuracy of determining the participant's speech state.

[0039] In one embodiment of the present invention, preferably, the program executes the second mute function unit to determine whether or not a predetermined condition is met based on the frequency band of the sound input from the participant side. According to one embodiment of the present invention configured as described above, the second muting function unit determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. This allows the second muting function unit to determine whether the sound is a participant's speech or other environmental noise based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0040] In one embodiment of the present invention, preferably, the program executes the second mute function unit to determine whether or not a predetermined condition is met based on the tone of the voice being input by the participant. According to one embodiment of the present invention configured in this manner, the second mute function unit can determine what a participant is saying, for example, based on the participant's tone of voice, thereby improving the accuracy of determining the participant's speaking state.

[0041] In one embodiment of the present invention, preferably, the program executes the second mute function unit to determine whether or not a predetermined condition is met based on the voiceprint of the voice being input by the participant. According to one embodiment of the present invention configured in this manner, the second mute function unit can determine what a participant is saying, for example, based on the voiceprint of the participant's voice, thereby improving the accuracy of determining the participant's speaking state.

[0042] In one embodiment of the present invention, a method for providing a mute function in an information processing device, preferably usable for a web conference via the Internet from a participant to an opposing participant, includes a sound mute step for executing a sound mute function that prevents the opposing participant from hearing the sound from the participant's side, and a speech suppression step during muting for suppressing speech from continuing to talk without the participant realizing that the sound mute function is being executed when sound input is made from the participant's side while the sound mute function is being executed by the sound mute step. According to one embodiment of the present invention configured as described above, when a sound is input from the participant while the sound muting function is being executed by the sound muting step, the muting-while-speech suppression step makes it easier for the participant to be aware that the sound muting function is being executed. Therefore, the occurrence of an accident in which a participant continues talking despite the sound muting function being executed can be reduced compared to the prior art.

[0043] In one embodiment of the present invention, the muting speech suppression step preferably includes a sound muting warning step of issuing a warning to make the participants more aware that the sound muting function is being executed. According to one embodiment of the present invention configured as described above, when a sound is input from a participant while the sound muting function is being executed by the sound muting step, the sound muting warning step can warn the participant that the sound muting function is being executed. Therefore, the occurrence of accidents in which a participant continues speaking despite the sound muting function being executed can be reduced compared to the prior art. Therefore, it is possible to reduce the waste of time and effort caused by a participant continuing to speak without realizing that the sound muting function is being executed, resulting in having to explain the same content again.

[0044] In one embodiment of the present invention, the sound mute warning step preferably includes issuing a warning by visual communication means to make it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, a visual communication means that is easily noticeable to participants can make them more aware that the sound mute function is being executed.

[0045] In one embodiment of the present invention, the sound mute warning step preferably includes issuing a warning by an auditory means to make the participants aware that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, auditory communication means using the five senses other than sight can make it easier for the participants to notice that the sound mute function is being executed.

[0046] In one embodiment of the present invention, the sound mute warning step preferably includes issuing a warning by a tactile communication means or the like to make it easier for the participants to notice that the sound mute function is being executed. According to one embodiment of the present invention configured in this manner, tactile communication means using the five senses other than sight can make it easier for participants to notice that the sound mute function is being executed.

[0047] In one embodiment of the present invention, the sound mute warning step preferably includes displaying a warning image indicating that the sound mute function is in operation in 5% or more of the screen area within the web conference on the participant's side, thereby providing a visual warning that makes it easier for the participant to notice that the sound mute function is in operation. According to one embodiment of the present invention configured in this manner, when sound input is received from the participant while the sound mute function is being executed, a warning image indicating that the sound mute function is being executed is displayed in 5% or more of the screen area within the web conference of the participant's information processing device, thereby making it easier for the participant to visually notice that the sound mute function is being executed through the warning in the sound mute warning step.

[0048] In one embodiment of the present invention, the sound mute warning step preferably includes displaying a warning image having a height of 10% or more of the height of the screen area within the web conference on the participant's side, thereby providing a visual warning to make it easier for the participant to notice that the sound mute function is being executed. According to one embodiment of the present invention configured as above, by displaying a warning image having a height equal to or greater than a predetermined height on the web conference screen, the warning image can be made more noticeable, and the warning in the sound mute warning step can make it easier for the participants to visually notice that the sound mute function is being executed.

[0049] In one embodiment of the present invention, the sound mute warning step preferably includes displaying a warning image having a width of 10% or more of the width of the screen area on the participant's side to provide a visual warning that makes it easier for the participant to notice that the sound mute function is being executed. According to one embodiment of the present invention configured as above, by displaying a warning image having a width equal to or greater than a predetermined width on the web conference screen, the warning image can be made more visible in the horizontal direction, thereby making it easier for the participants to visually notice that the sound mute function is being executed by the warning in the sound mute warning step.

[0050] In one embodiment of the present invention, the sound muting warning step preferably includes issuing a sound warning to make it easier for the participants to audibly notice that the sound muting function is being executed. According to one embodiment of the present invention configured in this manner, the auditory communication means can easily make the participants aware audibly that the sound mute function is being executed.

[0051] In one embodiment of the present invention, the sound muting warning step preferably includes issuing a tactile warning by vibration to make it easier for the participants to notice that the sound muting function is being executed. According to one embodiment of the present invention configured as described above, the participants can be made more aware that the sound muting function is being executed by using a tactile transmission means that uses vibration.

[0052] In one embodiment of the present invention, the sound muting step preferably includes a first muting function step of starting the sound muting function by a start operation on the part of the participant and terminating the sound muting function by a termination operation on the part of the participant, and a second muting function step of starting the sound muting function by a start operation on the part of the participant and, even if a termination operation on the part of the participant has not been performed, issuing a warning to make the participant more aware of the sound by the muted speech suppression step if a predetermined condition is met. According to one embodiment of the present invention configured as described above, even if a participant has not performed an end operation on the participant's side, a warning that makes the participant more likely to notice can be issued by the muting-while-speech suppression step based on a predetermined condition, thereby preventing an accident in which a participant continues speaking despite the sound muting function being activated. For example, in a case where a participant uses the sound muting function in a web conference but is likely to start speaking again, the muting-while-speech suppression step can easily prevent an accident in which a participant continues speaking despite the sound muting function being activated.

[0053] In one embodiment of the present invention, the sound muting step preferably includes a first muting function step of starting the sound muting function by a start operation on the participant's side and terminating the sound muting function by a termination operation on the participant's side, and a second muting function step of starting the sound muting function by a start operation on the participant's side and may terminate the sound muting function by the muted speech suppression step if a predetermined condition is met even when a termination operation on the participant's side has not been performed. According to one embodiment of the present invention configured as described above, the mute function can be terminated by the mute-while-speech suppression step based on a predetermined condition even if the participant has not performed a termination operation on the participant's side, so that the participant recognizes that the mute function was being executed when the mute function was terminated, and the occurrence of an accident in which the participant continues to speak even though the mute function is being executed can be prevented. For example, in a case where a participant uses the mute function in a web conference but is likely to start speaking again, the mute-while-speech suppression step can easily prevent the occurrence of an accident in which the participant continues to speak even though the mute function is being executed.

[0054] In one embodiment of the present invention, preferably, the second mute function step determines whether a predetermined condition is met based on the audio input from the participant side, even if the participant side has not performed an end operation. According to one embodiment of the present invention configured as described above, the second mute function step determines whether a predetermined condition is met based on the audio input from the participant even when the participant has not performed an end operation. As a result, the function of the muted speech suppression function unit is executed when it is determined that the participant has started speaking based on the audio input from the participant even when the participant has not performed an end operation. This further reduces the occurrence of accidents in which a participant continues speaking despite the mute function being activated.

[0055] In one embodiment of the present invention, the second mute function step preferably determines whether a predetermined condition is met based on the duration of the sound input from the participant side. According to one embodiment of the present invention configured as described above, the second mute function step determines whether or not a participant has started speaking based on the duration of the participant's sound input. This allows the second mute function step to make a determination based on the length of the participant's speech, thereby improving the accuracy of determining the participant's speech state.

[0056] In one embodiment of the present invention, the second muting step preferably determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. According to one embodiment of the present invention configured as described above, the second mute function step determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. This allows the second mute function step to determine whether the sound is a participant's speech or other environmental noise based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0057] In one embodiment of the present invention, the second muting step preferably determines whether a predetermined condition is met based on the tone of the voice being input from the participant side. According to one embodiment of the present invention configured in this manner, the second mute function step can determine what a participant is saying, for example, based on the participant's tone of voice, thereby improving the accuracy of determining the participant's speaking state.

[0058] In one embodiment of the present invention, the second muting step preferably determines whether a predetermined condition is met based on the voiceprint of the voice being input from the participant side. According to one embodiment of the present invention configured in this manner, the second mute function step can determine what a participant is saying, for example, based on the voiceprint of the participant's voice, thereby improving the accuracy of determining the participant's speaking state.

[0059] In one embodiment of the present invention, there is provided an information processing system that provides a web conference via the Internet from a participant to an opposite participant, preferably including the information processing device described above.

[0060] In one embodiment of the present invention, there is preferably provided a manufacturing method for manufacturing the information processing system. [Effects of the Invention]

[0061] According to the present invention, it is possible to provide an information processing device, a program, a method for providing a mute function, an information processing system, and a manufacturing method for an information processing system that allow participants to be aware that the mute function is being executed and reduce the likelihood of them continuing to talk compared to conventional technology. [Brief explanation of the drawings]

[0062] [Figure 1] 1 is a diagram showing an example of the configuration of an information processing system including an information processing device according to a first embodiment of the present invention. [Figure 2] 2 is a block diagram of a control unit of the information processing device according to the first embodiment of the present invention. FIG. [Figure 3] 1 is a diagram showing a state in which neither the sound mute button nor the video mute button is pressed on the monitor screen of the information processing device according to the first embodiment of the present invention. FIG. [Figure 4] 1 is a diagram showing a state in which the sound mute button and the video mute button are pressed on the monitor screen of the information processing device according to the first embodiment of the present invention. FIG. [Figure 5] FIG. 3 is a diagram showing a sound mute warning screen of the information processing device according to the first embodiment of the present invention. [Figure 6] 4 is a flowchart illustrating a process including a method for providing a mute function in the information processing device according to the first embodiment of the present invention. [Figure 7] FIG. 10 is a block diagram of a control unit of an information processing device according to a second embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing a state in which none of the sound mute button, video mute button, and second mute function button is pressed on the monitor screen of the information processing device according to the second embodiment of the present invention. [Figure 9] 10 is a flowchart illustrating a process including a method for providing a mute function in an information processing device according to a second embodiment of the present invention. [Figure 10]FIG. 10 is a block diagram of a control unit of an information processing device according to a third embodiment of the present invention. [Figure 11] 10 is a flowchart illustrating a process including a method for providing a mute function in an information processing device according to a third embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0063] Next, an information processing device according to a first embodiment of the present invention will be described with reference to the accompanying drawings. The embodiments of the present disclosure have been described as examples, and it will be apparent to those skilled in the art that many modifications, changes, and substitutions can be made within the spirit and scope of the present invention. Therefore, the present invention is not limited to the disclosed embodiments, and various modifications, changes, etc. can be made in form and details without departing from the scope of the claims. Fig. 1 is a diagram showing an example of the configuration of an information processing system including an information processing device according to a first embodiment of the present invention. Fig. 2 is a block diagram of a control unit of the information processing device according to the first embodiment of the present invention. Fig. 3 is a diagram showing a state in which neither the sound mute button nor the video mute button is pressed on the monitor screen of the information processing device according to the first embodiment of the present invention.

[0064] As shown in FIG. 1 , in the first embodiment of the present invention, an information processing system 2 includes an information processing device 1 and a router device 4. The information processing device 1 and the router device 4 are communicatively connected via wired or wireless communication. The information processing device 1 is communicatively connected to the router device 4 on the other side of participant B and the information processing device 1 via the Internet 3 from the router device 4. The information processing system 2 provides a web conferencing system in which participant A and other participant B communicate via the Internet 3 using the information processing device 1 and the router device 4. A plurality of information processing devices 1 may be provided so as to be connected to the router device 4 or the Internet 3. The router device 4 may be a server device or other Internet connection device. The router device 4 may be omitted, and the information processing device 1 may be connected to the Internet 3 without via the router device 4 or the like. A manufacturing method for the information processing system 2 includes the steps of preparing the information processing device 1 and the router device 4 and manufacturing the information processing system 2 by arranging the information processing device 1 and the router device 4 so as to be connected to the Internet 3.

[0065] The information processing device 1 can be used for a web conference (web conference service) via the Internet 3 from participant A to the other participant B. A web conference is a conference held by participants by transmitting video and audio via the Internet 3. A web conference is also called a video conference, a television conference, an Internet conference, etc. The information processing device 1 is an electronic device used by participant A and / or other participant B in a web conference. The information processing device 1 may provide the web conference from its side. The information processing device 1 is, for example, a laptop PC (Personal Computer). The information processing device 1 may also be a desktop PC, an electronic computer, a smartphone, a tablet terminal, a mobile information terminal, etc. Furthermore, a web conference application for using the web conference is installed on the information processing device 1. Alternatively, the web conference may not be installed on the information processing device 1, and a program or the like may be executed on another server or the like via the Internet, and the web conference may be provided on a browser or the like displayed on the information processing device 1.

[0066] The information processing device 1 includes a monitor 6 having a screen for displaying images and videos, a speaker 8 for outputting sounds such as voice from the web conference to participant A, a microphone 10 for inputting sounds such as voice from participant A as an input signal to the web conference, a camera 12 for capturing images and videos from participant A and inputting them into the web conference, a vibration generating unit 13 for generating vibrations, and a control unit 14 for controlling the speaker 8, microphone 10, camera 12, vibration generating unit 13, etc.

[0067] During the web conference, the monitor 6 obtains the information necessary for the web conference via the Internet 3 and displays it on the screen. The monitor 6 forms a rectangular screen area. The speaker 8 is provided on the monitor 6 and is configured to output sounds such as voice received from the web conference toward Participant A.

[0068] The microphone 10 is provided on the monitor 6 and is configured to input sounds such as the voice of participant A and transmit them to the other participant B during the web conference via a web conference application. The camera 12 is provided on the top of the monitor 6 and is configured to capture images and videos of participant A. The vibration generating unit 13 generates vibrations, allowing the participants to tactilely recognize notifications and warnings from the information processing device 1.

[0069] The control unit 14 is electrically connected to the monitor 6, speaker 8, microphone 10, camera 12, etc. These electrical connections are not limited to wired connections, and may be entirely or partially connected via wireless communication such as infrared communication or other methods. Therefore, the control unit 14 is not limited to being located within the information processing device 1, but may be located in another location such as the router device 4 or via the Internet 3. For example, the control unit 14 may be provided in the form of a program on a router device via the Internet 3.

[0070] In this embodiment, the control unit 14 has a built-in arithmetic unit such as a CPU and a storage unit such as a memory, and can control electrically connected devices based on a predetermined control program, etc. For example, the control unit 14 may temporarily or non-temporarily store a program for executing a web conference as a web conference function unit, as will be described later.

[0071] The control unit 14 includes a web conference function unit 16 that executes a web conference. The web conference function unit 16 provides a web conference via the Internet 3 from participant A to opposite participant B. A window screen 27 of the web conference (see FIG. 3) is displayed in an application window 29 executed by the web conference function unit 16. Basically, during the web conference, the web conference function unit 16 transmits video and audio from participant A to opposite participant B within the screen 27, and also transmits video and audio from opposite participant B to participant A.

[0072] The web conference function unit 16 includes an audio muting function unit 18 that executes an audio muting function to make the sounds and voices of participant A's side inaudible to the other participant B (regardless of the method, such as not outputting the sounds or turning off participant A's microphone to prevent sound from being picked up), a muted speech suppression function unit 19, and an audio muting warning unit 20. The web conference function unit 16 further includes a video muting function unit 22 that executes an audio muting function to make the images and videos of participant A's side invisible to the other participant B (regardless of the method, such as not outputting the sounds or turning off participant A's camera to prevent video from being captured).

[0073] The sound mute function unit 18 starts the sound mute function in response to a start operation on the side of participant A, and ends the sound mute function in response to a stop operation on the side of participant A.

[0074] The sound mute function unit 18 is executed when the sound mute button 25 (see FIG. 3) on participant A's side is pressed (start operation). When the sound mute function unit 18 is executing the sound mute function, a relatively small diagonal line is displayed on the sound mute button 25, as shown in FIG. 4. After the sound mute function is executed, the sound mute function unit 18 is terminated, in principle, when the sound mute button 25 (see FIG. 3) on participant A's side is pressed again (termination operation). When the sound mute function is terminated, the diagonal line on the sound mute button 25 disappears, indicating that the sound mute function is not being executed (sound is being input from the microphone).

[0075] The video mute function unit 22 is executed when the video mute button 31 (see FIG. 3) on the side of participant A is pressed (started). When the video mute function unit 22 is executing the video mute function, a relatively small diagonal line is displayed on the video mute button 31, similar to the sound mute button (see FIG. 4).

[0076] Next, the muted speech suppression function unit 19 will be described in more detail as shown in FIG. The muting speech suppression function unit 19, when there is sound input from participant A while the sound muting function unit 18 is executing the sound muting function, suppresses participant A from continuing to talk without realizing that the sound muting function is being executed, based on predetermined conditions. The muting speech suppression function unit 19 includes a sound muting warning unit 20 that, when there is sound input from the participant while the sound muting function unit 18 is executing the sound muting function, determines, based on predetermined conditions, that participant A has started speaking, and issues a warning to make it easier for the participant to realize that the sound muting function is being executed.

[0077] Here, the sound mute warning unit 20 of the muted speech suppression function unit 19 issues a warning to make it easier for participants to notice when it determines that participant A has started speaking based on sound input from participant A as a predetermined condition (when the predetermined condition is met), even if participant A has not performed an operation to terminate the sound mute function.

[0078] The sound mute warning unit 20 of the muted speech suppression function unit 19 determines whether participant A has started speaking based on the duration of sound input from participant A's side as a predetermined condition. For example, the sound mute function unit 18 determines that participant A has started speaking when the duration of sound input from participant A's side is equal to or longer than a certain period of time, for example, 3 seconds or longer, preferably 2 seconds or longer, and more preferably 1 second or longer. Based on the determination that participant A has started speaking, the sound mute function unit 18 issues a warning to make it easier for participants to notice.

[0079] The sound mute warning unit 20 of the muted speech suppression function unit 19 determines whether participant A has started speaking based on the frequency band of the sound input from participant A as a predetermined condition. For example, the sound mute function unit 18 determines that participant A has started speaking when the frequency band of the sound input (the average frequency band of the sound input), which is the predetermined condition, is within the range of 100 Hz to 1200 Hz, which includes the frequency band of human voices. The frequency band recognized as a human voice may be specified by a range, or several ranges may be presented as options in advance. In this case, it is useful to consider that the frequency of an adult male's voice is approximately 500 Hz and the frequency of an adult female's voice is approximately 1000 Hz. The second mute function unit 26 can determine whether a sound is a participant's speech or other environmental noise based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of predicting when participant A has started speaking. The second mute function unit 26 issues a warning to make participants more aware of the start of participant A's speech based on the determination that participant A has started speaking.

[0080] The sound mute warning unit 20 may determine whether or not participant A has started speaking based on the tone of voice or voiceprint of the voice being input from participant A's side as a predetermined condition. Alternatively, the predetermined condition may be a combination of all or any of the above predetermined conditions.

[0081] The sound mute warning unit 20 issues a warning by visual communication means to make it easier for the participants to notice that the sound mute function is being executed. Alternatively, the sound mute warning unit 20 may issue a warning by auditory communication means such as a sound emitted from a speaker or an audio warning to make it easier for the participants to notice that the sound mute function is being executed. Alternatively, the sound mute warning unit 20 may issue a warning by tactile communication means such as a vibration function to make it easier for the participants to notice that the sound mute function is being executed.

[0082] The sound mute warning unit 20 displays a warning image indicating that the sound mute function unit 18 is muting sound (displays the warning image 30 occupying the above-mentioned specified screen area) in 5% or more, 10% or more, 20% or more, 30% or more, 40% or more, 50% or more, 60% or more, 70% or more, 80% or more, 90% or more, or 100% of the 100% screen area of ​​the monitor 6 of the information processing device 1 on participant A's side or the screen 27 (application window screen) within the web conference, for example, a screen area within a range of 5% to 100%, for example, a screen area within a range of 10% to 100%, for example, a screen area within a range of 20% to 100%, etc., thereby issuing a warning to make it easier for participants to notice that the sound mute function is in operation. A test was conducted on five people who frequently use web conferencing to see if they could immediately notice a warning image on a simulated screen. When the area of ​​the warning image, as defined above, was 5% of the display screen, three people noticed it within one second. When it was 10%, all five people noticed it within one second. All five people stated that, based on their visual sense, even 5% is effective in preventing oversight, but if it was 20%, the possibility of oversight is extremely low. This is useful for exploring the expected limits of human visual attention ability.

[0083] The sound mute warning unit 20 issues a warning using a warning image (notification image) 30. The area of ​​the warning image 30 is a rectangle that surrounds the warning image 30 displayed on the screen and is just tangent to the warning image 30. If the screen is rectangular, the area of ​​the warning image 30 is the area of ​​a rectangle whose four sides are parallel to the four sides of the screen (the rectangle indicated by dashed lines in FIG. 5). As shown in FIG. 5, for example, if the warning image 30 is a triangular image, the area of ​​the rectangle that contains the triangle with each vertex tangent to the rectangular side (the area inside the dashed rectangle) is the area of ​​the warning image. Since the area of ​​such a warning image 30 occupies a predetermined percentage of the total screen area of ​​the monitor 6 as described above, it is easier for participants to notice that the sound mute function is being executed than in the prior art. If the warning image 30 includes multiple characters or graphics, the area of ​​the warning image 30 is the area of ​​a rectangle that is just tangent to the entire screen area. Such a warning image 30 makes it easier for participant A to notice the execution of the mute function while he or she is speaking, compared to the conventional displays of Zoom (registered trademark), Teams (registered trademark), Meet (registered trademark), etc.

[0084] The warning image 30 is formed to have a height h that is 10% or more, for example, in the range of 10% to 100%, of the height of the screen of the monitor 6 or the area of ​​the screen 27 in the web conference. Since the warning image 30 has a relatively large height, it is easy for participants to visually notice the warning image 30. The lower limit of h may be 10% or more, 20% or more, 30% or more, 40% or more, 50% or more, 60% or more, 70% or more, 80% or more, 90% or more, or 100%. Five people who frequently use web conferencing were tested to see if they could immediately notice a warning image on a simulated screen. When h was 10%, three of them noticed it within one second. When h was 20%, all five noticed it within one second. All five also stated that their visual sense indicated that if h was 30%, the chances of them missing it would be extremely low. This is useful for exploring the expected limits of human visual attention ability. (These five subjects are the same as those mentioned above.)

[0085] The warning image 30 is formed to have a width w that is 10% or more of the width of the screen of the monitor 6 or the width of the area of ​​the screen 27 in the web conference, for example, in the range of 10% to 100%. Since the warning image 30 has a relatively large width, it is easy for participants to visually notice the warning image 30. The lower limit of w may be 10% or more, 20% or more, 30% or more, 40% or more, 50% or more, 60% or more, 70% or more, 80% or more, 90% or more, or 100%. We tested five people who frequently use web conferencing to see if they could immediately notice a warning image on a simulated screen. When w was 10%, three of them noticed it within one second. When w was 20%, all five noticed it within one second. All five also stated that their visual sense indicated that if w was 30%, the chances of them missing it would be extremely low. This is useful for exploring the expected limits of human visual attention ability. (These five subjects are the same as those mentioned above.)

[0086] The warning image 30 may include an exclamation mark inside it. This makes it easier for participant A to recognize that some kind of abnormality has occurred, making it easier for the participant to notice the warning image 30. The warning image 30 may also include text such as "Mute Sound," as shown in FIG. 5 . The warning image 30 may be an image that occupies the entire screen (100% of the screen area). For example, the entire screen of the monitor 6 or the web conference screen 27 may be displayed as a grayed-out or blue screen. Part of the warning image 30 may also be colored yellow or red. Marks such as hazard marks, stop marks, and no-entry marks may also be drawn inside the warning image 30. Part or all of the warning image 30 may move (for example, the mark may move so as to tilt alternately left and right), or it may flash.

[0087] The control unit 14 may include a program that causes the information processing device 1 to function as the web conference function unit 16 to provide a web conference from participant A to the other participant B via the Internet 3. This program causes the sound mute function unit 18 to execute a sound mute function that prevents the other participant B from hearing the sound from participant A, and causes the sound mute warning unit 20 to execute a warning that makes participant A more aware that the sound mute function is in progress when there is sound input from the participant while the sound mute function unit 18 is in progress. The program also causes the sound mute warning unit 20 to execute a warning that makes the participant more aware that the sound mute function is in progress by displaying a warning image indicating that the sound mute function is in progress on 5% or more of the screen area of ​​participant A's screen. The program may be stored on the cloud. That is, the program may be executed on the cloud without being downloaded to the participant's information processing device 1, and the web conference may be provided over the Internet. Naturally, such programs are often provided by companies that provide web conference services.

[0088] Next, a method for providing a mute function in an information processing device 1 that provides a web conference from a participant to a remote participant via the Internet will be described with reference to Fig. 6. Fig. 6 is a flowchart illustrating a process including the method for providing a mute function in an information processing device 1 that provides a web conference. FIG. 6 shows a process for executing a sound mute step and a sound mute warning step while a web conference is being provided.

[0089] As shown in Figure 6, when the control unit 14 receives an operation command to start the execution of a web conference, it proceeds from Start to S1 and provides a web conference from participant A to the other participant B via the Internet 3. In the web conference, the control unit 14 transmits video and audio from participant A to the other participant B, and also transmits video and audio from the other participant B to participant A. Therefore, participant A and other participant B can communicate with each other through audio and video via the web conference application software.

[0090] In S2, the control unit 14 determines whether or not the mute button 25 on the participant A side has been pressed (start operation) or whether or not the second mute function button 32 has been pressed (start operation). If the mute button 25 or the second mute function button 32 on participant A's side is pressed (started) in S2, the control unit 14 can determine that participant A wants to start the mute function, and proceeds to S3. On the other hand, if the mute button 25 on participant A's side is not pressed (started), the control unit 14 can determine that participant A does not want to use the mute function, and proceeds from S2 to END after conducting the web conference without using the mute function. If the mute button 25 is pressed, the mute step is executed in the following S3.

[0091] In S3, the control unit 14 executes a sound mute step to execute a sound mute function that prevents the sound from participant A from being heard by the other participant B, and then proceeds to S4. While this sound mute function is being executed, a diagonal line is displayed on the sound mute button 25, but no warning message appears on the monitor 6 or on the screen 27 that displays the video of the other party in the web conference, so that the participant is not prevented from viewing the video of the other party.

[0092] In S4, when a sound is input from the microphone on participant A's side during execution of the sound muting function in the sound muting step, if a predetermined condition is satisfied, the control unit 14 proceeds to S5. If there is no sound input from the microphone on participant A's side during execution of the sound muting function in the sound muting step and the predetermined condition is not met, the control unit 14 returns to S4 and continues making the determination.

[0093] In S5, when a sound is input from the microphone on participant A's side while the sound mute function is being executed in the sound mute step, if a predetermined condition is met, the control unit 14 executes a muting-time speech suppression step that suppresses the participant from continuing to talk without realizing that the sound mute function is being executed. For example, the control unit 14 executes a muting warning step that issues a warning to participant A to make it easier for the participant to notice that the sound mute function is being executed in the muting-time speech suppression step. In the muting warning step, the control unit 14 executes a warning image indicating that the sound mute function is being executed in 5% or more of the screen area on participant A's side, thereby making it easier for the participant to notice that the sound mute function is being executed. In this way, the sound mute warning step uses visual communication means to warn the participant to make it easier for the participant to notice that the sound mute function is being executed. In this way, during a web conference, when there is sound input from participant A while the sound mute function is being executed by the sound mute step S3, the control unit 14 executes the sound mute warning step S5, making it easier for participant A to notice that the sound mute function is being executed. After executing S5, the control unit 14 proceeds to S6.

[0094] In S6, if the mute button 25 on the participant A side is pressed (termination operation) while the mute function is being executed in the mute step, the control unit 14 proceeds to S7 and terminates the mute function. In S6, if the sound mute button 25 on participant A's side is not pressed (termination operation) while the sound mute function is being executed by the sound mute step, the control unit 14 determines that the operation to cancel the sound mute function for the participant has not yet been performed, and returns to S4.

[0095] In S7, the control unit 14 terminates the sound mute function in response to the pressing operation (termination operation) of the sound mute button 25, and proceeds to END.

[0096] When the control unit 14 ends the sound mute function, it proceeds to END and returns to running the conference. The series of processes ends with the end of the conference. If the conference continues, the control unit 14 returns to START and continues running the web conference.

[0097] According to the first embodiment of the present invention described above, when there is sound input from the participant side while the sound muting function is being executed by the sound muting function unit 18, the participant can be made more aware that the sound muting function is being executed by the function of the muting-statement suppression function unit 19. Therefore, it is possible to reduce the occurrence of accidents in which a participant continues talking despite the sound muting function being executed, compared to the prior art.

[0098] Furthermore, according to the first embodiment of the present invention, when there is sound input from the participant while the sound muting function unit 18 is executing the sound muting function, the sound muting warning unit 20 can issue a warning to make the participant more aware that the sound muting function is being executed. Therefore, it is possible to reduce the occurrence of accidents in which a participant continues talking despite the sound muting function being executed, compared to the prior art.

[0099] Furthermore, according to the first embodiment of the present invention, by using a visual communication means that is easily noticeable to the participants, it is possible to make the participants more aware that the sound muting function is being executed.

[0100] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by auditory communication means that utilizes the five senses other than sight.

[0101] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by a tactile communication means using the five senses other than sight.

[0102] Furthermore, according to the first embodiment of the present invention, when there is sound input from the participant while the sound mute function unit 18 is executing the sound mute function, a warning image indicating that the sound mute function is being executed is displayed in 5% or more of the screen area of ​​the information processing device 1 on the participant's side, thereby making it easier for the participant to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit 20.

[0103] Furthermore, according to the first embodiment of the present invention, the warning image can be made more noticeable by displaying a warning image having a height equal to or greater than a predetermined height h on the web conference screen 27. This makes it easier for the participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit 20.

[0104] Furthermore, according to the first embodiment of the present invention, the warning image having a width equal to or greater than the predetermined width w can be displayed on the web conference screen 27, making the warning image more visible in the horizontal direction. This makes it easier for the participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit 20.

[0105] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by using an auditory means of communication.

[0106] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by using a tactile transmission means using vibration.

[0107] Furthermore, according to the first embodiment of the present invention, when a sound is input from a participant while the sound muting function unit 18 is executing the sound muting function, the program can execute the muting speech suppression function unit 19, which suppresses the participant from continuing to talk without realizing that the sound muting function is being executed, making it easier for the participant to notice that the sound muting function is being executed. This can prevent the participant from continuing to talk even when the sound muting function is being executed. This can reduce the effort and time wasted when a participant continues to talk without realizing that the sound muting function is being executed, resulting in having to explain the same content again.

[0108] Furthermore, according to the first embodiment of the present invention, when there is sound input from the participant A while the sound muting function unit 18 is executing the sound muting function, the program can cause the information processing device 1 to execute a warning that makes it easier for the participant A to notice that the sound muting function is being executed, thereby making it easier for the participant A to notice that the sound muting function is being executed. Therefore, it is possible to prevent the participant A from continuing to talk despite the sound muting function being executed.

[0109] Furthermore, according to the first embodiment of the present invention, by using a visual communication means that is easily noticeable to the participants, it is possible to make the participants more aware that the sound muting function is being executed.

[0110] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by auditory communication means that utilizes the five senses other than sight.

[0111] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by a tactile communication means using the five senses other than sight.

[0112] Furthermore, according to the first embodiment of the present invention, when there is sound input from the participant while the sound mute function is being executed by the sound mute function unit 18, a warning image indicating that the sound mute function is being executed can be displayed in 5% or more of the screen area within the web conference of the information processing device 1 on the participant's side, making it easier for the participant to visually notice that the sound mute function is being executed.

[0113] Furthermore, according to the first embodiment of the present invention, the warning image can be made more noticeable by displaying a warning image having a height equal to or greater than a predetermined height h on the web conference screen 27. This makes it easier for the participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit 20.

[0114] Furthermore, according to the first embodiment of the present invention, the warning image having a width equal to or greater than the predetermined width w can be displayed on the web conference screen 27, making the warning image more visible in the horizontal direction. This makes it easier for the participants to visually notice that the sound mute function is being executed through the warning from the sound mute warning unit 20.

[0115] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by using an auditory means of communication.

[0116] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by using a tactile transmission means using vibration.

[0117] Furthermore, according to the first embodiment of the present invention, when there is a sound input from the participant while the sound muting function is being executed by the sound muting step, the muting-statement suppression step can make the participant more aware that the sound muting function is being executed, thereby reducing the occurrence of accidents in which a participant continues talking despite the sound muting function being executed compared to the prior art.

[0118] Furthermore, according to the first embodiment of the present invention, when a sound is input from a participant while the sound muting function is being executed by the sound muting step, the sound muting warning step can make the participant more aware that the sound muting function is being executed. Therefore, the occurrence of an accident in which a participant continues speaking even though the sound muting function is being executed can be reduced compared to the prior art. Therefore, it is possible to reduce the waste of time and effort caused by a participant continuing to speak without realizing that the sound muting function is being executed, and having to explain the same content again.

[0119] Furthermore, according to the first embodiment of the present invention, by using a visual communication means that is easily noticeable to the participants, it is possible to make the participants more aware that the sound muting function is being executed.

[0120] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by auditory communication means that utilizes the five senses other than sight.

[0121] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by a tactile communication means using the five senses other than sight.

[0122] Furthermore, according to the first embodiment of the present invention, when sound input is received from the participant while the sound mute function is being executed, a warning image indicating that the sound mute function is being executed is displayed in 5% or more of the screen area within the web conference of the information processing device 1 on the participant's side, thereby making it easier for the participant to visually notice that the sound mute function is being executed through the warning in the sound mute warning step.

[0123] Furthermore, according to the first embodiment of the present invention, the warning image 30 having a height equal to or greater than a predetermined height h is displayed on the web conference screen 27, thereby making the warning image more noticeable. This makes it easier for the participants to visually notice that the sound mute function is being executed by the warning in the sound mute warning step.

[0124] Furthermore, according to the first embodiment of the present invention, by displaying a warning image having a width equal to or greater than a predetermined width w on the web conference screen, the warning image can be made more visible in the horizontal direction, thereby making it easier for the participants to visually notice that the sound muting function is being executed through the warning in the sound muting warning step.

[0125] Furthermore, according to the first embodiment of the present invention, the auditory transmission means can easily make the participants auditorily aware that the sound muting function is being executed.

[0126] Furthermore, according to the first embodiment of the present invention, the participants can be made more aware that the sound muting function is being executed by using a tactile, haptic vibration transmission means.

[0127] Furthermore, according to the first embodiment of the present invention, there is provided an information processing system 2 including the information processing device 1, which provides a web conference via the Internet from a participant to an opposite participant.

[0128] Furthermore, according to the first embodiment of the present invention, there is provided a manufacturing method for manufacturing the information processing system 2.

[0129] Next, an information processing device 101 according to a second embodiment of the present invention will be described with reference to Figures 7 to 9. The second embodiment is an example in which the sound mute function unit 118 of the information processing device according to the present invention includes a first mute function unit and a second mute function unit. Fig. 7 is a block diagram of a control unit of an information processing device according to a second embodiment of the present invention, Fig. 8 is a diagram showing a state in which none of the audio mute button, video mute button, and second mute function button has been pressed on the monitor screen of the information processing device according to the second embodiment of the present invention, and Fig. 9 is a flowchart illustrating processing including a method for providing a mute function in the information processing device according to the second embodiment of the present invention. Since the information processing device 101 according to the second embodiment has almost the same structure as the information processing device according to the first embodiment described above, only the differences between the second embodiment of the present invention and the first embodiment will be described, and similar parts will be given the same reference symbols in the drawings and will not be described again.

[0130] The control unit 114 has a web conference function unit 116 that executes the web conference, and the web conference function unit 116 has a sound muting function unit 118 that executes a sound muting function to prevent the sounds and voices of participant A from being heard by the other participant B (regardless of the method, such as not outputting them or turning off participant A's microphone to not pick up the sound). The sound muting function unit 118 includes a first muting function unit 124 that starts the sound muting function in response to a start operation on the part of participant A and ends the sound muting function in response to a stop operation on the part of participant A, and a second muting function unit 126 that starts the sound muting function in response to a start operation on the part of participant A and may issue a warning to make the participant more aware of the sound by using the muted speech suppression function unit when a predetermined condition is met even when the sound muting function has not been stopped by participant A. In the second embodiment, the second muting function unit 126 is provided so as to be able to execute a mode different from that of the first muting function unit 124.

[0131] The first mute function unit 124 is executed when the mute button 25 (see FIG. 3) on participant A's side is pressed (start operation). When the mute function unit 118 is executing the mute function, a relatively small diagonal line is displayed on the mute button 25 (see FIG. 4). After the mute function is executed, the first mute function unit 124 is terminated, in principle, when the mute button 25 (see FIG. 3) on participant A's side is pressed again (termination operation). When the mute function is terminated, the diagonal line on the mute button 25 disappears, indicating that the mute function is not being executed (sound is being input from the microphone).

[0132] The second mute function unit 126 of the sound mute function unit 118 is executed when the second mute function button 132 (see FIG. 8) on the participant A side is pressed (start operation). Even when the second mute function button 132 (see FIG. 8) is pressed, a sound mute step (details will be described later) in which the sound mute function unit 118 executes the sound mute function is first executed. When the sound mute function is being executed, a relatively small diagonal line is displayed on the second mute function button 132, just like the sound mute button. After the sound mute function is executed, if the second mute function button 132 on the participant A side is pressed again (end operation), the second mute function unit 126 ends the sound mute function. After the sound mute function is executed, when the second mute function button 132 on the participant A's side has not been pressed (terminated), the second mute function unit 126 issues a warning to the participant through the muting speech suppression function unit 119 to make the participant more aware of the sound when a predetermined condition is met, such as when a predetermined sound is input from the participant's microphone. The second mute function unit 126 also functions as part of the muting speech suppression function unit 119 and executes the functions of the muting speech suppression function unit 119. When a sound is input from participant A while the sound mute function unit 118 is executing the sound mute function, the muting speech suppression function unit 119 suppresses participant A from continuing to talk without realizing that the sound mute function is being executed, based on predetermined conditions. In this way, when both the first mute function unit 124 and the second mute function unit 126 are provided, the predetermined warning is not issued when the first mute function unit 124 is executed, but is issued only when the second mute function unit 126 is executed.

[0133] Here, when the second mute function unit 126 determines that participant A has started speaking based on the audio input from participant A's side, even if participant A has not yet performed the operation to terminate the audio mute function, the mute speech suppression function unit issues a warning to make the participant more aware of the situation.

[0134] The second muting function unit 126 determines whether participant A has started speaking based on the duration of the sound input from participant A's side as a predetermined condition. For example, the second muting function unit 126 determines that participant A has started speaking when the duration of the sound input from participant A's side is equal to or longer than a certain period of time, for example, 3 seconds or longer, preferably 2 seconds or longer, and more preferably 1 second or longer. Based on the determination that participant A has started speaking, the second muting function unit 126 issues a warning using the muted speech suppression function unit to make the participant more aware of the message. We tested five people who frequently use web conferencing to see if they could immediately notice a warning sound while looking at a mock screen. Three of them noticed it within one second, and all five noticed it within two seconds. All five also stated that their auditory sense meant that if it lasted for three seconds, it would be extremely unlikely that they would miss it. This is useful for exploring the expected limits of human auditory-based attention ability. (These five subjects were the same as those mentioned above.)

[0135] The second muting function unit 126 determines whether participant A has started speaking based on the frequency band of the sound input from participant A as a predetermined condition. For example, the second muting function unit 126 determines that participant A has started speaking when the frequency band of the sound input (the average frequency band of the sound input) is between 100 Hz and 1200 Hz, which includes the frequency band of human voices. The frequency band recognized as a human voice may be specified by a range, or several ranges may be presented as options in advance. In this case, it is useful to know that the frequency of an adult male's voice is approximately 500 Hz and the frequency of an adult female's voice is approximately 1000 Hz. The second muting function unit 126 can determine whether a sound is a participant's speech or other environmental noise based on, for example, a frequency band that is likely to include the participant's voice, thereby improving the accuracy of predicting when participant A has started speaking. The second muting function unit 126 issues a warning to make participants more aware of the sound based on the determination that participant A has started speaking.

[0136] The second muting function unit 126 may determine whether or not participant A has started speaking based on the tone of voice or voiceprint of the voice being input from participant A's side as a predetermined condition. Alternatively, the predetermined condition may be a combination of all or any of the above predetermined conditions.

[0137] Next, a method for providing a mute function in the information processing device 101 that provides a web conference from a participant to an opposite participant via the Internet will be described with reference to Fig. 9. Fig. 9 is a flowchart illustrating an example of processing including the method for providing a mute function in the information processing device 101 that provides a web conference. FIG. 9 shows a process for executing a sound mute step and a sound mute warning step while a web conference is being provided.

[0138] When the control unit 114 receives an operation command to start the web conference, the process proceeds from Start to S11, and the web conference is provided via the Internet 3 from participant A to the other participant B. S11 is the same as S1 in the first embodiment, and therefore the explanation thereof will be omitted.

[0139] In S12, the control unit 114 determines whether or not the mute button 25 on the participant A's side has been pressed (started). If the mute button 25 on participant A's side is pressed (start operation) in S12, the control unit 14 can determine that participant A wants to start the mute function, and proceeds to S13. On the other hand, if the mute button 25 on participant A's side is not pressed (start operation), the control unit 14 proceeds to S16 to determine whether the second mute function button is pressed.

[0140] In S13, the control unit 114 executes the first mute function step of the sound mute step to execute the sound mute function that prevents the sound from participant A from being heard by the other participant B, and then proceeds to S14. While the sound mute function is being executed, a diagonal line is displayed on the sound mute button 25, but no warning message appears on the monitor 6 or on the screen 27 that displays the video of the other party in the web conference, so that the participant is not prevented from viewing the video of the other party. In S14, if the mute button 25 on the participant A side is pressed (termination operation) while the mute function is being executed in the mute step, the control unit 114 terminates the mute function and proceeds to S15. In S14, if the mute button 25 on participant A's side is not pressed (termination operation) while the mute function is being executed by the mute step, the control unit 14 can determine that the participant is continuing the mute function, and therefore returns to S14.

[0141] In S15, the control unit 114 ends the first mute function step of the sound mute step by pressing the sound mute button 25 (termination operation), and proceeds to END.

[0142] In S16, the control unit 114 determines whether or not the second mute function button 132 on the participant A's side has been pressed (started). If the control unit 114 determines in S16 that the second mute function button 132 on participant A's side has been pressed (start operation), it can determine that participant A wants to start the sound mute function using the mode set by the second mute function button, and therefore proceeds to S17. On the other hand, if the second mute function button 132 is not pressed (started) in addition to the mute button 25 on participant A's side, the control unit 114 can determine that participant A does not use the mute function, and therefore proceeds from S16 to End after carrying out the web conference without using the mute function.

[0143] In S17, the control unit 114 executes the sound mute function by the second mute function step of the sound mute step, which prevents the sound from participant A from being heard by the other participant B, and then proceeds to S18. While this sound mute function is being executed, a diagonal line is displayed on the second mute function button 132, but no warning message appears on the monitor 6 or on the screen 27 that displays the video of the other party in the web conference, so that the participant is not prevented from viewing the video of the other party.

[0144] In S18, when there is sound input from the microphone on the side of participant A while the sound muting function is being executed in the sound muting step, the control unit 114 proceeds to S19. If there is still no sound input from the microphone on participant A's side while the sound mute function is being executed by the sound mute step, the control unit 114 can determine that there is still a possibility that the mute function will be released due to a participant's speech, and so returns to S18.

[0145] In S19, when there is sound input from the microphone on participant A's side while the sound mute function is being executed by the second mute function step of the sound mute step, the control unit 114 executes a sound mute warning step to issue a warning to make participant A more aware that the sound mute function is being executed. In the sound mute warning step, the control unit 114 executes a warning image indicating that the sound mute function is being executed in 5% or more of the screen area on participant A's side, thereby issuing a warning to make participant A more aware that the sound mute function is being executed. In this way, during a web conference, when there is sound input from participant A's side while the sound mute function is being executed by the sound mute step, the control unit 114 executes the sound mute warning step of S19, thereby making participant A more aware that the sound mute function is being executed. After executing S19, the control unit 114 proceeds to S20.

[0146] In S20, if the second mute function button 132 is pressed (termination operation) while the sound mute function is being executed in the sound mute step, the control unit 114 proceeds to S21 to terminate the sound mute function. In S20, if the second mute function button 132 on participant A's side is not pressed (termination operation) while the sound mute function is being executed by the sound mute step, the control unit 114 can determine that there is still a possibility that the participant wants to continue using the second mute function, and therefore returns to S18.

[0147] In S21, the control unit 114 determines that the participant A is attempting to terminate the sound mute function because the second mute function button 132 on the participant A side has been pressed (termination operation) in the second mute function step, so it terminates the sound mute function and proceeds to the end.

[0148] When the control unit 114 ends the sound mute function, it proceeds to END and returns to running the conference. The series of processes ends with the end of the conference. If the conference continues, the control unit 14 returns to START and continues running the web conference.

[0149] As described above, according to the second embodiment of the present invention, the information processing device can start the mute function by the first mute function unit 124 in response to a start operation by the participant and end the mute function by a termination operation by the participant. The second mute function unit 126 can start the mute function by a start operation by the participant, and can cause the mute-on-demand speech suppression function unit 119 to issue a warning to make the participant more aware of the mute function when a predetermined condition is met, even if the participant has not performed a termination operation. This allows the mute-on-demand speech suppression function unit 119 to issue a warning to make the participant more aware of the mute function based on a predetermined condition, even if the participant has not performed a termination operation, thereby preventing the participant from continuing to speak even when the mute function is active. For example, in a web conference, if a participant uses the mute function but is likely to start speaking again, the mute-on-demand speech suppression function unit 119 can help prevent the participant from continuing to speak even when the mute function is active.

[0150] Furthermore, according to the second embodiment of the present invention, the second mute function unit 126 determines whether a predetermined condition is met based on the audio input from the participant even when the participant has not performed an end operation. As a result, even when the participant has not performed an end operation, if it determines that the participant has started speaking based on the audio input from the participant, the function of the muted speech suppression function unit 119 is executed. This further reduces the occurrence of accidents in which a participant continues talking despite the mute function being activated.

[0151] Furthermore, according to the second embodiment of the present invention, the second muting function unit 126 determines whether or not the participant A has started speaking based on the duration of the sound input from the participant A's side. This allows the second muting function unit 126 to make a determination based on the length of the participant A's speech, thereby improving the accuracy of determining the speech state of the participant A.

[0152] Furthermore, according to the second embodiment of the present invention, the second muting function unit 126 determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. This allows the second muting function unit 126 to determine whether a sound is a participant's speech or other environmental sound based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0153] Furthermore, according to the second mute embodiment of the present invention, the second mute function unit 126 can determine what a participant is saying based on, for example, the tone of the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0154] Furthermore, according to the second embodiment of the present invention, the second mute function unit 126 can determine what a participant is saying based on, for example, the voiceprint of the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0155] Furthermore, according to the second embodiment of the present invention, even if a participant has not performed an end operation on the participant's side, the muting speech suppression function unit 119 can issue a warning based on a predetermined condition to make the participant more aware of the situation, thereby preventing an accident in which a participant continues speaking despite the sound muting function being activated. For example, in a web conference where a participant uses the sound muting function but is likely to start speaking again, the muting speech suppression function unit 119 can easily prevent an accident in which a participant continues speaking despite the sound muting function being activated.

[0156] Furthermore, according to the second embodiment of the present invention, even if the participant has not performed an end operation, if it is determined that the participant has started speaking based on the audio input from the participant, the function of the muted speech suppression function unit 119 is executed. This makes it possible to further suppress the occurrence of accidents in which a participant continues speaking despite the mute function being executed.

[0157] Furthermore, according to the second embodiment of the present invention, the second mute function unit 126 determines whether or not a participant has started speaking based on the duration of the participant's sound input. This allows the second mute function unit 126 to make a determination based on the length of the participant's speech, thereby improving the accuracy of determining the participant's speech state.

[0158] Furthermore, according to the second embodiment of the present invention, the second muting function unit 126 determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. This allows the second muting function unit 126 to determine whether a sound is a participant's speech or other environmental sound based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0159] Furthermore, according to the second embodiment of the present invention, the second mute function unit 126 can determine what a participant is saying based on, for example, the tone of the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0160] Furthermore, according to the second embodiment of the present invention, the second mute function unit 126 can determine what a participant is saying based on, for example, the voiceprint of the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0161] Furthermore, according to the second embodiment of the present invention, even if the participant has not performed an end operation on the participant's side, a warning that makes it easier for the participant to notice can be issued by the muting speech suppression step based on a predetermined condition, and the occurrence of an accident in which the participant continues to talk despite the sound muting function being activated can be suppressed. For example, in a case where a participant uses the sound muting function in a web conference but is likely to start speaking again, the muting speech suppression step can easily suppress the occurrence of an accident in which the participant continues to talk despite the sound muting function being activated.

[0162] Furthermore, according to the second embodiment of the present invention, the second mute function step determines whether a predetermined condition is met based on the audio input from the participant even when the participant has not performed an end operation. As a result, even when the participant has not performed an end operation, if it is determined that the participant has started speaking based on the audio input from the participant, the function of the muted speech suppression function unit 119 is executed. This further reduces the occurrence of accidents in which a participant continues speaking despite the mute function being activated.

[0163] Furthermore, according to the second embodiment of the present invention, the second mute function step determines whether or not a participant has started speaking based on the duration of the participant's sound input. This allows the second mute function step to make a determination based on the length of the participant's speech, thereby improving the accuracy of determining the participant's speech state.

[0164] Furthermore, according to the second embodiment of the present invention, the second mute function step determines whether a predetermined condition is met based on the frequency band of the sound input from the participant side. This allows the second mute function step to determine whether the sound is a participant's speech or other environmental sound based on, for example, a frequency band that is likely to contain the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0165] Furthermore, according to the second embodiment of the present invention, the second mute function step can determine what a participant is saying based on, for example, the tone of the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0166] Furthermore, according to the second embodiment of the present invention, the second mute function step can determine what a participant is saying based on, for example, the voiceprint of the participant's voice, thereby improving the accuracy of determining the participant's speech state.

[0167] Next, an information processing device 201 according to a third embodiment of the present invention will be described with reference to Fig. 10. The third embodiment is an example in which a second mute function unit of the sound mute function unit of the information processing device according to the present invention terminates the sound mute function without issuing a warning from the sound mute warning unit. Fig. 10 is a block diagram of a control unit of the information processing device according to the third embodiment of the present invention. Fig. 11 is a flowchart illustrating processing including a method for providing a mute function in the information processing device according to the third embodiment of the present invention. Since the information processing device 201 according to the third embodiment has almost the same structure as the information processing device according to the second embodiment described above, only the differences between the third embodiment of the present invention and the second embodiment will be described, and similar parts will be given the same reference symbols in the drawings and will not be described again.

[0168] The control unit 214 has a web conference function unit 216 that executes the web conference, and the web conference function unit 216 has a sound mute function unit 218 that executes a sound mute function that prevents the sounds and voices of participant A from being heard by the other participant B (regardless of the method, such as not outputting them or turning off participant A's microphone to not pick up the sound). The sound muting function unit 218 includes a first muting function unit 124 that starts the sound muting function in response to a start operation on the part of participant A and ends the sound muting function in response to a stop operation on the part of participant A, and a second muting function unit 226 that starts the sound muting function in response to a start operation on the part of participant A and ends the sound muting function based on a predetermined condition even if the stop operation on the part of participant A has not been performed. In the third embodiment, the second muting function unit 226 is provided so as to be able to execute a mode different from that of the first muting function unit 124.

[0169] The second mute function unit 226 of the sound mute function unit 218 is executed when the second mute function button 132 (see FIG. 8) on the participant A side is pressed (start operation). Even when the second mute function button 132 (see FIG. 8) is pressed, a sound mute step (details will be described later) in which the sound mute function unit 218 executes the sound mute function is first executed. When the sound mute function is being executed, a relatively small diagonal line is displayed on the second mute function button 132, just like the sound mute button. After the sound mute function is executed, if the second mute function button 132 on the participant A side is pressed again (end operation), the second mute function unit 226 ends the sound mute function. After the sound mute function is executed, the second mute function unit 226 terminates the sound mute function using the muted speech suppression function unit based on a predetermined condition such as a predetermined sound input from the participant's microphone when the second mute function button 132 on participant A's side has not been pressed (terminated). The second mute function unit 226 also functions as a part of the muted speech suppression function unit 219, and executes the functions of the muted speech suppression function unit 219.

[0170] When there is sound input from participant A while the sound muting function is being executed by the sound muting function unit 218, the muting-time speech suppression function unit 219 suppresses participant A from continuing to talk without realizing that the sound muting function is being executed, based on predetermined conditions. The muting-time speech suppression function unit 219 has a function to make the participant aware that the sound muting function has been executed by omitting the execution of a sound muting function warning or by executing the sound muting function warning and forcibly terminating the sound muting function. In this way, when both the first muting function unit 124 and the second muting function unit 226 are provided, the predetermined warning is not issued when the first muting function unit 124 is executed, and the predetermined warning is issued only when the second muting function unit 226 is executed.

[0171] Here, the second mute function unit 226 terminates the sound mute function using the muted speech suppression function unit when it determines that participant A has started speaking based on audio input from participant A's side, even if participant A has not performed an operation to terminate the sound mute function.

[0172] The second muting function unit 226 determines whether participant A has started speaking based on the duration of the sound input on participant A's side as a predetermined condition. For example, the second muting function unit 226 determines that participant A has started speaking when the duration of the sound input on participant A's side is equal to or longer than a certain period of time, for example, 3 seconds or longer, preferably 2 seconds or longer, and more preferably 1 second or longer. The second muting function unit 226 ends the sound muting function using the muted speech suppression function unit based on the determination that participant A has started speaking.

[0173] The second muting function unit 226 determines whether participant A has started speaking based on the frequency band of the sound input from participant A as a predetermined condition. For example, the second muting function unit 126 determines that participant A has started speaking if the frequency band of the sound input (the average frequency band of the sound input) is within the range of 100 Hz to 1200 Hz, which includes the frequency band of human voices. The frequency band recognized as a human voice may be specified by a range, or several ranges may be presented as options in advance. In this case, it is useful to consider that the frequency of an adult male's voice is approximately 500 Hz and the frequency of an adult female's voice is approximately 1000 Hz. The second muting function unit 226 can determine whether a sound is a participant's speech or other environmental noise based on, for example, a frequency band that is likely to contain a participant's voice, thereby improving the accuracy of predicting when participant A has started speaking. The second muting function unit 126 terminates the sound muting function using the muted speech suppression function unit upon determining that participant A has started speaking.

[0174] Next, a method for providing a mute function in an information processing device 201 that provides a web conference from a participant to a remote participant via the Internet will be described with reference to Fig. 11. Fig. 11 is a flowchart illustrating an example of processing including the method for providing a mute function in an information processing device 201 that provides a web conference.

[0175] The processes from S11 to S17 in the third embodiment are the same as the processes from S11 to S17 in the second embodiment, and therefore a description thereof will be omitted.

[0176] In S28, when there is sound input from the microphone on participant A's side while the sound mute function is being executed by the sound mute step, if the control unit 214 determines based on predetermined conditions that participant A has started speaking, the control unit 214 proceeds to S21. In this way, when it determines that participant A has started speaking, the control unit 214 can skip the execution of the sound mute warning step and automatically terminate the sound mute function, so that the control unit 214 can proceed to S21. In this way, by automatically terminating the sound mute function, the participant can be aware that the sound mute function is being executed. When there is still no sound input from the microphone on participant A's side while the sound mute function is being executed by the sound mute step, the control unit 214 can determine that there is still a possibility of disabling the mute function by pressing the second mute function button, and so proceeds to S29.

[0177] In S29, if the second mute function button 232 is pressed (termination operation) while the sound mute function is being executed by the sound mute step, the control unit 214 proceeds to S21 to terminate the sound mute function. In S29, if the second mute function button 232 on participant A's side is not pressed (termination operation) while the sound mute function is being executed by the sound mute step, the control unit 214 can determine that there is still a possibility that the participant wants to continue using the second mute function, and therefore returns to S28.

[0178] In S21, the control unit 214 determines that the participant A is attempting to terminate the sound mute function because the second mute function button 132 on the participant A side has been pressed (termination operation) in the second mute function step, and therefore terminates the sound mute function and proceeds to the end.

[0179] When the control unit 214 ends the sound mute function, it proceeds to END and returns to running the conference. The series of processes ends with the end of the conference. If the conference continues, the control unit 214 returns to START and continues running the web conference.

[0180] Furthermore, according to the third embodiment of the present invention, the information processing device can start the sound mute function in response to a start operation on the participant's side using the first mute function unit 124 and end the sound mute function in response to a stop operation on the participant's side, and can start the sound mute function in response to a start operation on the participant's side using the second mute function unit 226 and can end the sound mute function in response to a predetermined condition even if the participant has not performed a stop operation, by the muted speech suppression function unit 219. This allows the participant to end the sound mute function in response to the muted speech suppression function unit 219 based on the predetermined condition even if the participant has not performed a stop operation, so that the participant recognizes that the mute function has been executed by the end of the sound mute function and can prevent the participant from continuing to talk even though the sound mute function is being executed. For example, in a case where a participant uses the mute function during a web conference but is likely to start speaking again, the mute speech suppression function unit 219 can help prevent accidents in which a participant continues talking even though the mute function is active.

[0181] Furthermore, according to the third embodiment of the present invention, the mute function can be terminated by the mute speech suppression function unit 219 based on predetermined conditions even if the participant has not performed the termination operation on their side, so that the participant can recognize that the mute function has been executed by terminating the mute function, and accidents in which participants continue talking even though the mute function is being executed can be prevented.

[0182] Furthermore, according to the third embodiment of the present invention, the mute function can be terminated by the mute-while-speech suppression step based on a predetermined condition even if the participant has not performed the termination operation on the participant's side, so that the participant recognizes that the mute function was being executed when the mute function is terminated, and the occurrence of an accident in which the participant continues to talk despite the mute function being executed can be suppressed. For example, in a case where a participant uses the mute function in a web conference but is likely to start speaking again, the mute-while-speech suppression step can easily suppress the occurrence of an accident in which the participant continues to talk despite the mute function being executed.

[0183] The embodiments for carrying out the present invention are not limited to those described above, and other modified examples may also be applied. For example, in the third embodiment, if the control unit 214 determines in S28 that participant A has started speaking, the process skips the execution of the sound mute warning step and proceeds to S21. In contrast, as a modified example, if the control unit 214 determines in S28 that participant A has started speaking, the process may proceed to S21 after executing the sound mute warning step as shown in S19, for example.

[0184] Furthermore, as another variation, the information processing device in each embodiment may further include a second video mute function unit that executes a second video mute function, and when the second video mute function unit determines that audio input from participant A's side has been made while the second video mute function is in effect, the second video mute function unit may execute processing to display a warning image indicating that the video mute function is in effect or to automatically terminate the video mute function and display the video. Also, a program for causing such an information processing device to function, a system including such an information processing device, and a method for providing a video mute function in such an information processing device may be provided. All of the criteria for determining that audio input from participant A's side has been made are applicable to the criteria described for audio mute in this specification.

[0185] Furthermore, as another variant, when using a blurring function to obscure the background during a web conference in each embodiment, if a person or other object other than participant A is captured on the camera behind or beside participant A, the camera may automatically recognize this and turn off the camera.

[0186] Furthermore, as another variation, the programs in each embodiment are not limited to being stored temporarily or non-temporarily in a storage device such as a server or PC, but may also be stored in a USB memory, an SD card, or other recording medium. [Explanation of symbols]

[0187] 1: Information processing equipment 2: Information processing system 3: Internet 18: Sound mute function section 19: Mute speech suppression function unit 20: Sound mute warning 24: First mute function unit 26: Second mute function unit 101: Information processing device 118: Sound mute function section 119: Mute speech suppression function unit 124: First mute function unit 126: Second mute function unit 201: Information processing device 218: Sound mute function unit 219: Mute speech suppression function unit 226: Second mute function unit A:Participant B: Counterparty participant

Claims

[Claim 1] An information processing device that can be used for a web conference via the Internet from a participant to a remote participant, a sound muting function unit that executes a sound muting function to make the sound from the participant side inaudible to the other participant; a muting speech suppression function unit that has a function of suppressing the participant from continuing to talk without realizing that the sound muting function is being executed when there is sound input from the participant side while the sound muting function unit is executing the sound muting function, the mute-time speech suppression function unit includes a sound mute warning unit that issues a warning to make the participants more aware that the sound mute function is being executed, The sound mute warning unit distinguishes between other environmental sounds and sounds made by the participant's speech based on the frequency band of the sound input from the participant, and determines whether the participant has started speaking.

Images