Information processing device and program
The device and program manage audio volume and confidentiality in remote conferences by setting thresholds and issuing warnings, addressing the challenges of loud speech and sensitive content in voice communication.
Patent Information
- Application Number
- JP2023122554
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-07-27
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2038-04-09
AI Technical Summary
Voice communication in remote conferences is convenient but poses challenges in managing audio volume levels, especially when participants speak loudly, which can lead to security risks and leakage of confidential information.
An information processing device and program that set volume thresholds for audio input, issue warnings when exceeded, and adjust or block audio output based on location, environmental noise, topic sensitivity, or presence of confidential terms.
Effectively manages audio volume and reduces the risk of confidential information leakage by alerting speakers and adjusting audio inputs/output to maintain privacy and ensure orderly discussions.
Smart Images

Figure 0007601152000001 
Figure 0007601152000002 
Figure 0007601152000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device. and Program Regarding. [Background technology]
[0002] Patent Document 1 describes a web conference system in which an information processing device and a web conference server that stores conference room information for holding a web conference can be connected via a network, and the information processing device includes a network identification information acquisition means for acquiring network identification information that identifies a network used to connect to the web conference server, a network identification information transmission means for transmitting the network identification information acquired by the network identification information acquisition means to the web conference server in order to enter a conference room used in the web conference, an availability information receiving means for receiving web conference availability information transmitted from the web conference server as a result of transmitting the network identification information to the web conference server by the network identification information transmission means, and an availability information receiving means for receiving, when the availability result received by the availability information receiving means indicates that entry to the web conference is possible on the connected network, setting information including functional restriction information of the web conference and a profile of the conference room used in the web conference. and an entry means for entering a conference room where the web conference will be held by using the setting information acquired by the setting information acquisition means, wherein the web conference server comprises: a definition information storage means for storing the network identification information and function restriction information of functions provided in the web conference that can be used for each network identification information as definition information in a storage unit; a network identification information determination means for determining whether the definition information including the network identification information is stored in the definition information storage means by using the network identification information transmitted from the information processing device by the network identification information transmission means; and a setting information transmission means for transmitting setting information including the function restriction information included in the definition information and a profile of a conference room to be used in the web conference to the information processing device when the network identification information determination means determines that the definition information including the network identification information is stored. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2013-140560 A Summary of the Invention [Problem to be solved by the invention]
[0004] Compared to text-based chat, voice communication is convenient in that it is easier to send and receive information, and a large number of people can instantly share and discuss information. expensive.
[0005] An object of the present disclosure is to provide an information processing device and program that can set a threshold value for the volume of audio information acquired from a terminal device, and can send a specified notification to the terminal device when the volume of the audio information acquired from the terminal device exceeds the set threshold value. [Means for solving the problem]
[0006] The information processing device of the present disclosure is an information processing device that includes a setting means for setting a threshold value for the volume of audio information acquired from a terminal device, and a notification means for sending a predetermined notification to the terminal device when the volume of the audio information acquired from the terminal device exceeds the threshold value set by the setting means. The program disclosed herein is a program for causing a computer to function as a setting means for setting a threshold value for the volume of audio information acquired from a terminal device, and a notification means for issuing a predetermined notification to the terminal device when the volume of the audio information acquired from the terminal device exceeds the threshold value set by the setting means. Effect of the Invention
[0022] According to the information processing device and program disclosed herein, a threshold value can be set for the volume of audio information acquired from a terminal device, and a predetermined notification can be sent to the terminal device when the volume of the audio information acquired from the terminal device exceeds the set threshold. [Brief description of the drawings]
[0032] [Figure 1] 1 is a schematic diagram illustrating an example of a configuration of a remote conference system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing an example of an electrical configuration of a terminal device. [Diagram 3] FIG. 2 is a block diagram showing an example of an electrical configuration of the server device. [Figure 4] 2 is a functional block diagram illustrating an example of a functional configuration of a server device according to the first embodiment. FIG. [Diagram 5] FIG. 2 is a schematic diagram showing a specific example of the first embodiment. [Figure 6] 6 is a flowchart showing an example of a process flow of a remote conference program according to the first embodiment. [Figure 7] 13 is a flowchart showing an example of the flow of a volume response process. [Figure 8] 11 is a diagram showing the relationship between terminal IDs and locations. [Figure 9] 13 is a diagram showing the relationship between the placement location and the threshold value. [Figure 10] FIG. 11 is a sequence diagram showing a procedure for notifying a threshold value. [Figure 11] FIG. 13 is a functional block diagram illustrating an example of a functional configuration of a server device according to a third embodiment. [Figure 12] FIG. 13 is a schematic diagram showing a specific example of the fourth embodiment. [Figure 13] FIG. 13 is a schematic diagram showing an example of a setting screen according to a fifth embodiment. [Figure 14] 11 is a diagram showing the relationship between security levels and threshold values. [Figure 15] FIG. 11 is a sequence diagram showing a procedure for notifying a threshold value. [Figure 16] FIG. 11 is a sequence diagram showing a procedure for notifying a set volume. [Figure 17] FIG. 23 is a functional block diagram illustrating an example of a functional configuration of a server device according to a sixth embodiment. [Figure 18] FIG. 23 is a functional block diagram illustrating an example of a functional configuration of a server device according to a seventh embodiment. [Figure 19] FIG. 13 is a schematic diagram showing a specific example of the seventh embodiment. [Figure 20] 23 is a flowchart showing an example of a process flow of a remote conference program according to a seventh embodiment. [Figure 21] 13 is a flowchart showing an example of the flow of confidentiality management processing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0033] An embodiment of the present invention will now be described in detail with reference to the drawings.
[0034] <First embodiment> (Audio conference system) First, a remote conference system, which is an example of an information processing system, will be described. Fig. 1 is a schematic diagram showing an example of the configuration of a remote conference system according to an embodiment of the present invention. As shown in Fig. 1, a remote conference system 10 includes a server device 12 for remote conferences and a terminal device 14 used by participants who participate in the remote conference. The terminal device 14 and the server device 12 are connected to each other so as to be able to communicate with each other via a wired or wireless communication line 16 such as the Internet or a LAN.
[0035] 1 illustrates four terminal devices 14A, 14B, 14C, and 14D, but there is no particular limit to the number of terminal devices 14, as long as it is two or more. When there is no need to distinguish between the terminal devices 14A, 14B, 14C, and 14D, they will be collectively referred to as the terminal devices 14.
[0036] An application program for remote conferences (hereinafter referred to as the "remote conference program") is installed in the terminal device 14. A participant starts the remote conference program and connects the terminal device 14 to the remote conference server device 12 to participate in the remote conference. A voice input device such as a microphone for inputting voice, and a voice output device such as a speaker or earphones for outputting voice are connected to the terminal device 14.
[0037] The terminal device 14 transmits voice information corresponding to the voice input from the voice input device to the server device 12. The server device 12 distributes the voice information acquired from each terminal device 14 to each terminal device 14. The voice output device connected to each terminal device 14 reproduces and outputs voice corresponding to the received voice information.
[0038] This allows remote conference participants to speak and hear what they and other participants are saying. Compared to text-based chat, audio remote conferences are more convenient in that they make it easier to send and receive information and allow a large number of people to instantly share and discuss information.
[0039] In the illustrated example, the terminal device 14A is placed in a conference room in the head office. The terminal device 14A is a terminal used by Mr. A, the organizer of the remote conference. The terminal device 14A is equipped with a microphone, a speaker, A display, which is an example of a display unit, a projector, etc. are connected to the conference room in the head office. There are other participants besides the organizer, Mr. A. The projector projects the conference materials, etc.
[0040] The terminal device 14B is a terminal used by participant B of the remote conference. Participant B works from home, and the terminal device 14B is located in the home of participant B. A microphone, earphones, a display, etc. are connected to the terminal device 14B.
[0041] The terminal device 14C is a mobile terminal used by a remote conference participant C. The participant C works outside the company, such as in a rental office, and the terminal device 14C is used outside the company. The terminal device 14C is equipped with a microphone, earphones, a small display, and the like.
[0042] The terminal device 14D is placed in the conference room of the branch office. A microphone, a speaker, a display, a projector, etc. are connected to the terminal device 14D. At least one participant is present in the conference room of the branch office. Entry to the conference room of the head office and the conference room of the branch office is prohibited to anyone other than related persons.
[0043] (Terminal Device) Next, the terminal device will be described. Fig. 2 is a block diagram showing an example of the electrical configuration of the terminal device 14. As shown in Fig. 2, the terminal device 14 includes an information processing unit 20. The information processing unit 20 is configured as a computer that controls the entire device and performs various calculations.
[0044] Specifically, the information processing unit 20 includes a CPU 20A, a ROM 20B storing various programs, a RAM 20C used as a work area when the programs are executed, a non-volatile memory 20D storing various data, and an input / output interface (I / O) 20E. The CPU 20A, the ROM 20B, the RAM 20C, the memory 20D, and the I / O 20E are each connected via a bus 20F.
[0045] The various programs and data may be stored in other storage devices or in recording media such as CD-ROMs, etc. Also, the various programs and data may be acquired via communication.
[0046] An operation unit 22, a display unit 24, a storage unit 26, a communication unit 28, and a voice input / output interface (I / F) 30 are connected to the I / O 20E. The display unit 24 displays various information to the user. The storage unit 26 is an external storage device such as a hard disk. The communication unit 28 is an interface for communicating with an external device. The voice input / output I / F 30 is an interface for inputting and outputting voice. The information processing unit 20 controls each unit by sending and receiving information to and from each unit.
[0047] The audio input / output I / F 30 includes a microphone 32, which is an example of an audio input device for inputting audio. A speaker (or earphone) 34, which is an example of an audio output device that outputs audio, is connected to the audio input / output I / F 30. The audio input / output I / F 30 converts an acoustic signal detected by the microphone 32 into a digital signal. The audio input / output I / F 30 converts the audio data into voice data and inputs it to the information processing unit 20. The audio information acquired from the information processing unit 20 is converted into an acoustic signal for outputting audio from a speaker or the like 34, and output to the speaker or the like 34.
[0048] (Server device) Next, the hardware configuration of the server device will be described. Fig. 3 is a block diagram showing an example of the electrical configuration of the server device. As shown in Fig. 3, the server device 12 includes an information processing unit 40. The information processing unit 40 controls the entire device and The terminal device 14 and the server device 12 are configured as a computer that performs various calculations. Both the terminal device 14 and the server device 12 function as information processing devices, and the server device 12 is an example of an "information processing device."
[0049] The information processing unit 40 includes a CPU 40A, a ROM 40B storing various programs, a RAM 40C used as a work area when the programs are executed, a non-volatile memory 40D storing various data, and an input / output interface (I / O) 40E. The CPU 40A, the ROM 40B, the RAM 40C, the memory 40D, and the I / O 40E are each connected via a bus 40F.
[0050] The various programs and data may be stored in another storage device, or may be recorded on a recording medium such as a CD-ROM. Furthermore, the various programs and data may be acquired via communication.
[0051] A storage unit 42, which is an external storage device, and a communication unit 44, which is an interface for communicating with external devices, are connected to the I / O 40E. The information processing unit 40 controls each unit by sending and receiving information to and from each unit.
[0052] Next, the functional configuration of the server device will be described. Fig. 4 is a functional block diagram showing an example of the functional configuration of the server device according to the first embodiment. As shown in Fig. 4, the server device 12 includes a voice information acquisition unit 50, a voice information output unit 52, a volume detection unit 56, a volume determination unit 58, a threshold storage unit 60, and a warning output unit 62.
[0053] The audio information acquisition unit 50 acquires audio information from each terminal device 14. The audio information output unit 52 distributes the audio information acquired from the audio information acquisition unit 50 to each terminal device 14 in time synchronization. The volume detection unit 56 detects speech from the audio information acquired from the terminal device 14 for each terminal device 14, and detects the volume of the detected speech. Here, "volume" refers to the amount (level) of sound pressure expressed as the common logarithm of the ratio with respect to a reference value. The unit is decibels [dB]. The volume detection unit 56 outputs the detection result to the volume determination unit 58.
[0054] The volume determination unit 58 acquires the threshold value stored in the threshold value storage unit 60, and compares the volume detected by the volume detection unit 56 with the threshold value to determine whether the detected volume exceeds the threshold value. When the volume determination unit 58 determines that the volume exceeds the threshold value, it outputs the determination result to the warning output unit 62. The warning output unit 62 outputs a warning to the terminal device 14 (hereinafter referred to as the "problematic terminal") whose volume has been determined by the volume determination unit 58 to exceed the threshold value.
[0055] (Specific examples) Here, a concrete example will be given (see FIG. 1). 5 is a schematic diagram showing a specific example of the first embodiment. Assume a case where participant B, who works at home, speaks in a remote conference. When participant B speaks into a microphone, voice information is transmitted from terminal device 14B to server device 12. Server device 12 distributes participant B's voice (information) to other terminal devices 14A, 14C, and 14D in real time. Server device 12 also detects participant B's speech and measures the volume of the detected speech.
[0056] Here, the volume threshold stored in server device 12 is assumed to be 60 dB (the volume of a typical conversation). When the volume of participant B's speech exceeds 60 dB, server device 12 transmits a warning notification to terminal device 14B. Upon receiving the warning notification, terminal device 14B displays a warning message on the display unit saying "Your voice is too loud! Please lower your voice." Participant B is prompted to lower the volume of his speech.
[0057] In this embodiment, Participant B and Participant C participate in the remote conference from outside the company, such as from their homes or rental offices. Outside the company, the security risk is higher than at the company's base, since it is easier for a third party to be involved. In addition, in recent years, devices such as smart speakers that are always connected to a network and collect voice have become widespread. Therefore, the speech of participants participating in the remote conference is monitored, and a warning is issued to speakers who engage in problematic behavior, such as speaking too loudly, thereby reducing the leakage of confidential information due to speech acts.
[0058] The warning method is not limited to displaying a warning message, as long as it can prompt the speaker to take an action to avoid the warning. A warning voice or warning sound may be output from the audio output device of the terminal device 14. For example, in the example shown in FIG. 1, participant C uses a mobile terminal, and it may be difficult for him to participate in the remote conference while looking at the screen. In such a case, it is effective to play a warning voice or warning sound directly on the earphones instead of displaying it on the screen.
[0059] Also, the volume of speech of a participant who speaks loudly may be lowered or the distribution of speech may be stopped (microphone off). On the server device 12 side, the volume may be lowered when distributing the voice information acquired from the question terminal, or the distribution of the voice information acquired from the question terminal may be stopped. Alternatively, the server device 12 may instruct the question terminal to lower the voice input volume on the question terminal side or to stop voice input on the question terminal side.
[0060] 4, the volume determination unit 58 outputs terminal information such as the terminal ID of the problematic terminal to the audio information output unit 52. The audio information output unit 52 stops the distribution of the audio information acquired from the problematic terminal.
[0061] (Remote conference program) Next, the remote conference program will be described. 6 is a flowchart showing an example of a process flow of the "remote conference program" according to the first embodiment. The remote conference program is started when the host issues an instruction to execute the program from a terminal device and the instruction to execute the program is accepted by the CPU of the server device.
[0062] First, in step 100, audio information is acquired from each terminal device. Next, in step 102, the audio information is distributed to each terminal device. Next, in step 104, "volume response processing" is executed. Next, in step 106, it is determined whether or not the conference has ended. An instruction to end the conference is given from the host's terminal device, and the process ends when the instruction to end is accepted by the CPU of the server device. If the conference has ended, the routine ends, and if the conference has not ended, the process returns to step 100 and the procedures from step 100 to step 106 are repeated.
[0063] Next, the "volume response process" will be described. 7 is a flow chart showing an example of the flow of the "volume handling process." In the "volume handling process," if the volume of a participant's speech exceeds a threshold, a warning is issued to the speaker.
[0064] First, in step 200, one terminal device is selected. Next, in step 202, a volume threshold value corresponding to the terminal device is acquired. A speech volume threshold value is stored for each terminal device in the storage unit of the server device. Next, in step 204, the speech volume is detected from the voice information acquired from the selected terminal device.
[0065] Next, in step 206, it is determined whether the volume of the detected speech exceeds a threshold. If the volume of the detected speech exceeds the threshold, the process proceeds to step 208, where a warning is output. The warning information is sent to the selected terminal device, and a warning is issued to the participant who is speaking loudly. If the threshold is not exceeded, step 208 is skipped and the process proceeds to step 210.
[0066] Next, in step 210, it is determined whether there is any other terminal device that has not been selected. If there is any other terminal device that has not been selected, the process returns to step 200 to select the next terminal device, and the procedures from step 200 to step 210 are repeated. If there is no other terminal device that has not been selected, the routine ends.
[0067] <Second embodiment> In the second embodiment, the threshold value of the voice volume is set according to the location where the terminal device is placed. Since the rest is the same as in the first embodiment, the description of the same parts will be omitted.
[0068] FIG. 8 is a chart showing the relationship between the terminal ID and the location. Here, the reference numeral of the terminal device 14 shown in FIG. 1 is used as the terminal ID for identifying the terminal device. As described above, the terminal device 14A is placed in the conference room of the head office. The terminal device 14B is placed at the home of Participant B. The terminal device 14C is used outside the company (other than at home). The terminal device 14D is placed in the conference room of the branch office.
[0069] Since facilities inside the company, such as conference rooms in the head office and branch offices, are generally subject to access control, there is no problem even if people talk in a louder voice compared to outside the company. Also, when multiple people gather in a conference room, if the volume at the time of occurrence is not made louder, other participants will not be able to hear. Therefore, for the terminal devices 14A and 14D placed inside the company, a higher volume threshold may be set, or the volume may be unrestricted.
[0070] FIG. 9 is a chart showing the relationship between the location and the threshold value. For example, when the location is the head office, branch office, or home, the threshold value is set to A, and when the location is outside the company other than at home, the threshold value is set to B (<A). The volume of general conversation is 60 dB. For example, the threshold value A may be set to 70 dB and the threshold value B may be set to 40 dB.
[0071] <Third Embodiment> Whether it is easy for a third party to overhear the voice also varies depending on the ambient environmental sound. For example, in the example shown in FIG. 1, if the home of Participant B is close to a road with heavy traffic, Participant B may speak in a louder voice but it is difficult to be overheard from the surroundings. On the other hand, if the home of Participant B is in a quiet residential area, it may be heard from the surroundings even at a lower volume.
[0072] Therefore, in the third embodiment, a threshold for the volume of speech is set according to the environmental sound of the location where the terminal device is placed. The terminal device obtains a threshold according to the environmental sound, and notifies the server device of the obtained threshold. The threshold is set according to the environmental sound so that the speech is not heard by a third party. Since the rest of the third embodiment is the same as the first embodiment, a description of the same parts will be omitted.
[0073] Fig. 10 is a sequence diagram showing the procedure of threshold notification. As shown in Fig. 10, in step 300, the terminal device 14 acquires audio information of environmental sound picked up by a voice input device such as a microphone. Next, in step 302, the volume of the environmental sound is detected from the acquired audio information. For example, the volume of the surrounding environmental sound is constantly measured, and the average volume of the environmental sound is acquired. Next, in step 304, a threshold value according to the volume of the environmental sound is calculated. For example, the threshold value is set to a value obtained by adding 20 dB to the average volume of the environmental sound. Next, in step 306, the calculated threshold value is notified to the server device 12.
[0074] Next, the functional configuration of the server device will be described. 11 is a functional block diagram showing an example of a functional configuration of a server device according to the third embodiment. As shown in FIG. 11, the server device 12 includes a voice information acquisition unit 50, a voice information output unit 51, and a voice information acquisition unit 52. 2, a volume detection unit 56, a volume determination unit 58, a threshold setting unit 70, and a warning output unit 62. Except for the provision of the threshold setting unit 70 instead of the threshold storage unit 60, the functional configuration is the same as that of the server device shown in Fig. 4, and therefore the same components are denoted by the same reference numerals and description thereof will be omitted.
[0075] The threshold setting unit 70 sets the threshold notified from each terminal device 14 as the "threshold" of that terminal device. The set threshold is stored in association with the terminal ID of that terminal device. The volume determination unit 58 acquires the threshold stored in the threshold setting unit 70, and compares the volume detected by the volume detection unit 56 with the threshold to determine whether the detected volume exceeds the threshold.
[0076] <Fourth embodiment> In the first embodiment, an example was described in which a warning was issued to a participant who was speaking loudly, but in the fourth embodiment, a warning is issued to other participants. For example, when a warning is output in step 208 in Fig. 7, warning information is sent to the terminal device used by the organizer. Other than that, the fourth embodiment is the same as the first embodiment, and therefore a description of the same parts will be omitted.
[0077] Fig. 12 is a schematic diagram showing a specific example of the fourth embodiment. In the example shown in Fig. 12, the server device 12 (see Fig. 1) transmits a warning notification to the terminal device 14A of the organizer A at the timing when the volume of the speech of the participant B exceeds 60 dB. Upon receiving the warning notification, the terminal device 14A displays a warning message saying "Person B's voice is too loud!" on a display unit connected to the terminal device 14A.
[0078] Organizer A can take various measures, such as warning participant B, "Isn't your voice too loud, Mr. B?", prohibiting Mr. B from speaking, or temporarily halting the discussion to forcefully calm things down. Alternatively, as will be described later, organizer A may operate terminal device 14A to stop the distribution of participant B's voice. There is a possibility that the speaker, Mr. B, will be engrossed in the discussion and overlook the warning, so it may be more effective to warn other participants.
[0079] <Fifth embodiment> In a meeting that deals with multiple topics, there are topics with high confidentiality and topics with low confidentiality. In such a case, if a threshold is set based on the criteria for the topics with high confidentiality, there is a risk that sufficient discussion will not be held on the topics with low confidentiality.
[0080] Therefore, in the fifth embodiment, the organizer sets the speech volume threshold according to the agenda. The organizer's terminal device obtains a threshold according to the security level of the agenda, and notifies the server device of the obtained threshold. The organizer changes the security level according to the progress of the remote conference. The speech volume threshold is switched according to the change in the security level. Other than that, the fifth embodiment is the same as the first embodiment, so a description of the same parts will be omitted.
[0081] 13 is a schematic diagram showing an example of a setting screen according to the fifth embodiment. For example, a setting screen 100 is displayed on the display unit of the terminal device 14A of the organizer A to accept the setting of the security level. The setting screen 100 includes an icon 102 of the organizer, icons 106 of the participants, a setting section 104 for setting the security level, a setting section 108 for setting the sound volume, a button 110 for issuing a confirmation command, a button 112 for issuing a cancellation command, and the like.
[0082] Fig. 14 is a chart showing the relationship between security levels and thresholds. As shown in Fig. 14, multiple security levels are available. In the example shown, there are five levels, from "1" to "5," with the security level increasing in ascending order. Thresholds E to A are set for security levels 1 to 5. The higher the security level, the smaller the threshold.
[0083] Fig. 15 is a sequence diagram showing a procedure for notifying a threshold value. As shown in Fig. 15, the terminal device 14A acquires a set security level in step 400. Next, in step 402, the terminal device 14A acquires a threshold value corresponding to the acquired security level. Next, in step 404, the acquired threshold value is notified.
[0084] For example, the organizer operates the setting unit 104, buttons 110, etc. of the setting screen 100 shown in Fig. 13 to set a security level according to the agenda. For example, for an agenda with high confidentiality, the security level is set to "5." A threshold A (e.g., 20 dB) corresponding to level 5 is obtained and notified to the server device 12. For an agenda with high confidentiality, the volume threshold is set low to limit the volume of speech, improving confidentiality.
[0085] On the other hand, for topics that are not so highly confidential, the security level is set to "3." A threshold C (e.g., 50 dB) corresponding to level 3 is obtained and notified to the server device 12. For topics that are not so highly confidential, the volume threshold is set high so that the remote conference can be conducted without worrying about the volume of speech, improving convenience.
[0086] Sixth embodiment In the fifth embodiment, an example was described in which the organizer sets the threshold for the volume of speech depending on the agenda. In the sixth embodiment, the organizer sets the volume at which the voice acquired from each terminal device is distributed. For example, the organizer operates the setting unit 108, button 110, etc. of the setting screen 100 shown in Fig. 13 to set the volume at which the voice acquired from each terminal device is distributed. Since the rest is the same as in the first embodiment, a description of the same parts will be omitted.
[0087] Fig. 16 is a sequence diagram showing a procedure for notifying the set volume. As shown in Fig. 16, the terminal device 14A acquires the volume set for each terminal device in step 500. Next, in step 502, the server device 12 is notified of the acquired set volume.
[0088] Next, the functional configuration of the server device will be described. Fig. 17 is a functional block diagram showing an example of the functional configuration of a server device according to the sixth embodiment. As shown in Fig. 17, the server device 12 includes a voice information acquisition unit 50, a voice information output unit 52, a volume detection unit 56, a volume determination unit 58, a threshold storage unit 60, a warning output unit 62, and a volume adjustment unit 54. Since the server device 12 has the same functional configuration as the server device shown in Fig. 4 except for the volume adjustment unit 54, the same components are denoted by the same reference numerals and description thereof will be omitted.
[0089] The audio information acquisition unit 50 acquires audio information from each terminal device 14. The volume adjustment unit 54 acquires the set volume of each terminal device 14 from the organizer's terminal device 14A. The volume adjustment unit 54 adjusts the volume of the audio information of each terminal device 14 acquired from the audio information acquisition unit 50 in accordance with the set volume of each terminal device 14. The audio information output unit 52 distributes the audio information after the volume adjustment to each terminal device 14.
[0090] For example, as shown in FIG. 12, when the organizer A sees the warning message "B's voice is too loud!", he operates the setting unit 108, the button 110, etc. of the setting screen 100 shown in FIG. 13 to set the volume of the voice acquired from the terminal device 14B (B's home) to 0 dB. , that is, the microphone is off.
[0091] <Seventh embodiment> In the first to sixth embodiments, a warning is issued when the volume of the speech exceeds a threshold, but in the seventh embodiment, a warning is issued when the content of the speech includes a confidential term. Other than that, the seventh embodiment is the same as the first embodiment, so a description of the same parts will be omitted.
[0092] (Server device) Next, the functional configuration of the server device will be described. Fig. 18 is a functional block diagram showing an example of the functional configuration of a server device according to the seventh embodiment. As shown in Fig. 18, the server device 12 includes a voice information acquisition unit 50, a voice information output unit 52, a voice recognition unit 80, a confidential information detection unit 82, a volume adjustment unit 54, and a warning output unit 84.
[0093] The voice information acquisition unit 50 acquires voice information from each terminal device 14. The voice recognition unit 80 performs voice recognition processing on the voice information acquired from the voice information acquisition unit 50 and converts the contents of the utterance into text data. The voice recognition processing is performed for each terminal device. The confidential information detection unit 82 extracts predetermined confidential terms from the text data obtained by the voice recognition unit 80. Here, "confidential terms" are terms included in information treated as confidential, such as trade secrets and personal information. For example, proper nouns such as project names, product names, company names, and names of laws and regulations may be considered as confidential terms.
[0094] When a confidential term is detected, the confidential information detection unit 82 identifies the terminal device 14 that inputted the audio information containing the confidential term (hereinafter referred to as the "problem terminal") and notifies the volume adjustment unit 54 and the warning output unit 84 of terminal information such as the terminal ID of the problem terminal. The volume adjustment unit 54 adjusts the volume of the audio information of the problem terminal among the audio information acquired from the audio information acquisition unit 50. For example, the volume of the audio information acquired from the problem terminal is lowered or set to zero. The audio information output unit 52 distributes the audio information after the volume adjustment to each terminal device 14.
[0095] The warning output unit 84 outputs a warning to the problematic terminal. By monitoring the speech of the participants in the remote conference and issuing a warning to the speaker who engaged in problematic behavior such as speaking outside the company containing confidential terminology, the leakage of confidential information caused by the speech can be reduced.
[0096] Here, a specific example will be given for explanation. FIG. 19 is a schematic diagram showing a specific example of the seventh embodiment. Assume that participant B, who works at home, speaks during a remote conference. When participant B speaks into the microphone, the voice (information) of participant B is distributed in real time to other terminal devices 14A, 14C, and 14D. In addition, server device 12 detects participant B's speech and converts the content of the speech into text data by speech recognition processing.
[0097] When the server device 12 detects that the contents of the speech of participant B contain confidential words, it transmits a warning notice to the terminal device 14B. When the terminal device 14B receives the warning notice, it displays a warning message on the display unit saying "Confidential words are used. Please be careful when you speak." It may also output a warning voice or a warning sound. Participant B is urged to be careful about the contents of his / her speech.
[0098] Furthermore, when the server device 12 detects that the contents of the speech of the participant B contain confidential terms, the server device 12 lowers the volume of the audio information acquired from the terminal device 14B. The server device 12 may also stop the distribution.
[0099] Alternatively, even if the server device 12 detects that the contents of the speech of participant B contain confidential terms, it may issue a warning notice or reduce the volume only when the volume of the audio information acquired from the terminal device 14B exceeds a threshold. Conversations containing confidential terms will be spoken in a low voice, and general conversations will be spoken in a high voice, thereby reducing the leakage of confidential information due to speaking acts while maintaining the convenience of audio conferences.
[0100] (Remote conference program) Next, the remote conference program will be described. 20 is a flowchart showing an example of the process flow of the "remote conference program" according to the seventh embodiment. The remote conference program is started when the host issues an instruction to execute the program from a terminal device and the instruction to execute the program is accepted by the CPU of the server device.
[0101] First, in step 600, audio information is acquired from each terminal device. Next, in step 602, "confidentiality handling processing" is executed. Next, in step 604, the audio information is distributed to each terminal device. Next, in step 606, it is determined whether or not the conference has ended. An instruction to end the conference is issued from the host's terminal device, and the conference ends when the instruction to end is accepted by the CPU of the server device. If the conference has ended, the routine ends, and if the conference has not ended, the process returns to step 600 and the procedures from step 600 to step 606 are repeated.
[0102] Next, the "confidentiality management process" will be described. 21 is a flow chart showing an example of the flow of the "confidentiality handling process." In the "confidentiality handling process," if the content of a participant's speech contains confidential terms, a warning is given to the speaker and the volume of the speech is reduced.
[0103] First, in step 700, one terminal device is selected. Next, in step 702, speech information obtained from the terminal device is subjected to speech recognition processing, and the contents of the utterance are converted into text data. Next, in step 704, predetermined confidential terms are extracted from the text data obtained by the speech recognition processing. Next, in step 706, it is determined whether the contents of the utterance include confidential terms. If confidential terms are included, the process proceeds to step 708, and if confidential terms are not included, the process proceeds to step 712.
[0104] Next, the volume of the audio information acquired from the terminal device is reduced in step 708. Next, a warning is output in step 710. The warning information is transmitted to the selected terminal device, and a warning is given to the speaker of the utterance containing the confidential term.
[0105] Next, in step 712, it is determined whether there are any other terminal devices that have not been selected. If there are any other terminal devices that have not been selected, the process returns to step 700 to select the next terminal device, and the procedures from step 700 to step 710 are repeated. If there are no other terminal devices that have not been selected, the routine ends.
[0106] <Modification> It should be noted that the configurations of the information processing device, the program, and the information processing system described in the above embodiment are merely examples, and it goes without saying that the configurations may be changed without departing from the spirit of the present invention.
[0107] In the first to sixth embodiments, an example of issuing a warning when the volume of speech exceeds a threshold has been described, and in the seventh embodiment, an example of issuing a warning when the content of speech contains confidential terminology has been described. However, it is also possible to issue a warning at least when the volume of speech exceeds a threshold and when the content of speech contains confidential terminology.
[0108] In addition, in the above embodiment, the remote conference system is configured to include a server device, but any of the terminal devices used in the remote conference, such as the organizer's terminal device, may have the functions of a server device.
[0109] Furthermore, in the above embodiment, an example has been described in which each function is realized by software, but each function may also be realized by hardware. [Explanation of symbols]
[0110] 10. Remote conference system 12 Server equipment 14 Terminal Equipment 16. Communication Lines 20 Information Processing Section 22 Control section 24 Display section 26 Memory section 28 Communications Department 30 Audio Input / Output Interface 32. Mike 34 Speakers, etc. 40 Information Processing Section 42 Storage section 44 Communications Department 50 Audio information acquisition unit 52 Audio information output section 54 Volume control section 56 Volume detection unit 58 Volume Judgment Section 60 Threshold memory unit 62 Warning output section 70 Threshold setting unit 80 Voice Recognition Unit 82 Confidential Information Detection Department 84 Warning Output Section 100 Setting screen 102 Icons 106 Icons 104 Setting section 108 Setting section 110 Button 112 Button A. Organizer B Participants C Participants
Claims
1. a setting means for setting a threshold value for the volume of audio information acquired from a terminal device in accordance with the safety of a location where the terminal device is installed; a notification means for issuing a predetermined notification to the terminal device when the volume of the audio information acquired from the terminal device exceeds the threshold value set by the setting means; An information processing device comprising:
2. The threshold value is set lower when the location where the terminal device is installed is within a company where entry by unauthorized persons is prohibited than when the location is outside the company. The information processing device according to claim 1 .
3. The threshold value is set according to the environmental sound volume of a location where the terminal device is installed. The information processing device according to claim 1 .
4. The threshold is set according to the agenda. The information processing device according to claim 1 .
5. The setting means sets the threshold value notified from the terminal device as the threshold value. The information processing device according to claim 1 .
6. The predetermined notification is a notification that warns that the volume of speech is high. The information processing device according to claim 1 .
7. The terminal device performs any one of displaying a warning message, outputting a warning voice, outputting a warning sound, and lowering a speech volume in response to the predetermined notification. The information processing device according to claim 1 .
8. Computer, a setting means for setting a threshold value for the volume of audio information acquired from a terminal device in accordance with the safety of a location where the terminal device is installed; a notification means for issuing a predetermined notification to the terminal device when the volume of the audio information acquired from the terminal device exceeds the threshold value set by the setting means; A program to function as a
Citation Information
Patent Citations
Portable telephone set with annoying call preventing function
JP2000069126A
Call speech processor and call speech controller and method
JP2011199550A
Web conference system, information processing device, control method, and program
JP2013140560A
Server device, warning method and warning program
JP2016066923A
