Microphone status display method and microphone status display device
The microphone status display method ensures accurate mute state indication through LED indicators or displays, addressing the issue of mistaken mute assumptions and improving conversation privacy in multi-microphone systems.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- YAMAHA CORP
- Filing Date
- 2022-08-15
- Publication Date
- 2026-06-30
Smart Images
Figure 0007882047000001 
Figure 0007882047000002 
Figure 0007882047000003
Abstract
Description
Technical Field
[0001] One embodiment of the present invention relates to a microphone state display method and a microphone state display device for displaying the mute-on or mute-off state of a microphone.
Background Art
[0002] Patent Document 1 describes a laptop PC to which a plurality of microphones are connected. The laptop PC includes a CPU. The laptop PC stores a control table that registers device IDs corresponding to each of the plurality of microphones. The CPU sets the microphones corresponding to the device IDs registered in the control table to the same mute state with a single operation.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In a microphone system including a plurality of microphones, when a certain speaker (hereinafter referred to as Speaker A) turns on the mute of his / her own microphone, he / she may think that his / her voice does not reach the call partner and may conduct a conversation that he / she does not want the call partner to hear. At this time, there is a possibility that another microphone in the same space as Speaker A is not muted. In this case, another microphone picks up the conversation of Speaker A. As a result, there is a risk that the conversation of Speaker A can be heard by the call partner through another microphone.
[0005] An object of one embodiment of the present invention is to provide a microphone state display method that can prevent a speaker from mistakenly thinking that the microphone is in the mute-on state and thus inaudible to the call partner. [Means for solving the problem]
[0006] A microphone status display method according to one embodiment of the present invention is: Each of the multiple microphones can be muted or muted individually. The state of the microphone that has received the mute-off operation is displayed on the display as the first state. When the mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as the second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the state of the microphone that received the mute-on operation is displayed on the display as the third state. [Effects of the Invention]
[0007] According to one embodiment of this invention, the microphone status display method prevents the speaker from mistakenly believing that the other party cannot hear them because the microphone is muted. [Brief explanation of the drawing]
[0008] [Figure 1] Figure 1 is a block diagram showing an example of the connection between the control device 10, microphones 20, 21, and 22, and PC 30. [Figure 2] Figure 2 is a block diagram showing the configuration of the control device 10. [Figure 3] Figure 3 is a block view showing the configuration of the microphone 20. [Figure 4] Figure 4 is a flowchart showing an example of the processing of the processor 105 when a mute-on operation is received from at least one microphone. [Figure 5]Figure 5 is a flowchart showing an example of the processing of the processor 105 when a mute-off operation is received from at least one microphone. [Figure 6] Figure 6 shows the state transitions of the microphone 20. [Figure 7] Figure 7 is a flowchart showing an example of processing by the processor 105a of the control device 10a according to Modification 1. [Figure 8] Figure 8 is a block diagram showing the configuration of the control device 10b according to modified example 2. [Figure 9] Figure 9 shows an example of the processing performed by the control device 10c according to Modification 3. [Figure 10] Figure 10 shows an example of the menu screen MN1 displayed on the LCD300. [Figure 11] Figure 11 shows an example of an image CA1 acquired by the control device 10d from the camera. [Figure 12] Figure 12 shows an example of image CA2 generated by the control device 10d. [Modes for carrying out the invention]
[0009] (First Embodiment) The following describes the management device 10 that implements the microphone status display method according to the first embodiment, with reference to the figures. Figure 1 is a block diagram showing an example of the connection between the management device 10, microphones 20, 21, and 22, and PC 30. Figure 2 is a block diagram showing the configuration of the management device 10.
[0010] The management device 10 is used, for example, in a remote conversation. As shown in FIG. 1, the management device 10 connects a plurality of microphones 20, 21, 22. Each of the plurality of microphones 20, 21, 22 acquires an audio signal related to the voices of speakers U20, U21, U22 and transmits it to the management device 10. The management device 10 performs various signal processes on the acquired audio signal and transmits it to the PC 30. The PC 30 transmits the received audio signal to an information processing device (not shown) such as a PC on the remote side via a communication line. Also, the PC 30 receives an audio signal from an information processing device such as a PC on the remote side via a communication line. The PC 30 transmits the audio signal received from the information processing device on the remote side to the management device 10. The management device 10 connects a speaker (not shown). The speaker outputs the voice of the speaker on the remote side based on the audio signal received from the PC 30 via the management device 10. Thereby, the speakers U20, U21, U22 can have a conversation with the speaker on the remote side. The management device 10 is an example of a microphone state display device. The management device 10 is an example of a first information processing device connected to a plurality of microphones 20, 21, 22.
[0011] Incidentally, the PC 30 communicates with an information processing device such as a PC on the remote side via a communication line such as the Internet or a LAN (Local Area Network). The PC 30 communicates with an information processing device such as a PC on the remote side wirelessly or by wire.
[0012] In the example shown in FIG. 1, three microphones 20, 21, 22 are connected to the management device 10, but the number of microphones connected to the management device 10 does not necessarily have to be three. Two microphones may be connected to the management device 10, or four or more microphones may be connected.
[0013] Incidentally, it is not necessarily required that the management device 10 connects a speaker. For example, the PC 30 may connect a speaker (not shown). In this case, the speaker connected to the PC 30 performs an output based on the audio signal received from an information processing device such as a PC on the remote side.
[0014] As shown in FIG. 2, the management device 10 includes a first communication interface 100, a second communication interface 101, a user interface 102, a flash memory 103, a RAM (Random Access Memory) 104, and a processor 105. The processor 105 is, for example, a CPU (Central Processing Unit).
[0015] The first communication interface 100 communicates with the microphones 20, 21, and 22 via a signal line such as a LAN cable. The first communication interface 100 receives audio signals related to the voices of the speakers U20, U21, and U22 from each of the microphones 20, 21, and 22.
[0016] The second communication interface 101 is an interface based on a standard such as USB (Universal Serial Bus). The second communication interface 101 communicates with the PC 30 via a signal line. The processor 105 mixes the audio signals acquired from the microphones 20, 21, and 22 and transmits the mixed audio signals to the PC 30.
[0017] Note that the management device 10 does not necessarily have to communicate with the microphones 20, 21, and 22 by wire. The management device 10 may communicate with the microphones 20, 21, and 22 wirelessly based on a standard such as Bluetooth (registered trademark).
[0018] The user interface 102 receives operations on the management device 10 from the user of the management device 10. The user interface 102 is a button or the like for adjusting the volume of the management device 10.
[0019] The flash memory 103 stores various programs. These programs include, for example, a program to operate the management device 10, or a program to execute processing related to the microphone status display method. The flash memory 103 also stores data (hereinafter referred to as status data) indicating whether each of the microphones 20, 21, and 22 connected to the management device 10 is in a mute-off or mute-on state. For example, the flash memory 103 stores status data such as "microphone 20: mute off, microphone 21: mute on, microphone 22: mute off".
[0020] Furthermore, the flash memory 103 does not necessarily have to store various programs. These programs may be stored in other devices, such as a server. In this case, the management device 10 receives the various programs from the other devices, such as the server.
[0021] The processor 105 executes various operations by reading programs stored in the flash memory 103 into the RAM 104. For example, the processor 105 performs processing related to communication between the management device 10 and microphones 20, 21, and 22, or processing related to communication between the management device 10 and PC 30.
[0022] The configurations of microphones 20, 21, and 22 will be explained below with reference to the diagrams. Figure 3 is a block diagram showing the configuration of microphone 20. The configurations of microphones 21 and 22 are the same as those of microphone 20. The following explanation will use the configuration of microphone 20 as an example, and the explanations of the configurations of microphones 21 and 22 will be omitted.
[0023] As shown in Figure 3, the microphone 20 comprises a microphone unit 200, a user interface 201, a communication interface 202, flash memory 203, RAM 204, a processor 205, and a display 206. The processor 205 is, for example, a CPU. The display 206 is, for example, an LED (Light Emitting Diode).
[0024] The microphone unit 200 converts sound into an electrical signal, which is an audio signal. In the example shown in Figure 1, the microphone unit 200 acquires the voice of speaker U20 and converts the acquired voice of speaker U20 into an audio signal. The microphone unit 200 outputs the audio signal obtained by the conversion to the communication interface 202.
[0025] The user interface 201 receives a mute-on or mute-off command for the microphone 20 from the speaker U20. The user interface 201 is, for example, a toggle button. The speaker U20 switches the microphone 20 on or off by operating the toggle button.
[0026] The communication interface 202 communicates with the management device 10 via a signal line such as a LAN cable. The communication interface 202 transmits the sound signal acquired by the microphone unit 200 to the management device 10. When the user interface 201 receives a mute-on operation, the communication interface 202 does not transmit the sound signal to the management device 10. When the user interface 201 receives a mute-off operation, the communication interface 202 transmits the sound signal to the management device 10.
[0027] Alternatively, the management device 10 may implement the mute-on function by not outputting the sound signals received from microphones 20, 21, and 22 that have received the mute-on operation to the PC 30.
[0028] The flash memory 203 stores various programs. These various programs include programs for operating the microphone 20. Programs for operating the microphone 20 include programs related to communication between the management device 10 and the microphone 20, or programs related to the display of the display unit 206.
[0029] The processor 205 executes various operations by reading programs stored in the flash memory 203 into the RAM 204.
[0030] In this embodiment, the display unit 206 is composed of three LEDs, for example, a green LED, an orange LED, and a red LED. The display unit 206 lights up the green LED, orange LED, or red LED based on the control of the processor 205. Specifically, the processor 205 receives a command from the processor 105 to turn on or off one of the green LED, orange LED, or red LED. The processor 205 controls the lighting or turning off of the green LED, orange LED, or red LED based on the command received from the processor 105.
[0031] When the processor 105 receives a mute-on or mute-off operation from the microphones 20, 21, or 22, it executes a process (hereinafter referred to as process P) that changes the display on the indicator 206 of the microphones 20, 21, or 22. Process P will be described in detail below with reference to the figures. Figure 4 is a flowchart showing an example of the process of the processor 105 when it receives a mute-on operation from at least one microphone. Figure 5 is a flowchart showing an example of the process of the processor 105 when it receives a mute-off operation from at least one microphone.
[0032] The processor 105 starts process P, for example, when the power to the management device 10 is turned on (Figure 4 or Figure 5: START).
[0033] After the start of process P (Figure 4: START), the processor 105 determines whether or not a mute-on operation has been received by at least one of the microphones 20, 21, and 22 (Figure 4: Step S11). For example, the user interface 201 of microphone 20 receives a mute-on operation from speaker U20. At this time, the processor 205 of microphone 20 sends a signal to the processor 105 indicating that a mute-on operation has been received by microphone 20. When the processor 105 receives this signal, it determines that a mute-on operation has been received by microphone 20. At this time, the processor 105 updates the information related to microphone 20 in the status data to, for example, "Microphone 20: Mute On".
[0034] In step S11, if the processor 105 determines that it has received a mute-on operation from at least one of the microphones 20, 21, and 22 (Figure 4: Step S11 Yes), it determines whether all of the microphones 20, 21, and 22 are in the mute-on state or not (Figure 4: Step S12). The processor 105 determines whether all of the microphones 20, 21, and 22 are in the mute-on state or the mute-off state by referring to the state data stored in the flash memory 103.
[0035] If the processor 105 determines that all microphones 20, 21, and 22 are muted (Figure 4: Step S12 Yes), it outputs a command to display all the states of microphones 20, 21, and 22 as the third state on the display unit 206 (Figure 4: Step S13).
[0036] For example, in Figure 1, when microphone 20 is muted off and microphones 21 and 22 are muted on, microphone 20 accepts a mute-on operation. In this case, all microphones 20, 21, and 22 are muted on. Processor 105 outputs a command to microphone 20 to display the state of microphone 20 as the third state. In this embodiment, processor 105 outputs a command to light up the red LED of microphone 20 as the third state. The processor 205 of microphone 20 lights up the red LED based on this command. Similarly, processor 105 outputs commands to microphones 21 and 22 to display the state of microphones 21 and 22 as the third state. The processors 205 of microphones 21 and 22 light up the red LEDs based on these commands.
[0037] In step S12, if the processor 105 determines that at least one microphone is in the mute-off state (Figure 4: step S12 No), it outputs a command to display the state of the microphone that has received the mute-on operation as the second state on the display unit 206 (Figure 4: step S14).
[0038] For example, in Figure 1, when microphones 20 and 21 are muted off, and microphone 22 is muted on, microphone 20 accepts a mute-on operation. In this case, microphone 21 is muted off. Therefore, the processor 105 outputs a command to microphone 20 to display the state of microphone 20 as the second state. In this embodiment, the processor 105 outputs a command to light up the orange LED of microphone 20 as the second state. The processor 205 of microphone 20 lights up the orange LED based on this command.
[0039] Processor 105 terminates process P when it determines that it has not received a mute-on operation from at least one microphone (Figure 4: Step S11 No), the process in step S13, or the process in step S14 (Figure 4: END).
[0040] Furthermore, after the start of process P (Figure 5: START), the processor 105 determines whether or not a mute-off operation has been received by at least one microphone (Figure 5: Step S21). For example, if the processor 105 receives a mute-off operation at the user interface 201 of the microphone 20, it determines that the mute-off operation has been received by the microphone 20.
[0041] If the processor 105 determines that it has received a mute-off operation from at least one microphone (Figure 5: step S21 Yes), it outputs a command to display the state of the microphone that received the mute-off operation as the first state on the display unit 206 (Figure 5: step S22).
[0042] For example, microphone 20 accepts a mute-off operation. Processor 105 outputs a command to microphone 20 to display the state of microphone 20 as a first state. In this embodiment, processor 105 outputs a command to light up the green LED of microphone 20 as the first state. Based on this command, the processor 205 of microphone 20 lights up the green LED.
[0043] After step S22, the processor 105 determines whether any of the microphones 20, 21, or 22 are in the muted-on state by referring to the state data stored in the flash memory 103 (Figure 5: step S23).
[0044] In step S23, if the processor 105 determines that there is a microphone that is muted on among microphones 20, 21, and 22 (Figure 5: Step S23 Yes), it outputs a command to the muted microphone to display the state of the muted microphone as the second state (Figure 5: Step S24).
[0045] For example, in Figure 1, when microphones 20, 21, and 22 are all muted, microphone 20 accepts a mute-off operation. In this case, microphones 21 and 22 are muted. Therefore, the processor 105 outputs a command to microphones 21 and 22 to display the state of microphones 21 and 22 as the second state on the display 206 of microphones 21 and 22. The processor 205 of microphones 21 and 22 lights up the orange LED based on this command.
[0046] Processor 105 terminates process P when it determines that at least one microphone is not accepting a mute-off operation (Figure 5: Step S21 No), determines that there are no microphones in the mute-on state (Figure 5: Step S23 No), or executes the process in step S24 (Figure 5: END).
[0047] Note that the processor 105 does not necessarily have to start process P when the power to the management device 10 is turned on. The processor 105 may start process P, for example, when it receives an operation to start the execution of an application program related to process P. In this case, the management device 10 has, for example, a button or the like as a user interface 201 that accepts the start of process P.
[0048] As a result of the process P described above, microphones 20, 21, and 22 transition to the first, second, and third states, respectively. The state transitions in microphones 20, 21, and 22 will be explained below with reference to the diagram. Figure 6 shows the state transitions of microphone 20. The state transitions of microphones 21 and 22 are the same as those of microphone 20. The state transitions of microphone 20 will be explained below as an example, and the explanation of the state transitions of microphones 21 and 22 will be omitted.
[0049] As shown in Figure 6, the microphone 20 (first microphone), which is shown as the first state, transitions to the second or third state.
[0050] When a mute-on operation is received for microphone 20, which is displayed as the first state, if at least one of microphones 21 and 22 is in the mute-off state (i.e., condition Tr1 shown in Figure 6 is satisfied), the display for microphone 20 transitions from the first state to the second state.
[0051] When a mute-on operation is received for microphone 20, which is displayed as the first state, and all microphones 20, 21, and 22 are in the mute-on state (i.e., condition Tr2 shown in Figure 6 is satisfied), the display for microphone 20 transitions from the first state to the third state.
[0052] As shown in Figure 6, the microphone 20 (second microphone), which is shown as the second state, transitions to either the first or third state.
[0053] When a mute-off operation is received for microphone 20, which is displayed as the second state (when condition Tr3 shown in Figure 6 is met), the display for microphone 20 transitions from the second state to the first state.
[0054] When all microphones 20, 21, and 22 are muted (i.e., when condition Tr4 shown in Figure 6 is met), the display for microphone 20, which is shown as the second state, transitions from the second state to the third state.
[0055] As shown in Figure 6, the microphone 20 (third microphone), which is shown as the third state, transitions to either the first or second state.
[0056] When a mute-off operation is received by microphone 20, which is displayed as the third state (when condition Tr5 shown in Figure 6 is met), the display for microphone 20 transitions from the third state to the first state.
[0057] If at least one of the microphones 20, 21, and 22 (microphone 21 or microphone 22), other than microphone 20, is muted off (i.e., condition Tr6 shown in Figure 6 is met), the display for microphone 20 transitions from the third state to the second state.
[0058] The display unit 206 does not necessarily have to be composed of green, orange, and red LEDs; it may be composed of LEDs of colors other than green, orange, and red.
[0059] The display unit 206 may consist of a single LED that changes color. For example, the single LED may change to one of the following colors: green, orange, or red. The processor 105 outputs an instruction to the processor 205 to change the color of the single LED.
[0060] In this embodiment, instead of displaying the LEDs in different colors, the processor 205 may display one LED at a different blinking speed for each of the first, second, and third states. For example, the processor 105 keeps the LED constantly lit when the microphone 20 is in the first state. For example, the processor 205 blinks the LED at an interval of once per second when the microphone 20 is in the second state. For example, the processor 205 lights the LED at a faster rate than in the second state (for example, at an interval of once every 0.5 seconds) when the microphone 20 is in the third state. This allows the speaker U20 to recognize the state of the microphone 20 regardless of color.
[0061] Note that the display unit 206 does not necessarily have to be an LED. The display unit 206 may be a screen such as an organic EL display. In this case, the display unit 206 will display a text message indicating the status of the microphone 20 (for example, a text message such as "Microphone 20 is in state 1"). This will allow the speaker U20 to recognize the status of the microphone 20 regardless of color.
[0062] (Effects of the first embodiment) According to the management device 10, for example, it is possible to prevent speaker U20 from mistakenly believing that their voice cannot be heard by the other party because microphone 20 is muted. For example, speaker U20 mutes microphone 20. At this time, if at least one of microphones 21 and 22 is muted off, the management device 10 displays the status of microphone 20 as a second status on the display 206 of microphone 20. By looking at the display 206 of microphone 20, speaker U20 can know that their voice may be heard by the other party because either microphone 21 or 22 is muted off. In other words, speaker U20 does not mistakenly believe that their voice cannot be heard by the other party. As a result, speaker U20 can enjoy a smooth customer experience by not inadvertently having conversations that they do not want the other party to hear.
[0063] (Variation 1) The following describes the management device 10a and the processor 105a (not shown) provided in the management device 10a according to Modification 1, with reference to the figures. Figure 7 is a flowchart showing an example of the processing of the processor 105a provided in the management device 10a according to Modification 1. Note that the configuration of the management device 10a other than the processor 105a is the same as the configuration of the management device 10, so the illustration of the management device 10a is omitted.
[0064] The management device 10a differs from the management device 10 in that it performs a process (hereinafter referred to as process Q) to determine whether or not the sound acquired by one microphone is being picked up by another microphone. The management device 10a starts process Q, for example, when the power of the management device 10a is turned on, or when an operation to start the execution of the application program related to process Q is received (Figure 7: START).
[0065] After the start of process Q, processor 105a determines whether all microphones are muted or not (Figure 7: step S31).
[0066] If the processor 105a determines that at least one microphone is muted off (Figure 7: Step S31 No), it compares the sound signal acquired by the microphone that is muted on (hereinafter referred to as the first sound signal) with the sound signal acquired by the microphone that is muted off (hereinafter referred to as the second sound signal) (Figure 7: Step S33). Based on the result of this comparison, the processor 105a determines whether the second sound signal contains the sound of the sound source included in the first sound signal (Figure 7: Step S34).
[0067] For example, microphone 20 acquires the voice of speaker U20. In this case, speaker U20's voice may ripple through to microphone 21, which is located in the same space, and be acquired by microphone 21. In this case, the second tone signal acquired by microphone 21 contains the voice of speaker U20 that was included in the first tone signal acquired by microphone 20. At this time, processor 105a determines that "the second tone signal contains the sound of the sound source included in the first tone signal." Processor 105a then determines whether or not voice ripple is occurring in each of the microphones that are muted off.
[0068] In this modified example, the processor 105a performs the comparison based on the cross-correlation between the first sound signal and the second sound signal. Specifically, the processor 105a calculates the peak value of the cross-correlation between the first sound signal and the second sound signal. If the peak value is high (i.e., the peak value is above a predetermined threshold), the processor 105a determines that the second sound signal contains the sound of the sound source included in the first sound signal.
[0069] If processor 105a determines that "the second tone signal contains the sound of the sound source included in the first tone signal" (Figure 7: step S34 Yes), it outputs a command to display the state of the microphone that has received the mute-on operation as the second state on the display unit 206 (Figure 7: step S35). For example, if the second tone signal acquired by microphone 21 or microphone 22 contains the voice of speaker U20 included in the first tone signal acquired by microphone 20, then speaker U20's voice will be heard by the other party via microphone 21 or microphone 22. Therefore, processor 105a displays the state of microphone 20 as the second state on the display unit 206 of microphone 20. By looking at the display of microphone 20, speaker U20 can know in advance (before having a conversation that they do not want the other party to hear) that their voice is being picked up by microphone 21 or microphone 22. This allows speakers under 20 to enjoy a smoother conversation experience without inadvertently having conversations they don't want the other party to overhear.
[0070] If processor 105a determines that "the second tone signal does not contain the sound of the sound source included in the first tone signal" (Figure 7: step S34 No), it outputs a command to display the state of the microphone that has received the mute-on operation as the third state on the display unit 206, even if at least one of the multiple microphones 20, 21, 22 is muted off (Figure 7: step S36).
[0071] For example, if the second tone signal acquired by microphones 21 and 22 does not include the voice of speaker U20 that was included in the first tone signal acquired by microphone 20, then speaker U20's voice is not picked up by microphones 21 and 22. Consequently, speaker U20's voice is not heard by the other party through microphones 21 and 22. Therefore, processor 105a displays the state of microphone 20 as a third state on the display 206 of microphone 20. By looking at the display on microphone 20, speaker U20 can easily determine whether or not their conversation is being heard by the other party, and as a result, enjoy a smoother conversation experience.
[0072] In step S31, if the processor 105a determines that all microphones are muted (Figure 7: Step S31 Yes), it outputs a command to display the status of all microphones as the third state on the display unit 206 (Figure 7: Step S32).
[0073] Processor 105a terminates process P when it has executed the process in step S32, step S35, or step S36 (Figure 7: END).
[0074] The processor 105a may execute process Q repeatedly. In this case, the processor 105a terminates process Q, for example, when the power to the management device 10a is turned off, or when it receives an operation to terminate the application program related to process Q.
[0075] The processor 105a may execute both process P and process Q in parallel.
[0076] (Modification 2) The control device 10b according to Modification 2 will be described below with reference to the figures. Figure 8 is a block diagram showing the configuration of the control device 10b according to Modification 2. In the control device 10b, components that are the same as those in the control device 10 are denoted by the same reference numerals and their descriptions are omitted.
[0077] As shown in Figure 8, the management device 10b differs from the management device 10 in that it is equipped with a display unit 106b. The display unit 106b is an LED, similar to the display unit 206 of the microphone 20, for example. The processor 105 of the management device 10b performs a process to change the display on the display unit 106b when it receives a mute-on or mute-off operation on the microphones 20, 21, or 22.
[0078] In the modified example shown, if the management device 10b is equipped with a display unit 106b, each of the microphones 20-22 connected to the management device 10b does not necessarily have to be equipped with a display unit 206.
[0079] Such a control device 10b has the same effect as the control device 10.
[0080] (Variation 3) The control device 10c according to Modification 3 will be described below with reference to the figures. Figure 9 shows an example of the processing of the control device 10c according to Modification 3. Figure 10 shows an example of the menu screen MN1 displayed on the LCD 300. Note that the configuration of the control device 10c is the same as that of the control device 10, so the illustration of the control device 10c is omitted.
[0081] The management device 10c differs from the management device 10 in that it displays the status of microphones 20 to 22 on a display such as an LCD (Liquid Crystal Display) or organic EL display provided on the PC 30 (second information processing device). For example, as shown in Figure 9, the management device 10c outputs a command to the PC 30 to display the status of microphones 20 to 22 on the LCD 300 (display) provided on the PC 30. The PC 30 then displays the status of microphones 20 to 22 on the OSD (On Screen Display) based on this command. The OSD is a function that displays a menu screen related to equipment settings on the display. For example, as shown in Figure 9, the PC 30 displays a menu screen MN1 that displays the status of microphones 20 to 22 on the LCD 300 using the OSD. The PC 30 then displays the text message "Microphone 20: Mute ON, Microphone 21: Mute OFF, Microphone 22: Mute ON" on the menu screen MN1. In this modified example, PC30 is an example of an information processing device connected to the management device 10c (microphone status display device).
[0082] Furthermore, PC30 does not necessarily have to indicate the status of microphones 20, 21, and 22 by displaying text messages on the menu screen MN1. For example, PC30 may display images Ca20, Ca21, and Ca22, which are modeled after microphones 20, 21, and 22, respectively, on the menu screen MN1, and indicate the status of microphones 20, 21, and 22 by changing the color of images Ca20, Ca21, and Ca22 (see Figure 10). For example, when microphone 20 is muted off, PC30 changes the color of image Ca20 to green. Speakers U20, U21, and U22 can know that microphone 20 is muted off by recognizing that the color of image Ca20 is green. As a result, speakers U20, U21, and U22 can enjoy the same customer experience as with the management device 10.
[0083] (Effect of Modification 3) The management device 10c displays the status of all microphones (microphones 20, 21, 22) connected to the management device 10c on the menu screen MN1. By looking at the menu screen MN1, speaker U20 can know not only the status of microphone 20 that he is using, but also the status of microphones 21 and 22. Therefore, speaker U20 can determine whether or not there are microphones muted off in his vicinity. Consequently, speaker U20 can enjoy a smooth conversation experience without inadvertently having conversations that they do not want the other party to hear. Similarly, speakers U21 and U22 can also determine whether or not there are microphones muted off in their respective vicinity.
[0084] In this modified example, the PC 30 does not necessarily have to display the status of microphones 20-22. For example, a smartphone with similar functionality to the PC 30 (an example of an information processing device connected to a microphone status display device) may be connected to the management device 10c, and the display on the smartphone may display the status of microphones 20-22.
[0085] (Modification 4) The following describes the management device 10d according to Modification 4. Note that, since the configuration of the management device 10d other than the processor 105d is the same as that of the management device 10, the illustration of the management device 10d is omitted.
[0086] The management device 10d differs from the management device 10 in that it changes the display on the display unit 206 based on the image acquired by the camera (hereinafter referred to as the imaging camera). In this modified example, the imaging camera is connected to the management device 10d.
[0087] The camera acquires images, for example, by photographing the space in which it is located. For example, the camera is placed in a space (such as a conference room) where speaker U20 conducts a remote call. A microphone 20 used by speaker U20 for the call is also placed in that space.
[0088] A processor 105d (not shown) in the management device 10d receives an image from the camera. The processor 105d analyzes the received image to determine whether or not microphones other than microphone 20 are captured in the image. In other words, the processor 105d determines whether or not microphones other than the microphone 20 used by speaker U20 exist in the space where speaker U20 is located. This analysis may be performed by artificial intelligence such as a neural network (e.g., DNN (Deep Neural Network)) or by pattern matching using template data.
[0089] Even if microphones 21 and 22 are muted, if microphones 21 and 22 (microphones other than microphone 20 used by speaker U20) are not present in the space where speaker U20 is located, speaker U20's voice will not be picked up by microphones 21 and 22. Therefore, there is no risk that conversations that speaker U20 does not want the other party to hear will be heard by microphones other than microphone 20. Accordingly, in this modified example, if processor 105d determines that there are no microphones other than microphone 20 in the space where speaker U20 is located, it displays the status of microphone 20 as a third state on display 206. By looking at the display for microphone 20, speaker U20 can know that the other party cannot hear their conversation, and as a result, can enjoy a smooth conversation experience.
[0090] On the other hand, if processor 105d determines that there are microphones other than microphone 20 in the space where speaker U20 is located, it performs the same processing as processor 105 (processing in steps S11 to S14 or steps S21 to S24).
[0091] Alternatively, a camera for capturing images may be connected to the PC 30 instead of the management device 10d. In this case, the management device 10d will display the status of microphones 20, 21, and 22 on the display unit 206 based on the images acquired by the camera connected to the PC 30.
[0092] [Application example 1 of the control device 10d] The following describes application example 1 of the management device 10d. In this application example, the management device 10d performs a process (superimposition) on the image acquired by the camera, overlaying images that show the status of microphones 20, 21, and 22. For example, the camera captures the face of speaker U20 and acquires an image in which speaker U20's face is captured. The management device 10d generates an image (hereinafter referred to as the first image) that associates the state of speaker U20 with the state of microphone 20 by superimposing an image that shows the status of microphone 20 onto the image in which speaker U20's face is captured. Each of the PCs used by speakers U20, U21, and U22 receives the first image from the management device 10d and displays the first image. Speakers U20, U21, and U22 can find out the status of the microphone 20 that speaker U20 is using by looking at the first image displayed on their respective PCs. This allows speakers U20, U21, and U22 to enjoy a smoother conversation experience without inadvertently having conversations they don't want the other party to overhear when the microphone 20 is muted.
[0093] [Application example 2 of the control device 10d] The following describes application example 2 of the control device 10d with reference to the drawings. Figure 11 shows an example of image CA1 acquired by the control device 10d from the camera. Figure 12 shows an example of image CA2 generated by the control device 10d.
[0094] In this application example, the management device 10d acquires an image captured by the camera. Then, by analyzing the acquired image (analysis by artificial intelligence, or pattern matching using template data, etc.), it determines whether or not microphones 20, 21, and 22 are captured in the image. If the management device 10d determines that microphones 20, 21, and 22 are captured in the image, it identifies the portion of the image in which microphones 20, 21, and 22 are captured. Then, the management device 10d generates an image CA2 indicating the state of microphones 20, 21, and 22 by changing the color of the portion of the image in which microphones 20, 21, and 22 are captured according to the state of microphones 20, 21, and 22.
[0095] For example, as shown in Figure 11, the control device 10d receives image CA1 from the camera and processes image CA1. Microphones 20 and 21 are captured in image CA1 shown in Figure 11. Therefore, the control device 10d determines that "microphones 20 and 21 are captured in image CA1." The control device 10d identifies the portion of image CA1 in which microphones 20 and 21 are captured (for example, an area of 100 × 100 pixels).
[0096] For example, when microphone 20 is muted off and microphone 21 is muted on, the management device 10d changes the color of the portion of image CA1 in which microphone 20 is captured to green, and changes the color of the portion of image CA1 in which microphone 21 is captured to orange, thereby generating image CA2 which indicates the status of microphones 20 and 21 (see Figure 12). The management device 10d displays image CA2 on a display device provided in the PC 30 or the like. By looking at image CA2, speakers U20 and U21 can determine whether or not their conversation can be heard by the other party. As a result, speakers U20 and U21 can enjoy the same customer experience as with the management device 10.
[0097] In the example shown in Figure 11, the camera is placed, for example, on a desk in a room. However, the camera does not necessarily have to be placed on a desk in a room. The camera may be placed, for example, on a wall or ceiling in a room.
[0098] The management device 10d may generate a simplified image (hereinafter referred to as the second image) that mimics the room and microphones 20 and 21 based on the image CA1, and display the second image on a display device provided in the PC 30 or the like.
[0099] Furthermore, the management device 10d does not necessarily have to identify the portion of the image where the microphones 20 and 21 are captured by analyzing the image CA1. For example, the flash memory 203 of the management device 10d may store information relating to the location where the microphones 20 and 21 are placed (hereinafter referred to as location information) in advance. The management device 10d may then generate the image CA2 based on the location information.
[0100] The above-described embodiments and modifications should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims, rather than by the embodiments or modifications described above. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope equivalent to the claims.
[0101] The configurations of the control devices 10, 10a to 10d may be combined in any way. [Explanation of symbols]
[0102] 10,10a,10b,10c,10d: Management device 100: First communication interface 101: Second communication interface 102: User Interface 103: Flash memory 104:RAM 105,105a: Processor 20, 21, 22: Microphone 200: Microphone Unit 201: User Interface 202: Communication Interface 203: Flash memory 204:RAM 205: Processor 206:Display unit
Claims
1. Each of the multiple microphones can be muted or muted individually. The state of the microphone that has received the mute-off operation is displayed on the display as the first state. When the mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as the second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the state of the microphone that received the mute-on operation is displayed on the display as the third state. A method for displaying microphone status, The first tone signal acquired by the microphone in the mute-on state and the second tone signal acquired by the microphone in the mute-off state are compared. If the sound of the sound source included in the first sound signal is not included in the second sound signal, even if at least one of the plurality of microphones is in the mute-off state, the state of the microphone that received the mute-on operation will be displayed on the display as the third state. How to display microphone status.
2. The comparison is performed based on the cross-correlation between the first sound signal and the second sound signal. The microphone status display method according to claim 1.
3. Accepts a mute on or mute off operation for each of the multiple microphones, The state of the microphone that has received the mute-off operation is displayed on the display as the first state. When the mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as the second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the state of the microphone that received the mute-on operation is displayed on the display as the third state. A method for displaying microphone status, When the first microphone, which is displayed as the first state, receives the mute-on operation, If at least one of the plurality of microphones is in the mute-off state, the display of the first microphone is transitioned from the first state to the second state. If all of the aforementioned microphones are in the mute-on state, the display of the first microphone is transitioned from the first state to the third state. How to display microphone status.
4. A mute on or mute off operation is received for each of the multiple microphones. The state of the microphone that has received the mute-off operation is displayed on the display as the first state. When the mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as the second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the state of the microphone that received the mute-on operation is displayed on the display as the third state. A method for displaying microphone status, When the second microphone, which is displayed as the second state, receives the mute-off operation, the display of the second microphone is transitioned from the second state to the first state. When all of the aforementioned microphones are in the mute-on state, the display of the second microphone is transitioned from the second state to the third state. How to display microphone status.
5. A mute on or mute off operation is received for each of the multiple microphones. The state of the microphone that has received the mute-off operation is displayed on the display as the first state. When the mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as the second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the state of the microphone that received the mute-on operation is displayed on the display as the third state. A method for displaying microphone status, When the third microphone, which is displayed as the third state, receives a mute-off operation, the display of the third microphone is transitioned from the third state to the first state. If at least one of the plurality of microphones, other than the third microphone, is in the mute-off state, the display of the third microphone is transitioned from the third state to the second state. How to display microphone status.
6. Each of the aforementioned multiple microphones is equipped with the aforementioned display. A method for displaying microphone status according to claim 1 or claim 2.
7. The aforementioned display unit includes an LED, For each of the first, second, and third states, the LED is displayed in a different color or at a different flashing speed. The microphone status display method according to claim 6.
8. A first information processing device connected to the plurality of microphones or a second information processing device connected to the first information processing device is equipped with the display. A method for displaying microphone status according to claim 1 or claim 2.
9. A microphone status display device connected to multiple microphones, The process of displaying the state of the microphone that has received the mute-off command as the first state on the display unit, When a mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as a second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the process of displaying the state of the microphone that received the mute-on operation as the third state on the display unit, Equipped with a processor that performs the following: The aforementioned processor, The first tone signal acquired by the microphone in the mute-on state and the second tone signal acquired by the microphone in the mute-off state are compared. If the sound of the sound source included in the first sound signal is not included in the second sound signal, even if at least one of the plurality of microphones is in the mute-off state, the state of the microphone that received the mute-on operation will be displayed on the display as the third state. Microphone status display device.
10. The processor performs the comparison based on the cross-correlation between the first sound signal and the second sound signal. The microphone status display device according to claim 9.
11. A microphone status display device connected to a plurality of microphones, The process of displaying the state of the microphone that has received the mute-off command as the first state on the display unit, When a mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as a second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the process of displaying the state of the microphone that received the mute-on operation as the third state on the display unit, Equipped with a processor that performs the following: When the processor receives the mute-on operation on the first microphone which is displayed as the first state, If at least one of the plurality of microphones is in the mute-off state, the display of the first microphone is transitioned from the first state to the second state. If all of the aforementioned microphones are in the mute-on state, the display of the first microphone is transitioned from the first state to the third state. Microphone status display device.
12. A microphone status display device connected to a plurality of microphones, The process of displaying the state of the microphone that has received the mute-off command as the first state on the display unit, When a mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as a second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the process of displaying the state of the microphone that received the mute-on operation as the third state on the display unit, Equipped with a processor that performs the following: The aforementioned processor, When the second microphone, which is displayed as the second state, receives the mute-off operation, the display of the second microphone is transitioned from the second state to the first state. When all of the aforementioned microphones are in the mute-on state, the display of the second microphone is transitioned from the second state to the third state. Microphone status display device.
13. A microphone status display device connected to a plurality of microphones, The process of displaying the state of the microphone that has received the mute-off command as the first state on the display unit, When a mute-on operation is received, if at least one of the multiple microphones is in the mute-off state, the state of the microphone that received the mute-on operation is displayed on the display as a second state. When the mute-on operation is received, if all of the multiple microphones are in the mute-on state, the process of displaying the state of the microphone that received the mute-on operation as the third state on the display unit, Equipped with a processor that performs the following: The aforementioned processor, When the third microphone, which is displayed as the third state, receives a mute-off operation, the display of the third microphone is transitioned from the third state to the first state. If at least one of the plurality of microphones, other than the third microphone, is in the mute-off state, the display of the third microphone is transitioned from the third state to the second state. Microphone status display device.
14. Each of the aforementioned multiple microphones is equipped with the aforementioned display. The microphone status display device according to claim 9 or claim 10.
15. The aforementioned display unit includes an LED, The processor causes the LED to display a different color or a different blinking speed for each of the first, second, and third states. The microphone status display device according to claim 14.
16. The microphone status display device or the information processing device connected to the microphone status display device is equipped with the display device. The microphone status display device according to claim 9 or claim 10.