Communication device, control method, and control program

Abstract

To enable accurate mute control. [Solution] In a muted state, when a user's expression of intent to cancel the mute state is detected as a first event, the mode changes to a cancellation standby mode while remaining in the mute state, and when detection of the user's voice is detected as a second event in the cancellation standby mode, the mode cancels the mute state and transitions to an unmute state. Also, in the unmute state, when a non-detection of the user's voice is detected as a third event, the mode changes to a return standby mode while remaining in the unmute state, and when a fourth event is detected in the return standby mode that the user has not spoken for a predetermined period of time, the mode returns to the mute state.

Description

[Technical field]

[0001] The present invention relates to a telephone device equipped with a microphone, a receiver, and a mute control unit that controls whether or not the microphone's audio signal is output as upstream audio, a control method in which a processing device executes mute control in the telephone device, and a control program that causes a processor to execute mute control in the telephone device. [Background technology]

[0002] Communication devices such as headsets and intercoms are equipped with a mute function that prevents the user's unwanted voice from reaching the other party. Such communication devices are usually kept in a muted state, and the mute state is released (unmuted state) when the user presses a PTT (Push To Talk) button when starting a call. However, the operation of pressing the PTT button with a finger is inconvenient, so a technology that allows the mute state to be released hands-free is desired.

[0003] One known technology that can unmute a call in a hands-free manner is a conference system that determines whether or not a user has spoken with the intention of speaking based on the user's voice level and the voice level of the conference partner, and unmutes the call if the user has spoken with the intention of speaking (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2023-13073 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the conventional technology, it may not be possible to perform sufficiently accurate mute control by simply determining whether or not the user has intended to speak based on the voice picked up by the microphone. In other words, there are problems such as the mute state being erroneously released even when the user has not started speaking, or the mute state not being released even when the user starts speaking. occurrence It is conceivable that this could be done.

[0006] SUMMARY OF THE PRESENT DISCLOSURE In view of the above, a main object of the present invention is to provide a communication device, a control method, and a control program capable of performing mute control with high accuracy. [Means for solving the problem]

[0007] The communication device of the present invention is a communication device including a microphone and a receiver, and a mute control unit that controls whether or not to output the audio signal of the microphone as an upstream audio, and when the mute control unit detects, in a mute state, an expression of a user's intention to cancel the mute state as a first event, the mute control unit changes the mute state to a release standby mode while maintaining the mute state, and in the release standby mode, The user's voice was detected Second event As When this is detected, the mute state is cancelled and the state transitions to an unmute state.

[0008] The control method of the present invention is a control method in which a processing device executes mute control in a communication device equipped with a microphone and a receiver, controlling whether or not to output a voice signal of the microphone as an upstream voice, and when a first event is detected in a muted state, an expression of a user's intention to cancel the mute state is detected, and the control method changes to a release standby mode while maintaining the mute state, and in the release standby mode, The user's voice was detected Second event As When this is detected, the mute state is cancelled and the state transitions to an unmute state.

[0009] A control program of the present invention is a control program for causing a processor to execute mute control in a communication device equipped with a microphone and a receiver, which controls whether or not to output a voice signal from the microphone as an upstream voice, and when, in a muted state, a user's expression of intent to cancel the mute state is detected as a first event, the control program changes the state to a release standby mode while remaining in the mute state, and in the release standby mode: The user's voice was detected Second event As When this is detected, the mute state is cancelled and the state transitions to an unmute state. Effect of the Invention

[0010] According to the present invention, when a predetermined second event is detected after a user's expression of intent to unmute is detected as a first event, it is determined that the user has started speaking, and the muted state is unmuted. This makes it possible to perform accurate muting control while avoiding problems such as the muted state being erroneously unmuted even though the user has not started speaking, or the muted state not being unmuted even when the user has started speaking. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a perspective view showing a state in which a communication device according to a first embodiment is used; [Diagram 2] Exploded view of earphones [Diagram 3] FIG. 1 is an explanatory diagram showing an example of a body movement sound detected by a communication device; [Figure 4] FIG. 1 is a block diagram showing a schematic configuration of a main part related to mute control in a communication device; [Diagram 5] Graph showing frequency characteristics of air conduction microphone and bone conduction microphone [Figure 6] A timing diagram showing the state of mute control in a communication device. [Figure 7] A flowchart showing the procedure of processing performed by the mute control unit. [Figure 8] A flowchart showing the procedure of processing performed by the mute control unit. [Figure 9] FIG. 13 is a perspective view showing a state in which a communication device according to a second embodiment is used; [Figure 10] FIG. 11 is a block diagram showing a schematic configuration of a main part related to mute control of a communication device according to a third embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The first invention made to solve the above problems is a communication device including a microphone, a receiver, and a mute control unit that controls whether or not to output the audio signal of the microphone as an upstream audio, and when the mute control unit detects, in a mute state, an expression of a user's intention to cancel the mute state as a first event, the mute control unit changes the mute state to a release standby mode, and in the release standby mode: The user's voice was detected Second event As When this is detected, the mute state is cancelled and the state transitions to an unmute state.

[0013] According to this, when a predetermined second event is detected after the user's expression of intent to unmute is detected as a first event, it is determined that the user has started speaking, and the muted state is unmuted. This makes it possible to perform accurate muting control while avoiding problems such as the muted state being erroneously unmuted even though the user has not started speaking, or the muted state not being unmuted even when the user has started speaking. Moreover, the mute state can be reliably released at the timing when the user starts speaking for a call.

[0016] Also, 2 In the invention, when the mute control unit detects, as a third event, that no user speech is detected in the unmuted state, it changes to a recovery standby mode while maintaining the unmuted state, and when it detects, as a fourth event, that no user speech is detected for a predetermined period of time in the recovery standby mode, it returns to the mute state.

[0017] According to this, if the user stops speaking as the third event, and then the user continues not speaking for a predetermined period of time as the fourth event, it is determined that the user has finished speaking, and the mute state is restored. This allows for accurate mute control, avoiding problems such as the user erroneously returning to the mute state even though the user has not finished speaking, or not returning to the mute state even when the user has finished speaking.

[0018] Also, 3 The invention is configured to include a bone conduction microphone as the microphone and a specific sound detection unit that detects bodily movement sounds contained in the audio signal of the bone conduction microphone, and the mute control unit is configured to detect, as the first event, the detection of a user's bodily movement sound as an indication of the user's intention to cancel mute based on the detection result of the specific sound detection unit.

[0019] This makes it possible to accurately detect the user's physical movement sounds, i.e., sounds generated by the user moving his or her body. Note that physical movement sounds are sounds generated by the user moving his or her body. For example, sounds generated by the user clapping their upper and lower teeth together, or tapping their face (near the ear or on the cheek) are detected as physical movement sounds.

[0020] Also, 4 In the invention, the body movement sound is a sound generated inside the body.

[0021] According to this, when a sound generated inside the body is detected as a physical movement sound, such as the sound generated when the user claps their upper and lower teeth together, the user can express their intention to cancel the mute state in a hands-free manner, further improving convenience for the user.

[0022] Also, 5In the invention, the microphones include a bone conduction microphone and an air conduction microphone, and the mute control unit is configured to output the audio signal of the air conduction microphone as upstream audio in the unmuted state.

[0023] This allows accurate detection of the user's body movement sounds and accurate mute control. Also, a call can be made with clear sounds picked up by the air conduction microphone. Note that the audio signal of the bone conduction microphone may be output as the upstream audio. Also, the audio signal output as the upstream audio may be switched between the air conduction microphone and the bone conduction microphone.

[0024] Also, 6 The invention includes a specific sound detection unit that detects the user's vocalization contained in the audio signal of the bone conduction microphone, and the mute control unit is configured to detect the detection of the user's vocalization as the second event based on the detection result of the specific sound detection unit.

[0025] This allows accurate detection of the user's voice and accurate mute control. In this case, the process of detecting the detection of the user's voice as a second event is performed accurately based on the detection result of the specific sound detection unit. On the other hand, the process of detecting the absence of detection of the user's voice as a third event can also be performed accurately based on the detection result of the specific sound detection unit.

[0026] Also, 7 The invention includes a notification unit that outputs a notification sound from the receiver, and the notification unit is configured to output the notification sound when the first event is detected in the mute control unit, to notify the user that a physical movement sound has been detected and the mode has changed to a release standby mode.

[0027] This allows the user to recognize that a body movement sound has been detected and the mode has changed to the release standby mode.

[0028] Also, 8The invention includes a notification unit that outputs a notification sound from the receiver, and the notification unit is configured to output the notification sound to notify the user that the device has returned from an unmuted state to a muted state when the fourth event is detected in the mute control unit.

[0029] This allows the user to recognize that the state has returned from the unmuted state to the muted state.

[0030] Also, 9 The invention includes a specific sound detection unit that detects abnormal sounds and ambient sounds from the audio signal of the microphone, and the mute control unit is configured to maintain the mute state when it detects an abnormal state based on the detection result of the specific sound detection unit before proceeding to the process of detecting the first event in the mute state.

[0031] According to this, when an abnormal state occurs in which an abnormal sound such as feedback or an abnormally loud ambient sound is included in the audio signal of the microphone, the device is kept in the muted state, thereby avoiding the inconvenience of transitioning to the unmuted state in a state in which normal conversation is not possible. In this case, a notification sound may be output from the receiver to notify the user that an abnormal state has occurred.

[0032] Also, 10 The invention relates to a control method for a communication device having a microphone and a receiver, in which a processing device executes mute control for controlling whether or not to output a voice signal from the microphone as an upstream voice, and when a first event is detected in a muted state, a user's expression of intent to cancel the mute state is detected, and the control method changes the state to a release standby mode while remaining in the mute state, and in the release standby mode, The user's voice was detected Second event As When this is detected, the mute state is cancelled and the state transitions to an unmute state.

[0033] As a result, like the first invention, it is possible to accurately control the mute, avoiding the inconvenience of the mute state being mistakenly released even when the user has not started speaking, or the inconvenience of the mute state not being released even when the user has started speaking.

[0034] Also, 11 The invention relates to a control program for causing a processor to execute mute control for controlling whether or not to output a voice signal from the microphone as an upstream voice in a communication device equipped with a microphone and a receiver, and when a first event is detected in a muted state, the control program changes the state to a release standby mode while remaining in the muted state, and in the release standby mode: The user's voice was detected Second event As When this is detected, the mute state is cancelled and the state transitions to an unmute state.

[0035] As a result, like the first invention, it is possible to accurately control the mute, avoiding the inconvenience of the mute state being mistakenly released even when the user has not started speaking, or the inconvenience of the mute state not being released even when the user has started speaking.

[0036] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0037] (First embodiment) Fig. 1 is a perspective view showing a communication device 1 according to a first embodiment of the present disclosure in use. Fig. 2 is an exploded perspective view of the earphone 2 shown in Fig. 1.

[0038] 1, the communication device 1 includes an earphone 2 and a control box 3. The communication device 1 has functions as a so-called headset, an intercommunication (intercom), and a transceiver.

[0039] The communication device 1 includes a pair of left and right earphones 2, which are attached to the left and right ears of the user. In Fig. 1, an example in which the earphone 2 is attached to the right ear of the user is shown, but the earphone 2 is also attached to the left ear in a symmetrical manner. Note that the communication device 1 may also be configured to include one earphone 2, and the earphone 2 may be attached to only one ear of the user.

[0040] The earphones 2 and the control box 3 are wired and connected via a signal line 4. However, the earphones 2 and the control box 3 may be wirelessly connected using a wireless communication method such as Bluetooth (registered trademark). In addition to a configuration in which both the left and right earphones 2 are wirelessly connected to the control box 3 (fully wireless), a configuration in which the left and right earphones 2 are wired and one earphone 2 is wirelessly connected to the control box 3 is also possible.

[0041] The control box 3 has a function for controlling the earphones 2, a function for communicating with other devices having a calling function, and the like.

[0042] The control box 3 is provided with a PTT button 6. The user can switch between a mute state and an unmute state (a state in which the mute state is released) by operating the PTT button 6. Specifically, the unmute state is maintained when the user continues to press the PTT button 6. Also, the mute state is restored when the user releases the PTT button 6, that is, takes his / her finger off the PTT button 6.

[0043] In this embodiment, the communication device 1 is configured with the earphones 2 and the control box 3, but the function of the control box 3 may be integrated into the earphones 2, and the control box 3 may be omitted. The communication device 1 may also be configured as a head-mounted display or the like.

[0044] As shown in FIG. 2, the earphone 2 includes an exterior housing 9, a bone conduction microphone 10 and an air conduction microphone 11 housed in the exterior housing 9, an air conduction receiver 12, an internal housing 13, and a microphone rubber 15.

[0045] The exterior housing 9 constitutes the outer shell of the earphone 2. The exterior housing 9 includes a case 9A that constitutes the inner part (deeper part) of the user's ear, and a cover 9B that constitutes the outer part of the user's ear. The exterior housing 9 is constituted by overlapping the cover 9B on the case 9A from the outside. The exterior housing 9 is provided with a cable cap 18 for leading the signal line 4 to the outside.

[0046] The bone-conduction microphone 10 is a device that is provided in the ear of a user so as to mainly pick up vocal cord vibrations transmitted to the vocal cord vibration transmission site, and mainly picks up the voice of a user wearing the earphone 2. The bone-conduction microphone 10 includes an element (e.g., a vibration detection element) for converting sound vibrations into an electric signal. That is, the bone-conduction microphone 10 can pick up sounds such as the user's voice and generate an electric signal. The electric signal generated by the bone-conduction microphone 10 is input to the control box 3 via the signal line 4. The bone-conduction microphone 10 picks up vocal cord vibrations that propagate within the user's body as sound vibrations, and therefore has the property of being less susceptible to the influence of ambient sounds other than the user's voice.

[0047] The air conduction microphone 11 is a microphone equipped with an element (e.g., a vibration detection element) for converting air vibrations as sound vibrations into an electrical signal. The air conduction microphone 11 picks up the user's voice and ambient sounds generated around the user (in this embodiment, voices of people around the user). The electrical signal generated by the air conduction microphone 11 is input to the control box 3 via the signal line 4. However, the bone conduction microphone 10 and the air conduction microphone 11 are each connected to the control box 3 via different transmission paths that make up the signal line 4.

[0048] The air conduction receiver 12 converts an electrical signal (an example of a call reception signal) input from the control box 3 via the signal line 4 into a sound such as the voice of the other party and outputs the converted sound. The air conduction receiver 12 may be configured with a known speaker. A bone conduction receiver (bone conduction receiver) may be used instead of the air conduction receiver 12. For example, when the control box 3 outputs an electrical signal corresponding to the voice of the other party of the user's call, the air conduction receiver 12 outputs a sound corresponding to the voice of the other party. The sound output by the air conduction receiver 12 is not limited to the voice of the other party of the call, and may include, for example, a hold tone or a notification tone.

[0049] The internal housing 13 is a member for guiding the reproduced sound of the air conduction receiver 12 to the ear canal, and is provided with a passage 13A for guiding the reproduced sound of the air conduction receiver 12 to the ear canal. The air conduction receiver 12 is disposed on one end side of the passage 13A of the internal housing 13.

[0050] At the other end of the passage 13A, a cylindrical tube portion 13B is provided that extends to the outside of the exterior housing 9 through an opening 9C provided in the exterior housing 9 (specifically, the case 9A). In this embodiment, a tip rubber 16 that abuts against the user's ear canal over its entire circumference is provided at the extending end of the tube portion 13B. By having the tip rubber 16 abut against the ear canal over its entire circumference, airtightness of the ear canal is ensured, and the reproduced sound from the air conduction receiver 12 is effectively transmitted to the user.

[0051] The microphone rubber 15 elastically holds the bone-conduction microphone 10. The microphone rubber 15 connects the bone-conduction microphone 10 to a part where vocal cord vibration is transmitted via bones near the ear 5 (hereinafter referred to as vocal cord vibration transmission part). As a result, vocal cord vibration transmitted to the vocal cord vibration transmission part is transmitted to the bone-conduction microphone 10, and the bone-conduction microphone 10 picks up sound by detecting the vocal cord vibration propagating to the bones and skin around the ear via the microphone rubber 15.

[0052] The air conduction microphone 11 is disposed between the exterior housing 9 and the air conduction receiver 12. In order to prevent sound vibrations generated by the air conduction receiver 12 from being transmitted to the air conduction microphone 11, a resin member 17 is provided between the air conduction microphone 11 and the air conduction receiver 12. The air conduction microphone 11 mainly collects the user's voice by transmitting it through the air at the air conduction microphone 11 near the ear.

[0053] Next, a description will be given of body movement sounds detected by the communication device 1. Fig. 3 is an explanatory diagram showing an example of body movement sounds.

[0054] In this embodiment, the user's expression of intent to unmute (unmute request) is detected as the first event for unmuting. Furthermore, in this embodiment, the user's body movement sound, that is, the sound generated by the user moving his / her body, is detected as the user's expression of intent to unmute.

[0055] In the example shown in Fig. 3(A), the user generates a physical movement sound by clapping the upper and lower teeth together. In the example shown in Fig. 3(B), the user generates a physical movement sound by tapping the face (near the ear or cheek) with the fingers. Such physical movement sound is picked up by the bone conduction microphone 10 (see Fig. 2) provided in the earphone 2 and detected by the control box 3 (see Fig. 1).

[0056] The physical movement sounds are not limited to the examples shown in Figs. 3(A) and (B). For example, physical movement sounds generated by the user clicking his / her tongue may be detected. Physical movement sounds generated by the user clapping his / her hands or stamping his / her feet may also be detected. Note that physical movement sounds include sounds generated inside the body, such as the sound generated by clapping teeth, and sounds generated on the outside of the body, such as the sound generated by lightly tapping the face with fingers.

[0057] In this embodiment, the detection of the user's body movement sound as the first event is performed using the bone conduction microphone 10, but the user's body movement itself may be detected as the first event. For example, the user's head shaking movement may be detected as the first event using an acceleration sensor.

[0058] Next, a description will be given of main parts related to mute control in the communication device 1. Fig. 4 is a block diagram showing a schematic configuration of main parts related to mute control.

[0059] The control box 3 of the communication device 1 includes a changeover switch 21, first to third frequency band measurement units 22-24, first to third specific sound detection units 25-27, a mute control unit 28, and a notification unit 29.

[0060] Audio signals from the bone conduction microphone 10 and the air conduction microphone 11 are input to the mute control unit 28 via the changeover switch 21. The audio signal from the bone conduction microphone 10 is input to the first to third frequency band measurement units 22-24. Signals representing the measurement results from the first to third frequency band measurement units 22-24 are input to the first to third specific sound detection units 25-27, respectively. Signals representing the detection results from the first to third specific sound detection units 25-27 are input to the mute control unit 28. An operation signal from the PTT button 6 is input to the mute control unit 28.

[0061] In addition, the control box 3 is provided with a communication unit (not shown) for communicating with other devices equipped with a calling function. The communication unit includes an antenna, a communication circuit, etc., so as to be able to transmit upstream voice (the voice of the user of the calling device 1) and receive downstream voice (the voice of the other party).

[0062] The changeover switch 21 switches between the audio signals of the bone-conduction microphone 10 and the air-conduction microphone 11 that are input to the mute control unit 28. The changeover switch 21 is operated in response to a setting operation by the user.

[0063] The first frequency band measuring unit 22 measures, with respect to the audio signal output from the bone-conduction microphone 10, the power level of a first frequency band corresponding to the body movement sound of the user.

[0064] The second frequency band measuring unit 23 measures, with respect to the audio signal output from the bone-conduction microphone 10, the power level of a second frequency band corresponding to the user's voice.

[0065] The third frequency band measuring unit 24 measures, with respect to the audio signal output from the bone-conduction microphone 10, the power level of a third frequency band corresponding to an ambient sound (environmental sound).

[0066] The first to third frequency band measuring units 22-24 may be configured by a combination of a low pass filter (LPF) and a high pass filter (HPF), or may be configured by a band pass filter (BPF).

[0067] The first specific sound detection unit 25 detects the body movement sound of the user based on the measurement result of the first frequency band measurement unit 22.

[0068] The second specific sound detection unit 26 detects the user's vocalization (vocal cord vibration) based on the measurement result of the second frequency band measurement unit 23. Note that the second specific sound detection unit 26 may also use a VAD (Voice Activity Detection) technology.

[0069] The third specific sound detection unit 27 detects abnormal sounds and ambient sounds based on the measurement results of the third frequency band measurement unit 24.

[0070] The mute control unit 28 switches between a mute state and an unmute state based on the detection results of the first to third specific sound detection units 25-27.

[0071] Specifically, the mode is changed to the release standby mode when the detection of the user's body movement sound as an indication of the user's intention to release the mute is detected as a first event based on the detection result of the first specific sound detection unit 25. Then, in the release standby mode, when the detection of the user's voice is detected as a second event based on the detection result of the second specific sound detection unit 26, it is determined that the user has started speaking, the mute state is released, and the state is transitioned to the unmute state.

[0072] Furthermore, when the absence of user speech is detected as a third event based on the detection result of the second specific sound detection unit 26, the mode is changed to the return standby mode. Then, when the absence of user speech for a predetermined period of time is detected as a fourth event in the return standby mode, it is determined that the user has finished speaking, and the mode is returned to the mute state.

[0073] Furthermore, the mute control unit 28 switches between the mute state and the unmute state based on an operation signal from the PTT button 6. Specifically, the unmute state is maintained when the user continues to press the PTT button 6, and the mute state is restored when the user releases the PTT button 6.

[0074] In the unmuted state, the mute control unit 28 outputs, as an uplink sound, either the sound signal of the bone-conduction microphone 10 or the sound signal of the air-conduction microphone 11. The sound signal input to the mute control unit 28 is switched by the changeover switch 21.

[0075] The notification unit 29 outputs a notification sound from the air conduction receiver 12 when a predetermined notification event occurs based on information from the mute control unit 28. Specifically, when the user's body movement sound is detected and the mode transitions to the release standby mode, the notification sound notifies the user of the fact. Also, when the state where the user's voice is not detected continues for a predetermined period of time and the mute state is restored, the notification sound notifies the user of the fact. Also, when an abnormal state is detected, the notification sound notifies the user of the fact. The notification sound may be a sound effect (warning sound) or a voice message informing the user of the content of the notification event.

[0076] The changeover switch 21, the first to third frequency band measuring units 22-24, the first to third specific sound detecting units 25-27, the mute control unit 28, and the notification unit 29 may be realized by having a processor (CPU) execute a software program, or may be realized by appropriately combining various processing devices such as a programmable logic device and an analog device in addition to the processor.

[0077] In addition, in the example shown in FIG. 4, the control box 3 is provided with a changeover switch 21, first to third frequency band measurement units 22-24, first to third specific sound detection units 25-27, a mute control unit 28, and a notification unit 29, but all or some of these may be provided in the earphones 2.

[0078] In this embodiment, the changeover switch 21 switches between the audio signals of the air conduction microphone 11 and the bone conduction microphone 10 to be input to the mute control unit 28, but the changeover switch 21 may be omitted. For example, the audio signal of the bone conduction microphone 10 may be input to the first to third frequency band measurement units 22-24 and used for mute control, and the audio signal of the air conduction microphone 11 may be input to the mute control unit 28 and output as upstream audio.

[0079] Next, a description will be given of the processes performed by the first to third frequency band measuring units 22-24 and the first to third specific sound detecting units 25-27. Fig. 5 is a graph showing the frequency characteristics of the bone-conduction microphone 10 and the air-conduction microphone 11.

[0080] As shown in FIG. 5(A), with the air conduction microphone 11, differences appear in the low frequency band between the ambient sound and the user's body movement sounds and vocalizations (vocal cord vibration), but across the entire frequency range, no significant differences appear between the ambient sound, the user's body movement sounds, and the user's vocalizations.

[0081] 5(B), there is a large difference between the ambient sound, the user's body movement sound, and the user's voice depending on the frequency band in the bone-conduction microphone 10. Therefore, by measuring the power levels of the frequency bands corresponding to the user's body movement sound, the user's voice, and the ambient sound, the user's body movement sound, the user's voice, and the ambient sound can be detected separately from other sounds.

[0082] Specifically, in the first frequency band, there is a large difference between the user's body movement sound and the user's voice and surrounding sounds. Therefore, by measuring the power level of the first frequency band in the first frequency band measurement unit 22, the first specific sound detection unit 25 can detect the user's body movement sound separately from the user's voice and surrounding sounds.

[0083] Furthermore, in the second frequency band, a large difference appears between the user's vocalization (vocal cord vibration) and the surrounding sounds. Therefore, by measuring the power level of the second frequency band in the second frequency band measurement unit 23, the user's vocalization can be distinguished from the surrounding sounds and detected in the second specific sound detection unit 26. Note that, in the second frequency band, since there is no large difference between the user's body movement sounds and the user's vocalization, it is difficult to distinguish the user's vocalization from the user's body movement sounds.

[0084] In addition, in the third frequency band, there is a relatively large difference between the ambient sound and the user's voice and body movement sound. Therefore, by measuring the power level of the third frequency band in the third frequency band measurement unit 24, the third specific sound detection unit 27 can detect the ambient sound separately from the user's body movement sound and the user's voice.

[0085] Next, a description will be given of the state of mute control in the communication device 1. Fig. 6 is a timing diagram showing the state of mute control in the communication device 1.

[0086] 6(A) shows the sound pickup state of the bone-conduction microphone 10. The user's voice and surrounding sounds are picked up by the bone-conduction microphone 10. In addition, when the user performs an action that generates a body movement sound, such as clapping the upper and lower teeth together or tapping the face (near the ear or on the cheek) with the fingers (see FIG. 3), the body movement sound is picked up by the bone-conduction microphone 10.

[0087] 6(B) shows a detection state of the user's body movement sound. The first specific sound detection unit 25 detects the user's body movement sound. The mute control unit 28 detects the detection of the user's body movement sound in the muted state as a first event.

[0088] 6(C) shows the output state of the notification sound. In the notification unit 29, when the detection of the user's body movement sound is detected as a first event in the mute control unit 28 and the mute control unit 28 changes to the release standby mode, the notification sound is output. In addition, in the notification unit 29, when the detection of the user's voice not being detected for a predetermined period of time is detected as a fourth event and the mute state is restored, the notification sound is output.

[0089] Fig. 6(D) shows a detection state of the user's voice (vocal cord vibration). The second specific sound detection unit 26 detects the user's voice contained in the audio signal of the bone-conduction microphone 10. The mute control unit 28 detects the detection of the user's voice as a second event. Moreover, the mute control unit 28 detects the absence of the user's voice as a third event.

[0090] Fig. 6(E) shows the state of mute control. In the mute control unit 28, the detection of the user's body movement sound is detected as a first event and the mode is changed to the release standby mode. Then, when the detection of the user's voice is detected as a second event, it is determined that the user has started speaking, and the mode is transitioned to the unmuted state. In addition, when the absence of the user's voice is detected as a third event and the mode is changed to the return standby mode, it is determined that the user has finished speaking, and the mode is returned to the mute state.

[0091] Fig. 6(F) shows the output state of upstream audio (audio that reaches the other party on the call). In the unmuted state, the mute control unit 28 outputs the audio signal of the bone-conduction microphone 10 as upstream audio. The example of Fig. 6(F) is a case where the audio signal of the bone-conduction microphone 10 shown in Fig. 6(A) is input to the mute control unit 28. When the audio signal of the air-conduction microphone 11 is input to the mute control unit 28, the audio signal of the air-conduction microphone 11 is output as upstream audio in the unmuted state.

[0092] Incidentally, when a user operates the PTT button 6 provided on the control box 3, the state is forcibly switched between the mute state and the unmute state regardless of the user's physical movement sounds or vocalizations. That is, when the user presses the PTT button 6, the state transitions to the unmute state, when the user continues to press the PTT button 6, the state is maintained in the mute state, and when the user releases his / her finger from the PTT button 6, the state returns to the mute state.

[0093] In this embodiment, a notification sound is output from the air conduction receiver 12, but instead of or together with the notification sound, an indicator light (not shown) provided on the control box 3 may be turned on.

[0094] As shown in Figure 6, in the mute state, the mode is initially non-standby mode, and changes to release standby mode when the first event is detected. In the unmute state, the mode is initially non-standby mode, and changes to return standby mode when the third event is detected. Here, in the release standby mode and return standby mode, a state transition occurs when only one event is detected. On the other hand, in the non-standby mode, a state transition does not occur when only one event is detected.

[0095] Next, there will be described the procedure of the process performed by the mute control unit 28. Fig. 7 and Fig. 8 are flow charts showing the procedure of the process performed by the mute control unit 28.

[0096] 7, first, the mute control unit 28 sets the mute state (ST101). Next, the mute control unit 28 judges whether or not the user has performed an operation of pressing the PTT button 6 (mute cancellation operation) (ST102). Here, if the user has performed an operation of pressing the PTT button 6 (Yes in ST102), the mute control unit 28 transitions to the unmute state (ST103).

[0097] Next, the mute control unit 28 judges whether or not the user has performed an operation to release the PTT button 6 (mute return operation) (ST104). If the user has performed an operation to release the PTT button 6 (Yes in ST104), the mute control unit 28 returns to the mute state (ST105).

[0098] On the other hand, if the user does not press the PTT button 6 (unmute operation) (No in ST102), the mute control unit 28 then determines whether or not there is an abnormal state based on the detection result of the third specific sound detection unit 27 (ST106). At this time, if an abnormal sound such as howling or an abnormally loud ambient sound is detected, it is determined that there is an abnormal state.

[0099] If an abnormal state exists (Yes in ST106), the mute control unit 28 then causes the notification unit 29 to perform processing to notify the user that an abnormality has occurred (ST107). At this time, for example, a notification sound is output from the air conduction receiver 12.

[0100] On the other hand, if there is no abnormal state (No in ST106), as shown in FIG. 8, the mute control unit 28 then determines whether or not the user's physical movement sound has been detected based on the detection result of the first specific sound detection unit 25 (ST108).

[0101] Here, if the user's body movement sound is detected (Yes in ST108), next, the mute control unit 28 judges whether or not the user's voice has been detected based on the detection result of the second specific sound detection unit 26 (ST109). At this time, the mute control unit 28 causes the notification unit 29 to perform a process of notifying the user that the body movement sound has been detected.

[0102] If the user's voice is not detected (No in ST109), the mute control unit 28 then judges whether the time that has elapsed since the user's body movement sound was detected is equal to or greater than a predetermined threshold (ST110). At this time, the mode changes to the release standby mode, and the judgments in ST109 and ST110 are repeated until the user's voice is detected or the time that has elapsed since the user's body movement sound was detected is equal to or greater than the threshold.

[0103] That is, if the time that has elapsed since the user's body movement sound was detected is equal to or greater than the threshold (Yes in ST110), the process returns to ST101 (see FIG. 7). On the other hand, if the time that has elapsed since the user's body movement sound was detected is less than the threshold (No in ST110), the process returns to ST109.

[0104] On the other hand, if the user's voice is detected (Yes in ST109), the mute control unit 28 cancels the mute state and transitions to the unmute state (ST111).

[0105] Next, the mute control unit 28 determines whether or not the user's voice is detected based on the detection result of the second specific sound detection unit 26 (ST112).

[0106] If the user's voice is not detected (Yes in ST112), the mute control unit 28 then judges whether the duration of the state in which the user's voice is not detected is equal to or longer than a predetermined threshold (ST113). At this time, the mode changes to the recovery standby mode, and the judgments in ST112 and ST113 are repeated until the duration of the state in which the user's voice is not detected is equal to or longer than the threshold.

[0107] That is, if the duration of the state in which the user's voice is not detected is less than the threshold value (No in ST113), the process returns to ST112.

[0108] On the other hand, if the duration of the state in which the user's voice is not detected is equal to or longer than the threshold value (Yes in ST113), the device is returned to the muted state (ST114). At this time, the mute control unit 28 causes the notification unit 29 to perform a process of notifying the user that the device has been returned to the muted state.

[0109] In this embodiment, when the user's body movement sound is detected, the mode changes to the release standby mode, and when the user's voice is detected in this release standby mode, the mute state is released. On the other hand, if the user's voice is not detected even after a predetermined time has passed since the user's body movement sound was detected, it is determined that an operation error has occurred, and the release standby mode returns to the non-standby mode, and the mute state is not released even if the user's voice is detected thereafter. This makes it possible to prevent unnecessary user voice from being transmitted as uplink audio even if an operation error occurs that erroneously detects the user's body movement sound.

[0110] In this embodiment, if the user's voice is not detected, the mode changes to the return standby mode, and if the state where the user's voice is not detected continues for a predetermined time in this return standby mode, the mode returns to the mute state. On the other hand, if the user's voice is detected before the predetermined time has elapsed in the return standby mode, the mode returns from the return standby mode to the non-standby mode. This makes it possible to avoid returning to the mute state immediately when the user's voice is interrupted.

[0111] In addition, in this embodiment, if an abnormal state is detected, the device is forcibly kept in the mute state. That is, if an abnormal sound such as feedback or an abnormally loud ambient sound is included in the audio signal of the bone-conduction microphone 10, the device is kept in the mute state without being released. This makes it possible to avoid the inconvenience of transitioning to the unmute state when normal communication is not possible.

[0112] In the present embodiment, the detection of the user's voice in the release standby mode is detected as the second event, but the second event is not limited to this. For example, the second event may be detected as the time that has elapsed since the user's expression of intent to release the mute state is detected as the first event and is equal to or greater than a predetermined threshold. In this case, if the threshold value of the elapsed time is appropriately set in consideration of the timing at which the user starts speaking after performing an action that generates a body movement sound, the mute control can be performed with high accuracy.

[0113] Second embodiment Next, a second embodiment will be described. Note that the points not mentioned here are the same as those in the above embodiment. Fig. 9 is a perspective view showing a communication device 1 according to the second embodiment in a used state.

[0114] In the first embodiment (see FIG. 1), a control box 3 having functions of controlling and communicating with the earphones 2 is connected to the earphones 2. On the other hand, in the present embodiment, a smartphone 31 is connected to the earphones 2. An application that controls the earphones 2 is installed in the smartphone 31, thereby realizing functions similar to those of the control box 3 in the first embodiment. In addition, the smartphone 31 is provided with a touch panel display 32. An operation screen is displayed on the touch panel display 32.

[0115] In the first embodiment (see FIG. 1), a PTT button 6 (hardware button) that allows a user to forcibly switch between a mute state and an unmute state is provided on the control box 3. Meanwhile, in this embodiment, a microphone icon 33 (software button) having the same function as the PTT button 6 in the first embodiment is displayed on the operation screen of the touch panel display 32.

[0116] The user can forcibly switch between the mute state and the unmute state by performing a predetermined operation (for example, a tap operation) on the microphone icon 33. At this time, the display form of the microphone icon 33 changes depending on whether it is the mute state or the unmute state.

[0117] In this embodiment, similarly to the first embodiment (see FIG. 6), when a first event is detected, the mode changes to release standby mode, and when a third event is detected, the mode changes to return standby mode. At this time, the display form of the microphone icon 33 may change depending on the release standby mode and the return standby mode.

[0118] In the first embodiment (see FIG. 6), a notification sound is output from the air conduction receiver 12 of the earphone 2 to notify the user that the mode has changed to the release standby mode while remaining in the mute state, and to notify the user that the state has returned from the unmute state to the mute state. In the first embodiment, the control box 3 may be provided with an indicator light (not shown) having a notification function similar to that of the notification sound.

[0119] On the other hand, in this embodiment, the user may be notified that the mode has changed to the release standby mode while remaining in the mute state, and may be notified that the mode has returned from the unmute state to the mute state, using a screen displayed on the touch panel display 32 of the smartphone 31. In this case, a screen notifying the user of the mode change or state transition may be displayed together with or instead of the notification sound. Also, a notification screen notifying the user that an abnormality has occurred may be displayed on the touch panel display 32 of the smartphone 31.

[0120] In this embodiment, the smartphone 31 is connected to the earphones 2 in a wired manner via the signal line 4, but the smartphone 31 may be connected to the earphones 2 wirelessly using Bluetooth (registered trademark) or the like. Also, an information terminal other than the smartphone 31, such as a laptop computer or a tablet terminal, may be connected to the earphones 2.

[0121] Third embodiment Next, a third embodiment will be described. Note that the points not mentioned here are the same as those of the above-mentioned embodiment. Fig. 10 is a block diagram showing a schematic configuration of a main part related to mute control of the communication device 1 according to the third embodiment.

[0122] In the first embodiment (see FIG. 4), an air conduction microphone 11 and a bone conduction microphone 10 are provided in the earphone 2, and mute control is performed using the audio signal of the bone conduction microphone 10, and in the unmuted state, the audio signal of either the bone conduction microphone 10 or the air conduction microphone 11 is transmitted as upstream audio.

[0123] On the other hand, in this embodiment, the air conduction microphone 11 of the earphone 2 and the changeover switch 21 of the control box 3 in the first embodiment (see FIG. 4) are omitted. In this embodiment, an audio signal of the bone conduction microphone 10 is input to a mute control unit 28, and in the unmuted state, the audio signal of the bone conduction microphone 10 is transmitted as upstream audio. Also, in this embodiment, as in the first embodiment, mute control is performed using the audio signal of the bone conduction microphone 10.

[0124] In this embodiment, in the mute control that controls whether or not to output the microphone audio signal as upstream audio, the user's expression of intent to cancel the mute state is detected as a first event, and then, when the detection of the user's voice is detected as a second event, the mute state is canceled.

[0125] On the other hand, the control method of this embodiment, i.e., a control method in which a predetermined control is performed on the condition that a first and second event related to a user are detected, can be applied to controls other than mute control. Specifically, the predetermined control may be performed when a user's expression of intent to instruct a predetermined control is detected as a first event, and then the detection of the user's voice or the like is detected as a second event.

[0126] For example, in a communication device equipped with a bone conduction microphone and an air conduction microphone, one of the audio signals from the bone conduction microphone and the air conduction microphone is selected and output as upstream audio, or one of the audio signals from the bone conduction microphone and the air conduction microphone is prioritized and synthesized to output as upstream audio, the control method of this embodiment may be applied when control over microphone selection and audio signal synthesis is performed based on the user's expressed intention.

[0127] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. In addition, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0128] The telephone device, control method, and control program of the present invention have the effect of being able to perform mute control with high precision, and are useful as a telephone device equipped with a microphone and receiver, and a mute control unit that controls whether or not the audio signal from the microphone is output as upstream audio, a control method in which a processing device executes mute control in a telephone device, and a control program that causes a processor to execute mute control in a telephone device. [Explanation of symbols]

[0129] 1:Communication device 2: Earphones 3: Control box 6: PTT button 10: Bone conduction microphone 11: Air conduction microphone 12: Air conduction receiver 21: Changeover switch 22: First frequency band measurement unit 23: Second frequency band measurement unit 24: Third frequency band measurement unit 25: First specific sound detection unit 26: Second specific sound detection unit 27: Third specific sound detector 28: Mute control section 29: Notification Department 31: Smartphone 32: Touch panel display 33: Microphone icon

Claims

1. A communication device including a microphone, a receiver, and a mute control unit that controls whether or not a sound signal of the microphone is output as an upstream sound, The mute control unit is When the device is in a muted state and detects a user's intention to cancel the muted state as a first event, the device remains in the muted state and changes to a waiting mode for cancellation; The communication device is characterized in that, when the detection of a user's voice as a second event is detected in the release standby mode, the communication device releases the mute state and transitions to an unmute state.

2. The mute control unit is When the third event is detected as the absence of the user's voice in the unmuted state, the device remains in the unmuted state and changes to a recovery standby mode; 2. The communication device according to claim 1, wherein, in the recovery standby mode, when a fourth event is detected as a state in which the user does not speak for a predetermined period of time, the communication device returns to the mute state.

3. The microphone includes a bone conduction microphone, a specific sound detection unit that detects a body movement sound included in the audio signal of the bone conduction microphone; The mute control unit is The communication device according to claim 1, characterized in that, based on the detection result of the specific sound detection unit, the detection of a user's physical movement sound as an indication of the user's intention to unmute is detected as the first event.

4. 4. The communication device according to claim 3, wherein the body movement sound is a sound generated inside the body.

5. The microphones include the bone conduction microphone and an air conduction microphone, The mute control unit is 4. The communication device according to claim 3, wherein in the unmuted state, the audio signal of the air conduction microphone is output as an upstream audio.

6. a specific sound detection unit that detects a user's voice included in the audio signal of the bone conduction microphone; The mute control unit is 4. The communication device according to claim 3, wherein detection of a user's voice is detected as the second event based on a detection result of the specific sound detection unit.

7. a notification unit that outputs a notification sound from the receiver; The notification unit is The communication device according to claim 1, characterized in that, when the first event is detected in the mute control unit, the notification sound is output to notify the user that a physical movement sound has been detected and the mode has changed to a release standby mode.

8. a notification unit that outputs a notification sound from the receiver; The notification unit is 3. The communication device according to claim 2, wherein when the fourth event is detected in the mute control unit, the notification sound is output to notify a user that the device has returned from an unmuted state to a muted state.

9. a specific sound detection unit that detects abnormal sounds and ambient sounds from the audio signal of the microphone; The mute control unit is 2. The communication device according to claim 1, wherein, in a mute state, if an abnormal state is detected based on a detection result of the specific sound detection unit before proceeding to a process of detecting the first event, the mute state is maintained.

10. A control method for controlling whether or not a voice signal of a microphone is output as an upstream voice in a communication device having a microphone and a receiver, the method comprising the steps of: When the device is in a muted state and detects a user's intention to cancel the muted state as a first event, the device remains in the muted state and changes to a waiting mode for cancellation; The control method is characterized in that, when a second event is detected in the release standby mode in which a user's voice is detected, the mute state is released and the state transitions to an unmute state.

11. A control program for causing a processor to execute mute control for controlling whether or not a voice signal of the microphone is output as an upstream voice in a communication device having a microphone and a receiver, the control program comprising: When the device is in a muted state and detects a user's intention to cancel the muted state as a first event, the device remains in the muted state and changes to a waiting mode for cancellation; The control program is characterized in that, when a second event is detected in the release standby mode, that is, detection of a user's voice, the control program releases the mute state and transitions to an unmute state.

Images