Call control device, call control method, and program
The call control device manages speaker playback based on microphone use and speech detection to minimize acoustic echo, ensuring high-quality calls by exploiting differential sound attenuation, thus overcoming echo cancellation limitations in noisy environments.
Patent Information
- Application Number
- JP2023077854
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-10
- Publication Date
- 2024-11-21
AI Technical Summary
Acoustic echo cancellation during phone calls is ineffective in noisy environments, particularly when using in-ear microphones, leading to degraded transmission signals and high computational demands.
A call control device determines the state of microphone use or speech to restrict playback from one speaker during microphone usage or speech, and reproduces signals from another speaker when not in use, leveraging differential sound attenuation to reduce echo without echo cancellation processing.
This approach effectively reduces acoustic echo without the need for echo cancellation processing, maintaining high-quality voice calls even in noisy conditions.
Smart Images

Figure 2024162395000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a communication technology, and more particularly to a technology for suppressing acoustic echo. [Background technology]
[0002] In earphones and headphones that have a speaker and a microphone and can be used for phone calls, it is necessary to cancel the sound (acoustic echo) that goes from the speaker to the microphone. Conventionally, the cancellation of the acoustic echo has generally been performed by echo cancellation processing using an echo canceller (see, for example, Non-Patent Document 1, etc.). There is also a method that uses an in-ear microphone to make phone calls in a noisy environment (see, for example, Non-Patent Document 2, etc.). [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] Yoichi Haneda, “:5-1 Acoustic Echo in Communications”, November 2011, Institute of Electronics, Information and Communication Engineers, “Knowledge Base Knowledge Forest 2 Group-6 Chapter-5”, [Retrieved March 20, 2023], Internet<https: / / www.ieice-hbkb.org / files / 02 / 02gun_06hen_05.pdf> [Non-Patent Document 2] “SANYO Nippon Steel Elex launches “eMimikun”, an earphone microphone that “talks with your ears”, [online], December 18, 2007, Nippon Steel Elex, [Retrieved December 8, 2022], Internet<https: / / www.phileweb.com / news / d-av / 200712 / 18 / 19995.html> Summary of the Invention [Problem to be solved by the invention]
[0004] However, when an in-ear microphone is used in a noisy environment, the level (magnitude, for example, amplitude and power) of the acoustic echo picked up by the in-ear microphone is very large, whereas the level of the wearer's voice picked up is small in comparison. Therefore, when echo cancellation processing is performed in such a case, the transmission signal based on the collected voice is significantly degraded. Furthermore, the amount of calculation required for echo cancellation processing is large. Such problems are not limited to cases where earphones or headphones are used, or where an in-ear microphone is used, but are common to cases where echo cancellation processing is performed during phone calls.
[0005] In view of the above, the present invention provides a technique for reducing acoustic echo during a call without performing echo cancellation processing. [Means for solving the problem]
[0006] The call control device determines the use state of the microphone for obtaining a transmission signal, or determines the state of speech based on an acoustic signal collected by the microphone. Furthermore, the call control device limits the reproduction of the first received signal from the first speaker and reproduces the second received signal from the second speaker in a limited section, which is either a time section in which the microphone is used or a time section in which speech is being performed, and reproduces the first received signal from the first speaker and reproduces the second received signal from the second speaker in a non-limited section, which is a time section other than the limited section. Here, the amount of sound attenuation from the sound emission position of the second speaker to the sound reception position of the microphone is greater than the amount of sound attenuation from the sound emission position of the first speaker to the sound reception position of the microphone. Effect of the Invention
[0007] This makes it possible to reduce acoustic echo during a call without performing echo cancellation processing. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating a telephone call system according to an embodiment. [Diagram 2] Fig. 2A is a perspective view illustrating the configuration of a communication device according to an embodiment configured to be worn on one ear (left ear), and Fig. 2B is a perspective view illustrating the configuration of a communication device according to an embodiment configured to be worn on the other ear (right ear). [Diagram 3] FIG. 3 is a block diagram illustrating a functional configuration of the call control device of the embodiment. [Figure 4] Fig. 4 is a diagram illustrating the sensitivity X of a sound signal observed by an external microphone attached to the user's mouth, the sensitivity Y of a sound signal observed by an external microphone attached to the user's ear, and the sensitivity A of a sound signal observed by an in-ear microphone attached to the ear canal or its vicinity. The "sensitivity" of a sound signal means the frequency spectrum of the sound signal normalized by the frequency spectrum of the sound signal of the user observed by an external microphone attached to the user's mouth. The horizontal axis of Fig. 6 represents frequency (Frequency [Hz]), and the vertical axis represents sensitivity (Sensitivity [dB]). [Diagram 5] FIG. 5 is a flow diagram illustrating the determination steps of an embodiment. [Figure 6] FIG. 6 is a see-through view illustrating the configuration of a communication device of an embodiment configured to be worn on the other ear (right ear). [Figure 7] FIG. 7 is a block diagram illustrating a functional configuration of the call control device of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In each embodiment described below, the call control device determines the use state of the microphone for obtaining a transmission signal, or determines the state of speech based on an acoustic signal collected by the microphone. Furthermore, the call control device limits the reproduction of the first received signal from the first speaker and reproduces the second received signal from the second speaker in a limited section, which is either a time section in which the microphone is used or a time section in which speech is being made, and reproduces the first received signal from the first speaker and reproduces the second received signal from the second speaker in a non-limited section, which is a time section other than the limited section. Here, the amount of sound attenuation from the sound emission position of the second speaker (for example, the position of the diaphragm) to the sound receiving position of the microphone is greater than the amount of sound attenuation from the sound emission position of the first speaker to the sound receiving position of the microphone.
[0010] Here, when the microphone is in use or speech is being made, the reproduction of the first speaker is limited, so that sound (acoustic echo) circulating from the first speaker to the microphone can be suppressed. Even in such a case, the second received signal is reproduced from the other second speaker. Note that the amount of sound attenuation between the sound emission position of the second speaker and the sound reception position of the microphone is greater than the amount of sound attenuation between the sound emission position of the first speaker and the sound reception position of the microphone. Therefore, even if the second received signal is being reproduced from the second speaker, the amount of sound circulating from the second speaker to the microphone is small. This makes it possible to reduce acoustic echo during a call without performing echo cancellation processing.
[0011] For example, the first speaker is configured to be worn on one ear (e.g., the left ear), and the second speaker is configured to be worn on the other ear (e.g., the right ear). The first speaker and the second speaker are, for example, speakers such as earphones and headphones. However, this does not limit the present invention. The microphone may be configured to collect an acoustic signal propagated through the air, or may be configured to collect an acoustic signal propagated through the body. The former microphone is, for example, an external microphone configured to be placed outside the ear (outside the ear canal). The latter microphone may be, for example, an in-ear microphone configured to be worn near the ear canal (space connected to the ear canal) or in the ear canal, a throat microphone configured to be worn on the neck, or a bone conduction microphone configured to be worn on a body part such as the head, throat, torso, arm, or hand. In addition, when making a call in a noisy environment, the former microphone collects not only the user's voice but also external noise at a high level, resulting in a decrease in the S / N ratio of the voice. On the other hand, the latter microphone collects the acoustic signal transmitted through the body, so that it can collect the user's voice while suppressing the collection of external noise, and can collect voice with a higher S / N ratio than the former microphone. For example, when an in-ear microphone provided in an earphone or the like is used, the noise that reaches the in-ear microphone is blocked by the earphone or the like and has a low sound pressure, but the voice emitted by the user reaches the in-ear microphone not only through the air but also through the user's body. The sound that travels through the air is blocked by the earphone or the like like the noise and has a low sound pressure, but the sound that travels through the body is not attenuated much. Therefore, the in-ear microphone can collect voice with a high S / N ratio even in a noisy environment. Therefore, when making a call in a noisy environment, the latter microphone is preferable.
[0012] The speech state is determined based on the acoustic signal collected by the microphone. This determination may be performed, for example, using all of the acoustic signal collected by the microphone, or may be performed using the remaining components of the acoustic signal without using some components, or may be performed using a signal obtained by weighting each frequency component of the acoustic signal. For example, high frequency components of a voice transmitted through the body are greatly attenuated. Therefore, when using a microphone configured to collect an acoustic signal transmitted through the body, the speech state may be determined by taking into account the frequency characteristics of such an acoustic signal. This determination may also be performed using the acoustic signal collected by the microphone and other signals. For example, this determination may be performed based on the acoustic signal collected by the microphone and the first received signal. Specific examples of these will be described later.
[0013] In the restricted section, the reproduction of the first received signal from the first speaker is restricted. For example, in the restricted section, the reproduction of the first received signal from the first speaker may be stopped, or the reproduction level of the first received signal from the first speaker (the volume of the reproduced sound, for example, the amplitude or power of the reproduced sound) may be reduced. In addition, the reproduction of the first received signal may be stopped or the reproduction level may be reduced uniformly, for example, in all frequencies. For example, the high frequency components of the sound transmitted through the body are greatly attenuated. Therefore, in the case of using a microphone configured to collect the sound signal transmitted through the body, the reproduction of the first received signal from the first speaker may be stopped or the reproduction level may be reduced in consideration of the frequency characteristics of such sound signals transmitted through the body. Specific examples of these will be described later. In addition, in the restricted section, the second received signal is reproduced from the second speaker. For example, the second speaker reproduces the second received signal without restricting it.
[0014] The amount of sound attenuation between the sound emission position of the second speaker and the sound receiving position of the microphone is greater than the amount of sound attenuation between the sound emission position of the first speaker and the sound receiving position of the microphone. That is, the sound pressure level of the sound (acoustic echo) that goes from the first speaker to the microphone is greater than the sound pressure level of the sound that goes from the second speaker to the microphone. For example, the sound pressure level of the sound that goes from the second speaker to the microphone is negligibly small compared to the sound pressure level of the sound that goes from the first speaker to the microphone. For example, a signal of a certain sound pressure level (sound volume, for example, sound amplitude or power) emitted from the first speaker reaches the microphone, but a signal of the same sound pressure level emitted from the second speaker does not reach the microphone. For example, the distance from the sound emission position of the first speaker to the sound receiving position of the microphone is closer than the distance from the sound emission position of the second speaker to the sound receiving position of the microphone. For example, the sound receiving position of the microphone is near the sound emitting position of the first speaker but is distant from the sound emitting position of the first speaker. For example, the sound receiving position of the microphone faces the same space as the sound emitting position of the first speaker, but the sound receiving position of the microphone and the sound emitting position of the second speaker face different spaces from each other.
[0015] [First embodiment] Next, a first embodiment of the present invention will be described. In the first embodiment, the state of use of the microphone for obtaining a transmission signal is determined, and the time period during which the microphone is used is set as the aforementioned restricted period. In addition, in the first embodiment, an example in which the present invention is implemented in an earphone equipped with a microphone and a speaker will be described as an example. However, this does not limit the present invention.
[0016] <Configuration> As illustrated in FIG. 1, in the call system of this embodiment, I users 1000-i wearing the call system 1-i make a call (voice communication). The call system 1-i includes call devices 11-i and 12-i. However, i=1, 2, ..., I, and I is an integer equal to or greater than 2. FIG. 1 shows an example where I=2, in which two users 1000-1 and 1000-2 wearing the call system 1-1 and the call system 1-2, respectively, make a call. However, this does not limit the present invention, and three or more users may make a call wearing the call system 1-i of this embodiment. Hereinafter, the call systems 1-i are collectively referred to as the call system 1, the call devices 11-i are collectively referred to as the call device 11, the call devices 12-i are collectively referred to as the call device 12, and the users 1000-i are collectively referred to as the user 1000. The reference symbols attached to other names are also collectively referred to as "α-i" as "α".
[0017] <Communication device 11> 2A, the communication device 11 of this embodiment is configured to be worn on one ear 1010 (for example, the left ear) of the user 1000. The communication device 11 of this embodiment has a communication control device 111, a speaker 112 (first speaker), a microphone 113 (in-ear microphone), a microphone 114 (external microphone), a housing 115, and an ear tip 116 (ear piece, ear pad).
[0018] The housing 115 has hollow hollow portions 1151 and 1152 and a tip portion 1153. A sound hole 115a is provided in the wall of the housing 115 on the hollow portion 1151 side. The sound hole 115a is a hole that transmits sound more easily than the wall of the housing 115, and is, for example, a through hole. The diameter of the tip portion 1153 is smaller than the diameter of the hollow portion 1152, and the area of the hollow portion 1152 on the tip portion 1153 side is formed in a tapered shape and is connected to the hollow portion 1152. The end of the tip portion 1153 is an open end 1153a, and the inside of the hollow portion 1152 and the tip portion 1153 are opened to the outside of the open end 1153a through this open end 1153a. An ear tip 116 that surrounds the tip portion 1153 is attached to the outside of the tip portion 1153.
[0019] A call control device 111 is attached inside the hollow portion 1151, and the call control device 111 is electrically connected to a speaker 112 and microphones 113 and 114. In this embodiment, the microphones 113 and 114 are used to obtain a transmission signal for a call. That is, the transmission signal is obtained based on an acoustic signal such as a voice collected by the microphones 113 and 114.
[0020] The speaker 112 is attached between the hollow portion 1151 and the hollow portion 1152. The speaker 112 is disposed so as to emit a reproduced sound of a received signal R1 (first received signal) toward the hollow portion 1152. For example, the sound emission position of the speaker 112 (for example, the position of the diaphragm) faces the hollow portion 1152.
[0021] The microphone 113 is attached, for example, at a position on the hollow portion 1152 side inside the tip portion 1153. The sound receiving position of this microphone 113 faces the same space as the hollow portion 1152. Here, the microphone 113 is configured to collect an acoustic signal (for example, a voice signal of the user 1000) transmitted through the body of the user 1000. However, the sound receiving position of the microphone 113 faces the same space as the sound emission position of the speaker 112, and is also close to the sound emission position of the speaker 112. In other words, the microphone 113 is disposed at a position where not only the acoustic signal transmitted through the body of the user 1000 but also the reproduced sound of the received signal R1 emitted from the speaker 112 can reach it.
[0022] The microphone 114 is disposed inside the hollow portion 1151. The sound receiving position of the microphone 114 is in the vicinity of the sound hole 115a, and the microphone 114 is configured to be able to collect sound outside the housing 115 through the sound hole 115a. In the example of FIG. 2A, the microphone 114 is disposed on the rear side of the speaker 112. That is, the sound receiving position of the microphone 114 does not face the same space as the sound emitting position of the speaker 112. However, the sound receiving position of the microphone 114 is close to the sound emitting position of the speaker 112. Therefore, depending on the sound pressure level of the received signal R1 emitted from the speaker 112, the microphone 114 is disposed at a position where not only the sound outside the housing 115 but also the reproduced sound of the received signal R1 emitted from the speaker 112 can reach the microphone 114.
[0023] The communication device 11 is configured such that the tip 1153 to which the ear tip 116 is attached is inserted into the ear canal 1011 of the ear 1010 with the open end 1153a facing one eardrum 1012 side of the user 1000 (for example, the eardrum of the left ear). As a result, the microphone 113 attached inside the tip 1153 is disposed near the ear canal 1011 or inside the ear canal 1011. Meanwhile, the microphone 114 disposed inside the hollow portion 1151 is disposed outside the ear canal 1011. Also, the speaker 112 is disposed facing the ear canal 1011. That is, the reproduced sound of the received signal R1 is emitted from the speaker 112 toward the ear canal 1011.
[0024] <Communication device 12> 2B, the communication device 12 of this embodiment is configured to be worn on the other ear 1020 (for example, the right ear) of the user 1000. The communication device 12 of this embodiment has a call control device 121, a speaker 122 (second speaker), a housing 125, and an ear tip 126.
[0025] The housing 125 has hollow hollow portions 1251 and 1252 and a tip portion 1253. The diameter of the tip portion 1253 is smaller than the diameter of the hollow portion 1252, and the region of the hollow portion 1252 on the tip portion 1253 side is formed in a tapered shape and is connected to the hollow portion 1252. The end of the tip portion 1253 is an open end 1253a, and the inside of the hollow portion 1252 and the tip portion 1253 are opened to the outside of the open end 1253a through this open end 1253a. An ear tip 126 surrounding the tip portion 1253 is attached to the outside of the tip portion 1253.
[0026] A call control device 121 is attached inside the hollow portion 1251 , and the call control device 121 is electrically connected to a speaker 122 .
[0027] The speaker 122 is attached between the hollow portion 1251 and the hollow portion 1252. The speaker 122 is disposed so as to emit a reproduced sound of the received signal R2 (second received signal) toward the hollow portion 1252. For example, the sound emission position of the speaker 122 (for example, the position of the diaphragm) faces the hollow portion 1252.
[0028] The communication device 12 is configured so that the tip 1253 to which the ear tip 126 is attached is inserted into the external auditory canal 1022 of the other ear 1020 with the open end 1253a facing the other eardrum 1022 of the user 1000 (e.g., the eardrum of the right ear).
[0029] The communication device 11 (FIG. 2A) is worn on one ear 1010 (for example, the left ear) of the user 1000, while the communication device 12 (FIG. 2B) is worn on the other ear 1020 (for example, the right ear) of the user 1000. Therefore, when the communication devices 11 and 12 are worn by the user 1000, the sound receiving positions of the microphones 113 and 114 of the communication device 11 (FIG. 2A) face a space different from the sound emitting position of the speaker 122 of the communication device 12 (FIG. 2B) and are also far from the sound emitting position of the speaker 122. Therefore, the reproduced sound of the received signal R2 emitted from the speaker 122 of the communication device 12 (FIG. 2B) hardly reaches the microphones 113 and 114 of the communication device 11 (FIG. 2A). Therefore, unlike the reproduced sound of the received signal R1 emitted from the speaker 112 of the communication device 11 (FIG. 2A), the reproduced sound of the received signal R2 emitted from the speaker 122 of the communication device 12 (FIG. 2B) hardly causes acoustic echo.
[0030] The amount of sound attenuation between the sound emission position of the speaker 112 (second speaker) of the communication device 12 (FIG. 2B) and the sound receiving positions of the microphones 113 and 114 is greater than the amount of sound attenuation between the sound emission position of the speaker 112 (first speaker) of the communication device 11 (FIG. 2A) and the sound receiving positions of the microphones 113 and 114. Therefore, the sound reproduced from the speaker 122 of the communication device 12 is less likely to cause an acoustic echo than the sound reproduced from the speaker 112 of the communication device 11. In particular, when the sound reproduced from the speaker 122 is hardly observed by the microphones 113 and 114, the sound reproduced from the speaker 122 hardly causes an acoustic echo.
[0031] <Call control device 111, 121> 3, the call control device 111 includes a determination unit 111a, an incoming call control unit 111b, and an outgoing call control unit 111c. The call control device 121 includes an incoming call control unit 121b. The speaker 112 is electrically connected to the incoming call control unit 111b, and the microphones 113 and 114 are electrically connected to the outgoing call control unit 111c. The speaker 122 is electrically connected to the incoming call control unit 121b.
[0032] <Processing> As described above, a user 1000 making a call wears a communication device 11 on one ear 1010 (for example, the left ear) and a communication device 12 on the other ear 1020 (for example, the right ear) (FIGS. 1, 2A, and 2B).
[0033] <Microphone control step> The outgoing-talk control unit 111c (FIG. 3) of the communication device 11 can switch the microphones 113, 114 between the ON state and the OFF state. For example, the outgoing-talk control unit 111c switches the microphones 113, 114 between the ON state and the OFF state based on a signal input based on an operation by the user 1000, a signal input from another device such as a smartphone, or a signal input by other triggers. The ON state of the microphones 113, 114 means that the microphones 113, 114 are in use, and the OFF state of the microphones 113, 114 means that the microphones 113, 114 are not in use. The speech of the user 1000 is collected by the microphones 113, 114 in the ON state, but is not collected by the microphones 113, 114 in the OFF state.
[0034] An acoustic signal (e.g., a voice signal) collected by the microphones 113, 114 in the ON state is sent to the outgoing talk control unit 111c. The outgoing talk control unit 111c obtains and outputs an outgoing talk signal T based on the sent acoustic signal. The outgoing talk signal T is transmitted to another communication system 1 worn by another user 1000. On the other hand, since no sound is collected by the microphones 113, 114 in the OFF state, the outgoing talk signal T is not transmitted either.
[0035] <Judgment step> The determination unit 111a accesses the transmission control unit 111c and determines the use state of the microphones 113 and 114. For example, the determination unit 111a may determine whether the microphones 113 and 114 are in use, may determine whether the microphones 113 and 114 are not in use, or may determine whether the microphones 113 and 114 are in use. The determination unit 111a performs this determination by, for example, software processing, electrical processing, or mechanical processing. For example, the determination unit 111a determines the use state of the microphones 113 and 114 based on the software profile of the transmission control unit 111c, whether the transmission control unit 111c receives signals from the microphones 113 and 114, the state of an electrical or mechanical switch, and the like. For example, the software profile of Bluetooth (registered trademark) includes A2DP (Advanced Audio Distribution Profile) for listening to music and HFP (Hands-Free Profile) for calling. For example, the determination unit 111a determines that the microphones 113 and 114 are in use when HFP is used, and determines that the microphones 113 and 114 are not in use when HFP is not used. Alternatively, the determination unit 111a may determine that the microphones 113 and 114 are in use when HFP is used, and may determine that the microphones 113 and 114 are not in use when A2DP is used. For example, the transmission control unit 111c may observe the levels of the output signals of the microphones 113 and 114, and the determination unit 111a may determine that the microphones 113 and 114 are in use when the levels of the output signals are equal to or higher than a preset threshold, and may determine that the microphones 113 and 114 are not in use when the levels of the output signals are not equal to or higher than a preset threshold. This threshold is set to a value larger than the expected noise level of the microphones 113 and 114. Alternatively, the noise level of the microphones 113 and 114 may be estimated in real time, and the value obtained by multiplying the estimated noise level by a coefficient of 1.0 or more may be set as the threshold.For example, the communication system 1 may be provided with a push-to-talk switch for switching the microphones 113, 114 between an ON state and an OFF state, and the determination unit 111a may determine that the microphones 113, 114 are in use when the push-to-talk switch is in an ON state, and determine that the microphones 113, 114 are not in use when the push-to-talk switch is not in an ON state. Alternatively, the determination unit 111a may determine that the microphones 113, 114 are in use when the push-to-talk switch is in an ON state, and determine that the microphones 113, 114 are not in use when the push-to-talk switch is in an OFF state. The determination result by the determination unit 111a is sent to the call receiving control unit 111b.
[0036] <Receive control step> A transmission signal transmitted from another call system 1 worn by another user 1000 is input as a received call signal R1 (first received call signal) to the received call control unit 111b of the call control device 111 of the call device 11, and is input as a received call signal R2 (second received call signal) to the received call control unit 121b of the call control device 121 of the call device 12. The received call control unit 111b switches whether or not to reproduce the received call signal R1 from the speaker 112 based on the determination result by the determination unit 111a. This will be described in detail below.
[0037] <Processing in restricted areas> The receiving control unit 111b sets the time interval in which the microphones 113 and 114 are used as the limited interval based on the determination result by the determination unit 111a. For example, the receiving control unit 111b sets the time interval in which the microphones 113 and 114 are determined to be used or the time interval in which the microphones 113 and 114 are not determined to be not used as the limited interval. In the limited interval, the receiving control unit 111b does not reproduce the receiving signal R1 from the speaker 112. For example, in the limited interval, the receiving control unit 111b does not supply a signal based on the receiving signal R1 to the speaker 112. Therefore, even if the microphones 113 and 114 are in the ON state, the reproduced sound of the receiving signal R1 is not emitted from the speaker 112, and the reproduced sound of the receiving signal R1 is not picked up by the microphones 113 and 114. On the other hand, the receiving control unit 121b reproduces the receiving signal R2 from the speaker 122 regardless of the judgment result of the judgment unit 111a. The speaker 122 reproduces the receiving signal R2 without restricting it, for example. Even if the receiving signal R1 is not reproduced from the speaker 112 attached to one ear 1010, the user 1000 can hear the reproduction sound of the receiving signal R2 reproduced from the speaker 122 attached to the other ear 1020. In addition, in the restricted section, the sending control unit 111c transmits the sending signal T based on the acoustic signal sent from the microphones 113 and 114 to the other communication system 1 of the call destination. In this case, some components of the sending signal T may be included in the receiving signal R2 transmitted from this other communication system 1. Such a receiving signal R2 is input to the receiving control unit 121b and reproduced from the speaker 122. However, since the speaker 122 is far from the microphones 113 and 114, the reproduced sound of the received signal R2 emitted from the speaker 122 hardly reaches the microphones 113 and 114. Therefore, even if the received signal R2 contains some components of the transmitted signal T, the components are hardly picked up by the microphones 113 and 114.
[0038] <Processing in non-restricted areas> In the non-restricted time interval other than the restricted interval, the receiving control unit 111b reproduces the receiving signal R1 from the speaker 112. For example, the receiving control unit 111b supplies a signal based on the receiving signal R1 to the speaker 112. The speaker 112 reproduces the receiving signal R1, for example, without restricting the receiving signal R1. The receiving control unit 121b also reproduces the receiving signal R2 from the speaker 122. The speaker 122 reproduces the receiving signal R2, for example, without restricting the receiving signal R2. This allows the user 1000 to hear the reproduced sound of the receiving signal R1 with one ear 1010 and the reproduced sound of the receiving signal R2 with the other ear 1020. Note that in the non-restricted interval, the sending control unit 111c does not transmit the sending signal T. Therefore, the receiving signal R1 and the receiving signal R2 do not include the component of the sending signal T.
[0039] <Features of this form> The processing contents of this embodiment are summarized in the table below. [Table 1] In this embodiment, when the microphones 113 and 114 are in the ON state (restricted section), the received signal R1 is not reproduced from the speaker 112 attached to one ear 1010, and the received signal R2 is reproduced from the speaker 122 attached to the other ear 1020. As a result, the reproduced sound of the received signal R1 emitted from the speaker 112 can be prevented from being collected by the microphones 113 and 114. In addition, since the speaker 122 is far from the microphones 113 and 114, the reproduced sound of the received signal R2 emitted from the speaker 122 hardly reaches the microphones 113 and 114. As a result, in this embodiment, the occurrence of acoustic echo can be prevented or suppressed without performing echo cancellation processing. Also, as described above, if echo cancellation processing is performed on the audio signal collected by the microphone 113, which is an in-ear microphone, in a noisy environment, the resulting transmitted signal T is significantly deteriorated. In this embodiment, such a problem does not occur because echo cancellation processing is not performed. This enables high quality voice communication.
[0040] On the other hand, when the microphones 113, 114 are in the OFF state (non-restricted section), the received signal R1 is reproduced from the speaker 112 attached to one ear 1010, and the received signal R2 is reproduced from the speaker 122 attached to the other ear 1020. This allows the user 1000 to hear the reproduced sounds of the received signals R1, R2 with both ears, and enables conversation in a comfortable listening environment.
[0041] [Modification 1 of the first embodiment] In the first embodiment, the received signal R1 is not reproduced at all in the restricted section. However, the level of the received signal R1 in the restricted section may be attenuated to be lower than the level of the received signal R1 in the non-restricted section. This is because, even if the reproduction of the received signal R1 is not completely stopped in the restricted section, the acoustic echo may be suppressed by lowering the level of the reproduced sound of the received signal R1 in the restricted section to be lower than the level of the reproduced sound of the received signal R1 in the non-restricted section.
[0042] [Modification 2 of the First Embodiment] The microphone 113 in this embodiment is an in-ear microphone, and is configured to collect an acoustic signal transmitted through the body. As described above, the high-frequency components of the voice transmitted through the body are greatly attenuated. Therefore, the voice signal collected by the microphone 113 has high-frequency components that are greatly attenuated compared to low-frequency components. FIG. 4 illustrates the sensitivity X of the voice signal observed by a microphone (not shown) attached to the mouth of the user 1000, the sensitivity Y of the voice signal observed by the microphone 114 (external microphone) of the communication device 11 attached to the ear 1010 of the user 1000 as described above, and the sensitivity A of the voice signal observed by the microphone 113 (in-ear microphone) (the microphone 113 attached to the ear canal 1011 of the user 1000 or in its vicinity). Note that the "sensitivity" of the voice signal means the frequency spectrum of the voice signal normalized by the frequency spectrum of the voice signal of the user 1000 observed by the microphone attached to the mouth of the user 1000. The horizontal axis of Fig. 4 represents frequency (Frequency [Hz]), and the vertical axis represents sensitivity (Sensitivity [dB]). As illustrated in Fig. 4, the sensitivity A of the audio signal transmitted through the body of user 1000 and observed by microphone 113 decreases as the frequency increases. On the other hand, the sensitivity Y of the audio signal propagated through the air and observed by microphone 114 remains high even when the frequency increases.
[0043] Therefore, the transmission control unit 111c may generate the transmission signal T by amplifying the high frequency components of the acoustic signal (e.g., a voice signal, etc.) collected by the microphone 113 more than the low frequency components. That is, the high frequency components of the acoustic signal collected by the microphone 113 are attenuated more than the low frequency components. Therefore, the transmission control unit 111c may generate the transmission signal T by amplifying the high frequency components of the acoustic signal collected by the microphone 113 more than the low frequency components. Note that the high frequency is a frequency higher than the low frequency. For example, the transmission control unit 111c may generate the transmission signal T based on B(ω)X(ω) / A(ω) obtained by multiplying the component B(ω) of each frequency ω [Hz] of the acoustic signal collected by the microphone 113 by each ratio X(ω) / A(ω). Here, X(ω) represents the frequency ω component of the sensitivity X, and A(ω) represents the frequency ω component of the sensitivity A. In this case, the sensitivities X and A are set in advance. Alternatively, the transmission control unit 111c may generate the transmission signal T based on B(ω)Y(ω) / A(ω) obtained by multiplying the component B(ω) of each frequency ω [Hz] of the acoustic signal collected by the microphone 113 by each ratio Y(ω) / A(ω). Here, Y(ω) represents the frequency ω component of the sensitivity Y. In this case, the sensitivities A and Y may be set in advance or may be calculated based on the acoustic signals collected by the microphones 113 and 114, respectively. Alternatively, the transmission control unit 111c may generate the transmission signal T by amplifying only the frequency components higher than a certain frequency TH1 among the frequency components of the acoustic signal collected by the microphone 113. Here, the frequency TH1 is, for example, a frequency in the range of 2 kHz to 3 kHz.
[0044] In this way, when the high frequency components of the acoustic signal collected by the microphone 113 are amplified more than the low frequency components to generate the transmission signal T, the high frequency components are more likely to cause acoustic echo than the low frequency components. Therefore, the reception control unit 111b may limit the reproduction of the high frequency components of the reception signal R1 (first reception signal) from the speaker 112 in the limited section more than the reproduction of the low frequency components of the reception signal R1 (first reception signal). This is because, in consideration of the frequency characteristics of the acoustic signal collected by the microphone 113 (acoustic signal transmitted through the body), this may also suppress the acoustic echo in some cases. For example, the reception control unit 111b may limit the reproduction of the low frequency components and the high frequency components of the reception signal R1 in the limited section, but may reproduce the high frequency components by attenuating the level of the high frequency components more than the level of the low frequency components. For example, the reception control unit 111b reduces the level of the low frequency components of the reception signal R1 that are lower than a certain frequency TH2 in the limited section by 1 / β L and the level of the high frequency components above TH2 is set to 1 / β H and reproduced from the speaker 112. L ,β H is a positive real number, and β L >1, β H >1, β H >β L The frequency TH2 may or may not be the same as the frequency TH1. The frequency TH2 is, for example, a frequency in the range of 2 kHz to 3 kHz. Alternatively, for example, the reception control unit 111b may limit the reproduction of high frequency components of the reception signal R1 in the restricted section without limiting the reproduction of low frequency components of the reception signal R1. For example, the reception control unit 111b may limit the reproduction of high frequency components equal to or higher than the frequency TH2 in the restricted section without limiting the reproduction of low frequency components lower than the frequency TH2 in the reception signal R1. For example, the reception control unit 111b may attenuate the level of low frequency components lower than the frequency TH2 in the reception signal R1 in the restricted section, and increase the level of high frequency components equal to or higher than the frequency TH2 by 1 / β H and play it from speaker 112.
[0045] [Third Modification of the First Embodiment] In the first embodiment, the transmission control unit 111c simultaneously switches between the ON state and the OFF state of the microphones 113 and 114. However, the transmission control unit 111c may independently switch between the ON state and the OFF state of the microphone 113 and the ON state and the OFF state of the microphone 114. Also, in the first embodiment, the time period during which the microphones 113 and 114 are used is set as the limited period. However, the time period during which the microphone 113 is used may be set as the limited period, or the time period during which the microphone 114 is used may be set as the limited period.
[0046] The transmission control unit 111c may switch between using the microphone 113 (in-ear microphone) and using the microphone 114 (external microphone) according to the level of external noise. For example, when the level of the acoustic signal observed by the microphone 114 becomes equal to or greater than a threshold TH11 (when the noise is loud), the microphone 114 may be switched to the microphone 113, and when the level of the acoustic signal observed by the microphone 113 becomes smaller than a threshold TH12 (when the noise is quiet), the microphone 113 may be switched to the microphone 114. Note that the threshold TH12 is smaller than the threshold TH11. When the microphone 113 is switched to, the transmission control unit 111c can switch between the ON and OFF states of the microphone 113, but the microphone 114 is always in the OFF state. On the other hand, when the microphone 114 is switched to, the transmission control unit 111c can switch between the ON and OFF states of the microphone 114, but the microphone 113 is always in the OFF state. Here, the microphone 114 is, for example, an external microphone configured to be placed outside the ear, and there are cases where the reproduced sound of the received signal R1 emitted from the speaker 112 does not reach very far. In such a case, even if the reproduced sound of the received signal R1 is emitted from the speaker 112 in a time period in which the microphone 114 is used, acoustic echo is hardly a problem. Therefore, when the noise is small and the microphone 114 is switched to, the microphone 114 may be set as a non-restricted period regardless of whether the microphone 114 is in an ON state or an OFF state. On the other hand, the microphone 113 is, for example, an in-ear microphone configured to be placed inside the ear, and it is easy to collect the reproduced sound of the received signal R1 emitted from the speaker 112. Therefore, when the noise is large and the microphone 113 is switched to, the time period in which the microphone 113 is in an ON state (the time period in which the microphone 113 is used) may be set as a restricted period, and the time period in which the microphone 113 is in an OFF state (the time period in which the microphone 113 is not used) may be set as a non-restricted period. The following table summarizes this process: [Table 2] Also, instead of automatically switching between microphone 113 and microphone 114 depending on the level of external noise, user 1000 may manually switch between using microphone 113 and microphone 114. Here, when switching to microphone 114, the non-restricted section may be set regardless of whether microphone 114 is in the ON state or the OFF state. On the other hand, when switching to microphone 113, the time section in which microphone 113 is in the ON state (the time section in which microphone 113 is being used) may be set as the restricted section, and the time section in which microphone 113 is in the OFF state (the time section in which microphone 113 is not being used) may be set as the non-restricted section.
[0047] In summary, the speaker 112 (first speaker) is configured to be fitted facing the ear canal 1011, and is switchable between setting the microphone 113 (in-ear microphone) configured to be fitted inside the ear canal 1011 as the microphone, or setting the microphone 114 (external microphone) configured to be placed outside the ear canal 1011 as the microphone, and the restricted section is a time section in which the microphone 113 (in-ear microphone) is set as the microphone and the microphone 113 is used, and the unrestricted section may be any other time section.
[0048] [Fourth Modification of the First Embodiment] Either the microphone 113 or the microphone 114 may be omitted. Also, the communication device 12 may be provided with a microphone that is not used to generate a transmission signal (for example, a microphone for active noise canceling (ANC)). Also, the communication device 12 may be provided with a microphone used to generate a transmission signal and an echo canceller for suppressing an acoustic echo based on an acoustic signal collected therein.
[0049] [Fifth Modification of the First Embodiment] In the restricted section, the receiving control unit 121b of the call control device 121 (FIG. 3) may reproduce not only the receiving signal R2 (second receiving signal) but also the receiving signal R1 (first receiving signal) from the speaker 122. For example, the receiving control unit 111b of the call control device 111 may send the receiving signal R1 to the receiving control unit 121b during the restricted section, and the receiving control unit 121b may reproduce the receiving signal R1 and the receiving signal R2 from the speaker 122. As a result, even if the reproduction of the receiving signal R1 by the speaker 112 is restricted in the restricted section, the receiving signal R1 is reproduced from the speaker 122. As a result, even in the restricted section, the user 1000 can hear the reproduced sounds of both the receiving signal R1 and the receiving signal R2. This is particularly effective when the receiving signal R1 and the receiving signal R2 are different, such as a stereo signal.
[0050] [Second embodiment] In the first embodiment, the reproduction of the received signal R1 from the speaker 112 is controlled based on the state of the microphone used to obtain the transmission signal. In contrast, in the second embodiment, the reproduction of the received signal R1 from the speaker 112 is controlled based on the state of the speech based on the acoustic signal collected by the microphone. That is, in this embodiment, the state of the speech is determined based on the acoustic signal collected by the microphones 113 and 114. Also, the time period during which the speech is being performed is set as the restricted period, and the time period other than this restricted period is set as the non-restricted period. In the restricted period, the reproduction of the received signal R1 from the speaker 112 is restricted, but the received signal R2 is reproduced from the speaker 122. For example, the received signal R2 reproduced from the speaker 122 is not restricted. This makes it possible to reduce acoustic echo in a call without performing echo cancellation processing. Also, in the non-restricted period, the received signal R1 is reproduced from the speaker 112, and the received signal R2 is reproduced from the speaker 122. These reproductions are not restricted. Hereinafter, the same reference numbers will be used for items that have already been described, and the description will be simplified.
[0051] <Configuration> As illustrated in FIG. 1, in the communication system of this embodiment, I users 1000-i equipped with a communication system 2-i make a call. The communication system 2-i includes communication devices 21-i and 12-i. Here, i=1, 2, ..., I, and I is an integer of 2 or more. FIG. 1 shows an example where I=2, in which two users 1000-1 and 1000-2 equipped with a communication system 2-1 and a communication system 2-2, respectively, make a call. However, this does not limit the present invention, and three or more users may make a call by wearing the communication system 2-i of this embodiment.
[0052] <Communication device 21> 2A, the communication device 21 of the present embodiment is obtained by replacing the call control device 111 of the communication device 11 of the present embodiment of the first embodiment with a call control device 211. That is, the communication device 21 has the call control device 211, a speaker 112, a microphone 113, a microphone 114, a housing 115, and an ear tip 116.
[0053] <Communication device 12> This is the same as the first embodiment.
[0054] <Call control device 211> 3, the call control device 211 includes a determination unit 211a, a call receiving control unit 211b, and a call transmitting control unit 211c. The speaker 112 is electrically connected to the call receiving control unit 211b, and the microphones 113 and 114 are electrically connected to the call transmitting control unit 211c.
[0055] <Processing> As described above, a user 1000 making a call wears a communication device 21 on one ear 1010 (for example, the left ear) and a communication device 12 on the other ear 1020 (for example, the right ear) (FIGS. 1, 2A, and 2B).
[0056] <Microphone control step> As in the first embodiment, the outgoing talk control unit 211c (FIG. 3) of the communication device 21 can switch between the ON state and the OFF state of the microphones 113, 114. The acoustic signal collected by the microphones 113, 114 in the ON state is sent to the outgoing talk control unit 211c. Based on the determination result of the determination unit 211a described later, the outgoing talk control unit 211c determines whether to obtain and output an outgoing talk signal T based on the sent acoustic signal. The outgoing talk signal T output from the outgoing talk control unit 211c is transmitted to another communication system 2 worn by another user 1000. On the other hand, the microphones 113, 114 in the OFF state do not collect an acoustic signal, and therefore the outgoing talk signal T is not transmitted. A transmission signal transmitted from another call system 2 worn by another user 1000 is input as a received call signal R1 (first received call signal) to the receiving call control unit 211b of the call control device 211 of the call device 21, and is input as a received call signal R2 (second received call signal) to the receiving call control unit 121b of the call control device 121 of the call device 12. The receiving call control unit 211b switches whether or not to play back the received call signal R1 from the speaker 112 based on the determination result of the following determination unit 211a.
[0057] <Judgment step> The determination unit 211a accesses at least the transmission control unit 211c and determines the state of speech based on the acoustic signals collected by the microphones 113 and 114. For example, the determination unit 211a determines the state of speech based on the level of the collected acoustic signals. The determination unit 211a may determine the state of speech based on the acoustic signals collected by either the microphones 113 and 114, or may determine the state of speech based on the acoustic signals collected by both the microphones 113 and 114. The determination unit 211a may further access the reception control unit 211b and further determine the state of speech using the acoustic signal based on the reception signal R1. For example, the determination unit 211a determines the state of speech based on the levels of the collected acoustic signals and the acoustic signal based on the reception signal R1. The determination unit 211a may determine a time period during which speech is being made (speech period), may determine a time period during which speech is not being made (non-speech period), or may determine both a speech period and a non-speech period. In addition, when the microphones 113 and 114 are in the OFF state, no acoustic signal is collected, and therefore it is determined that no speech is being made.
[0058] <An example of a judgment step> In the following, an example will be shown in which the determination unit 211a determines the state of speech based on the acoustic signal collected by the microphone 113 and the acoustic signal based on the received signal R1. However, this is only an example and does not limit the present invention.
[0059] The microphone 113 collects not only an acoustic signal based on the speech of the user 1000, but also an acoustic signal based on the received signal R2 reproduced from the speaker 112. Therefore, the speech state of the user 1000 can be determined more accurately by subtracting the component of the acoustic signal based on the received signal R1 (estimated feedback signal) from the acoustic signal collected by the microphone 113 and then determining the speech state of the user 1000. However, even if the determination is made in this way, it is not always possible to determine the speech state completely accurately. In other words, it may be erroneously determined that no speech is being made (erroneous determination I) when speech is actually being made, or it may be erroneously determined that speech is being made (erroneous determination II) when speech is not actually being made.
[0060] In this embodiment, either a time period in which it is determined that speech is occurring or a time period in which it is not determined that speech is occurring is determined as a restricted period, and the other time periods are determined as non-restricted periods. Therefore, when erroneous determination I occurs, a time period that should be a restricted period ends up being determined as a non-restricted period. In the non-restricted period, the received signal R1 is reproduced from the speaker 112. Therefore, when erroneous determination I occurs, the reproduced sound of the received signal R1 is reproduced from the speaker 112 even though speech is occurring, inducing the generation of an acoustic echo.
[0061] On the other hand, when erroneous determination II occurs, a time period that should be a non-restricted period ends up being a restricted period. In the restricted period, reproduction of the received signal R1 from the speaker 112 is restricted. Therefore, when erroneous determination II occurs, reproduction of the received signal R1 from the speaker 112 is restricted even though no speech is being made. However, even in this case, since the received signal R2 is reproduced from the speaker 122, the occurrence of erroneous determination II does not pose a major problem.
[0062] Therefore, a setting that reduces erroneous determination I is preferable even if the overall determination accuracy decreases. Here, when the previous time interval is a restricted interval (a time interval determined to be speech occurring), there is a high probability that speech is occurring in the current time interval as well. Therefore, a setting that makes it easy to determine that speech is occurring in the current time interval when the previous time interval is a restricted interval is preferable, because this reduces erroneous determination I. Therefore, when the previous time interval is a restricted interval, it is preferable to determine the speech state of user 1000 based on the acoustic signal collected by microphone 113 without taking into account the estimated feedback signal based on received signal R1.
[0063] On the other hand, if the previous time interval is a non-restricted interval (a time interval determined as not having speech), there is a high probability that speech is not being made in the current time interval either. If speech is not being made in the current time interval, erroneous determination I does not occur. This is because erroneous determination I is based on the premise that speech is being made in the current time interval. Although erroneous determination II may occur when speech is not being made in the current time interval, as described above, erroneous determination II is not a major problem. Therefore, when the previous time interval is a non-restricted interval, it is preferable to set the erroneous determination II so as to increase the overall accuracy of determining the speech state. Therefore, when the previous time interval is a non-restricted interval, it is preferable to determine the speech state of the user 1000 by subtracting an estimated feedback signal based on the received signal R1 from the acoustic signal collected by the microphone 113.
[0064] In view of the above, it is preferable that the determination unit 211a performs the following determination. (1) When the previous time interval t-1 is a restricted interval, the judgment unit 211a judges the state of speech based on the signal M(t) based on the acoustic signal collected by the microphone 113, without taking into account the estimated feedback signal W(t) based on the received signal R1 (first received signal). (2) When the previous time interval t-1 is a non-restricted interval, the determining unit 211a determines the speech state based on the estimated transmitted speech signal S(t) obtained by subtracting the estimated feedback signal W(t) from the signal M(t). Here, W(t) represents an estimated leakage signal in the current time interval t (the time interval following the time interval t-1). For example, W(t)=H(t)*R1(t). Here, H(t) is an impulse response from the sound emission position of the speaker 112 to the sound receiving position of the microphone 113, and * represents a convolution operation. In an environment where delay and reflection can be ignored (for example, when the communication device 11 is an earphone), H(t) can be approximated as a real constant H. In this case, W(t) can be approximated as W(t)=H*R1(t) (similarly below). R1(t) represents a received signal R1 in the time interval t. M(t) represents a signal based on an acoustic signal collected by the microphone 113 in the current time interval t. M(t) may be the acoustic signal itself collected by the microphone 113, or may be a function value (for example, a monotonically increasing function value) of the acoustic signal collected by the microphone 113. S(t) represents an estimated speech signal in the current time interval t. For example, S(t)=M(t)-H(t)*R1(t). When the microphone 113 is in the OFF state, no acoustic signal is collected, and it is determined that no speech is being made.
[0065] More specifically, for example, the determining unit 211a performs the following determination. (1) If the previous time interval t-1 is the limit interval When the level of the signal M(t) based on the acoustic signal collected by the microphone 113 in the current time interval t exceeds a reference value Tm (first reference value), the determination unit 211a determines that speech is occurring in the current time interval t, or determines that speech is not occurring, where Tm is a positive real constant. When the level of the signal M(t) based on the acoustic signal collected by the microphone 113 in the current time interval t is equal to or lower than the reference value Tm, the judgment unit 211a judges that no speech is occurring in the current time interval t, or judges that no speech is occurring.
[0066] (2) If the previous time interval t-1 is an unrestricted interval When the level of the estimated transmitted speech signal S(t) exceeds a reference value Ts (second reference value), the determination unit 211a determines that speech is occurring or does not determine that speech is not occurring, where Ts is a positive real constant. When the level of the estimated transmitted speech signal S(t) is equal to or lower than the reference value Ts, the determining unit 211a determines that no speech is being made, or determines that no speech is being made.
[0067] A specific example of this will be described with reference to FIG. 5. The judgment unit 211a judges whether the previous time interval t-1 is a restricted interval or not (step S201). Here, if the previous time interval t-1 is a restricted interval, the process proceeds to step S202. On the other hand, if the previous time interval t-1 is a non-restricted interval, the process proceeds to step S203. Note that if no judgment has been made in the previous time interval t-1, the previous time interval t-1 may be regarded as a restricted interval or as a non-restricted interval. However, in order to reduce erroneous judgment I that causes acoustic echo, it is desirable to regard the previous time interval t-1 as a restricted interval if no judgment has been made in the previous time interval t-1.
[0068] In step S202, the judgment unit 211a judges whether the level of the signal M(t) exceeds a reference value Tm. For example, the judgment unit 211a judges whether |M(t)|>Tm. |M(t)| represents the amplitude of M(t). Here, if the level of the signal M(t) exceeds the reference value Tm (for example, |M(t)|>Tm), the judgment unit 211a does not judge that speech is not occurring in the time interval t, or judges that speech is occurring in the time interval t (step S204). On the other hand, if the level of the signal M(t) is equal to or lower than the reference value Tm (for example, |M(t)|≦Tm), the judgment unit 211a judges that speech is not occurring in the time interval t, or does not judge that speech is occurring in the time interval t (step S205). Thereafter, the judgment unit 211a ends the judgment in the time interval t.
[0069] In step S203, the judgment unit 211a judges whether or not the level of the estimated transmission signal S(t)=M(t)-H(t)*R1(t) exceeds the reference value Ts. For example, the judgment unit 211a judges whether or not |S(t)|>Ts. Here, if the level of the estimated transmission signal S(t) exceeds the reference value Ts (for example, |S(t)|>Ts), the judgment unit 211a judges that no speech is occurring in the time interval t, or judges that speech is occurring in the time interval t (step S204). On the other hand, if the level of the estimated transmission signal S(t) is equal to or lower than the reference value Ts (for example, |S(t)|≦Ts), the judgment unit 211a judges that no speech is occurring in the time interval t, or judges that no speech is occurring in the time interval t (step S205). Thereafter, the judgment unit 211a ends the judgment in the time interval t. In step S202, instead of |M(t)|, Pm(t) obtained by time-smoothing |M(t)| may be used. m is a positive integer greater than or equal to 2.
number
number
[0070] <Receive control step> The reception control unit 211b receives the result of the determination by the determination unit 211a. Based on the result of the determination by the determination unit 211a, the reception control unit 211b switches whether or not to reproduce the reception signal R1 from the speaker 112. This will be described in detail below.
[0071] <Processing in restricted areas> The receiving control unit 211b sets the time period during which speech is being made as the limited section based on the result of the determination by the determination unit 211a. For example, the receiving control unit 211b sets either the time period during which speech is being made or the time period during which speech is not being made as the limited section. The rest is the same as the process in the limited section in the receiving control step of the first embodiment, except that the receiving control unit 111b is replaced by the receiving control unit 211b. That is, in the limited section, the receiving control unit 211b does not reproduce the receiving signal R1 from the speaker 112. On the other hand, the receiving control unit 121b reproduces the receiving signal R2 from the speaker 122.
[0072] <Processing in non-restricted areas> The processing of the non-restricted section, which is a time section other than the restricted section, is the same as the processing of the non-restricted section in the receiving control step of the first embodiment, except that the receiving control section 111b is replaced with the receiving control section 211b. That is, the receiving control section 111b reproduces the receiving signal R1 from the speaker 112. The receiving control section 121b also reproduces the receiving signal R2 from the speaker 122.
[0073] <Transmission control step> The result of the determination made by the determination unit 211a is input to the transmission control unit 211c. Based on the result of the determination made by the determination unit 211a, the transmission control unit 211c switches whether or not to transmit the transmission signal T. This will be described in detail below.
[0074] <Processing in restricted areas> The outgoing-talk control unit 211c also sets the time period during which speech is being made as the restricted section based on the determination result by the determination unit 211a. For example, the outgoing-talk control unit 211c sets the time period during which speech is being made as the restricted section, or the time period during which speech is not being made as the restricted section. In the restricted section, the outgoing-talk control unit 211c obtains and outputs an outgoing-talk signal T based on an acoustic signal sent from the microphones 113 and 114. The outgoing-talk signal T is transmitted to another communication system 2 worn by another user 1000.
[0075] <Processing in non-restricted areas> In the non-restricted time interval other than the restricted interval, the transmission control unit 211c does not output the transmission signal T based on the acoustic signal sent from the microphones 113, 114. This makes it possible to prevent acoustic noise from occurring due to a partial component of the transmission signal T sent to the other communication system 2 in the non-restricted interval returning to the reception control unit 211b as the reception signal R1 and being reproduced from the speaker 112.
[0076] <Features of this form> The processing contents of this embodiment are summarized in the table below. [Table 3] In this embodiment, when speech is being made (restricted section), the received signal R1 is not reproduced from the speaker 112 attached to one ear 1010, and the received signal R2 is reproduced from the speaker 122 attached to the other ear 1020. As a result, the reproduced sound of the received signal R1 emitted from the speaker 112 can be prevented from being collected by the microphones 113 and 114. In addition, since the speaker 122 is far from the microphones 113 and 114, the reproduced sound of the received signal R2 emitted from the speaker 122 hardly reaches the microphones 113 and 114. As a result, in this embodiment, the occurrence of acoustic echo can be prevented or suppressed without performing echo cancellation processing. Also, as described above, if echo cancellation processing is performed on the voice signal collected by the microphone 113, which is an in-ear microphone, in a noisy environment, the resulting transmitted signal T is significantly deteriorated. In this embodiment, such a problem does not occur because echo cancellation processing is not performed.
[0077] On the other hand, when no speech is being made (non-restricted section), the received signal R1 is reproduced from the speaker 112 attached to one ear 1010, and the received signal R2 is reproduced from the speaker 122 attached to the other ear 1020. This allows the user 1000 to hear the reproduced sounds of the received signals R1 and R2 with both ears. At this time, the outgoing-talk control unit 211c does not output the outgoing-talk signal T based on the acoustic signals sent from the microphones 113 and 114. That is, the outgoing-talk control unit 211c transmits the outgoing-talk signal T in the restricted section, but restricts the transmission of the outgoing-talk signal T in the non-restricted section. This makes it possible to prevent acoustic noise from occurring in the non-restricted section.
[0078] <Modification 1 of the second embodiment> In the second embodiment, the received signal R1 is not reproduced at all in the restricted section. However, the level of the received signal R1 in the restricted section may be attenuated to be lower than the level of the received signal R1 in the non-restricted section. This is because, even if the reproduction of the received signal R1 is not completely stopped in the restricted section, the acoustic echo may be suppressed by lowering the level of the reproduced sound of the received signal R1 in the restricted section to be lower than the level of the reproduced sound of the received signal R1 in the non-restricted section.
[0079] <Modification 2 of the second embodiment> As in the second modification of the first embodiment, the transmission control unit 211c may generate the transmission signal T by amplifying the high frequency components of the acoustic signal (e.g., a voice signal, etc.) collected by the microphone 113 more than the low frequency components. In this way, when the transmission signal T is generated by amplifying the high frequency components of the acoustic signal collected by the microphone 113 more than the low frequency components, the high frequency components are more likely to cause acoustic echo than the low frequency components. Therefore, the reception control unit 211b may limit the reproduction of the high frequency components of the reception signal R1 (first reception signal) from the speaker 112 in the restricted section more than the reproduction of the low frequency components of the reception signal R1 (first reception signal). This is because, in consideration of the frequency characteristics of the acoustic signal collected by the microphone 113 (acoustic signal transmitted through the body), this may also suppress the acoustic echo in some cases.
[0080] [Modification 3 of the second embodiment] In the second embodiment, the transmission control unit 211c simultaneously switches between the ON state and the OFF state of the microphones 113 and 114. However, the transmission control unit 211c may independently switch between the ON state and the OFF state of the microphone 113 and switch between the ON state and the OFF state of the microphone 114.
[0081] The outgoing voice control unit 211c may switch between using microphone 113 (in-ear microphone) and microphone 114 (external microphone) depending on the level of external noise. Here, when the noise is loud and switching is made to microphone 113, the time period during which it is determined that speech is occurring may be set as a restricted period, and the time period during which it is determined that speech is not occurring may be set as a non-restricted period. On the other hand, when the noise is quiet and switching is made to microphone 114, the period may be set as a non-restricted period regardless of whether speech is occurring or not.
[0082] Instead of automatically switching between microphone 113 and microphone 114 according to the level of external noise, user 1000 may manually switch between using microphone 113 and microphone 114. In this case as well, when switching to microphone 113, a time period during which it is determined that speech is occurring may be set as a restricted period, and a time period during which it is determined that speech is not occurring may be set as a non-restricted period. On the other hand, when switching to microphone 114, it may be set as a non-restricted period regardless of whether speech is occurring or not.
[0083] In summary, the speaker 112 (first speaker) is configured to be fitted facing the ear canal 1011, and is switchable between setting the microphone 113 (in-ear microphone) configured to be fitted inside the ear canal 1011 as the microphone, or setting the microphone 114 (external microphone) configured to be placed outside the ear canal 1011 as the microphone, and the restricted section is a time section during which the microphone 113 (in-ear microphone) is set as the microphone and speech is determined to be occurring based on the acoustic signal collected by the microphone 113, and the unrestricted section may be any other time section.
[0084] [Variation 4 of the second embodiment] In <an example of a determination step> shown in the second embodiment, the state of speech is determined based on an acoustic signal collected by microphone 113 and an acoustic signal based on received signal R1. However, in <an example of a determination step>, microphone 113 may be replaced with microphone 114, or microphone 113 may be replaced with microphones 113, 114. Also, in <an example of a determination step>, an example is shown in which the previous time interval is time interval t-1, but the previous time interval may be time interval t-γ, where γ is an integer equal to or greater than 1.
[0085] [Fifth Modification of the Second Embodiment] The microphone 113 in this embodiment is an in-ear microphone, and is configured to collect an acoustic signal transmitted through the body. As described above, the high frequency components of the sound transmitted through the body are greatly attenuated. Therefore, the sound signal collected by the microphone 113 has high frequency components that are greatly attenuated compared to low frequency components. Therefore, in the determination step, the determination unit 211a may determine the state of speech by treating low frequency components of the acoustic signal collected by the microphone 113 with priority over high frequency components. This is because the state of speech can be determined more accurately. For example, the determination unit 211a may determine the state of speech as in any of the following cases. Note that the high frequency is higher than the low frequency. (1) The judgment unit 211a may use, instead of the acoustic signal collected by the microphone 113, a signal that contains low frequency components of the acoustic signal collected by the microphone 113 but does not contain high frequency components of the acoustic signal to judge the state of speech. (2) The judgment unit 211a may use, instead of the acoustic signal collected by the microphone 113, a signal obtained by weighting the low frequency components of the acoustic signal collected by the microphone 113 more heavily than the high frequency components to judge the state of speech. (3) Instead of the acoustic signal collected by the microphone 113, the judgment unit 211a may use a signal obtained by suppressing the high frequency components of the acoustic signal collected by the microphone 113 more than the low frequency components to judge the state of speech.
[0086] [Modification 6 of the second embodiment] In one example of the above-mentioned determination step, the determination unit 211a determines the state of speech based on the estimated transmission signal S(t) when the previous time interval t-γ (for example, γ=1) is a non-restricted interval. Here, the estimated transmission signal S(t)=M(t)-H(t)*R1(t) is a signal obtained by subtracting the estimated feedback signal W(t)=H(t)*R1(t) based on the reception signal R1(t) (first reception signal) from the signal M(t) based on the acoustic signal collected by the microphone 113. Here, the audio signal collected by the microphone 113 has high frequency components attenuated more than low frequency components. In such a case, it is preferable to use a signal obtained by suppressing the low frequency components of the estimated feedback signal W(t) more than the high frequency components as the estimated feedback signal, or to use a signal obtained by amplifying the high frequency components of the estimated feedback signal W(t) more than the low frequency components as the estimated feedback signal, instead of W(t)=H(t)*R1(t). This is because the low frequency components of the signal M(t) included in the estimated transmitted signal S(t) are emphasized, and the speech state can be determined more accurately.
[0087] More preferably, a signal obtained by prioritizing low frequency components over high frequency components of the acoustic signal collected by the microphone 113 may be used as the signal M(t) based on the acoustic signal collected by the microphone 113 (Modification 5 of the second embodiment). As exemplified in Modification 5 of the second embodiment, a specific example of a signal obtained by prioritizing low frequency components over high frequency components of the acoustic signal collected by the microphone 113 is as follows: (1) A signal that includes low frequency components of the acoustic signal collected by the microphone 113 but does not include high frequency components of the acoustic signal. (2) A signal obtained by weighting the low frequency components of the acoustic signal collected by the microphone 113 more heavily than the high frequency components. (3) A signal obtained by suppressing the high frequency components of the acoustic signal collected by the microphone 113 more than the low frequency components.
[0088] [Seventh Modification of the Second Embodiment] The judgment unit 211a may access the transmission control unit 111c and the reception control unit 211b, judge the state of speech as described above, and further judge the level (magnitude, for example, amplitude or power) of the reception signal R1 (first reception signal). In this case, the reception control unit 211b may set the time interval during which speech is being made and the level of the reception signal R1 exceeds a reference value TH3 (third reference value) as a limited interval, and set the other time intervals as non-limited intervals, based on the judgment results of the judgment unit 211a. Here, the reference value TH3 is a predetermined real constant. That is, even if speech is being made, when the level of the reception signal R1 reproduced from the speaker 112 is low, the acoustic echo may not be a problem. On the other hand, when speech is being made and the level of the reception signal R1 reproduced from the speaker 112 is high, the problem of acoustic echo becomes serious. Therefore, by setting the time period during which speech is being taken and the level of the received signal R1 exceeds the reference value TH3 as a restricted period, and setting the other time periods as non-restricted periods, it is possible to achieve an appropriate balance between suppressing acoustic echo and creating a comfortable listening environment.
[0089] [Eighth Modification of the Second Embodiment] As in the fifth modified example of the first embodiment, in the restricted section, the receiving control unit 121b of the call control device 121 (FIG. 3) may reproduce not only the receiving signal R2 (second receiving signal) but also the receiving signal R1 (first receiving signal) from the speaker 122. For example, the receiving control unit 211b of the call control device 211 may send the receiving signal R1 to the receiving control unit 121b during the restricted section, and the receiving control unit 121b may reproduce the receiving signal R1 and the receiving signal R2 from the speaker 122. As a result, even if the reproduction of the receiving signal R1 by the speaker 112 is restricted in the restricted section, the receiving signal R1 is reproduced from the speaker 122. As a result, even in the restricted section, the user 1000 can hear the reproduced sounds of both the receiving signal R1 and the receiving signal R2. This is particularly effective when the receiving signal R1 and the receiving signal R2 are different, such as in the case of a stereo signal.
[0090] [Modification 9 of the second embodiment] In the second embodiment, the outgoing talk control unit 211c does not output the outgoing talk signal T based on the acoustic signal sent from the microphones 113 and 114 in the non-restricted section. However, for example, in the non-restricted section, the outgoing talk control unit 211c may transmit an outgoing talk signal with a lowered level of the outgoing talk signal T, or may transmit a signal with a higher frequency attenuated than the lower frequency of the outgoing talk signal T. That is, the outgoing talk control unit 211c may transmit the outgoing talk signal T in the restricted section and limit the transmission of the outgoing talk signal T in the non-restricted section. This is because the acoustic echo based on the outgoing talk signal T can be suppressed. In addition, the outgoing talk control unit 211c may transmit the outgoing talk signal T without limiting it in both the restricted section and the non-restricted section. This is because there are also cases where the acoustic echo based on the outgoing talk signal T does not become a problem. That is, the following processing may be performed. [Table 4]
[0091] [Third embodiment] The microphone and speaker used for active noise canceling (ANC) may be used as the microphone and speaker in the first and second embodiments and their modified examples.
[0092] <Configuration> As illustrated in FIG. 1, in the call system of this embodiment, I users 1000-i equipped with a call system 3-i make a call (voice communication). The call system 3-i includes call devices 31-i, 32-i. Here, i=1, 2, ..., I, and I is an integer equal to or greater than 2. FIG. 1 shows an example where I=2, in which two users 1000-1 and 1000-2 equipped with a call system 3-1 and a call system 3-2, respectively, make a call. However, this does not limit the present invention, and three or more users may make a call equipped with the call system 3-i of this embodiment.
[0093] <Communication device 31> 2A, the communication device 31 of the present embodiment is obtained by replacing the call control device 111 of the communication device 11 of the present embodiment of the first embodiment with a call control device 311. That is, the communication device 31 has the call control device 311, a speaker 112, a microphone 113, a microphone 114, a housing 115, and an ear tip 116.
[0094] <Communication device 32> 6, the communication device 32 of this embodiment is configured to be worn on the ear 1020 of a user 1000. The communication device 32 of this embodiment has a communication control device 321, a speaker 122, a microphone 323 (in-ear microphone), a microphone 324 (external microphone), a housing 325, and an ear tip 126.
[0095] Housing 325 has hollow portions 1251 and 1252 and tip portion 1253. Sound hole 325a is provided in the wall of housing 325 on the hollow portion 1251 side. Sound hole 325a is a hole that transmits sound more easily than the wall of housing 325, and is, for example, a through hole. Call control device 321 is attached inside hollow portion 1251, and call control device 321 is electrically connected to speaker 122 and microphones 323 and 324.
[0096] Microphone 323 is attached, for example, at a position on the hollow portion 1252 side inside tip portion 1253. The sound receiving position of microphone 323 faces the same space as hollow portion 1252. Here, microphone 323 is configured to collect an acoustic signal transmitted through the body of user 1000.
[0097] Microphone 324 is disposed inside hollow portion 1251. The sound receiving position of microphone 324 is in the vicinity of sound hole 325a, and microphone 324 is configured to be able to collect sound from outside housing 325 through sound hole 325a. In the example of FIG. 6, microphone 324 is disposed on the rear side of speaker 122.
[0098] The communication device 32 is configured so that the tip portion 1253 to which the ear tip 126 is attached is inserted into the ear canal 1021 of the ear 1020 with the open end 1253a facing one eardrum 1022 of the user 1000. As a result, the microphone 323 attached inside the tip portion 1253 is disposed near the ear canal 1021 or inside the ear canal 1021. On the other hand, the microphone 324 disposed inside the hollow portion 1251 is disposed outside the ear canal 1021.
[0099] As illustrated in FIG. 7, the call control device 311 includes a determination unit 111c (211a), a receiving control unit 111b (211b), a transmitting control unit 111c (211c), an ANC processing unit 311d, and a synthesis unit 311e. The speaker 112 is electrically connected to the ANC processing unit 311d and the receiving control unit 111b (211b) via the synthesis unit 311e. The microphone 113 is electrically connected to the transmitting control unit 111c (211c) and the ANC processing unit 311d. The microphone 114 is electrically connected to the ANC processing unit 311d.
[0100] The call control device 321 includes an incoming call control unit 121b, an ANC processing unit 321d, and a synthesis unit 321e. The speaker 122 is electrically connected to the incoming call control unit 121b and the ANC processing unit 321d via the synthesis unit 321e. The microphones 323 and 324 are electrically connected to the ANC processing unit 321d.
[0101] <Processing> As described above, the user 1000 who makes a call wears the communication device 31 on one ear 1010 (for example, the left ear) and wears the communication device 32 on the other ear 1020 (for example, the right ear) (FIGS. 1, 2A, and 6). The ANC processing unit 311d generates an output acoustic signal for ANC based on the acoustic signals collected by the microphones 113 and 114, and sends it to the speaker 112. The speaker 112 emits this output acoustic signal. Similarly, the ANC processing unit 321d generates an output acoustic signal for ANC based on the acoustic signals collected by the microphones 323 and 324, and sends it to the speaker 122. The speaker 122 emits this output acoustic signal. Note that a well-known method may be used for ANC. Other processes are the same as those in the first and second embodiments and their modified examples.
[0102] [Hardware configuration] The call control devices 111, 211, 311, 121, and 321 in each embodiment are devices configured by a general-purpose or dedicated computer having a processor (hardware processor) such as a CPU (central processing unit) and a memory such as a RAM (random-access memory) and a ROM (read-only memory) executing a predetermined program. That is, the call control devices 111, 211, 311, 121, and 321 in each embodiment have, for example, a processing circuit configured to implement each unit that each of them has. This computer may have one processor and memory, or may have multiple processors and memories. This program may be installed in the computer, or may be recorded in a ROM or the like in advance. In addition, some or all of the processing units may be configured using electronic circuits that realize processing functions independently, rather than electronic circuits that realize functional configurations by reading programs like a CPU. In addition, an electronic circuit that configures one device may include multiple CPUs.
[0103] The above-mentioned program can be recorded in a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium include a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.
[0104] The distribution of this program is performed, for example, by selling, transferring, lending, etc., a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Furthermore, the program may be stored in a storage device of a server computer, and the program may be distributed by transferring the program from the server computer to another computer via a network. As described above, a computer that executes such a program, for example, first temporarily stores in its own storage device the program recorded in the portable recording medium or the program transferred from the server computer. Then, when executing the process, the computer reads the program stored in its own storage device and executes the process according to the read program. As another execution form of the program, the computer may directly read the program from the portable recording medium and execute the process according to the program, and further, each time the program is transferred from the server computer to the computer, the computer may execute the process according to the received program. Furthermore, the server computer may not transfer the program to the computer, and the above-mentioned process may be executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by issuing an execution instruction and obtaining the result. In addition, the program in this embodiment includes information used for processing by an electronic computer and equivalent to a program (such as data that is not a direct instruction to a computer but has the nature of defining computer processing).
[0105] In each embodiment, the present device is configured by executing a predetermined program on a computer, but at least a part of the processing contents may be realized by hardware.
[0106] [Other variations] The present invention is not limited to the above-mentioned embodiment. For example, instead of the microphone 113, which is an in-ear microphone, other microphones configured to collect sound signals transmitted through the body may be used. For example, a throat microphone or a bone conduction microphone may be used as the microphone 113. Also, one of the microphones 113 and 114 may be omitted. Also, instead of the microphone 113, a microphone that observes sound signals propagated through the air may be used.
[0107] In the above-mentioned embodiment and the modified examples thereof, an example in which the present invention is implemented in an earphone having a microphone and a speaker has been described. However, the present invention may be implemented in other devices such as headphones having a microphone and a speaker. Also, the user 1000 may wear the above-mentioned communication system and further wear earmuffs. Also, the microphone and the speaker do not have to be attached to the body of the user 1000 such as the ear. For example, a microphone and a plurality of speakers may be installed on a floor, a wall, a chair, etc., and among the plurality of speakers, a playback sound from any one of the first speakers may be mainly heard by one ear of the user 1000, and a playback sound from any other one of the second speakers may be mainly heard by the other ear of the user 1000. For example, a playback sound from the first speaker may be only heard by one ear of the user 1000, and a playback sound from the second speaker may be only heard by the other ear of the user 1000. Even in such a case, the above-mentioned effect can be obtained if the amount of sound attenuation between the sound emission position of the second speaker and the sound receiving position of the microphone is greater than the amount of sound attenuation between the sound emission position of the first speaker and the sound receiving position of the microphone.
[0108] In the second embodiment and its modified example, the decision unit 211a may perform the decision step after performing echo cancellation processing on the received signal R1 using an adaptive filter.
[0109] The level of the received signal R2 reproduced from the speaker 122 may also differ between the restricted section and the non-restricted section. For example, the level of the received signal R2 reproduced from the speaker 122 in the restricted section may be higher than the level of the received signal R2 reproduced from the speaker 122 in the non-restricted section. In the restricted section, the level of the received signal R1 reproduced from the other speaker 112 is restricted, which reduces the ease of hearing for the user 1000. This problem can be alleviated by increasing the level of the received signal R2 reproduced from the speaker 122 in the restricted section.
[0110] Furthermore, the processing in each of the above-mentioned units may be performed in the time domain or in the time-frequency domain.
[0111] In addition, the various processes described above may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capacity of the device executing the processes or as necessary. Needless to say, other modifications may be made without departing from the spirit of the claims. For example, the above-mentioned modified examples may be combined and executed. [Explanation of symbols]
[0112] 1,2,3 Call System 11,12,21,31,32 Telephone device 111,121,211,311,321 Call control device 112,122 speakers 113,114,122,323,324 Microphones 111a,211a Judgment section 111b, 211b Reception control unit 111c, 211c Transmitting control unit
Claims
1. a determination unit that determines a state of use of a microphone for obtaining a transmission signal, or determines a state of speech based on an acoustic signal collected by the microphone; a receiving control unit that restricts reproduction of a first received signal from a first speaker and reproduces a second received signal from a second speaker during a restricted section, which is either a time section in which the microphone is used or a time section in which the speech is being made, and reproduces the first received signal from the first speaker and reproduces the second received signal from the second speaker during a non-restricted section, which is a time section other than the restricted section; A call control device, wherein an amount of sound attenuation between a sound emission position of the second speaker and a sound receiving position of the microphone is greater than an amount of sound attenuation between a sound emission position of the first speaker and a sound receiving position of the microphone.
2. The call control device of claim 1, The determination unit determines a state of the utterance, The restricted section is a time section during which the speech is being made.
3. The call control device of claim 2, The call control device further includes a transmission control unit that transmits the transmission signal in the restricted section and limits the transmission of the transmission signal in the non-restricted section.
4. The call control device of claim 2, The determination unit is (1) if the previous time period is the limited period, determining the speech state based on a signal based on the acoustic signal without taking into account an estimated wraparound signal based on the first received speech signal; (2) if the previous time period is the non-restricted period, the speech state is determined based on an estimated speech signal obtained by subtracting the estimated feedback signal from a signal based on the acoustic signal; Call control device.
5. The call control device of claim 2, The determination unit determines the state of the speech and the magnitude of the first received speech signal, The restricted section is a time section during which the speech is being made and the magnitude of the first received speech signal exceeds a third reference value.
6. The call control device of claim 2, The microphone is configured to collect the body-transmitted acoustic signal; the determination unit determines the speech state by prioritizing low frequency components over high frequency components of the acoustic signal; The high frequency is higher than the low frequency. Call control device.
7. The call control device of claim 2, The microphone is configured to collect the body-transmitted acoustic signal; the determination unit determines the speech state based on an estimated transmitted signal obtained by subtracting an estimated wraparound signal based on the first received signal from a signal based on the acoustic signal; a low frequency component of the estimated feedback signal is suppressed more than a high frequency component of the estimated feedback signal, or a high frequency component of the estimated feedback signal is amplified more than a low frequency component of the estimated feedback signal, The high frequency is higher than the low frequency. Call control device.
8. The call control device of claim 7, A call control device, wherein the signal based on the acoustic signal is a signal obtained by treating low frequency components of the acoustic signal with priority over high frequency components.
9. The call control device of claim 1, The microphone is configured to collect the body-transmitted acoustic signal; The transmission signal is based on a signal obtained by amplifying a high frequency component of the acoustic signal more than a low frequency component, the high frequency is higher than the low frequency, The call control device, wherein the receiving control unit limits reproduction of the high frequency components of the first received signal to be more restricted than reproduction of the low frequency components of the first received signal in the restricted section.
10. The call control device of claim 1, The receiving control unit further reproduces the first receiving signal from the second speaker during the restricted section. Call control device.
11. The call control device of claim 1, The first speaker is configured to be mounted toward an ear canal, It is possible to switch between setting an in-ear microphone configured to be fitted in the ear canal as the microphone and setting an external microphone configured to be placed outside the ear canal as the microphone; The restricted section is either a time section in which the in-ear microphone is set as the microphone and the microphone is used, or a time section in which the in-ear microphone is set as the microphone and it is determined that the speech is being made based on an acoustic signal collected by the microphone. Call control device.
12. A call control method by a call control device, a determination step of determining a state of use of a microphone for obtaining a transmission signal, or determining a state of speech using an acoustic signal collected by the microphone; a receiving control step of restricting reproduction of a first received signal from a first speaker and reproducing a second received signal from a second speaker in a restricted section which is either a time section in which the microphone is used or a time section in which the speech is being made, and reproducing the first received signal from the first speaker and reproducing the second received signal from the second speaker in a non-restricted section which is a time section other than the restricted section, A call control method, wherein an amount of sound attenuation between the sound emission position of the second speaker and the sound receiving position of the microphone is greater than an amount of sound attenuation between the sound emission position of the first speaker and the sound receiving position of the microphone.
13. A program for causing a computer to function as the call control device according to any one of claims 1 to 11.
Citation Information
Patent Citations
Speech enhancement method, device and system and computer readable storage medium
CN112767963A
Voice signal characteristic adjuster
JP2005333429A
Loudspeaker system
JP2006238254A
Portable electronic equipment
JP2009105797A
Stereo earphone microphone with remote control
JP2010147982A
