Microphone Array System

Abstract

To provide a microphone array system capable of improving a signal-to-noise ratio in low frequency band even with a small number of the microphones.SOLUTION: A microphone array system 1 includes: a plurality of first microphones 11A and 11B arranged along a first axis A1; a plurality of second microphones 11C, 11D, 11E and 11F arranged along a second axis A2 orthogonal to the first axis, arranged in equal distance apart with a first distance H1, H2 from the first axis; and a beam forming processor for performing beam forming by filtering sound signals from the plurality of first microphones and the plurality of second microphones and by synthesizing them. When the plurality of second microphones are projected to the first axis, the plurality of first microphones and the projected plurality of second microphones (virtual microphones 11N1 and 11N2) are arranged in equal distance apart with a second distance D1, D2 and D3.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a microphone array system having a plurality of microphones. [Background technology]

[0002] Patent Document 1 discloses a microphone array system in which multiple microphones are arranged concentrically and beam steering is performed. The microphone array system of Patent Document 1 includes several tens of microphones. By including a large number of microphones, the microphone array system of Patent Document 1 achieves a uniform signal-to-noise ratio from low frequency bands (e.g., 10 kHz or less) to high frequency bands (e.g., 10 kHz or more). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2018-515028 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with a small number of microphones (for example, less than 10), it is difficult to ensure a sufficient signal-to-noise ratio in the low frequency range.

[0005] Therefore, an object of the present invention is to provide a microphone array system that can improve the S / N ratio in the low frequency band even with a small number of microphones. [Means for solving the problem]

[0006] The microphone array system includes a plurality of first microphones arranged along a first axis, a plurality of second microphones arranged along a second axis perpendicular to the first axis at equal intervals a first distance from the first axis, and a beamforming processor that performs beamforming by filtering and synthesizing sound signals of the plurality of first microphones and the plurality of second microphones, wherein when the plurality of second microphones are projected onto the first axis, the plurality of first microphones and the projected plurality of second microphones are arranged at equal intervals a second distance, and when the plurality of second microphones are projected onto the first axis, the distance between two microphones arranged at both ends of the plurality of first microphones and the projected plurality of second microphones lined up along the first axis is longer than the distance between two microphones arranged at both ends of the plurality of first microphones and the plurality of second microphones lined up along the second axis when the plurality of first microphones are projected onto the second axis. Effect of the Invention

[0007] A microphone array system can improve the signal-to-noise ratio in low frequency bands even with a small number of microphones. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a front view of the microphone array system 1. [Diagram 2] FIG. 1 is a block diagram of a microphone array system 1. [Diagram 3] FIG. 2 is a diagram showing a directivity coefficient of the microphone array system 1. [Figure 4] FIG. 1 is a front view of a microphone array system 1A equipped with eight microphones. [Diagram 5] FIG. 11 is a front view of a microphone array system 1B in which first microphones are not arranged at both ends. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] 1 is a front view of a microphone array system 1. The microphone array system 1 includes a plurality of microphones on the front side of a housing 10. The microphone array system 1 of this embodiment includes six microphones, namely, microphone 11A, microphone 11B, microphone 11C, microphone 11D, microphone 11E, and microphone 11F.

[0010] As an example, the housing 10 has a rectangular parallelepiped shape with a short depth, but the shape of the housing 10 may be any shape that allows multiple microphones to be arranged on the front side.

[0011] 1 is long in the left-right direction (horizontal direction) and short in the up-down direction (vertical direction). The housing 10 is disposed, for example, above or below a display (not shown). The microphone array system 1 uses multiple microphones disposed in front of the housing 10 to pick up the voice of a speaker in front of the display (not shown).

[0012] 2 is a block diagram showing the configuration of the microphone array system 1. The microphone array system 1 further includes a beamforming processor 15, a communication unit 16, a CPU 17, a flash memory 18, and a RAM 19, in addition to the six microphones 11A, 11B, 11C, 11D, 11E, and 11F.

[0013] The CPU 17 is a control unit that controls the operation of the microphone array system 1. The CPU 17 performs various operations by reading out a predetermined program stored in a flash memory 18, which is a storage medium, into the RAM 19 and executing the program. For example, the CPU 17 controls the beamforming processor 15 by the program.

[0014] The program read by CPU 17 does not have to be stored in flash memory 18 in the device itself. For example, the program may be stored in a storage medium of an external device such as a server. In this case, CPU 17 may read the program from the server to RAM 19 and execute it each time.

[0015] The beamforming processor 15 is composed of a DSP (Digital Signal Processor). The beamforming processor 15 acquires sound signals from the microphones 11A, 11B, 11C, 11D, 11E, and 11F. The beamforming processor 15 performs beamforming by filtering and synthesizing the sound signals acquired from the microphones 11A, 11B, 11C, 11D, 11E, and 11F. The signal processing related to beamforming may be any method such as a delay sum method, a Griffiths Jim type, a Henry cox type, a Sidelobe Canceller type, or a Frost type Adaptive Beamformer.

[0016] The CPU 17 determines the content of the filter processing of the beamforming processor 15 and controls the beamforming of the beamforming processor 15. For example, the CPU 17 detects the position of a speaker and controls the beamforming processor 15 to direct a beam to the detected position of the speaker. The beamforming processor 15 acquires the speaker's voice with a high S / N ratio by performing beamforming.

[0017] The communication unit 16 transmits the sound signal after the beamforming process by the beamforming processor 15 to another device. The other device is, for example, an information processing device installed at a remote location. In this way, the microphone array system 1 transmits the voice of the speaker to the information processing device at the remote location. In this case, the microphone array system 1 functions as one component of a communication system for conducting voice conversation with a remote location.

[0018] 1, in the microphone array system 1, microphones 11A and 11B are arranged on a first axis A1 in a horizontal direction. In addition, in the microphone array system 1, microphones 11C, 11D, 11E, and 11F are arranged along a second axis A2 in a vertical direction perpendicular to the first axis A1.

[0019] Microphones 11C and 11D are each disposed at a distance H1 above first axis A1. Microphones 11E and 11F are each disposed at a distance H2 below first axis A1. Distance H1 and distance H2 are the same.

[0020] That is, microphones 11A and 11B constitute a plurality of first microphones arranged along a first axis A1. Microphones 11C, 11D, 11E, and 11F constitute a plurality of second microphones arranged at equal intervals at a first distance H1 (=H2) from the first axis A1. Note that in this embodiment, equal intervals do not mean exactly the same intervals. For example, even if there is an error of about ±5%, it is included in the equal intervals.

[0021] Furthermore, when microphones 11C, 11D, 11E, and 11F are projected onto the first axis A1, the microphones on the first axis are all arranged at equal intervals. When microphones 11C and 11E are projected onto the first axis A1, they form a virtual microphone 11N1 on the first axis A1. When microphones 11D and 11F are projected onto the first axis A1, they form a virtual microphone 11N2 on the first axis A1. The distance D1 between virtual microphone 11N1 and microphone 11A, the distance D2 between virtual microphone 11N2 and virtual microphone 11N1, and the distance D3 between microphone 11B and virtual microphone 11N2 are all the same.

[0022] A microphone array consisting of microphone 11A, microphone 11B, microphone 11C, microphone 11D, microphone 11E, and microphone 11F is equivalent to using the sound signals of four microphones (microphone 11A, virtual microphone 11N1, virtual microphone 11N2, and microphone 11B) lined up on the first axis A1 in horizontal beamforming.

[0023] These four microphones are equally spaced at a second distance D1 (=D2=D3) along the first axis A1. When beamforming is performed with equally spaced microphones, the Gibbs phenomenon produces larger ripples than when beamforming is performed with microphones spaced at different intervals. Therefore, the interaction (resonance) of the four microphones results in a higher or lower signal-to-noise ratio at certain frequencies.

[0024] Fig. 3 is a diagram showing the directivity coefficient of the microphone array system 1. The horizontal axis of the graph shown in Fig. 3 is frequency, and the vertical axis is directivity coefficient. The directivity coefficient corresponds to a relative S / N ratio when one microphone (for example, microphone 11A) is used as a reference and six microphones 11A, 11B, 11C, 11D, 11E, and 11F are combined and assumed to be one microphone.

[0025] In the microphone array system 1, peaks occur in the SNR at specific frequencies that depend on the distance between the microphones due to interactions between the microphone 11A and the virtual microphone 11N1, between the virtual microphone 11N1 and the virtual microphone 11N2, and between the microphone 11B and the virtual microphone 11N2. The peaks occur periodically at multiple frequencies, starting from the lowest frequency.

[0026] The example in Fig. 3 shows the characteristics when the distance (D1+D2+D3) between microphones 11A and 11B arranged at both ends is about 1 m. In this case, the distances D1, D2, and D3 are each about 33 cm. Therefore, as shown in Fig. 3, a peak occurs at about 1 kHz at the lowest frequency. Furthermore, in the frequency band higher than 1 kHz, peaks occur periodically at multiple frequencies.

[0027] The lowest frequency peak (hereinafter referred to as the minimum peak) varies depending on the distance between microphone 11A and microphone 11B, i.e., distances D1, D2, and D3. The greater the distances D1, D2, and D3, the lower the frequency of the minimum peak. For example, if the distance between microphone 11A and microphone 11B is approximately 10 m, the frequency of the minimum peak is approximately 100 Hz. Also, the smaller the distances D1, D2, and D3, the higher the frequency of the minimum peak. For example, if the distance between microphone 11A and microphone 11B is approximately 10 cm, the frequency of the minimum peak is approximately 10 kHz.

[0028] Usually, indoor noise, reverberation, and echo have high levels in the low frequency band below 10 kHz. In particular, indoor noise, reverberation, and echo have higher levels in lower frequency bands such as below 1 kHz. Therefore, for beamforming, it is important to ensure a higher S / N ratio in the lower frequency band below 10 kHz. The microphone array system 1 of this embodiment has a small number of microphones (six), but shows a very high S / N ratio at the low frequency of 1 kHz where the influence of indoor noise, reverberation, and echo is large. The microphone array system 1 of this embodiment can improve the S / N ratio in the low frequency band even with a small number of microphones. Therefore, the microphone array system 1 can reduce the influence of indoor noise, reverberation, and echo and form good directivity.

[0029] In addition, the microphone array system 1 of this embodiment has multiple microphones arranged not only in the horizontal direction but also in the vertical (perpendicular) direction. When the microphones 11B, 11C, 11D, 11E, and 11F are projected onto the second axis A2, the microphones 11A, virtual microphones 11M1, and virtual microphones 11M2 on the second axis are arranged at equal intervals. Therefore, similar to the horizontal direction, the interaction of the multiple microphones also produces a peak in the SNR at a specific frequency in the vertical direction. Therefore, the microphone array system 1 of this embodiment can perform beamforming in the vertical direction as well.

[0030] As described above, the microphone array system 1 is disposed above or below a display (not shown) and picks up the voice of a speaker in front of the display (not shown). The speaker is located at a height of about 1m to 2m above the floor in the vertical direction, and is rarely located at a position significantly beyond the range of 1m to 2m. On the other hand, the speaker is often located at various positions in the horizontal direction. For example, the speaker may be located directly in front of the display (not shown) or at a position away to the left or right.

[0031] In contrast, in the microphone array system 1, the distance between the ends of the microphones aligned along the first axis A1 in the horizontal direction (the distance between microphone 11A and microphone 11B) is longer than the distance between the ends of the microphones aligned along the second axis A2 in the vertical direction (the distance between microphone 11C and microphone 11E). This allows the microphone array system 1 to improve the beamforming performance in the horizontal direction more than in the vertical direction, and to pick up the voices of speakers at various positions along the horizontal direction.

[0032] In addition, the number of microphones (microphone 11A, virtual microphone 11N1, virtual microphone 11N2, and microphone 11B) aligned along the first axis A1 in the horizontal direction is four. The number of microphones (microphone 11A, virtual microphone 11M1, and virtual microphone 11M2) aligned along the second axis A2 in the vertical direction is three. That is, the number of microphones aligned along the first axis A1 in the horizontal direction is greater than the number of microphones aligned along the second axis A2 in the vertical direction. This allows the microphone array system 1 to form a sharper beam in the horizontal direction than in the vertical direction. Therefore, even when multiple speakers are present, the microphone array system 1 can separate and collect the voices of each speaker with high accuracy.

[0033] 1, the second distance (D1, D2, D3) is longer than the first distance (H1, H2). However, the second distance (D1, D2, D3) may be the same as the first distance (H1, H2).

[0034] Also, the microphone array system 1 in Fig. 1 is an example equipped with six microphones. However, the number of microphones is not limited to six. For example, Fig. 4 is a front view of a microphone array system 1A equipped with eight microphones. Configurations common to Fig. 1 are given the same reference numerals and descriptions thereof will be omitted.

[0035] The microphone array system 1A further includes a microphone 11G and a microphone 11H. The microphone 11G is disposed at a distance H1 upward from the first axis A1. The microphone 11H is disposed at a distance H2 downward from the first axis A1. That is, the microphones 11G and 11H constitute a plurality of second microphones disposed at equal intervals at a first distance H1 (=H2) from the first axis A1.

[0036] When microphones 11G and 11H are projected onto the first axis A1, they form a virtual microphone 11N3 on the first axis A1. When microphones 11G and 11H are projected onto the first axis A1, the microphones on the first axis are all spaced at equal intervals. The distance D1 between virtual microphone 11N1 and microphone 11A, the distance D2 between virtual microphone 11N2 and virtual microphone 11N1, the distance D3 between virtual microphone 11N3 and virtual microphone 11N2, and the distance D4 between microphone 11B and virtual microphone 11N3 are all the same.

[0037] In this case, too, similar to the microphone array system 1 in Fig. 1, the interaction between the multiple microphones arranged in the horizontal direction causes a peak in the SNR at a specific frequency. Therefore, the microphone array system 1A can improve the SNR in the low frequency band even with a small number of microphones (8). The microphone array system 1A has a larger number of microphones arranged in the horizontal direction than the microphone array system 1 in Fig. 1, and therefore can improve the SNR in the low frequency band.

[0038] Also, the first microphones arranged on the first axis A1 do not need to be arranged at both ends. For example, Fig. 5 is a front view of a microphone array system 1B in which the first microphones are not arranged at both ends. The same reference numerals are used to designate components common to Fig. 1, and descriptions thereof will be omitted.

[0039] In the microphone array system 1B, microphones 11C and 11E are arranged at the left end when viewed from the front, and microphone 11A is arranged between virtual microphones 11N1 and 11N2. The other configurations are the same as those of the microphone array system 1 in FIG.

[0040] In this case, when microphones 11C, 11D, 11E, and 11F are projected onto first axis A1, the microphones on the first axis are all arranged at equal intervals. Therefore, microphone array system 1B can improve the SNR in the low frequency band, even though it has a small number of microphones (six), similar to microphone array system 1 in FIG.

[0041] The description of the present embodiment is illustrative in all respects and is not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope of the claims.

[0042] For example, in this embodiment, an example in which the number of microphones is six or eight has been shown. However, the number of microphones may be ten or more. However, since the microphone array system of this embodiment can improve the signal-to-noise ratio in the low frequency band even with a small number of microphones, by reducing the number of microphones, the size of the housing can be reduced and costs can be reduced. Therefore, the number of microphones is preferably six or eight. [Explanation of symbols]

[0043] 1,1A,1B...Microphone array system 10…Housing 11A, 11B, 11C, 11D, 11E, 11F, 11G, 11H...Microphone 11M1, 11M2, 11N1, 11N2, 11N3...Virtual microphone 15…Beamforming processor 16…Communications Department 17…CPU 18. Flash memory 19…RAM

Claims

1. a plurality of first microphones arranged along a first axis; a plurality of second microphones disposed along a second axis perpendicular to the first axis and equally spaced apart a first distance from the first axis; a beamforming processor that performs beamforming by filtering and synthesizing sound signals from the first microphones and the second microphones; Equipped with When the plurality of second microphones are projected onto the first axis, the plurality of first microphones and the projected plurality of second microphones are disposed at equal intervals at a second distance, When the second microphones are projected onto the first axis, the distance between the first microphones arranged along the first axis and the two microphones arranged at both ends of the projected second microphones is when the plurality of first microphones are projected onto the second axis, the distance between both ends of the plurality of first microphones and the plurality of second microphones aligned along the second axis is longer than the distance between two microphones arranged at both ends; 1. A microphone array system, comprising: when the plurality of second microphones are projected onto the first axis, the number of the plurality of first microphones aligned along the first axis and the number of the projected plurality of second microphones is greater than the number of the plurality of first microphones and the number of the projected plurality of second microphones aligned along the second axis when the plurality of first microphones are projected onto the second axis; When a single beam is formed by filtering and synthesizing the sound signals of the multiple first microphones and the multiple second microphones in the beamforming process, the lowest frequency peak occurring in the relative S / N ratio between the S / N ratio when the beam is assumed to be one microphone and the S / N ratio of any one of the multiple first microphones and the multiple second microphones is 100 Hz to 10 kHz. Microphone array system.

2. The second distance is greater than the first distance. The microphone array system according to claim 1 .

3. The first distance is the same as the second distance. The microphone array system according to claim 1 .

4. When the second microphones are projected onto the first axis, the distance between the two microphones arranged at both ends of the first microphones and the projected second microphones arranged along the first axis is 10 cm or more and 10 m or less. The microphone array system according to any one of claims 1 to 3.

5. The total number of the first microphones and the second microphones is six or more. The microphone array system according to claim 1 .

6. The total number of the first microphones and the second microphones is eight or less. The microphone array system according to claim 5 .

Images