Terminal, sound pickup method, sound pickup device and storage medium

Abstract

This disclosure relates to a terminal, a sound pickup method, a sound pickup device, and a storage medium. The terminal includes: a first omnidirectional microphone array for picking up audio in a first beam direction via beamforming; and a second omnidirectional microphone array for picking up audio in a second beam direction via beamforming. A processing module is used to identify a target audio pickup direction and non-target audio pickup directions among the audio picked up in overlapping beam directions, pick up audio in the target audio pickup direction, and suppress audio in the non-target audio pickup direction. Through this disclosure, based on the reasonable arrangement of multiple omnidirectional microphones on the terminal, multiple microphones form multiple different omnidirectional microphone arrays, and beamforming technology is used to fix the audio beam at a fixed angle matching the acquisition target, so that the sound within the beam is clearly picked up by the terminal, and the sound outside the beam is effectively suppressed.

Description

Technical Field

[0001] This disclosure relates to the field of terminal sound pickup, and more particularly to terminals, sound pickup methods, sound pickup devices, and storage media. Background Technology

[0002] In related technologies, the sound pickup method used on terminals such as tablets and mobile phones is mainly 360-degree omnidirectional sound pickup, with some tablet terminals featuring far-field sound pickup technology. However, when used in noisy environments, both other ambient sounds and the sound the user wants to capture will be picked up by the terminal's microphone. Even if the terminal's noise reduction algorithm suppresses ambient sounds, other ambient sounds will still be preserved, causing the sound the user wants to capture to be interfered with or even covered by other ambient sounds. Summary of the Invention

[0003] To overcome the problems existing in related technologies, this disclosure provides a terminal, a sound pickup method, a sound pickup device, and a storage medium.

[0004] According to a first aspect of the present disclosure, a terminal is provided, comprising: a first omnidirectional microphone array for picking up audio in a first beam direction via beamforming; a second omnidirectional microphone array for picking up audio in a second beam direction via beamforming; wherein there is a directional angle between the microphone arrangement direction in the first omnidirectional microphone array and the microphone arrangement direction in the second omnidirectional microphone array, and the angle difference between the directional angle and a right angle is less than a threshold; the overlapping beam direction of the first beam direction and the second beam direction includes at least a target audio pickup direction; and a processing module configured to identify a target audio pickup direction and a non-target audio pickup direction in the audio picked up in the overlapping beam direction, pick up audio in the target audio pickup direction, and suppress audio in the non-target audio pickup direction.

[0005] In one embodiment, the target audio pickup direction includes the audio pickup direction facing the front of the terminal, and / or, the target audio pickup direction includes the audio pickup direction facing the back of the terminal.

[0006] In one embodiment, the angle between the microphone arrangement direction in the first omnidirectional microphone array and the direction corresponding to the long side of the terminal is less than an angle threshold, and the angle between the microphone arrangement direction in the second omnidirectional microphone array and the direction corresponding to the short side of the terminal is less than an angle threshold.

[0007] In one embodiment, the first omnidirectional microphone array includes a first omnidirectional microphone and a second omnidirectional microphone, and the second omnidirectional microphone array includes a first omnidirectional microphone and a third omnidirectional microphone.

[0008] In one embodiment, the first omnidirectional microphone and the second omnidirectional microphone are disposed on the long side bezel of the terminal, or on the screen near the long side bezel of the terminal.

[0009] In one embodiment, the first omnidirectional microphone and the second omnidirectional microphone are symmetrically arranged along the vertical center line of the long side of the terminal.

[0010] In one embodiment, the first omnidirectional microphone array includes a first omnidirectional microphone and a second omnidirectional microphone, and the second omnidirectional microphone array includes a third omnidirectional microphone and a fourth omnidirectional microphone.

[0011] In one embodiment, the third omnidirectional microphone is disposed on the back of the terminal.

[0012] In one embodiment, a camera module is provided on the back of the terminal; the third omnidirectional microphone is disposed on the frame of the camera module on the back of the terminal.

[0013] In one embodiment, the fourth omnidirectional microphone is disposed on the short side frame of the terminal near the third omnidirectional microphone.

[0014] In one embodiment, the terminal further includes a fifth omnidirectional microphone, which is disposed on the short side frame of the terminal where the USB interface is located.

[0015] In one embodiment, the sounds picked up by different omnidirectional microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction have a phase difference; the processing module identifies the non-target audio pickup direction in the audio picked up in the overlapping beam direction based on the phase difference.

[0016] According to a second aspect of the present disclosure, a sound pickup method is provided, applied to a terminal as described in any one of the first aspects. The method includes: acquiring audio picked up by a first omnidirectional microphone array and a second omnidirectional microphone array in an overlapping beam direction, wherein the overlapping beam direction is the beam direction where the first beam direction and the second beam direction overlap, the first beam direction being the beam direction in which the first omnidirectional microphone array picks up audio through beamforming, and the second beam direction being the beam direction in which the second omnidirectional microphone array picks up audio through beamforming; identifying a target audio pickup direction and a non-target audio pickup direction in the audio picked up in the overlapping beam direction; picking up audio in the target audio pickup direction and suppressing audio in the non-target audio pickup direction.

[0017] In one embodiment, identifying the target audio pickup direction and non-target audio pickup direction in the audio picked up in the overlapping beam direction includes: identifying the target audio pickup direction and non-target audio pickup direction in the audio picked up in the overlapping beam direction based on the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction.

[0018] In one embodiment, picking up audio in the target audio pickup direction includes: adjusting the audio pickup width in the target audio pickup direction; and picking up audio in the target audio pickup direction after adjusting the audio pickup width.

[0019] According to a third aspect of the present disclosure, a sound pickup device is provided, applied to a terminal as described in any one of the first aspects. The device includes: an acquisition unit, configured to acquire audio picked up by a first omnidirectional microphone array and a second omnidirectional microphone array in an overlapping beam direction, wherein the overlapping beam direction is the beam direction in which the first beam direction and the second beam direction overlap, the first beam direction being the beam direction in which the first omnidirectional microphone array picks up audio through beamforming, and the second beam direction being the beam direction in which the second omnidirectional microphone array picks up audio through beamforming; an identification unit, configured to identify a target audio pickup direction and a non-target audio pickup direction among the audio picked up in the overlapping beam direction; and a processing unit, configured to pick up audio in the target audio pickup direction and suppress audio in the non-target audio pickup direction.

[0020] In one embodiment, the identification unit identifies the target audio pickup direction and the non-target audio pickup direction in the audio picked up in the overlapping beam direction in the following manner: based on the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction, the target audio pickup direction and the non-target audio pickup direction are identified in the audio picked up in the overlapping beam direction.

[0021] In one embodiment, the processing unit picks up audio in the target audio pickup direction by adjusting the audio pickup width in the target audio pickup direction and picking up audio in the target audio pickup direction after adjusting the audio pickup width.

[0022] According to a fourth aspect of the present disclosure, a sound pickup device is provided, comprising: a processor: a memory for storing processor-executable instructions; wherein the processor is configured to: perform the sound pickup method described in any one of the first aspects.

[0023] According to a fifth aspect of the present disclosure, a storage medium is provided that stores instructions which, when executed by a processor, enable the processor to perform the sound pickup method described in any one of the first aspects.

[0024] The technical solutions provided by the embodiments of this disclosure can include the following beneficial effects: audio from different beam directions is picked up using beamforming with different omnidirectional microphone arrays. A processing module identifies the target audio pickup direction and non-target audio pickup directions among the audio picked up in overlapping beam directions, picking up audio in the target audio pickup direction and suppressing audio in the non-target audio pickup direction. Through this disclosure, based on the reasonable arrangement of multiple omnidirectional microphones on the terminal, multiple microphones form multiple different omnidirectional microphone arrays, and beamforming technology is used to fix the audio beam at a fixed angle matching the acquisition target, so that the sound within the beam is clearly picked up by the terminal, and the sound outside the beam is effectively suppressed.

[0025] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0026] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0027] Figure 1 This is a block diagram illustrating a terminal according to an exemplary embodiment.

[0028] Figure 2 This is a schematic diagram illustrating a multi-microphone array beamforming according to an exemplary embodiment of the present disclosure.

[0029] Figure 3 This is a schematic diagram illustrating a multi-microphone array beamforming according to yet another exemplary embodiment of the present disclosure.

[0030] Figure 4 This is a schematic diagram illustrating a beamforming result of a multi-microphone array according to yet another exemplary embodiment of this disclosure.

[0031] Figure 5A This is a schematic diagram illustrating the location of an omnidirectional microphone on the front of a terminal according to an exemplary embodiment of the present disclosure.

[0032] Figure 5B This is a schematic diagram illustrating the location of an omnidirectional microphone on the back of a terminal according to an exemplary embodiment of the present disclosure.

[0033] Figure 6AThis is a front view of the pickup range of a microphone array according to an exemplary embodiment of the present disclosure.

[0034] Figure 6B This is a side view of the pickup range of a microphone array according to an exemplary embodiment of the present disclosure.

[0035] Figure 6C This is a top view of the pickup range of a microphone array according to an exemplary embodiment of the present disclosure.

[0036] Figure 7A This is a front view of the pickup range of a microphone array according to yet another exemplary embodiment of this disclosure.

[0037] Figure 7B This is a side view of the pickup range of a microphone array according to yet another exemplary embodiment of this disclosure.

[0038] Figure 7C This is a top view of the pickup range of a microphone array according to yet another exemplary embodiment of this disclosure.

[0039] Figure 8A This is a front view of the overlapping area of ​​the pickup range of two omnidirectional microphone arrays, as shown in an exemplary embodiment of this disclosure.

[0040] Figure 8B This is a side view of the overlapping area of ​​the pickup range of two omnidirectional microphone arrays, as shown in an exemplary embodiment of this disclosure.

[0041] Figure 8C This is a top view of the overlapping area of ​​the pickup range of two omnidirectional microphone arrays, as shown in an exemplary embodiment of this disclosure.

[0042] Figure 9A This is a schematic diagram illustrating the location of an omnidirectional microphone on the front of a terminal according to yet another exemplary embodiment of this disclosure.

[0043] Figure 9B This is a schematic diagram illustrating the location of an omnidirectional microphone on the back of a terminal according to yet another exemplary embodiment of this disclosure.

[0044] Figure 10 This is a flowchart illustrating a sound pickup method according to an exemplary embodiment.

[0045] Figure 11 This is a flowchart illustrating a method for distinguishing target audio pickup direction and non-target audio pickup direction according to an exemplary embodiment.

[0046] Figure 12 This is a flowchart illustrating a method for picking up audio in a target audio pickup direction according to an exemplary embodiment.

[0047] Figure 13 This is a schematic diagram illustrating an adjustment of the pickup range of an omnidirectional microphone array according to an exemplary embodiment of the present disclosure.

[0048] Figure 14A This is a top view of the pickup range of an omnidirectional microphone array according to yet another exemplary embodiment of the present disclosure.

[0049] Figure 14B This is a side view of the pickup range of an omnidirectional microphone array according to yet another exemplary embodiment of the present disclosure.

[0050] Figure 15 This is a schematic diagram illustrating an omnidirectional microphone array for determining the direction of sound according to an exemplary embodiment of the present disclosure.

[0051] Figure 16 This is a schematic diagram illustrating the pickup range of an omnidirectional microphone array according to yet another exemplary embodiment of this disclosure.

[0052] Figure 17 This is a schematic diagram illustrating the pickup range of an omnidirectional microphone array according to yet another exemplary embodiment of this disclosure.

[0053] Figure 18 This is a block diagram illustrating a pickup device according to an exemplary embodiment.

[0054] Figure 19 This is a block diagram illustrating a device for sound pickup according to an exemplary embodiment. Detailed Implementation

[0055] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure.

[0056] The sound pickup method provided in this disclosure is applied to scenarios where a terminal acquires audio information within a fixed area and blocks audio information from other sources. For example, it can acquire the user's voice during a video call and block ambient noise, or acquire the sound of the target being filmed and block ambient noise outside the target while filming a video.

[0057] In related technologies, the sound pickup methods used on terminals such as tablets and mobile phones mainly involve using one or more omnidirectional microphones to pick up sound 360 degrees in the surrounding space. Some tablet terminals also have far-field sound pickup technology, which can obtain sound from a greater distance through multi-level audio signal enhancement. However, the sound pickup methods of tablets and mobile phones are not directional. When used in noisy environments, other sounds in the environment and the sound the user wants to capture will be picked up by the terminal's microphone. Even if the terminal's noise reduction algorithm suppresses ambient sounds, other ambient sounds will still be preserved. This can cause the sound the user wants to capture to be interfered with or even covered by other ambient sounds. For example, when a user is making a voice call, the user's own voice and the sounds of people or objects in the surrounding environment will be picked up by the terminal's microphone. If the external ambient sound is too loud, it will affect the clarity of the user's voice, causing the target of communication to be unable to accurately obtain the information the user wants to convey.

[0058] In view of this, this disclosure proposes a terminal equipped with multiple omnidirectional microphones. By rationally arranging the multiple omnidirectional microphones on a flat panel and using beamforming technology, the audio beam is fixed at a fixed angle that matches the acquisition target, so that the terminal can clearly pick up the sound of the target sound source.

[0059] Figure 1 This is a block diagram illustrating a terminal 100 according to an exemplary embodiment. For example... Figure 1 As shown, the terminal 100 includes a first omnidirectional microphone array 101, a second omnidirectional microphone array 102, and a processing module 103.

[0060] The first omnidirectional microphone array 101 is configured to pick up audio in the direction of the first beam through beamforming.

[0061] The second omnidirectional microphone array 102 is configured to pick up audio in the direction of the second beam through beamforming.

[0062] Wherein, there is a directional angle between the microphone arrangement direction in the first omnidirectional microphone array 101 and the microphone arrangement direction in the second omnidirectional microphone array 102, and the angle difference between the directional angle and the right angle is less than a threshold, and the overlapping beam direction of the first beam direction and the second beam direction includes at least the target audio pickup direction.

[0063] In this embodiment of the disclosure, the terminal includes multiple omnidirectional microphones, and both the first omnidirectional microphone array and the second omnidirectional microphone array consist of two omnidirectional microphones. Figure 2 and Figure 3The diagram illustrates beamforming with multiple omnidirectional microphone arrays. Two omnidirectional microphone arrays can consist of three omnidirectional microphones, multiplexing one of them, or four microphones, without microphone multiplexing. Understandably, using three omnidirectional microphones to form two omnidirectional microphone arrays occupies less space in the terminal, but the effect is inferior. Using four omnidirectional microphones to form two omnidirectional microphone arrays occupies more space in the terminal, but the effect is good. One of these solutions can be used based on the requirements.

[0064] In this embodiment of the disclosure, such as Figure 2 and Figure 3 As shown in the schematic diagram of beamforming using a multi-omnidirectional microphone array, the first and second omnidirectional microphone arrays achieve beamforming in the form of a wide-side array. Beamforming with a wide-side array attenuates sound on both sides of the array, causing the pickup area to be distributed in a ring around the center of the array. In other words, beamforming using a multi-omnidirectional microphone array can limit the pickup area of ​​the terminal. Furthermore, this disclosure uses two microphones for beamforming, further limiting the pickup area of ​​the terminal.

[0065] In this embodiment of the disclosure, such as Figure 4 As shown in the schematic diagram of the beamforming result of the omnidirectional microphone array, beamforming in front of or behind a single omnidirectional microphone array can limit the audio pickup range to a certain area, such as a certain area in front of or behind the omnidirectional microphone array. It is understood that the omnidirectional microphone array in this disclosure is composed of omnidirectional microphones, thus limiting the audio pickup range to a certain area in front of and behind the omnidirectional microphone array, and also limiting the audio on the left and right sides of the omnidirectional microphone array.

[0066] The processing module 103 is configured to identify the target audio pickup direction and non-target audio pickup direction in the audio picked up in the overlapping beam direction, pick up the audio in the target audio pickup direction, and suppress the audio in the non-target audio pickup direction.

[0067] In this embodiment, the angle difference between the directional angle and the right angle between the microphone arrangement direction in the first omnidirectional microphone array and the microphone arrangement direction in the second omnidirectional microphone array is less than a threshold. That is, the spatial relationship between the two omnidirectional microphone arrays in this disclosure is perpendicular or approximately perpendicular, and the spatial relationship between the corresponding pickup areas of the two omnidirectional microphone arrays is also perpendicular or approximately perpendicular. It can be understood that the closer the angular relationship between the two omnidirectional microphone arrays is to perpendicularity, the smaller the overlap area of ​​the pickup areas corresponding to the two omnidirectional microphone arrays. Therefore, using the overlap area of ​​the pickup areas corresponding to the omnidirectional microphone arrays as the area for acquiring the target audio can achieve accurate pickup of the target sound source. Furthermore, the overlap area of ​​the pickup areas corresponding to the omnidirectional microphone arrays can be divided into two areas. Based on actual needs, only the audio information in one area can be acquired, while the audio in the other area can be suppressed, ensuring that only the audio in the target direction is acquired.

[0068] In this embodiment, beamforming is performed using a first omnidirectional microphone array and a second omnidirectional microphone array to pick up audio from different beam directions. A processing module identifies the target audio pickup direction and non-target audio pickup directions among the audio picked up in overlapping beam directions, picking up audio from the target audio pickup direction and suppressing audio from the non-target audio pickup direction. Through a reasonable arrangement of multiple omnidirectional microphones on the terminal, multiple microphones form multiple different omnidirectional microphone arrays, and beamforming technology is used to fix the audio beam at a fixed angle matching the acquisition target. Sound within the beam will be clearly picked up by the terminal, while sound outside the beam will be effectively suppressed.

[0069] In one embodiment of this disclosure, the target audio pickup direction includes the audio pickup direction facing the front of the terminal, and / or, the target audio pickup direction includes the audio pickup direction facing the back of the terminal.

[0070] In this embodiment of the present disclosure, the overlapping areas of the pickup areas corresponding to the first omnidirectional microphone array and the second omnidirectional microphone array are respectively distributed in the front and back orientations of the terminal, and the target audio pickup direction corresponds to the distribution of the overlapping areas.

[0071] In one embodiment of this disclosure, the angle between the microphone arrangement direction of the first omnidirectional microphone array 101 and the direction corresponding to the long side of the terminal is less than an angle threshold, and the angle between the microphone arrangement direction of the second omnidirectional microphone array 102 and the direction corresponding to the short side of the terminal is less than an angle threshold.

[0072] In this embodiment, the closer the angular relationship between the two omnidirectional microphone arrays is to being perpendicular, the smaller the overlap area of ​​the pickup areas corresponding to the two omnidirectional microphone arrays is, thus enabling the acquisition of a smaller target pickup area and achieving accurate pickup of the target sound source. The long and short sides of the terminal have a geometrically perpendicular relationship. By making the microphone arrangement direction in the first omnidirectional microphone array parallel or approximately parallel to the direction corresponding to the long side of the terminal, and making the microphone arrangement direction in the second omnidirectional microphone array parallel or approximately parallel to the short side of the terminal, the microphone arrangement direction in the first omnidirectional microphone array can be made perpendicular or nearly perpendicular to the microphone arrangement direction in the second omnidirectional microphone array. This limits the target pickup area to a smaller range, achieving accurate pickup of audio in the target audio pickup direction.

[0073] In one embodiment of this disclosure, the first omnidirectional microphone array 101 includes a first omnidirectional microphone and a second omnidirectional microphone, and the second omnidirectional microphone array 102 includes a first omnidirectional microphone and a third omnidirectional microphone.

[0074] In this embodiment of the present disclosure, the two omnidirectional microphone subarrays of the terminal are each composed of two omnidirectional microphones, and the microphones that make up the omnidirectional microphone subarrays can be reused, that is, the same microphone can participate in the composition of the two omnidirectional microphone arrays respectively.

[0075] In one embodiment of this disclosure, the first omnidirectional microphone and the second omnidirectional microphone are disposed on the long side bezel of the terminal, or disposed on the screen near the long side bezel of the terminal.

[0076] In this embodiment of the disclosure, the distribution positions of the first omnidirectional microphone and the second omnidirectional microphone that make up the first omnidirectional microphone array will affect the audio pickup of the two microphone arrays in the target audio pickup direction. The sound pickup effect is best when the first omnidirectional microphone and the second omnidirectional microphone are set on the screen close to the long side bezel of the terminal, but this will affect the appearance of the front of the terminal.

[0077] In an exemplary embodiment of this disclosure, such as Figures 5A to 5B The diagram shows the placement of an omnidirectional microphone on a terminal. The first omnidirectional microphone mic1 and the second omnidirectional microphone mic2, which form the first omnidirectional microphone array, are both located on the upper side of the tablet terminal, specifically on the long side corresponding to the front camera. As shown in the three-view diagram of the pickup range of the omnidirectional microphone array in Figure 6, the pickup range of the first omnidirectional microphone array is a ring-shaped area surrounding the midpoint of the first omnidirectional microphone mic1 and the second omnidirectional microphone mic2, perpendicular to the direction of the microphone arrangement in the first omnidirectional microphone array.

[0078] In an exemplary embodiment of this disclosure, such as Figures 5A to 5BThe diagram illustrates the placement of an omnidirectional microphone on a terminal. A third omnidirectional microphone (mic3), forming the second omnidirectional microphone array, is located on the back of the tablet terminal, and the microphone arrangement direction in the first omnidirectional microphone array is approximately perpendicular to the microphone arrangement direction in the second omnidirectional microphone array. Figures 7A to 7C The three-view diagram of the pickup range of the omnidirectional microphone array in the diagram shows that the pickup range of the second omnidirectional microphone array is a ring-shaped area that surrounds the midpoint of the first omnidirectional microphone mic1 and the third omnidirectional microphone mic3 and is perpendicular to the microphone arrangement direction in the first omnidirectional microphone array.

[0079] In an exemplary embodiment of this disclosure, due to Figures 5A to 5B The microphone arrangement direction in the first omnidirectional microphone array is approximately perpendicular to the microphone arrangement direction in the second omnidirectional microphone array, therefore Figures 6A to 6C The pickup area of ​​the first omnidirectional microphone array in the middle and Figures 7A to 7C The pickup area of ​​the second omnidirectional microphone array is approximately vertical. For example... Figures 8A to 8C The three-view diagram shows the overlapping area of ​​the omnidirectional microphone array pickup range. The overlapping pickup area of ​​the first omnidirectional microphone array and the second omnidirectional microphone array consists of two cone-shaped areas distributed on the front and back sides of the terminal.

[0080] In one embodiment of this disclosure, the first omnidirectional microphone and the second omnidirectional microphone are symmetrically arranged along the vertical center line of the long side of the terminal.

[0081] In this embodiment of the disclosure, a first omnidirectional microphone array is formed by a first omnidirectional microphone and a second omnidirectional microphone to obtain a ring-shaped sound pickup area that is perpendicular to the long side of the terminal and centered at the midpoint of the long side where the first omnidirectional microphone array is located.

[0082] In one embodiment of this disclosure, the first omnidirectional microphone array 101 includes a first omnidirectional microphone and a second omnidirectional microphone, and the second omnidirectional microphone array 102 includes a third omnidirectional microphone and a fourth omnidirectional microphone.

[0083] In this embodiment, the first and second omnidirectional microphone arrays of the terminal have different configurations. The first omnidirectional microphone can be reused, allowing it to form a first omnidirectional microphone array with both the first and second microphones, and then with a third microphone to form a second omnidirectional microphone array. Alternatively, a fourth microphone can be introduced, forming a first omnidirectional microphone array with both the first and second microphones, and then with both the third and fourth microphones to form a second omnidirectional microphone array. Figures 9A to 9BThe diagram shows the location of the omnidirectional microphones on the terminal. The settings of the first omnidirectional microphone mic1, the second omnidirectional microphone mic2, and the third omnidirectional microphone mic3 remain unchanged. The fourth omnidirectional microphone mic4 is set on the short side of the terminal.

[0084] In one embodiment of this disclosure, a third omnidirectional microphone is disposed on the back of the terminal.

[0085] In this embodiment of the disclosure, such as Figures 5A to 5B and Figures 9A to 9B As shown in the schematic diagram of the omnidirectional microphone placement on the terminal, the third omnidirectional microphone is located on the back of the terminal, while the other omnidirectional microphone, forming a second omnidirectional microphone array with the third omnidirectional microphone, is located on the front screen or bezel of the terminal. This results in a phase difference between the two omnidirectional microphones constituting the second omnidirectional microphone array in the direction from the front of the terminal to the back.

[0086] In one embodiment of this disclosure, a camera module is provided on the back of the terminal; a third omnidirectional microphone is provided on the frame of the camera module on the back of the terminal.

[0087] In this embodiment, the third omnidirectional microphone is placed on the frame of the camera module on the back of the terminal, so that it is distributed together with the camera and flash on the camera module, ensuring a good appearance on the back of the terminal.

[0088] In one embodiment of this disclosure, the fourth omnidirectional microphone is disposed on the short side frame of the terminal near the third omnidirectional microphone.

[0089] In this embodiment of the disclosure, by placing the fourth omnidirectional microphone on the short side frame close to the third omnidirectional microphone, the microphone arrangement direction in the first omnidirectional microphone array is ensured to be perpendicular or approximately perpendicular to the microphone arrangement direction in the second omnidirectional microphone array.

[0090] In one embodiment of this disclosure, the terminal further includes a fifth omnidirectional microphone, which is disposed on the short side frame of the terminal where the USB interface is located.

[0091] In this embodiment of the disclosure, the terminal's multiple microphones are not only used for beamforming to achieve directional sound pickup, but also for conventional sound pickup, acquiring sound within a 360-degree range of the surrounding space. For example... Figures 5A to 5B The diagram shows the location of the omnidirectional microphone on the terminal. In addition to the omnidirectional microphone used for directional sound pickup and forming an omnidirectional microphone array, the terminal can also have an omnidirectional microphone on the short side frame of the USB interface that is only used for regular sound pickup and does not participate in directional sound pickup. This microphone is in the off state by default when picking up directional sound.

[0092] In one embodiment of this disclosure, the sounds picked up by different omnidirectional microphones in the second omnidirectional microphone array 102 in the non-target audio pickup direction and the target audio pickup direction have a phase difference; the processing module 103 identifies the non-target audio pickup direction in the audio picked up in the overlapping beam direction based on the phase difference.

[0093] In this embodiment, the phase difference between the sound picked up in the non-target audio pickup direction and the target audio pickup direction is determined by using two omnidirectional microphones forming the second omnidirectional microphone array. In this disclosure, the third omnidirectional microphone forming the second omnidirectional microphone array is located on the back side of the terminal, while the other omnidirectional microphone forming the second omnidirectional microphone array is located on the terminal bezel or the edge of the terminal screen. That is, there is a phase difference between the two omnidirectional microphones forming the second omnidirectional microphone array in the direction from the front of the terminal to the back. Furthermore, the target audio pickup direction includes both the pickup direction facing the front of the terminal and the pickup direction facing the back of the terminal. By determining the order in which the two omnidirectional microphones forming the second omnidirectional microphone array receive the audio, it can be determined whether the target audio originates from the front or the back of the terminal. Thus, the audio in the target audio pickup direction is acquired, while the audio in the non-target audio pickup direction is masked. For example, if the front of the terminal is taken as the target audio pickup direction, then the audio arriving later at the third omnidirectional microphone in the second omnidirectional array is picked up as audio in the target audio pickup direction; and the audio arriving later at the third omnidirectional microphone is masked as audio in the target audio pickup direction.

[0094] In this embodiment of the disclosure, the target audio picked up from the target pickup area is obtained by the corresponding audio in the overlapping area of ​​the pickup areas of the first omnidirectional microphone array and the second omnidirectional microphone array, respectively. The audio in the overlapping area comes from the first omnidirectional microphone array and the second omnidirectional microphone array. The audio picked up by the first omnidirectional microphone array and the second omnidirectional microphone array must be processed by a pickup method suitable for the terminal to obtain the target audio. The following embodiments of this disclosure describe the pickup method of this disclosure applied to the above-mentioned terminal.

[0095] Figure 10 This is a flowchart illustrating a sound pickup method according to an exemplary embodiment, such as... Figure 10 As shown, the method includes steps S101 to S103.

[0096] In step S101, the audio picked up by the first omnidirectional microphone array and the second omnidirectional microphone array in the direction of overlapping beams is acquired.

[0097] Wherein, the overlapping beam direction is the beam direction that overlaps with the first beam direction and the second beam direction, the first beam direction is the beam direction in which the first omnidirectional microphone array picks up audio through beamforming, and the second beam direction is the beam direction in which the second omnidirectional microphone array picks up audio through beamforming.

[0098] In this embodiment, the pickup areas of the first omnidirectional microphone array and the second omnidirectional microphone array are geometrically perpendicular or approximately perpendicular. The pickup area of ​​the first omnidirectional microphone array is a ring-shaped area perpendicular or approximately perpendicular to the long side of the terminal, and the pickup area of ​​the second omnidirectional microphone array is a ring-shaped area perpendicular or approximately perpendicular to the short side of the terminal. By obtaining the overlapping area of ​​the two pickup areas, pickup areas distributed on the front and back of the terminal can be obtained.

[0099] In step S102, the target audio pickup direction and non-target audio pickup direction are identified among the audio picked up in the overlapping beam direction.

[0100] In this embodiment of the disclosure, the target audio pickup direction and the non-target audio pickup direction are determined based on the application scenario of the terminal. For example, in a video call scenario, it is necessary to collect the user's voice from the front of the terminal. In this case, the front of the terminal is the target audio pickup direction, and the back of the terminal is the non-target audio pickup direction. Similarly, when shooting video, it is necessary to collect the sound of the subject being filmed. In this case, the back of the terminal is the target audio pickup direction, and the front of the terminal is the non-target audio pickup direction.

[0101] In step S103, audio in the target audio pickup direction is picked up, and audio in the non-target audio pickup direction is suppressed.

[0102] In this embodiment of the disclosure, non-target audio is suppressed and target audio is retained by a preset noise reduction algorithm, thereby achieving directional sound pickup based on the pickup direction of the target audio.

[0103] In this embodiment of the disclosure, the sound pickup area of ​​the terminal is limited to two areas on the front and back of the terminal by two arrays, and the corresponding target audio pickup direction is determined based on the actual scene. The audio in the target audio pickup direction is acquired and other audio is blocked to achieve directional sound pickup.

[0104] In this embodiment of the disclosure, after determining the target audio pickup direction, the direction of audio arrival must be determined by an omnidirectional microphone array to determine the audio corresponding to the target audio pickup direction. The following embodiments of this disclosure describe the method for identifying the target audio pickup direction and non-target audio pickup directions.

[0105] Figure 11This is a flowchart illustrating a method for identifying target audio pickup direction and non-target audio pickup direction according to an exemplary embodiment, such as... Figure 11 As shown, the method includes steps S201 to S202.

[0106] In step S201, the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction is determined.

[0107] In step S202, based on the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction, the target audio pickup direction and the non-target audio pickup direction are identified in the audio picked up in the overlapping beam direction.

[0108] In this embodiment, the phase difference between the sound picked up in the non-target audio pickup direction and the target audio pickup direction is determined by using two omnidirectional microphones forming the second omnidirectional microphone array. In this disclosure, the third omnidirectional microphone forming the second omnidirectional microphone array is located on the back of the terminal, while the other omnidirectional microphone forming the second omnidirectional microphone array is located on the terminal bezel or the edge of the terminal screen. That is, there is a phase difference between the two omnidirectional microphones forming the second omnidirectional microphone array in the direction from the front of the terminal to the back. Furthermore, the target audio pickup direction includes both the pickup direction facing the front of the terminal and the pickup direction facing the back of the terminal. By determining the order in which the two omnidirectional microphones forming the second omnidirectional microphone array receive the audio, it can be determined whether the target audio originates from the front or the back of the terminal. Thus, the audio in the target audio pickup direction is acquired, while the audio in the non-target audio pickup direction is masked. For example, if the front of the terminal is taken as the target audio pickup direction, then the audio arriving later at the third omnidirectional microphone in the second omnidirectional microphone array is picked up as audio in the target audio pickup direction; and the audio arriving later at the third omnidirectional microphone is masked as audio in the target audio pickup direction.

[0109] In this embodiment of the disclosure, the target pickup area for picking up the target audio can be adjusted by adjusting the pickup areas of the first omnidirectional microphone array and the second omnidirectional microphone array. The following embodiments of the disclosure illustrate the method for adjusting the target pickup area.

[0110] Figure 12 This is a flowchart illustrating a method for identifying target audio pickup direction and non-target audio pickup direction according to an exemplary embodiment, such as... Figure 12 As shown, the method includes steps S301 to S302.

[0111] In step S301, the audio pickup width in the target audio pickup direction is adjusted.

[0112] In step S302, audio is picked up in the target audio pickup direction after adjusting the audio pickup width.

[0113] In this embodiment of the disclosure, the maximum pickup width of a single omnidirectional microphone array in the target audio pickup direction is 180 degrees. The audio pickup width of the omnidirectional microphone array can be adjusted as needed using a pickup width adjustment algorithm. For example... Figure 13 The diagram illustrates the adjustment of the audio pickup width in the microphone array. During video calls, if there are multiple users in front of the screen, the left-right audio pickup width of the first omnidirectional microphone array can be adjusted to 120 degrees; if there is only one user in front of the screen, the left-right audio pickup width can be set to 60 degrees. Similarly, the up-down audio pickup width of the second omnidirectional microphone array can be adjusted as needed.

[0114] In this embodiment of the disclosure, as shown in the top view and side view of the pickup range of the multi-omnidirectional microphone array in FIG14, the target pickup area is limited by the first omnidirectional microphone array and the second omnidirectional microphone array, and the pickup width of the target pickup area is adjusted. The pickup area can be limited to the area corresponding to the target sound source, and the sound of the target audio pickup target in the pickup direction can be accurately picked up.

[0115] In this embodiment of the disclosure, the audio pickup width is adjusted by audio input to further limit the audio pickup area of ​​the terminal and ensure the targeting of directional audio pickup.

[0116] In this embodiment of the disclosure, such as Figure 15 As shown in the schematic diagram of the second omnidirectional microphone array in this disclosure, if the second omnidirectional microphone array used to determine the direction of sound is... Figures 5A to 5B The first and third omnidirectional microphones in the array, and the two omnidirectional microphones in the second omnidirectional microphone array, have a phase difference in both the direction from the front of the terminal to the back and the direction corresponding to the short side of the terminal. Therefore, when determining the direction of audio through the second omnidirectional microphone array, audio from slightly behind the top of the terminal will arrive at the second omnidirectional microphone later, causing the audio from slightly behind the top of the terminal to be judged as audio from the front of the terminal. When the target pickup range is the front of the terminal, the corresponding pickup range diagram is as follows. Figure 16 As shown. If the second omnidirectional microphone array used in this disclosure to determine the direction of sound is... Figures 9A to 9B The third and fourth omnidirectional microphones in the second omnidirectional microphone array reduce the phase of the two omnidirectional microphones in the short side direction of the terminal, and adaptively adjust the pickup width of the first omnidirectional microphone array to prevent audio from being misinterpreted as audio from the upper rear of the terminal as audio from the front of the terminal. The corresponding pickup range diagram when the target pickup range is the front of the terminal is shown in the figure below. Figure 17As shown. In summary, directional sound pickup using four omnidirectional microphones is more effective than directional sound pickup using three omnidirectional microphones.

[0117] In this embodiment, the microphones in the first omnidirectional microphone array are arranged parallel or approximately parallel to the long side of the terminal. One omnidirectional microphone forming the second omnidirectional microphone array is mounted on the camera module on the back of the terminal, and the microphones in the two omnidirectional microphone arrays are arranged parallel or approximately parallel to the short side of the terminal. Beamforming is used to pick up audio from different beam directions using both the first and second omnidirectional microphone arrays. A processing module identifies the target audio pickup direction and non-target audio pickup directions among the audio picked up in overlapping beam directions, picking up audio in the target audio pickup direction and suppressing audio in the non-target audio pickup direction. Through this disclosure, based on the reasonable layout of multiple omnidirectional microphones on the terminal, multiple microphones form multiple different omnidirectional microphone arrays. Beamforming technology is used to fix the audio beam at a fixed angle matching the acquisition target, ensuring that the sound within the beam is clearly picked up by the terminal and that the sound outside the beam is effectively suppressed.

[0118] Based on the same concept, this disclosure also provides a pickup device 200.

[0119] It is understood that the microphone 200 provided in this disclosure includes hardware structures and / or software modules corresponding to each function in order to achieve the above-mentioned functions. In conjunction with the units and algorithm steps of the various examples disclosed in this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of this disclosure.

[0120] Figure 18 This is a block diagram illustrating a microphone 200 according to an exemplary embodiment. (Refer to...) Figure 18 The device includes an acquisition unit 201, an identification unit 202, and a processing unit 203.

[0121] Acquisition unit 201 is configured to acquire audio picked up by the first omnidirectional microphone array and the second omnidirectional microphone array in the direction of overlapping beams.

[0122] Wherein, the overlapping beam direction is the beam direction that overlaps with the first beam direction and the second beam direction, the first beam direction is the beam direction in which the first omnidirectional microphone array picks up audio through beamforming, and the second beam direction is the beam direction in which the second omnidirectional microphone array picks up audio through beamforming.

[0123] The identification unit 202 is configured to identify the target audio pickup direction and non-target audio pickup direction in audio picked up in the overlapping beam direction.

[0124] Processing unit 203 is configured to pick up audio in the target audio pickup direction and suppress audio in non-target audio pickup directions.

[0125] In one embodiment, the identification unit 202 identifies the target audio pickup direction and the non-target audio pickup direction in the audio picked up in the overlapping beam direction in the following manner: based on the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction, the target audio pickup direction and the non-target audio pickup direction are identified in the audio picked up in the overlapping beam direction.

[0126] In one embodiment, the processing unit 203 picks up audio in the target audio pickup direction in the following manner: adjusting the audio pickup width in the target audio pickup direction; and picking up audio in the target audio pickup direction after adjusting the audio pickup width.

[0127] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0128] Figure 19 This is a block diagram illustrating a device 800 for sound pickup according to an exemplary embodiment. For example, device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0129] Reference Figure 19 The device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0130] Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0131] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0132] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device 800.

[0133] Multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0134] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0135] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0136] Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or a component of device 800, the presence or absence of user contact with device 800, the orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0137] Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices. Device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0138] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0139] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of the device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0140] It is understood that in this disclosure, "multiple" refers to two or more, and other quantifiers are similar. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. The singular forms "a," "the," and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0141] It is further understood that the terms "first," "second," etc., are used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.

[0142] It is further understood that the terms “center,” “longitudinal,” “lateral,” “front,” “rear,” “up,” “down,” “left,” “right,” “vertical,” “horizontal,” “top,” “bottom,” “inner,” and “outer,” etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation.

[0143] It can be further understood that, unless otherwise specified, "connection" includes both direct connections where no other components exist between the two parties and indirect connections where other components exist between them.

[0144] It is further understood that although operations are described in a specific order in the accompanying drawings in the embodiments of this disclosure, this should not be construed as requiring these operations to be performed in the specific order or serial order shown, or requiring all of the shown operations to be performed to obtain the desired result. In certain environments, multitasking and parallel processing may be advantageous.

[0145] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0146] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A terminal, characterized in that, include: The first omnidirectional microphone array picks up audio in the direction of the first beam through beamforming; The second omnidirectional microphone array picks up audio in the direction of the second beam through beamforming. The first omnidirectional microphone array and the second omnidirectional microphone array implement beamforming in the form of a wide-side array. The beamforming of the wide-side array attenuates the sound on both sides of the array and makes the sound pickup area distributed in a ring around the midpoint of the array. There is a directional angle between the microphone arrangement direction in the first omnidirectional microphone array and the microphone arrangement direction in the second omnidirectional microphone array, and the directional angle is a right angle or close to a right angle; The overlapping beam direction of the first beam direction and the second beam direction includes at least the target audio pickup direction. The overlapping areas of the pickup areas corresponding to the first omnidirectional microphone array and the second omnidirectional microphone array are respectively distributed in the front and back faces of the terminal. The target audio pickup direction corresponds to the distribution of the overlapping areas. The processing module is used to identify the target audio pickup direction and non-target audio pickup direction in the audio picked up in the overlapping beam direction, pick up the audio in the target audio pickup direction, and suppress the audio in the non-target audio pickup direction.

2. The terminal according to claim 1, characterized in that, The target audio pickup direction includes the audio pickup direction facing the front of the terminal, and / or, the target audio pickup direction includes the audio pickup direction facing the back of the terminal.

3. The terminal according to claim 2, characterized in that, In the first omnidirectional microphone array, the angle between the microphone arrangement direction and the direction corresponding to the long side of the terminal is less than an angle threshold, and in the second omnidirectional microphone array, the angle between the microphone arrangement direction and the direction corresponding to the short side of the terminal is less than an angle threshold.

4. The terminal according to any one of claims 1 to 3, characterized in that, The first omnidirectional microphone array includes a first omnidirectional microphone and a second omnidirectional microphone, and the second omnidirectional microphone array includes a first omnidirectional microphone and a third omnidirectional microphone.

5. The terminal according to claim 4, characterized in that, The first omnidirectional microphone and the second omnidirectional microphone are disposed on the long side bezel of the terminal, or on the screen near the long side bezel of the terminal.

6. The terminal according to claim 5, characterized in that, The first omnidirectional microphone and the second omnidirectional microphone are symmetrically arranged along the vertical center line of the long side of the terminal.

7. The terminal according to any one of claims 1 to 3, characterized in that, The first omnidirectional microphone array includes a first omnidirectional microphone and a second omnidirectional microphone, and the second omnidirectional microphone array includes a third omnidirectional microphone and a fourth omnidirectional microphone.

8. The terminal according to claim 4, characterized in that, The third omnidirectional microphone is located on the back of the terminal.

9. The terminal according to claim 5, characterized in that, The third omnidirectional microphone is located on the back of the terminal.

10. The terminal according to claim 6, characterized in that, The third omnidirectional microphone is located on the back of the terminal.

11. The terminal according to claim 7, characterized in that, The third omnidirectional microphone is located on the back of the terminal.

12. The terminal according to claim 8, characterized in that, A camera module is installed on the back of the terminal; The third omnidirectional microphone is located on the frame of the camera module on the back of the terminal.

13. The terminal according to claim 7, characterized in that, The fourth omnidirectional microphone is located on the short side frame of the terminal near the third omnidirectional microphone.

14. The terminal according to claim 4, characterized in that, The terminal also includes: A fifth omnidirectional microphone is provided on the short side frame of the terminal, which is equipped with a USB interface.

15. The terminal according to any one of claims 1 to 3, characterized in that, The sounds picked up by different omnidirectional microphones in the second omnidirectional microphone array have a phase difference in the non-target audio pickup direction and the target audio pickup direction; The processing module identifies non-target audio pickup directions in the audio picked up in the overlapping beam direction based on the phase difference.

16. A sound pickup method, characterized in that, Applied to the terminal according to any one of claims 1 to 15, the method comprises: Audio is acquired from a first omnidirectional microphone array and a second omnidirectional microphone array in an overlapping beam direction. The overlapping beam direction is the beam direction where the first beam direction and the second beam direction overlap. The first beam direction is the beam direction in which the first omnidirectional microphone array picks up audio through beamforming, and the second beam direction is the beam direction in which the second omnidirectional microphone array picks up audio through beamforming. The first omnidirectional microphone array and the second omnidirectional microphone array implement beamforming in the form of a wide-side array. The beamforming of the wide-side array attenuates the sound on both sides of the array and makes the sound pickup area distributed in a ring around the midpoint of the array. In the audio picked up in the overlapping beam direction, the target audio pickup direction and non-target audio pickup direction are identified. The overlapping areas of the pickup areas corresponding to the first omnidirectional microphone array and the second omnidirectional microphone array are respectively distributed in the front and back orientations of the terminal. The target audio pickup direction corresponds to the distribution of the overlapping areas. Pick up audio in the target audio pickup direction and suppress audio in the non-target audio pickup direction.

17. The method according to claim 16, characterized in that, Identifying the target audio pickup direction and non-target audio pickup direction among the audio picked up in the overlapping beam direction includes: Based on the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction, the target audio pickup direction and the non-target audio pickup direction are identified in the audio picked up in the overlapping beam direction.

18. The method according to claim 16 or 17, characterized in that, The process of picking up audio in the target audio pickup direction includes: Adjust the audio pickup width in the target audio pickup direction; Pick up audio in the target audio pickup direction after adjusting the audio pickup width.

19. A sound pickup device, characterized in that, Applied to the terminal according to any one of claims 1 to 15, the device comprises: An acquisition unit is used to acquire audio picked up by a first omnidirectional microphone array and a second omnidirectional microphone array in an overlapping beam direction. The overlapping beam direction is the beam direction in which the first beam direction and the second beam direction overlap. The first beam direction is the beam direction in which the first omnidirectional microphone array picks up audio through beamforming, and the second beam direction is the beam direction in which the second omnidirectional microphone array picks up audio through beamforming. The first omnidirectional microphone array and the second omnidirectional microphone array implement beamforming in the form of a wide-side array. The beamforming of the wide-side array attenuates the sound on both sides of the array and makes the sound pickup area distributed in a ring around the midpoint of the array. The identification unit is used to identify the target audio pickup direction and non-target audio pickup direction in the audio picked up in the overlapping beam direction. The overlapping areas of the pickup areas of the first omnidirectional microphone array and the second omnidirectional microphone array are respectively distributed in the front and back faces of the terminal. The target audio pickup direction corresponds to the distribution of the overlapping areas. The processing unit is used to pick up audio in the target audio pickup direction and suppress audio in the non-target audio pickup direction.

20. The apparatus according to claim 19, characterized in that, The identification unit identifies the target audio pickup direction and non-target audio pickup direction in the audio picked up in the overlapping beam direction in the following manner: Based on the phase difference between the sounds picked up by different microphones in the second omnidirectional microphone array in the non-target audio pickup direction and the target audio pickup direction, the target audio pickup direction and the non-target audio pickup direction are identified in the audio picked up in the overlapping beam direction.

21. The apparatus according to claim 19 or 20, characterized in that, The processing unit picks up the audio in the target audio pickup direction in the following manner: Adjust the audio pickup width in the target audio pickup direction; Pick up audio in the target audio pickup direction after adjusting the audio pickup width.

22. A sound pickup device, characterized in that, include: processor: Memory used to store processor-executable instructions; The processor is configured to execute the sound pickup method according to any one of claims 16 to 18.

23. A storage medium, characterized in that, The storage medium stores instructions that, when executed by a processor, enable the processor to perform the sound pickup method according to any one of claims 16 to 18.

Images