Electronic equipment and pickup method

Abstract

The invention provides an electronic device and a pickup method, and belongs to the technical field of terminals.The electronic device comprises a directional microphone array, and the directional microphone array at least comprises a first directional microphone and a second directional microphone. The pickup enhancement direction of the first directional microphone is perpendicular to the pickup enhancement direction of the second directional microphone. The direction with the maximum sound signal gain of the directional microphone array is a target direction, and the target direction is jointly determined by the first directional microphone and the second directional microphone. According to the scheme provided by the invention, the array structure of the first directional microphone and the second directional microphone is combined with the back-end algorithm, so that pickup enhancement in a specific direction can be realized.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to an electronic device and a sound pickup method. Background Technology

[0002] Sound pickup technology is widely used in various audio and video scenarios, and it mainly uses microphone arrays to pick up sound. Currently, in electronic devices, sound is usually picked up by deploying omnidirectional microphones or omnidirectional microphone arrays. However, omnidirectional microphones have a consistent response to sound signals in all directions of space, and can only rely on array algorithms to enhance sound from specific directions in space.

[0003] For scenarios such as large conferences and speeches, it is often necessary to pick up sound from a specific direction at a distance. However, the pickup distance of omnidirectional microphone arrays is relatively short, which cannot meet this requirement. Omnidirectional microphone arrays have many requirements on the distance between microphones, and the consistency of their directional effect at different frequencies is often poor, thus affecting the overall directional performance of the array.

[0004] Furthermore, due to the weak frequency consistency of the array algorithm, it can lead to different gain effects on acoustic signals of different frequencies, i.e., "sound coloration," which affects the sound quality of the picked-up sound. Therefore, how to solve the above problems has become a topic worthy of research. Summary of the Invention

[0005] This application provides an electronic device and a sound pickup method. By combining the structural design of multiple directional microphones with a backend algorithm, directional sound pickup enhancement and improved sound pickup effect can be achieved.

[0006] In a first aspect, an electronic device is provided, including a directional microphone array, the directional microphone array including at least a first directional microphone and a second directional microphone, wherein the sound pickup enhancement direction of the first directional microphone is perpendicular to the sound pickup enhancement direction of the second directional microphone; the direction in which the sound signal gain of the directional microphone array is maximized is a target direction, the target direction being jointly determined by the first directional microphone and the second directional microphone.

[0007] This application designs a directional microphone array by modifying the structure of multiple directional microphones. Combined with a backend signal processing module, the acoustic signal is post-processed, allowing adjustment of the enhancement direction of the directional microphone array to achieve directional sound pickup enhancement. It should be understood that arranging multiple directional microphones in an XY configuration means that the enhancement directions of the microphones can be mutually perpendicular in the X and Y directions. By adjusting the pickup weight ratio of the microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect, broadening the range of applicable scenarios, and enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall device architecture and has minimal impact on the device's appearance.

[0008] In conjunction with the first aspect, in some implementations of the first aspect, the first directional microphone is disposed at the upper left corner of the electronic device, and the second directional microphone is disposed at the upper right corner of the electronic device; the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the second directional microphone includes a third sound inlet and a fourth sound inlet connected together; the first sound inlet is disposed on the top side of the electronic device, the second sound inlet is disposed on the left side of the electronic device, the third sound inlet is disposed on the top side of the electronic device, and the fourth sound inlet is disposed on the right side of the electronic device; the direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone, and the direction of the line connecting the third sound inlet and the fourth sound inlet is the sound pickup enhancement direction of the second directional microphone.

[0009] Exemplarily, as in Embodiment 1 of this application Figure 8 As shown.

[0010] It should be understood that the line connecting the first and second sound inlets is perpendicular to the line connecting the third and fourth sound inlets.

[0011] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two inlets of one directional microphone can be distributed on the top and left side of the electronic device, while the two inlets of the other directional microphone can be distributed on the top and right side of the electronic device. The sound pickup enhancement directions of the two directional microphones are perpendicular to each other in the X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the directional microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect and broadening the range of scenarios the sound pickup can adapt to, thereby enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall architecture of the device and has little impact on the device's appearance.

[0012] In conjunction with the first aspect, in some implementations of the first aspect, when the electronic device is a laptop computer including a display portion and a host portion, the first directional microphone is disposed at the upper left corner of the display portion and the second directional microphone is disposed at the upper right corner of the display portion; or, the first directional microphone is disposed at the upper left corner of the host portion and the second directional microphone is disposed at the upper right corner of the host portion.

[0013] In conjunction with the first aspect, in some implementations of the first aspect, any one of the first sound inlet, the second sound inlet, the third sound inlet, and the fourth sound inlet is a hole or a micro-slit.

[0014] In conjunction with the first aspect, in some implementations of the first aspect, the directional microphone array is disposed at the top corner of the electronic device; the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the directional microphone includes a second sound inlet and a third sound inlet connected together; the first sound inlet is disposed on the top side of the electronic device, the second sound inlet is disposed at the junction of the top of the electronic device and the first side, and the third sound inlet is disposed on the first side of the electronic device; wherein, when the top corner is the upper left corner, the first side is the left side; when the top corner is the upper right corner, the first side is the right side; the direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone; the direction of the line connecting the second sound inlet and the third sound inlet is the sound pickup enhancement direction of the second directional microphone.

[0015] As exemplarily shown in Embodiment 2 of this application.

[0016] It should be understood that the line connecting the first and second sound inlets is perpendicular to the line connecting the second and third sound inlets.

[0017] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two microphones can share a single sound inlet, which can be located in the upper left or upper right corner of the electronic device. The two non-shared sound inlets can be located at the top and side of the electronic device, respectively, with the two microphones enhancing sound in mutually perpendicular X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect and broadening the range of applicable scenarios, thus enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall device architecture and has minimal impact on the device's appearance.

[0018] In addition, in Embodiment 2, since the two directional microphones share a single sound inlet, the two directional microphones are positioned closer together, resulting in less influence on the transfer function. Compared to Embodiment 1, the directional enhancement capability and sound pickup effect are better.

[0019] In conjunction with the first aspect, in some implementations of the first aspect, when the electronic device is a laptop computer including a display portion and a host portion, the directional microphone array is disposed at the top corner of the display portion, or the directional microphone array is disposed at the top corner of the host portion.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, any one of the first sound inlet, the second sound inlet, and the third sound inlet is a hole or a micro-slit.

[0021] In conjunction with the first aspect, in some implementations of the first aspect, the directional microphone array is disposed on the rear camera Deco included in the electronic device; the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the directional microphone includes a second sound inlet and a third sound inlet connected together; if the rear camera Deco has thickness, the first sound inlet and the third sound inlet are both disposed on the side of the rear camera Deco; if the rear camera Deco has no thickness, the first sound inlet and the third sound inlet are both disposed on the side edge of the rear camera Deco; the second sound inlet is disposed on the plane where the rear camera Deco is located, and the plane is parallel to the screen of the electronic device; the direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone; the direction of the line connecting the second sound inlet and the third sound inlet is the sound pickup enhancement direction of the second directional microphone.

[0022] Exemplarily, as in embodiment 3 of this application Figure 14 and Figure 16 As shown.

[0023] It should be understood that the line connecting the first and second sound inlets is perpendicular to the line connecting the second and third sound inlets.

[0024] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two microphones can share a single sound inlet, which can be located on the plane of the rear camera deco of the electronic device. The two non-shared sound inlets can be located on the top side or side edge of the rear camera deco, and the other can be located on the left or right side or side edge of the rear camera deco. The sound pickup enhancement directions of the two directional microphones are perpendicular to each other in the X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the directional microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect, broadening the range of applicable scenarios, and enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall architecture of the device and has little impact on the device's appearance.

[0025] In conjunction with the first aspect, in certain implementations of the first aspect, if the rear camera deco has thickness, both the first sound inlet and the third sound inlet are disposed on the side of the rear camera deco, including: if the rear camera deco has thickness, the first sound inlet is disposed on the upper side of the rear camera deco, and the third sound inlet is disposed on the left or right side of the rear camera deco; if the rear camera deco has no thickness, both the first sound inlet and the third sound inlet are disposed on the side edge of the rear camera deco, including: if the rear camera deco has no thickness, the first sound inlet is disposed on the upper side edge of the rear camera deco, and the third sound inlet is disposed on the left or right side edge of the rear camera deco.

[0026] In conjunction with the first aspect, in some implementations of the first aspect, if the rear camera deco has thickness, the first sound inlet is disposed on the upper side of the rear camera deco, including:

[0027] The first sound inlet is a hole, and the first sound inlet is located on the upper side of the rear camera Deco;

[0028] The first sound inlet is a micro-slit, and the first sound inlet is located on the edge of the upper side of the rear camera deco, close to the screen, or the first sound inlet is located on the edge of the upper side of the rear camera deco, away from the screen.

[0029] In conjunction with the first aspect, in some implementations of the first aspect, if the rear camera deco has a thickness, the third sound inlet is disposed on the left or right side of the rear camera deco, including: the third sound inlet is a hole, and the third sound inlet is disposed on the left or right side of the rear camera deco; the third sound inlet is a micro-slit, and the third sound inlet is disposed on the edge of the left or right side of the rear camera deco near the screen; or, the third sound inlet is disposed on the edge of the left or right side of the rear camera deco away from the screen.

[0030] In conjunction with the first aspect, in some implementations of the first aspect, the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the second directional microphone includes a third sound inlet and a fourth sound inlet connected together.

[0031] The first sound inlet, the second sound inlet, and the third sound inlet are all located on the top side of the electronic device, and the third sound inlet is located between the first sound inlet and the second sound inlet;

[0032] The fourth sound inlet is located on the upper side of the first sound inlet, which is located on the side of the rear camera Deco included in the electronic device.

[0033] The direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone, and the direction of the line connecting the third sound inlet and the fourth sound inlet is the sound pickup enhancement direction of the second directional microphone.

[0034] As exemplarily shown in Embodiment 4 of this application.

[0035] It should be understood that the line connecting the first and second sound inlets is perpendicular to the line connecting the third and fourth sound inlets.

[0036] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two inlets of one directional microphone can be located on the top of the electronic device, while the two inlets of the other directional microphone can be located in the middle of the top of the electronic device and on the top side or side edge of the rear camera deco. The sound pickup enhancement directions of the two directional microphones are perpendicular to each other in the X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the directional microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect, expanding the range of scenarios that the sound pickup can adapt to, and thus enhancing the user experience. In addition, the added directional microphone array is compatible with the overall architecture of the device and has little impact on the appearance of the device.

[0037] In conjunction with the first aspect, in some implementations of the first aspect, any one of the first sound inlet, the second sound inlet, the third sound inlet, and the fourth sound inlet is a hole or a micro-slit.

[0038] In conjunction with the first aspect, in some implementations of the first aspect, when the first directional microphone or the second directional microphone is a figure-eight directional microphone, both bidirectional sound signals transmitted in the direction of sound pickup enhancement are enhanced; when the first directional microphone or the second directional microphone is a cardioid or supercardioid directional microphone, only unidirectional sound signals transmitted in the direction of sound pickup enhancement are enhanced.

[0039] In conjunction with the first aspect, in some implementations of the first aspect, the bidirectional direction of the sound pickup enhancement direction includes any one of the left-right direction, up-down direction, and diagonal up-down direction of the electronic device;

[0040] The unidirectional direction of the sound pickup enhancement direction includes any one of the following: left direction, right direction, up direction, and diagonally upward direction.

[0041] Secondly, a sound pickup method is provided, applied to an electronic device. The electronic device includes a directional microphone array, which includes a first directional microphone and a second directional microphone. The sound pickup enhancement direction of the first directional microphone is perpendicular to the sound pickup enhancement direction of the second directional microphone. The direction in which the acoustic signal gain of the directional microphone array is maximized is a target direction, which is jointly determined by the first directional microphone and the second directional microphone. The direction includes: acquiring the acoustic signal picked up by the first directional microphone and the acoustic signal picked up by the second directional microphone; transforming both the acoustic signal picked up by the first directional microphone and the acoustic signal picked up by the second directional microphone in the time domain to the frequency domain using a short-time Fourier transform algorithm; obtaining filter coefficients based on the acoustic signal from the first directional microphone transformed to the frequency domain and the acoustic signal from the second directional microphone transformed to the frequency domain; the filter coefficients ensure that the direction in which the filtered acoustic signal gain is maximized is the target direction.

[0042] In conjunction with the second aspect, in some implementations of the second aspect, when the electronic device is a laptop computer including a display portion and a host portion, if the directional microphone array is disposed on the display portion, the target direction is a direction close to the top of the display portion; if the directional microphone array is disposed on the host portion, the target direction is a direction close to the top of the host portion.

[0043] In conjunction with the second aspect, in some implementations of the second aspect, when the electronic device is a tablet computer or a mobile phone, the target direction is a direction close to the top of the mobile phone.

[0044] For example, the direction near the top of the phone can be perpendicular to the top of the phone.

[0045] In conjunction with the second aspect, in some implementations of the second aspect, the method of processing the acoustic signal from the first directional microphone transformed into the frequency domain and the acoustic signal from the second directional microphone transformed into the frequency domain includes: performing dereverberation processing on the acoustic signal from the first directional microphone transformed into the frequency domain; performing dereverberation processing on the acoustic signal from the second directional microphone transformed into the frequency domain; wherein the dereverberation processing is used to remove ambient noise from the acoustic signal transformed into the frequency domain; and obtaining the filter coefficients based on the dereverberated acoustic signal.

[0046] In conjunction with the second aspect, in some implementations of the second aspect, obtaining the filter coefficients based on the dereverberated acoustic signal includes: performing amplitude compensation and phase compensation on the acoustic signal of the first directional microphone in the dereverberated frequency domain and the acoustic signal of the second directional microphone in the dereverberated frequency domain; wherein the amplitude compensation is used to compensate for the amplitude loss of the acoustic signal caused by the device structure and environmental objects of the electronic device, and the phase compensation makes the phase difference between the compensated acoustic signals of the first directional microphone and the compensated acoustic signals of the second directional microphone a preset phase difference; and obtaining the filter coefficients based on the compensated acoustic signals of the first directional microphone and the compensated acoustic signals of the second directional microphone.

[0047] In conjunction with the second aspect, in some implementations of the second aspect, obtaining the filter coefficients based on the compensated acoustic signals from the first directional microphone and the second directional microphone includes:

[0048] The filter coefficients are obtained based on the compensated acoustic signals from the first and second directional microphones and the steering vector, wherein the steering vector is:

[0049]

[0050] in, θ represents the direction of the acoustic signal gain of the directional microphone array, j 2 =-1, ω=2πf, f is the frequency point of the sound signal in the frequency domain, τ0 is the delay of the plane wave arriving at the two adjacent microphones when it is incident from the 0° direction, ⊙ is the Adama product of the matrix, and c(ω,θ) is the microphone directivity correction factor when sound signals of different frequencies are incident from different directions as measured.

[0051] The filter coefficient h t (ω) is:

[0052] h t (ω)=A H (AA H ) -1 b

[0053] Where H is the matrix conjugate transpose. b = [1 0] T T denotes matrix transpose; θ max θ represents the direction of maximum acoustic signal gain. min This indicates the direction of maximum acoustic signal attenuation.

[0054] In conjunction with the second aspect, in some implementations of the second aspect, the method further includes: performing post-processing noise reduction on the filtered acoustic signal; and transforming the post-processed noise-reduced acoustic signal to the time domain using inverse short-time Fourier transform.

[0055] Thirdly, an electronic device is provided, comprising: a processor; and a memory;

[0056] The memory stores a computer program, which includes instructions that, when executed by the processor, cause the electronic device to perform the method as described in any of the implementations of the second aspect above.

[0057] Fourthly, a chip system is provided, the chip system including a processing circuit, a receiving pin, and a transmitting pin; wherein the receiving pin, the transmitting pin, and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method described in any of the implementations of the second aspect above to control the receiving pin to receive signals and control the transmitting pin to transmit signals.

[0058] Fifthly, a computer-readable storage medium is provided that stores computer-executable program instructions, which, when executed on a computer, cause the computer to perform the method as described in any of the implementations of the second aspect above.

[0059] In a sixth aspect, a computer program product is provided, the computer program product including computer program code, which, when run on a computer, causes the computer to perform the method as described in any of the implementations of the second aspect above. Attached Figure Description

[0060] Figure 1 A schematic diagram of the structure of an omnidirectional microphone provided for related technologies;

[0061] Figure 2 A schematic diagram of the structure of a directional microphone provided for related technologies;

[0062] Figure 3 This is a schematic diagram illustrating the directional characteristics of an omnidirectional microphone.

[0063] Figure 4 A schematic diagram illustrating the directional behavior of a directional microphone;

[0064] Figure 5 A schematic diagram of a pickup device suitable for a directional microphone provided in an embodiment of this application;

[0065] Figure 6 A schematic diagram of a pickup device suitable for another directional microphone provided in an embodiment of this application;

[0066] Figure 7 A schematic diagram of a pickup device suitable for another directional microphone provided in an embodiment of this application;

[0067] Figure 8 A schematic diagram of the planar distribution of the sound inlet of a directional microphone provided for an embodiment of this application;

[0068] Figure 9 A three-dimensional schematic diagram of the sound inlet distribution of a directional microphone provided for an embodiment of this application;

[0069] Figure 10 A three-dimensional schematic diagram of the sound inlet distribution of another directional microphone provided in an embodiment of this application;

[0070] Figure 11 A schematic diagram of the planar distribution of the sound inlet of another directional microphone provided in an embodiment of this application;

[0071] Figure 12 A three-dimensional schematic diagram of the sound inlet of a directional microphone provided in an embodiment of this application;

[0072] Figure 13 A three-dimensional schematic diagram of the sound inlet of a directional microphone provided in an embodiment of this application;

[0073] Figure 14 A schematic diagram of the planar distribution of the sound inlet of another directional microphone provided in an embodiment of this application;

[0074] Figure 15 A three-dimensional schematic diagram of the sound inlet distribution of a directional microphone provided for an embodiment of this application;

[0075] Figure 16A schematic diagram of the planar distribution of the sound inlet of a directional microphone provided for an embodiment of this application;

[0076] Figure 17 A schematic diagram of the planar distribution of the sound inlet of a directional microphone provided for an embodiment of this application;

[0077] Figure 18 A three-dimensional schematic diagram of the sound inlet distribution of a directional microphone provided for an embodiment of this application;

[0078] Figure 19 A three-dimensional schematic diagram of the sound inlet distribution of another directional microphone provided in an embodiment of this application;

[0079] Figure 20 A three-dimensional schematic diagram of the sound inlet distribution of another directional microphone provided in an embodiment of this application;

[0080] Figure 21 A schematic flowchart illustrating a sound pickup method provided in an embodiment of this application;

[0081] Figure 22 A simplified layout diagram of a directional microphone array provided in an embodiment of this application;

[0082] Figure 23 This is a schematic diagram illustrating the simulated directivity of a directional microphone array, provided as an embodiment of this application. Detailed Implementation

[0083] It should be noted that the terminology used in the implementation section of the embodiments of this application is only used to explain the specific embodiments of this application and is not intended to limit this application. In the description of the embodiments of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in this document is merely a description of the association relationship of related obstacles, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. In addition, in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more, "at least one" or "one or more" means one, two or more.

[0084] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0085] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0086] The technical solution of this application will be described in detail below with reference to specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0087] To better understand the device sound pickup method provided in the embodiments of this application, the following will first introduce the terms or concepts that may be involved in the embodiments below.

[0088] 1. Omnidirectional microphone

[0089] An omnidirectional microphone is a microphone that is equally sensitive to sound signals (or speech signals) in all directions of space, and it can collect sound signals from any direction.

[0090] For example, Figure 1 A schematic diagram of an omnidirectional microphone provided for related technologies.

[0091] like Figure 1 As shown, the opening at the top is the sound inlet of an omnidirectional microphone, which can use this sound inlet to collect sound signals from any direction.

[0092] 2. Directional microphone

[0093] A directional microphone is a microphone that is only sensitive to sound signals from a specific direction; that is, a directional microphone can only collect sound signals from a specific direction. In the embodiments of this application, the directional microphone can be a figure-eight directional microphone or a cardioid directional microphone. The figure-eight directional microphone's pickup shape resembles the number "8," while the cardioid microphone's pickup shape resembles a pattern. A figure-eight directional microphone can also be called a bicardioid microphone or a bidirectional microphone.

[0094] For example, Figure 2 A schematic diagram of the structure of a directional microphone provided for related technologies.

[0095] like Figure 2 As shown, the two openings at the top and bottom are the two sound inlets of a directional microphone. These two sound inlets are connected by a pipe, and the directional microphone can use these two sound inlets to collect sound signals from a specific direction.

[0096] 3. Beam

[0097] The spatial direction of a microphone's response to a sound signal can be represented by a beam. In other words, the beam can represent the microphone's sensitivity to sound signals in a specific direction. The direction in which the beam points indicates that the microphone is more sensitive to sound signals in that direction.

[0098] like Figure 3 The diagram shows the beam pattern of an omnidirectional microphone. The beam pattern of an omnidirectional microphone is close to a circle, with the boundary of the circle at 0 dB, meaning the maximum concavity is 0 dB. This indicates that the omnidirectional microphone is sensitive to sound signals from all directions in space and does not only collect sound signals from a specific direction, resulting in poor directivity.

[0099] like Figure 4 Figure (a) shows a schematic diagram of the beam directionality of a figure-eight directional microphone. The beam shape of this directional microphone resembles the number "8". For example, in the 0° and 180° directions, the directional beam can achieve 0dB, meaning that the sound signal in these directions is not attenuated. However, sound signals in other directions are suppressed. For example, the maximum dip depth corresponding to the 90° and 270° directions is -40dB, indicating significant sound signal attenuation. The maximum dip depth can be used to represent the degree of sound signal attenuation by the directional microphone in a specific direction. Figure 4 For example, in (a), the maximum indentation of the figure-eight directional microphone is -40dB, which indicates that the directional microphone does not collect sound signals in that particular direction.

[0100] like Figure 4 As shown in (b) above, this is a schematic diagram of the beam directionality formed by a cardioid microphone; Figure 4 As shown in (c), this is a schematic diagram of the beam pointing of a supercardioid microphone. The beam shapes of the two directional microphones are similar to the pattern shown. For example, in the 0° direction shown in the diagram, the directional beam can reach 0dB, meaning that the sound signal in the 0° direction is not attenuated. However, sound signals in other directions are suppressed, for example... Figure 4 In (b) of the diagram, the maximum indentation depth corresponding to the 180° direction is -40dB, indicating significant acoustic signal attenuation. The maximum indentation depth can be used to represent the degree of acoustic signal attenuation by a directional microphone in a specific direction. Figure 4For example, in (b) of the diagram, the maximum indentation of the cardioid microphone is -40dB, which indicates that the directional microphone does not collect sound signals in that particular direction.

[0101] 4. Microelectromechanical system (MEMS) microphone

[0102] MEMS microphones, also known as silicon microphones, are acoustic-to-electrical transducers based on MEMS technology. They are characterized by good frequency response and low noise. The general structure of a MEMS microphone consists of a printed circuit board (PCB) and a housing forming a microphone package. Internally, a MEMS chip and an application-specific integrated circuit (ASIC) chip electrically connected to it are integrated on the PCB, transmitting signals via bonding wires. The MEMS chip includes a substrate, a diaphragm fixed to the substrate, and a backplate. The diaphragm and backplate constitute a capacitor integrated on a silicon wafer. During sound pickup, sound enters the microphone through the sound hole and acts on the diaphragm of the MEMS chip. The vibration of the diaphragm changes the distance between the diaphragm and the backplate, thereby converting the acoustic signal into an electrical signal. In this application's embodiments, both the omnidirectional and directional microphones can be MEMS microphones.

[0103] 5. Deco

[0104] "Deco" refers to the decorative design of a camera module. It is not an abbreviation, but a noun used to describe the decorative design elements around a camera module. These elements can be of different shapes, colors, or materials, used to enhance the overall design language and aesthetics of electronic devices.

[0105] In this embodiment, "rear camera Deco" refers to the decorative design area corresponding to the rear camera module of the electronic device.

[0106] As described in the background section, omnidirectional microphones exhibit a consistent response to sound signals in all spatial directions, leading to poor overall directional performance of the array and impacting sound quality. Unlike omnidirectional microphones, directional microphones possess specific spatial directivity, allowing them to enhance sound signals in specific directions and improve pickup performance.

[0107] In recent years, with the development of microphone technology, the technology of directional microphones has matured, making their application in electronic products possible. However, some problems and contradictions have emerged in actual use.

[0108] For example, firstly, when directional microphones are used in electronic devices, two sound holes are generally required on the device's surface. This necessitates a meticulous design of the device's structure to ensure both the microphone's pickup characteristics and compatibility with the overall device architecture. Secondly, considering the limitations on the number of microphones in consumer electronics and the impact of the structural requirements of directional microphones (requiring two sound holes) on the product's appearance, the number of directional microphones should not be excessive. Thirdly, while the spatial directivity of a directional microphone is fixed once integrated into the device, in practical applications, the direction of directional sound enhancement should be flexibly adjustable within a 360° range depending on the scenario. Therefore, how to further address these issues becomes a worthy research topic.

[0109] In view of this, the present application provides a sound pickup device that designs the structure of multiple directional microphones to form a directional microphone array, and then combines it with a back-end signal processing module to perform post-processing on the sound signal, thereby adjusting the enhancement direction of the directional microphone array and thus achieving directional sound pickup enhancement.

[0110] It should be understood that arranging multiple directional microphones in an XY configuration, where the enhancement directions of these microphones can be mutually perpendicular in the X and Y directions, and by adjusting the pickup weight ratio of the microphones enhancing the X and Y directions, the direction of pickup enhancement can be adaptively adjusted. This effectively improves the pickup effect, broadens the range of scenarios the microphones can be used in, and enhances the user experience. Furthermore, the added directional microphone array is compatible with the overall device architecture and has minimal impact on the device's appearance.

[0111] In this application embodiment, the sound pickup device can also be referred to as an electronic device. This application embodiment does not specifically limit the type of electronic device. In some embodiments, the device can be a mobile phone, wearable device (e.g., smart bracelet, smartwatch, earphones, etc.), tablet computer, laptop computer, handheld computer, laptop, ultra-mobile personal computer (UMPC), cellular phone, personal digital assistant (PDA), augmented reality (AR) / virtual reality (VR) device, or other IoT (Internet of Things) devices, as well as a television, large screen, printer, projector, etc.

[0112] For example, such as Figure 5As shown, the sound pickup device can be a laptop computer; wherein, the laptop computer typically includes a display part and a host part, wherein the display part includes an A side (i.e., a top cover or shell) and a B side (screen), and the host part includes a C side (keyboard area) and a D side (bottom). In the embodiments of this application, multiple directional microphones can be added to the top of the display part and / or the host part of the laptop computer.

[0113] It should be understood that the top of the main unit refers to the side closest to the display section.

[0114] For example, such as Figure 6 As shown in (a) and (b) in the figure, the sound pickup device can be a tablet computer. In the embodiments of this application, multiple directional microphones can be added to the top of the tablet computer and / or the rear camera Deco.

[0115] For example, such as Figure 7 As shown in (a) and (b) in the figure, the sound pickup device can also be a mobile phone. In the embodiments of this application, multiple directional microphones can be added to the top of the mobile phone and / or the rear camera Deco.

[0116] Optionally, in the embodiments of this application, the sound inlet of the directional microphone can be any shape such as a hole or a micro-slit. When the sound inlet is a hole, the shape of the hole can be circular, elliptical, etc. The embodiments of this application do not impose any limitations on the shape, size, etc. of the sound inlet.

[0117] Optionally, in this embodiment, when the sound inlet of the directional microphone is set on the rear camera Deco, it can be set on the plane where the rear camera Deco is located; if the rear camera Deco has a certain thickness, the sound inlet of the directional microphone can be set on the side of the rear camera Deco, where the side refers to the curved surface in the thickness direction; if the rear camera Deco has no thickness, the sound inlet of the directional microphone can also be set on the side edge (or side) of the rear camera Deco.

[0118] It should be noted that, taking a directional microphone as an example, the direction of the line connecting the two sound inlets of the directional microphone is the sound pickup enhancement direction of a single directional microphone. When the directional microphone is a figure-eight directional microphone, it can enhance the sound transmitted in both directions in the sound pickup enhancement direction; when the directional microphone is a cardioid or supercardioid directional microphone, it can only enhance the sound transmitted in one direction in the sound pickup enhancement direction.

[0119] The distribution of the sound inlets of the directional microphones on the sound pickup device will be described in detail below with reference to four embodiments. In embodiments 1 and 2, a laptop computer is used as an example for illustration; in embodiments 3 and 4, a mobile phone is used as an example for illustration.

[0120] Example 1

[0121] Figure 8 This diagram illustrates the planar distribution of the sound inlet of a directional microphone according to an embodiment of this application.

[0122] like Figure 8 As shown, taking the addition of two directional microphones to a laptop as an example, the two sound inlets of each directional microphone can be evenly distributed on the side (thickness direction) of the laptop. The two directional microphones added to the laptop can be referred to as the first directional microphone and the second directional microphone, respectively. The two sound inlets of the first directional microphone can be referred to as sound inlet 1 and sound inlet 2, and the two sound inlets of the second directional microphone can be referred to as sound inlet 3 and sound inlet 4.

[0123] Optionally, such as Figure 8 As shown in (a) and (b), the first directional microphone can be located at the upper left corner of the display portion of the laptop computer, and the second directional microphone can be located at the upper right corner of the display portion of the laptop computer; or, the first directional microphone can be located at the upper left corner of the main body portion of the laptop computer, and the second directional microphone can be located at the upper right corner of the main body portion of the laptop computer.

[0124] Optionally, taking two directional microphones respectively positioned at the upper left and upper right corners of the laptop's main body as an example, such as... Figure 8 As shown in (a) and (b), the first directional microphone includes an inlet 1 that can be located on the top side of the main unit and an inlet 2 that can be located on the left side of the main unit; the second directional microphone includes an inlet 3 that can be located on the top side of the main unit and an inlet 4 that can be located on the right side of the main unit.

[0125] It should be understood that when two directional microphones are placed in the upper left and upper right corners of the laptop's display, the distribution of the four sound inlets can be similar to that described above, and will not be repeated here.

[0126] It should be understood that in the application scenarios of laptops, the main body of the laptop is placed horizontally, and the display part is placed vertically or at an obtuse angle to the main body. When it is necessary to pick up sound, it is generally used to pick up sound coming from the top of the main body of the laptop or the back of the display part. Therefore, it is necessary to enhance the sound in these directions. Taking this into consideration, the sound inlet of a directional microphone can be set on the top of the display part and / or the main body.

[0127] For example, taking two directional microphones respectively located at the upper left and upper right corners of the main body of a laptop computer, with the line connecting sound inlet 1 and sound inlet 2 in the Y direction, as shown... Figure 8 As shown in (a), when the directional microphone is a figure-eight directional microphone, the first directional microphone, through inlet 1 and inlet 2, can amplify the sound received from the top and left side (positive and negative Y) directions of the main unit; as Figure 8 As shown in (b), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the top side (positive Y direction) of the main unit can be enhanced.

[0128] Meanwhile, the line connecting sound inlet 3 and sound inlet 4 is in the Y direction, and the X and Y directions are perpendicular to each other, such as... Figure 8 As shown in (a), when the directional microphone is a figure-eight directional microphone, the second directional microphone, through inlets 3 and 4, can enhance the sound received from the top and right sides (positive and negative X) of the main unit; as Figure 8 As shown in (b), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the top side (negative X) direction of the main unit can be enhanced.

[0129] Optionally, in the above example, the sound inlets 1 to 4 can be either holes or micro-slits. When the sound inlet is a hole, since the main body of the laptop has a certain thickness, the sound inlet can be distributed on the top side, left side, or right side of the main body; when the sound inlet is a micro-slit, the sound inlet can be distributed on the side of the main body closer to surface C or on the side of the main body closer to surface D. This application embodiment does not limit this.

[0130] For example, Figure 9 and Figure 10 These are three-dimensional schematic diagrams showing the sound inlets of various directional microphones provided in the embodiments of this application.

[0131] If all four sound inlets are holes, such as Figure 9 As shown in (a) and (b), the sound inlet 1 can be located on the top side of the main unit, and the sound inlet 2 can be located on the left side of the main unit; similarly, as... Figure 9 As shown in (a), the sound inlet 3 can be located on the top side of the main unit, and the sound inlet 4 can be located on the right side of the main unit.

[0132] If both sound inlets of the first directional microphone are microslits, such as Figure 10 As shown in (a) and (b), the sound inlet 1 can be located on the top side edge of the main unit near the C-surface, and the sound inlet 2 can be located on the left side edge of the main unit near the C-surface; as Figure 10 As shown in (c), the sound inlet 1 can be located on the top side edge of the main unit near the D-side, and the sound inlet 2 can be located on the left side edge of the main unit near the D-side; as shown in (c). Figure 10 As shown in (d), the sound inlet 1 can be located on the top side edge of the main unit near surface D, and the sound inlet 2 can be located on the left side edge of the main unit near surface C; as shown in (d). Figure 10 As shown in (e), the sound inlet 1 can be distributed on the top side edge of the main unit near the C side, and the sound inlet 2 can be distributed on the left side edge of the main unit near the D side.

[0133] It should be understood that the figure only shows the distribution of the first directional microphone where both sound inlets are holes and both are microslits; in the embodiments of this application, the two sound inlets of the first directional microphone can also be one hole and the other a microslit, and the specific layout can be obtained by combining the above methods, which will not be repeated here. The distribution of the second directional microphone is similar to that of the first directional microphone, and will not be repeated here.

[0134] It should be understood that the above is only an example of a laptop computer. The sound pickup device of this application can also be a tablet computer, a mobile phone or other devices. For details, please refer to the above description, which will not be repeated here.

[0135] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two inlets of one directional microphone can be distributed on the top and left side of the electronic device, while the two inlets of the other directional microphone can be distributed on the top and right side of the electronic device. The sound pickup enhancement directions of the two directional microphones are perpendicular to each other in the X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the directional microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect and broadening the range of scenarios the sound pickup can adapt to, thereby enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall architecture of the device and has little impact on the device's appearance.

[0136] Example 2

[0137] Figure 11 This paper shows a schematic diagram of the planar distribution of the sound inlet of another directional microphone provided in an embodiment of this application.

[0138] like Figure 11As shown, taking the addition of two directional microphones to a laptop as an example, the two directional microphones can share a single sound inlet, which can be located at the upper left or upper right corner of the laptop. The non-shared sound inlet for each directional microphone can be located on the side (thickness direction) of the laptop.

[0139] The two directional microphones added to the laptop can be referred to as the first directional microphone and the second directional microphone, respectively. The first directional microphone includes two sound inlets, which can be referred to as sound inlet 1 and sound inlet 2, and the second directional microphone includes two sound inlets, which can be referred to as sound inlet 2 and sound inlet 3. It should be understood that sound inlet 2 is a shared sound inlet for both the first and second directional microphones.

[0140] Optionally, such as Figure 11 As shown in (a) and (b), the first directional microphone and the second directional microphone can be placed together in the upper left corner of the display portion of the laptop, or the first directional microphone and the second directional microphone can be placed together in the upper right corner of the display portion of the laptop; or the first directional microphone and the second directional microphone can be placed together in the upper left corner of the main body portion of the laptop, and the first directional microphone and the second directional microphone can be placed together in the upper right corner of the main body portion of the laptop.

[0141] Alternatively, taking the example of two directional microphones positioned together in the upper left corner of the laptop's main body, such as... Figure 11 As shown in (a) and (b), the sound inlet 1 of the first directional microphone can be distributed on the top side of the main unit; the sound inlet 3 of the second directional microphone can be distributed on the left side of the main unit; and the sound inlet 2 shared by the first and second directional microphones can be distributed at the upper left corner of the main unit, that is, at the junction of the top side and the left side.

[0142] It should be understood that when two directional microphones are placed together in the upper right corner of the laptop's display, the distribution of the three sound inlets can be similar to that described above, and will not be repeated here.

[0143] It should be understood that in the application scenarios of laptops, the main body of the laptop is placed horizontally, and the display part is placed vertically or at an obtuse angle to the main body. When it is necessary to pick up sound, it is generally used to pick up sound coming from the top of the main body of the laptop or the back of the display part. Therefore, it is necessary to enhance the sound in these directions. Taking this into consideration, the sound inlet of a directional microphone can be set on the top of the display part and / or the main body.

[0144] For example, taking two directional microphones together located in the upper left corner of the main body of a laptop computer, the line connecting sound inlet 1 and sound inlet 2 is in the X direction, as shown below. Figure 11 As shown in (a), when the directional microphone is a figure-eight directional microphone, the first directional microphone, through sound inlet 1 and sound inlet 2, can amplify the sound received from the left and right sides (positive and negative X) of the main unit; as Figure 11 As shown in (b), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the left side (negative X) direction of the main unit can be enhanced.

[0145] Meanwhile, the line connecting sound inlet 2 and sound inlet 3 is in the Y direction, and the X and Y directions are perpendicular to each other, such as... Figure 11 As shown in (a), when the directional microphone is a figure-eight directional microphone, the second directional microphone, through inlets 2 and 3, can enhance the sound received from the top and bottom (positive and negative Y) directions of the main unit; as Figure 11 As shown in (b), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the top side (positive Y direction) of the main unit can be enhanced.

[0146] Optionally, in the above example, the sound inlets 1 to 3 can be either holes or micro-slits. When the sound inlet is a hole, since the main body of the laptop has a certain thickness, the sound inlet can be distributed on the top side, left side, or right side of the main body; when the sound inlet is a micro-slit, the sound inlet can be distributed on the side of the main body closer to surface C or on the side of the main body closer to surface D. This application embodiment does not limit this.

[0147] For example, Figure 12 and Figure 13 These are three-dimensional schematic diagrams showing the sound inlets of various directional microphones provided in the embodiments of this application.

[0148] It should be noted that since the sound inlet 2 is located in the upper left or upper right corner, it is not convenient to make a hole in this position. Therefore, the sound inlet 2 can be set in the form of a micro slit.

[0149] Taking the sound inlet 2 as a micro-slit located in the upper left corner of the main unit as an example, sound inlets 1 and 3 are both holes, such as... Figure 12 As shown in (a), (b) and (c), the sound inlet 1 can be located on the top side of the main unit, and the sound inlet 3 can be located on the left side of the main unit; or, the sound inlet 1 can be located on the top side of the main unit, and the sound inlet 3 can be located on the right side of the main unit.

[0150] like Figure 12As shown in (b), the sound inlet 2 can be located on the upper left side edge of the main unit near surface C; or, as shown in (b), Figure 12 As shown in (c), the sound inlet 2 can be located on the upper left side edge of the main unit near the D side.

[0151] Taking sound inlet 2 as a microslit located in the upper left corner of the main unit as an example, sound inlets 1 and 3 are also microslits, such as... Figure 13 As shown in (a), (b), and (c), the sound inlet 1 can be located on the top side edge of the main unit near the C-surface, and the sound inlet 3 can be located on the left side edge of the main unit near the C-surface; as Figure 13 As shown in (d) and (e), the sound inlet 1 can be distributed on the top side edge of the main unit near the D surface, and the sound inlet 3 can be distributed on the left side edge of the main unit near the D surface; as Figure 13 As shown in (f), the sound inlet 1 can be located on the top side edge of the main unit near the D surface, and the sound inlet 3 can be located on the left side edge of the main unit near the C surface; as shown in (f), Figure 13 As shown in (g), the sound inlet 1 can be distributed on the top side edge of the main unit near the C surface, and the sound inlet 3 can be distributed on the left side edge of the main unit near the D surface.

[0152] It should be understood that the figure only shows the three sound inlets of the first and second directional microphones. The non-shared sound inlets are holes, the shared sound inlets are microslits, and the distribution of all three sound inlets being microslits. In the embodiments of this application, the two non-shared sound inlets of the first and second directional microphones can also be one hole and the other a microslit. The specific layout can be obtained by combining the above methods, which will not be repeated here. The distribution of the first and second directional microphones in the upper right corner is similar to that in the upper left corner, and will not be repeated here.

[0153] It should be understood that the above is only an example of a laptop computer. The sound pickup device of this application can also be a tablet computer, a mobile phone or other devices. For details, please refer to the above description, which will not be repeated here.

[0154] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two microphones can share a single sound inlet, which can be located in the upper left or upper right corner of the electronic device. The two non-shared sound inlets can be located at the top and side of the electronic device, respectively, with the two microphones enhancing sound in mutually perpendicular X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect and broadening the range of applicable scenarios, thus enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall device architecture and has minimal impact on the device's appearance.

[0155] In addition, in Embodiment 2, since the two directional microphones share a single sound inlet, the two directional microphones are positioned closer together, resulting in less influence on the transfer function. Compared to Embodiment 1, the directional enhancement capability and sound pickup effect are better.

[0156] Example 3

[0157] Figure 14 This paper shows a schematic diagram of the planar distribution of the sound inlet of another directional microphone provided in an embodiment of this application.

[0158] like Figure 14 As shown, taking the addition of two directional microphones to a mobile phone as an example, these two directional microphones can share a single sound inlet, which is distributed on the plane where the rear camera deco is located. Specifically, the sound inlet on the plane of the rear camera deco is located on a plane parallel to the phone screen, that is, on the XOY plane; here, the sound inlet on the XOY plane is in the shape of an aperture, and its position on the rear camera deco can be slightly higher, closer to the top of the phone.

[0159] If the rear camera deco has a certain thickness, then a non-shared sound inlet for each directional microphone can be distributed on the side of the rear camera deco; if the rear camera deco has no thickness, then a non-shared sound inlet for each directional microphone can be distributed on the side edge of the rear camera deco.

[0160] The two directional microphones added to the mobile phone can be referred to as the first directional microphone and the second directional microphone, respectively. The two sound inlets of the first directional microphone can be referred to as sound inlet 1 and sound inlet 2, and the two sound inlets of the second directional microphone can be referred to as sound inlet 2 and sound inlet 3. It should be understood that sound inlet 2 is a shared sound inlet for both the first and second directional microphones.

[0161] Optionally, taking the example where both inlet 1 and inlet 3 are holes, such as... Figure 14 As shown in (a) and (b), if the rear camera deco has a certain thickness, the sound inlet 1 can be distributed on the top side of the rear camera deco, and the sound inlet 3 can be distributed on the left side of the rear camera deco; or, as shown in (a) and (b), if the rear camera deco has a certain thickness, the sound inlet 1 can be distributed on the top side of the rear camera deco, and the sound inlet 3 can be distributed on the left side of the rear camera deco; or, as shown in (b) and (c ... Figure 14 As shown in (c) and (d), the sound inlet 1 can be located on the top side of the rear camera Deco, and the sound inlet 3 can be located on the right side of the rear camera Deco.

[0162] Optionally, taking the example where both sound inlets 1 and 3 are micro-slits, if the rear camera has a certain thickness, sound inlets 1 can be distributed on the side edge of the phone near the rear camera deco or away from the rear camera deco (also known as the side near the screen); whereby, regardless of which edge it is located on, sound inlets 1 are located at the top of the rear camera deco. Similarly, sound inlets 3 can be distributed on the side edge of the phone near the rear camera deco or near the screen; regardless of which edge it is located on, sound inlets 3 can be located on the left or right side of the rear camera deco. If the rear camera deco has no thickness, sound inlets 1 can be distributed on the top side edge of the rear camera deco, and sound inlets 3 can be distributed on the left or right side edge of the rear camera deco.

[0163] It should be understood that in the application scenarios of laptops, the main body of the laptop is placed horizontally, and the display part is placed vertically or at an obtuse angle to the main body. When it is necessary to pick up sound, it is generally used to pick up sound coming from the top of the main body of the laptop or the back of the display part. Therefore, it is necessary to enhance the sound in these directions. Taking this into consideration, the sound inlet of a directional microphone can be set on the top of the display part and / or the main body.

[0164] It should be understood that in application scenarios, regardless of whether the phone is placed upright, lying flat, or on its side, it is generally used to pick up sound coming from the top or back of the phone, so specific enhancement is needed for these directions. The bottom of the phone is generally only used to pick up the user's own voice, and the sound inlets of the omnidirectional microphones are already distributed in this position. Therefore, considering these two aspects, it is not necessary to set the sound inlets of directional microphones at the bottom of the phone and the lower side of the rear camera deco. It is sufficient to set the sound inlets of directional microphones only on the plane, top, or left and right sides of the rear camera deco.

[0165] For example, taking two directional microphones together on the rear camera Deco of a mobile phone as an example, the direction of the line connecting the sound inlet 1 and the sound inlet 2 of the first directional microphone is the Y direction or approximately the Y direction, such as... Figure 14As shown in (a) and (c), when the directional microphone is a figure-eight directional microphone, it can enhance the sound received from the top and bottom (Y or approximately Y) directions; as Figure 14 As shown in (b) and (d), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the top side (Y or approximately Y direction) can be enhanced.

[0166] Meanwhile, the line connecting the sound inlet 2 and the sound inlet 3 of the second directional microphone is in the X direction or approximately the X direction, and the X direction is perpendicular to the Y direction. Figure 14 As shown in (a) and (c), when the directional microphone is a figure-eight directional microphone, the second directional microphone, through inlet 2 and inlet 3, can amplify the sound received from the left and right sides (positive and negative X directions); as Figure 14 As shown in (b) and (d), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the left or right side (negative X or positive X) direction can be enhanced.

[0167] It should be explained that while sound inlets 1 and 2 are on the same vertical line in the Y-axis direction, they may not indicate the same position in the Z-axis direction (the thickness of the phone). The approximate Y-axis direction means that when sound inlets 1 and 2 indicate different positions on the Z-axis, the line connecting sound inlets 1 and 2 will form a certain angle with the Y-axis and Z-axis.

[0168] Similarly, sound inlets 2 and 3 are on the same horizontal line in the X-axis direction, but they may not indicate the same position in the Z-axis direction (the thickness of the phone). Approximate X-axis means that when sound inlets 2 and 3 indicate different positions on the Z-axis, the line connecting sound inlets 2 and 3 will form a certain angle with the Y-axis and Z-axis.

[0169] Optionally, when the sound inlet 1 and the sound inlet 3 are located at the same height or on the same plane along the thickness direction of the mobile phone, the distance between the sound inlet 1 and the sound inlet 3 (actually the surface distance) should be greater than or equal to 12mm; when the sound inlet 1 and the sound inlet 3 are not on the same plane along the thickness direction of the mobile phone, the distance between the sound inlet 1 and the sound inlet 3 (actually the sum of the distance in the thickness direction and the surface distance) should be greater than or equal to 12mm.

[0170] For example, Figure 15 This is a three-dimensional schematic diagram of the sound inlet of a directional microphone provided in an embodiment of this application.

[0171] It should be noted that since the sound inlet 2 is located on the plane where the rear camera Deco is located, this position is convenient for making holes. Therefore, the sound inlet 2 can be mainly set in the form of a hole.

[0172] Taking sound inlet 2 as an example, distributed on the plane where the rear camera Deco is located, if the rear camera Deco has a certain thickness, both sound inlet 1 and sound inlet 3 are holes. Figure 15 As shown in (a), the sound inlet 1 can be located on the top side of the rear camera Deco, and the sound inlet 3 can be located on the left side of the rear camera Deco; or, the sound inlet 1 can be located on the top side of the rear camera Deco, and the sound inlet 3 can be located on the right side of the rear camera Deco.

[0173] Both sound inlets 1 and 3 are micro-slits. If the rear camera deco has a certain thickness, such as Figure 15 As shown in (b), the sound inlet 1 can be located on the top side edge of the rear camera Deco on the side away from the screen, and the sound inlet 3 can be located on the left side edge of the rear camera Deco on the side away from the screen; as shown in (b). Figure 15 As shown in (c), the sound inlet 1 can be located on the top side edge of the rear camera Deco near the screen, and the sound inlet 3 can be located on the left side edge of the rear camera Deco near the screen; as shown in (c). Figure 15 As shown in (d), the sound inlet 1 can be located on the top side edge of the rear camera Deco on the side away from the screen, and the sound inlet 3 can be located on the left side edge of the rear camera Deco on the side closer to the screen; as shown in (d), Figure 15 As shown in (e), the sound inlet 1 can be located on the top side edge of the rear camera Deco near the screen, and the sound inlet 3 can be located on the left side edge of the rear camera Deco away from the screen. If the rear camera Deco has no thickness, such as... Figure 15 As shown in (f), the sound inlet 1 can be distributed on the top side edge of the rear camera Deco, and the sound inlet 3 can be distributed on the left side edge of the rear camera Deco.

[0174] It should be understood that the distribution of the sound inlet 3 on the right side or side edge is similar to that on the left side, and will not be described again here.

[0175] It should also be understood that the above example takes the sound inlet 1 being located on the top side or side edge of the rear camera Deco, and the sound inlet 3 being located on the left side or side edge, or the right side or side edge of the rear camera Deco. In this case, the X direction is horizontal and the Y direction is vertical.

[0176] For example, Figure 16 This is a schematic diagram of the planar distribution of another directional microphone provided in an embodiment of this application.

[0177] like Figure 16 As shown, relative to Figure 14 and Figure 15 In other words, Figure 16The sound inlet 1 can be located on the upper right side or side edge of the rear camera Deco, and the sound inlet 3 can be located on the upper left side or side edge of the rear camera Deco. The distribution of both sound inlet 1 and sound inlet 3 as holes or micro slits can be referred to the above example, and will not be repeated here.

[0178] It should be noted that the line connecting the sound inlet 1 and sound inlet 2 of the first directional microphone is still in the Y direction or approximately the Y direction, and the line connecting the sound inlet 2 and sound inlet 3 of the second directional microphone is still in the X direction or approximately the X direction. The direction of the enhanced sound can also be referred to the above description, and will not be repeated here. However, at this time, the X direction no longer indicates the horizontal direction, but is a downward direction at a certain angle to the horizontal direction; the Y direction no longer indicates the vertical direction, but is an upward direction at a certain angle to the horizontal direction, and the X and Y directions are still perpendicular to each other. For example, the angle can be 45°, and of course, it can also be other degrees. This application embodiment does not limit this.

[0179] It should also be understood that the above example only shows the distribution where the common sound inlet of the first directional microphone and the second directional microphone is a hole, and the two non-shared sound inlets are both holes or both are micro slits. Of course, the common sound inlet can also be a micro slit set on the deco plane of the rear camera, and the non-shared sound inlet can also be one hole and the other a micro slit. The specific layout can be referred to the above description, and will not be repeated here.

[0180] It should be understood that the above is only an example of a mobile phone. The sound pickup device of this application can also be other devices such as tablet computers and laptops. For details, please refer to the above description, which will not be repeated here.

[0181] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two microphones can share a single sound inlet, which can be located on the plane of the rear camera deco of the electronic device. The two non-shared sound inlets can be located on the top side or side edge of the rear camera deco, and the other can be located on the left or right side or side edge of the rear camera deco. The sound pickup enhancement directions of the two directional microphones are perpendicular to each other in the X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the directional microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect, broadening the range of applicable scenarios, and enhancing the user experience. Furthermore, the added directional microphone array is compatible with the overall architecture of the device and has little impact on the device's appearance.

[0182] Example 4

[0183] Figure 17 This paper shows a schematic diagram of the planar distribution of the sound inlet of another directional microphone provided in an embodiment of this application.

[0184] like Figure 17 As shown, taking the addition of two directional microphones to a mobile phone as an example, the two directional microphones can be referred to as the first directional microphone and the second directional microphone, respectively. The two sound inlets of the first directional microphone can be referred to as sound inlet 1 and sound inlet 2, and the two sound inlets of the second directional microphone can be referred to as sound inlet 3 and sound inlet 4.

[0185] The first directional microphone includes two sound inlets that can be evenly distributed at the top of the phone. The second directional microphone includes one sound inlet that can be distributed at the top of the phone, and the other sound inlet that can be distributed on the rear camera deco. If the rear camera deco has a certain thickness, the sound inlet can be distributed on the top side or top side edge of the rear camera deco.

[0186] Optionally, taking all four sound inlets as examples, sound inlets 1 to 3 can be evenly distributed at the top of the phone. Specifically, they can be distributed at the top of the phone's mid-frame. Among them, sound inlet 3 can be located between sound inlets 1 and sound inlets 2.

[0187] Optionally, taking all four sound inlets as micro-slits as an example, any one of the sound inlets located at the top of the phone can be distributed on the edge of the phone near the rear camera deco or away from the rear camera deco (also known as the side near the screen). The sound inlets on the rear camera deco can be distributed on the top side of the rear camera deco, or on the top side edge of the rear camera deco near the screen or away from the screen.

[0188] It should be understood that when the sound inlets located at the top of the phone are distributed on the edge of the phone near the rear camera (Deco side), they can be located at the top of the phone's back cover or at the junction of the phone's back cover and the top frame; when the sound inlets 1 are distributed on the edge of the phone near the screen, they can be located at the top of the phone's screen or at the junction of the phone's screen and the top frame.

[0189] It should be understood that in application scenarios, regardless of whether the phone is placed upright, lying flat, or on its side, it is generally used to pick up sound coming from the top of the phone, so specific enhancement is needed in these directions. The bottom of the phone is generally only used to pick up the user's own voice, and the sound inlets of the omnidirectional microphones are already distributed in this position. Therefore, considering these two aspects, it is not necessary to set the sound inlets of directional microphones at the bottom of the phone and the lower side of the rear camera deco. It is sufficient to set the sound inlets of directional microphones only at the top of the phone and on the top side or side edge of the rear camera deco.

[0190] For example, the line connecting the sound inlet 1 and the sound inlet 2 of the first directional microphone is in the X direction, such as... Figure 17 As shown in (a), when the directional microphone is a figure-eight directional microphone, it can enhance the sound received from the left and right sides (X or approximately X directions); as Figure 17 As shown in (b) and (c), when the directional microphone is a cardioid or supercardioid microphone, it can enhance the sound received from the left or right side (X or approximately X direction).

[0191] The line connecting inlet 3 and inlet 4 is in the Y direction or approximately the Y direction, and the Y direction is perpendicular to the X direction. Figure 17 As shown in (a), when the directional microphone is a figure-eight directional microphone, it can enhance the sound received from the top and bottom (Y or approximately Y) directions; as Figure 17 As shown in (b) and (c), when the directional microphone is a cardioid or supercardioid microphone, the sound received from the top side (Y or approximately Y direction) can be enhanced.

[0192] It should be explained that while sound inlets 1 and 2 are on the same vertical line in the X-axis direction, they may indicate the same or different positions in the Z-axis direction (the thickness of the phone). The approximate X-axis direction means that when sound inlets 1 and 2 indicate different positions on the Z-axis, the line connecting sound inlets 1 and 2 will form a certain angle with the Y-axis and Z-axis.

[0193] Similarly, sound inlets 3 and 4 are on the same vertical line in the Y-axis direction, but in the Z-axis direction (the thickness of the phone), they may indicate the same position or not. Approximate Y-axis means that when sound inlets 3 and 4 indicate different positions on the Z-axis, the line connecting sound inlets 3 and 4 will form a certain angle with the Y-axis and Z-axis.

[0194] Figures 18 to 20 A three-dimensional schematic diagram of the sound inlets of various directional microphones provided in the embodiments of this application.

[0195] For example, such as Figure 18 As shown in (a), (b), and (c), when sound inlets 1, 2, and 3 are all located on the top of the phone's frame, if the rear camera Deco has a certain thickness, such as Figure 18 As shown in (a), the sound inlet 4 can be located on the top side of the rear camera Deco; as Figure 18 As shown in (b), the sound inlet 4 can be located on the top side edge of the rear camera Deco near the screen, or, as... Figure 18 As shown in (c), the sound inlet 4 can be located on the top side edge of the rear camera on the side away from the Deco.

[0196] like Figure 18 As shown in (d) and (e), when the sound inlet 1 and the sound inlet 2 can be holes located on the top of the phone frame, and the sound inlet 4 is a hole on the top side of the rear camera Deco, the sound inlet 3 can be a micro slit located on the side edge of the top of the phone near the screen or on the side edge near the rear camera Deco.

[0197] like Figure 19 As shown in (a) and (b), when the sound inlet 1 and the sound inlet 2 can be micro-slits located on the top of the phone near the screen, and the sound inlet 3 can be a hole located on the top of the phone, the sound inlet 4 can be a micro-slit located on the side edge of the rear camera Deco near the screen or on the side edge away from the screen.

[0198] like Figure 19 As shown in (c) and (d), when the sound inlet 1 and the sound inlet 2 can be micro-slits located on the top of the phone away from the screen, and when the sound inlet 3 can be a hole located on the top of the phone, the sound inlet 4 can be a micro-slit located on the side edge of the top of the rear camera Deco, either close to the screen or away from the screen.

[0199] like Figure 20 As shown in (a) and (b), the sound inlet 1, sound inlet 2 and sound inlet 3 can be micro-slits located on the top of the phone near the screen; the sound inlet 4 can be a micro-slit, located on the side edge of the top of the rear camera Deco near the screen or on the side edge away from the screen.

[0200] like Figure 20 As shown in (c) and (d), the sound inlet 1, sound inlet 2 and sound inlet 3 can be micro-slits located on the top of the phone near the rear camera Deco side; the sound inlet 4 can be a micro-slit, located on the side edge of the top of the rear camera Deco near the screen or on the side edge away from the screen.

[0201] It should also be understood that the above examples only show examples where the sound inlets of the first and second directional microphones are all holes, all are microslits, three are holes, one is a microslit, one is a microslit, and three are holes. The four sound inlets can also be combinations of other forms. For specific layouts, please refer to the above description, which will not be repeated here.

[0202] It should be understood that the above is only an example of a mobile phone. The sound pickup device of this application can also be other devices such as tablet computers and laptops. For details, please refer to the above description, which will not be repeated here.

[0203] In this embodiment, multiple directional microphones can be added to an electronic device. Taking two directional microphones as an example, the two inlets of one directional microphone can be located on the top of the electronic device, while the two inlets of the other directional microphone can be located in the middle of the top of the electronic device and on the top side or side edge of the rear camera deco. The sound pickup enhancement directions of the two directional microphones are perpendicular to each other in the X and Y directions. Therefore, by adjusting the sound pickup weight ratio of the directional microphones enhancing the X and Y directions, the direction of sound pickup enhancement can be adaptively adjusted, effectively improving the sound pickup effect, expanding the range of scenarios that the sound pickup can adapt to, and thus enhancing the user experience. In addition, the added directional microphone array is compatible with the overall architecture of the device and has little impact on the appearance of the device.

[0204] Next, in conjunction with the appendix Figure 21 The backend algorithm processing involved in the sound pickup method provided in the embodiments of this application is described. For example, as shown below... Figure 21 The diagram shown illustrates the algorithm processing involved in the implementation of a device sound pickup method according to an embodiment of this application. The execution entity of this process may include a sound acquisition module and a processing module in the electronic device, and specifically includes the following steps:

[0205] S111, the first directional microphone acquires the first sound signal.

[0206] Here, the directional microphone can correspond to the first directional microphone in the above embodiment.

[0207] In some embodiments, the first sound signal may be the signal corresponding to the input sound acquired by the first directional microphone. The directional microphone here may be any one of a figure-eight, cardioid, or supercardioid directional microphone.

[0208] S112, the first sound signal is framed.

[0209] S113 transforms the acoustic signal corresponding to the first directional microphone after framing from the time domain to the frequency domain.

[0210] In some embodiments, the acoustic signal corresponding to the first directional microphone can be transformed from the time domain to the frequency domain using a short-time Fourier transform. The specific calculation method will be described below and will not be detailed here.

[0211] S114 performs dereverberation processing on the signal transformed to the frequency domain.

[0212] In some embodiments, a reverberation algorithm can be used to de-reverberate the first sound signal corresponding to the first directional microphone in the frequency domain.

[0213] S121, the second directional microphone acquires the second sound signal.

[0214] Here, the directional microphone can correspond to the second directional microphone in the above embodiment.

[0215] In some embodiments, the second acoustic signal may be the signal corresponding to the input sound acquired by the second directional microphone. The directional microphone here may be any one of a figure-eight, cardioid, or supercardioid microphone.

[0216] S122, the second sound signal is framed.

[0217] S123 transforms the acoustic signal corresponding to the second directional microphone after framing from the time domain to the frequency domain.

[0218] In some embodiments, the acoustic signal corresponding to the second directional microphone can be transformed from the time domain to the frequency domain using a short-time Fourier transform. The specific calculation method will be described below and will not be detailed here.

[0219] S124 performs dereverberation processing on the signal transformed to the frequency domain.

[0220] In some embodiments, a reverberation algorithm can be used to de-reverberate the second sound signal corresponding to the second directional microphone in the frequency domain.

[0221] S140: Amplitude compensation and phase compensation are performed on the signals obtained in S114 and S124 above to obtain the corresponding compensated signals.

[0222] In some embodiments, amplitude compensation and phase compensation can be performed on the acoustic signal corresponding to the directional microphone in the frequency domain using amplitude compensation factors and phase compensation factors, respectively. The specific calculation process will be described below and will not be detailed here.

[0223] It should be understood that amplitude compensation of the acoustic signal can reduce the amplitude loss caused by actual equipment structure and environmental factors, making the subsequently processed acoustic signal closer to the theoretical value. Phase compensation of the acoustic signal can ensure that the phase difference between the acoustic signal corresponding to the first directional microphone and the acoustic signal corresponding to the second directional microphone is specific, thereby achieving acoustic signal enhancement at a specific angle.

[0224] S150, design guide vector to obtain filter coefficients.

[0225] Among them, the guide vector can be designed based on the strongest and weakest directions of the desired directivity after synthesis, and the filter coefficients can be obtained.

[0226] S160 uses a filter to process the acoustic signal in the frequency domain and obtain the filtered signal.

[0227] In some embodiments, a filter can be set according to the filter coefficients, and then the filter can be used to filter the signal after amplitude compensation and phase compensation.

[0228] Specifically, after obtaining the filter, the frequency-domain compensated signal can be divided into frames and filter coefficients h. t The signals are multiplied by (ω), and the results of the multiplication are then summed to obtain a single-channel output signal containing the results of the array algorithm. The process of obtaining the filter coefficients can be found in the following description, which will not be detailed here.

[0229] S170 performs post-processing noise reduction on filtered acoustic signals based on statistical methods.

[0230] In some embodiments, after acquiring a single-channel output signal, a single-channel post-processing noise reduction module based on a statistical model can be cascaded at the back end to denoise the acquired signal. This noise reduction module can be, for example, a noise reduction module based on Wiener filtering, or a noise reduction module based on logarithmic minimum mean square error, etc.

[0231] S180 transforms the post-processed, noise-reduced acoustic signal to the time domain using the inverse short-time Fourier transform.

[0232] Then, the acoustic signal in the time domain can be output.

[0233] It should be noted that, through actual testing of the device combining the directional microphone array and the back-end algorithm involved in the sound pickup method provided in this application embodiment, an excellent unidirectional sound signal enhancement effect can be obtained. That is, electronic devices such as mobile phones that use this directional microphone array and back-end algorithm can enhance the sound signals coming from the front and sides of the mobile phone, while significantly reducing the influence of sound signals in other spatial directions on the sound pickup effect.

[0234] For ease of understanding, the following uses a mobile phone with the above-mentioned directional microphone array structure as an example, combined with simplified layout and simulation results, to introduce the backend algorithm processing and the effects of the sound pickup method provided in this application embodiment during implementation.

[0235] After the first and second directional microphones pick up the sound signals, the sound signals in the time domain can be converted to the frequency domain using a short-time Fourier transform. The sound signal after the short-time Fourier transform can be calculated using the following formula (1-1):

[0236]

[0237] Where m represents the microphone array element number, which can be 1, 2, ..., M; t represents the sequence number of each frame of the sound signal after dividing the sound signal into T frames, which can be 1, 2, ..., T, where T is an integer greater than or equal to 2; τ0 = δ / c is the delay of the plane wave arriving at two adjacent microphones when it is incident from the 0° direction; j 2 =-1, ω=2πf;x m,t Let y be the t-th frame of the speech signal acquired by the m-th microphone element under ideal conditions; m,t (ω) represents the acoustic signal in the frequency domain after the short-time Fourier transform.

[0238] Then, the acoustic signal y can be processed using a dereverberation algorithm. m,t (ω) is used for dreverberation processing to remove background noise and reverberation caused by sound reflections in space from the audio signal. For example, this dreverberation algorithm can be the WPE (weighted prediction error) algorithm. The audio signal after dreverberation using the WPE algorithm can be represented by the following formula (1-2):

[0239] y′ m,t (ω)=WPE(y m,t (ω)) (1-2)

[0240] Among them, y' m,t (ω) represents the sound signal after de-reverberation.

[0241] In some embodiments, to reduce the loss of acoustic signals caused by the spatial environment or equipment structure, amplitude compensation can be applied to the dedero-reverberant acoustic signal. For example, the following formulas (1-3) and (1-4) can be used to calculate the amplitude-compensated acoustic signal picked up by the corresponding microphone array elements:

[0242]

[0243] Among them, y”1,t (ω) represents the sound signal after amplitude compensation of the sound signal picked up by the omnidirectional microphone; y” 2,t (ω) represents the sound signal after amplitude compensation of the sound signal picked up by the second directional microphone; ω is the frequency point of the sound signal in the frequency domain; This is the amplitude compensation factor corresponding to the first directional microphone; This is the amplitude compensation factor corresponding to the second directional microphone; and It can be obtained by comparing the deviation between the measured value and the theoretical value of the acoustic signal at the maximum incident direction; is the phase compensation factor; e is the natural constant.

[0244] It should be understood that by performing amplitude compensation on the sound signal, the amplitude loss caused by the influence of equipment structure, environmental factors, etc. during the transmission process can be reduced, making the sound signal closer to the theoretical value without the influence of external factors.

[0245] In some embodiments, phase compensation can also be performed on the acoustic signal corresponding to the directional microphone using the following formulas (1-5):

[0246] y” m,t (ω)=[y” 1,t (ω),y” 2,t (ω)] T =d(ω,θ)c(ω,θ)x” m,t (ω) (1-5)

[0247] in, For the guide vector; x” m,t (ω) represents the acoustic signal acquired by the m-th microphone element under real-world conditions; c(ω,θ) represents the amplitude correction factor for acoustic signals of different frequencies incident from different directions, obtained through actual measurements; y” m,t (ω) represents the acoustic signal after phase compensation.

[0248] It should be understood that by performing phase compensation on the acoustic signals in the frequency domain corresponding to each directional microphone, multiple acoustic signals with specific phase differences can be obtained, which facilitates subsequent enhancement of acoustic signals in a specific direction.

[0249] Then, the filter coefficients can be solved using the null method, which requires finding the enhancement direction θ = θ max The gain is strongest when the attenuation direction is specified as θ = θ min The gain is 0. For example, the filter coefficients can be calculated using the following formulas (1-6) to (1-11):

[0250]

[0251] Formulas (1-6) and (1-7) can be uniformly expressed by the following formula (1-8):

[0252] Ah t (ω)=b (1-8)

[0253] in, b = [1 0] T .

[0254] Solving the above formula (1-11) yields the filter coefficients, which are shown in the following formula (1-9):

[0255] h t (ω)=A H (AA H ) -1 b (1-9)

[0256] Among them, h t (ω) represents the filter coefficients; H represents the matrix conjugate transpose.

[0257] In some embodiments, a corresponding filter can be designed based on the calculated filter coefficients. After obtaining the filter, the acoustic signal in the frequency domain can be compared frame by frame with the filter coefficients h. t (ω) are multiplied, and the results of each frame after multiplication are superimposed to obtain a single-channel output signal containing the results of array algorithm processing.

[0258] In some embodiments, after acquiring the single-channel output signal, a single-channel post-processing noise reduction module based on a statistical model can be cascaded at the back end to denoise the acquired signal. This noise reduction module can be, for example, a noise reduction module based on Wiener filtering, or a noise reduction module based on logarithmic minimum mean square error, etc.

[0259] It should be understood that the noise reduction effect can be further enhanced through the processing of this post-processing noise reduction module.

[0260] In some embodiments, after post-processing and denoising the single-channel output signal in the frequency domain, the optimized time-domain speech signal can be output through inverse short-time Fourier transform to obtain the final output signal.

[0261] For example, such as Figure 22 The diagram shows a combined layout of two directional microphones in a directional microphone array provided in an embodiment of this application. The two directional microphone arrays are in an XY configuration, meaning that the enhancement directions of the two directional microphones are perpendicular to each other, and their centers coincide, i.e., τ0 = 0.

[0262] by Figure 22 Taking the layout as an example, Figure 23 for Figure 22 Simulated directivity diagrams at different frequencies.

[0263] For example, the test environment can be as follows: in a fully anechoic chamber, the test sound source is white noise, a directional microphone array is fixed on a pre-set turntable, the turntable is controlled by a motor to rotate in 10° increments, and the pickup signal of the directional microphone array is collected after each rotation; then, a pickup directivity map representing the relationship between the pickup signal and the angle is obtained. Figure 23 The results from the directivity diagram show that the strongest pointing directions of the two figure-eight directional microphones are 45° / 225° and 135° / 315°, respectively. The enhancement direction was set to 60° / 240°. It is evident that the final synthesized array exhibits the required directivity, with good directivity at 1kHz, 2kHz, 4kHz, and 8kHz, indicating good consistency of the directional microphone array across different frequencies.

[0264] Therefore, the directional microphone array structure and corresponding back-end algorithm provided in the embodiments of this application described above can meet the requirements for enhancement in a specific direction.

[0265] Based on the same technical concept, embodiments of this application also provide an electronic device, including a processor; a memory; the memory storing a computer program, the computer program including instructions, which, when executed by the processor, cause the electronic device to perform one or more steps of any of the above methods.

[0266] Based on the same technical concept, this application embodiment also provides a chip system, the chip system including: a processing circuit, a receiving pin, and a transmitting pin; wherein, the receiving pin, the transmitting pin, and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes one or more steps of any of the above methods to control the receiving pin to receive signals and control the transmitting pin to transmit signals.

[0267] Based on the same technical concept, embodiments of this application also provide a computer-readable storage medium storing computer-executable program instructions, which, when executed on a computer, cause the computer or processor to perform one or more steps of any of the above methods.

[0268] Based on the same technical concept, embodiments of this application also provide a computer program product containing instructions, the computer program product including computer program code, which, when run on a computer, causes the computer or processor to perform one or more steps of any of the above methods.

[0269] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk, SSD), etc.

[0270] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0271] The above description is merely a specific implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.

Claims

1. An electronic device, characterized in that, The system includes a directional microphone array, which includes at least a first directional microphone and a second directional microphone, wherein the pickup enhancement direction of the first directional microphone is perpendicular to the pickup enhancement direction of the second directional microphone. The direction in which the acoustic signal gain of the directional microphone array is greatest is the target direction, which is determined jointly by the first directional microphone and the second directional microphone.

2. The electronic device according to claim 1, characterized in that, The first directional microphone is located at the upper left corner of the electronic device, and the second directional microphone is located at the upper right corner of the electronic device; the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the second directional microphone includes a third sound inlet and a fourth sound inlet connected together. The first sound inlet is located on the top side of the electronic device, the second sound inlet is located on the left side of the electronic device, the third sound inlet is located on the top side of the electronic device, and the fourth sound inlet is located on the right side of the electronic device. The direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone; the direction of the line connecting the third sound inlet and the fourth sound inlet is the sound pickup enhancement direction of the second directional microphone.

3. The electronic device according to claim 2, characterized in that, When the electronic device is a laptop computer including a display section and a host section, the first directional microphone is located at the upper left corner of the display section, and the second directional microphone is located at the upper right corner of the display section; Alternatively, the first directional microphone may be located at the upper left corner of the main unit, and the second directional microphone may be located at the upper right corner of the main unit.

4. The electronic device according to claim 2 or 3, characterized in that, Any one of the first sound inlet, the second sound inlet, the third sound inlet, and the fourth sound inlet is a hole or a micro-slit.

5. The electronic device according to claim 1, characterized in that, The directional microphone array is disposed at the top corner of the electronic device; the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the directional microphone includes a second sound inlet and a third sound inlet connected together. The first sound inlet is located on the top side of the electronic device, the second sound inlet is located at the junction of the top of the electronic device and the first side, and the third sound inlet is located on the first side of the electronic device; wherein, when the top corner is the upper left corner, the first side is the left side; when the top corner is the upper right corner, the first side is the right side. The direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone; the direction of the line connecting the second sound inlet and the third sound inlet is the sound pickup enhancement direction of the second directional microphone.

6. The electronic device according to claim 5, characterized in that, When the electronic device is a laptop computer including a display section and a host section, the directional microphone array is disposed at the top corner of the display section, or the directional microphone array is disposed at the top corner of the host section.

7. The electronic device according to claim 5 or 6, characterized in that, Any one of the first sound inlet, the second sound inlet, and the third sound inlet is a hole or a micro-slit.

8. The electronic device according to claim 1, characterized in that, The directional microphone array is disposed on the rear camera Deco included in the electronic device; the first directional microphone includes a first sound inlet and a second sound inlet connected together, and the directional microphone includes a second sound inlet and a third sound inlet connected together. If the rear camera deco has thickness, the first sound inlet and the third sound inlet are both located on the side of the rear camera deco; if the rear camera deco has no thickness, the first sound inlet and the third sound inlet are both located on the side edge of the rear camera deco. The second sound inlet is located on the plane where the rear camera Deco is located, and the plane is parallel to the screen of the electronic device; The direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone; the direction of the line connecting the second sound inlet and the third sound inlet is the sound pickup enhancement direction of the second directional microphone.

9. The electronic device according to claim 8, characterized in that, If the rear camera deco has thickness, both the first sound inlet and the third sound inlet are located on the side of the rear camera deco, including: If the rear camera deco has a thickness, the first sound inlet is located on the upper side of the rear camera deco, and the third sound inlet is located on the left or right side of the rear camera deco. If the rear camera deco has no thickness, both the first and third sound inlets are located on the side edges of the rear camera deco, including: If the rear camera deco has no thickness, the first sound inlet is located on the upper side edge of the rear camera deco, and the third sound inlet is located on the left or right side edge of the rear camera deco.

10. The electronic device according to claim 9, characterized in that, If the rear camera deco has thickness, the first sound inlet is disposed on the upper side of the rear camera deco, including: The first sound inlet is a hole, and the first sound inlet is located on the upper side of the rear camera Deco; The first sound inlet is a micro-slit, and the first sound inlet is located on the edge of the upper side of the rear camera deco, close to the screen, or the first sound inlet is located on the edge of the upper side of the rear camera deco, away from the screen.

11. The electronic device according to claim 8 or 9, characterized in that, If the rear camera deco has thickness, the third sound inlet is located on the left or right side of the rear camera deco, including: The third sound inlet is a hole, and the third sound inlet is located on the left or right side of the rear camera Deco. The third sound inlet is a micro-slit, and the third sound inlet is located on the edge of the left or right side of the rear camera Deco, close to the screen, or on the edge of the left or right side of the rear camera Deco, away from the screen.

12. The electronic device according to claim 1, characterized in that, The first directional microphone includes a first sound inlet and a second sound inlet connected together, and the second directional microphone includes a third sound inlet and a fourth sound inlet connected together. The first sound inlet, the second sound inlet, and the third sound inlet are all located on the top side of the electronic device, and the third sound inlet is located between the first sound inlet and the second sound inlet; The fourth sound inlet is located on the upper side of the first sound inlet, which is located on the side of the rear camera Deco included in the electronic device. The direction of the line connecting the first sound inlet and the second sound inlet is the sound pickup enhancement direction of the first directional microphone, and the direction of the line connecting the third sound inlet and the fourth sound inlet is the sound pickup enhancement direction of the second directional microphone.

13. The electronic device according to claim 12, characterized in that, Any one of the first sound inlet, the second sound inlet, the third sound inlet, and the fourth sound inlet is a hole or a micro-slit.

14. The electronic device according to any one of claims 1 to 13, characterized in that, When the first directional microphone or the second directional microphone is a figure-eight directional microphone, both bidirectional sound signals transmitted in the pickup enhancement direction are enhanced; when the first directional microphone or the second directional microphone is a cardioid or supercardioid directional microphone, only unidirectional sound signals transmitted in the pickup enhancement direction are enhanced.

15. The electronic device according to claim 14, characterized in that, The bidirectional direction of the sound pickup enhancement includes any one of the left-right direction, up-down direction, and diagonal up-down direction of the electronic device; The unidirectional direction of the sound pickup enhancement direction includes any one of the following: left direction, right direction, up direction, and diagonally upward direction.

16. A sound pickup method, characterized in that, This invention relates to an electronic device, which includes a directional microphone array comprising a first directional microphone and a second directional microphone. The pickup enhancement direction of the first directional microphone is perpendicular to the pickup enhancement direction of the second directional microphone. The direction in which the acoustic signal gain of the directional microphone array is maximized is a target direction, which is jointly determined by the first directional microphone and the second directional microphone. The target direction includes: Acquire the sound signal picked up by the first directional microphone and the sound signal picked up by the second directional microphone; The short-time Fourier transform algorithm is used to transform the sound signals picked up by the first directional microphone and the second directional microphone in the time domain to the frequency domain. Based on the acoustic signals from the first directional microphone transformed into the frequency domain and the acoustic signals from the second directional microphone transformed into the frequency domain, filter coefficients are obtained; the direction in which the gain of the filtered acoustic signal is maximized is the target direction.

17. The sound pickup method according to claim 16, characterized in that, When the electronic device is a laptop computer including a display section and a host section, if the directional microphone array is disposed on the display section, the target direction is a direction close to the top of the display section; if the directional microphone array is disposed on the host section, the target direction is a direction close to the top of the host section.

18. The sound pickup method according to claim 16, characterized in that, When the electronic device is a tablet or a mobile phone, the target direction is a direction close to the top of the mobile phone.

19. The sound pickup method according to any one of claims 16 to 18, characterized in that, Based on the acoustic signal from the first directional microphone transformed into the frequency domain and the acoustic signal from the second directional microphone transformed into the frequency domain, including: The acoustic signal from the first directional microphone, transformed into the frequency domain, is subjected to de-reverberation processing. The acoustic signal from the second directional microphone, transformed into the frequency domain, is subjected to dereverberation processing; wherein the dereverberation processing is used to remove environmental noise from the acoustic signal transformed into the frequency domain. The filter coefficients are obtained from the reverberation-reduced acoustic signal.

20. The sound pickup method according to claim 19, characterized in that, The filter coefficients are obtained from the dereverberation-processed acoustic signal, including: Amplitude compensation and phase compensation are performed on the acoustic signal of the first directional microphone in the frequency domain after dereverberation processing, and the acoustic signal of the second directional microphone in the frequency domain after dereverberation processing. The amplitude compensation is used to compensate for the loss of acoustic signal amplitude caused by the device structure and environmental objects of the electronic device, and the phase compensation makes the phase difference between the acoustic signals of the first directional microphone and the second directional microphone after compensation a preset phase difference. The filter coefficients are obtained based on the compensated acoustic signals from the first directional microphone and the second directional microphone.

21. The method according to claim 20, characterized in that, The filter coefficients are obtained based on the compensated acoustic signals from the first directional microphone and the second directional microphone, including: The filter coefficients are obtained based on the compensated acoustic signals from the first and second directional microphones and the steering vector, wherein the steering vector is: in, θ represents the direction of the acoustic signal gain of the directional microphone array, j 2 =-1, ω=2πf, f is the frequency point of the sound signal in the frequency domain, τ0 is the delay of the plane wave arriving at the two adjacent microphones when it is incident from the 0° direction, ⊙ is the Adama product of the matrix, and c(ω,θ) is the microphone directivity correction factor when sound signals of different frequencies are incident from different directions as measured. The filter coefficient h t (ω) is: h t (ω)=A H (AA H ) -1 b Where H is the matrix conjugate transpose. b = [10] T T denotes matrix transpose; θ max θ represents the direction of maximum acoustic signal gain. min This indicates the direction of maximum acoustic signal attenuation.

22. The sound pickup method according to any one of claims 16 to 21, characterized in that, The method further includes: Post-processing and noise reduction are performed on the filtered acoustic signal; The post-processed denoised acoustic signal is transformed to the time domain using the inverse short-time Fourier transform.

23. An electronic device, characterized in that, include: processor; Memory; The memory stores a computer program that includes instructions that, when executed by the processor, cause the electronic device to perform the method as described in any one of claims 16 to 22.

24. A chip system, characterized in that, The chip system includes a processing circuit, a receiving pin, and a transmitting pin; wherein the receiving pin, the transmitting pin, and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method as described in any one of claims 16 to 22 to control the receiving pin to receive signals and control the transmitting pin to transmit signals.

25. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable program instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 16 to 22.

Images