A pickup control method, device and equipment of a microphone and a storage medium
By using multiple pickup modules and calculating the Pearson correlation coefficient in the microphone, the microphone pointing is automatically adjusted, solving the problem of inaccurate microphone pickup in dynamic sound source environments in existing technologies, and achieving flexible and accurate audio acquisition.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- GUANGZHOU BAOLUN ELECTRONICS CO LTD
- Filing Date
- 2025-01-16
- Publication Date
- 2026-05-29
AI Technical Summary
Existing multi-directional microphones have difficulty automatically adjusting their direction in dynamically changing sound source environments, resulting in cumbersome operation and easy loss of key audio information, thus reducing the sound pickup effect.
Using at least two microphone modules, the system receives the intensity and frequency data of the sound signal, calculates the frequency characteristic parameters of the human voice using the Pearson correlation coefficient, automatically adjusts the microphone direction, shuts down microphone modules that do not meet the requirements, and keeps the modules that meet the requirements picking up sound.
It improves the accuracy and flexibility of microphone pickup, and can automatically switch between multiple pickup modes according to the scene, thus enhancing the flexibility and accuracy of audio acquisition.
Smart Images
Figure CN119946482B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of sound pickup technology, specifically to a microphone sound pickup control method, device, equipment, and computer-readable storage medium. Background Technology
[0002] In the current audio equipment field, existing multidirectional microphones have a significant drawback: they struggle to adapt flexibly to dynamically changing sound source environments. Specifically, when the speaker's position moves, or multiple sound sources from different directions suddenly appear in the same space, these microphones often reveal their limitations. Because their built-in directional adjustment mechanisms are relatively fixed, they cannot automatically and accurately adjust according to real-time changes in the sound source, requiring manual operation to change the microphone's direction. This is not only cumbersome and labor-intensive, but also prone to delays during manual adjustments, leading to the loss of crucial audio information and significantly reducing sound pickup performance in complex and changing environments. Summary of the Invention
[0003] In view of the above problems, embodiments of the present invention provide a microphone pickup control method, apparatus, device, and computer-readable storage medium to improve the accuracy and flexibility of microphone pointing adjustment.
[0004] According to one aspect of the present invention, a method for controlling the pickup of a microphone is provided, the microphone including at least two pickup modules, each pickup module pointing in a different direction, the method comprising:
[0005] When the microphone's pointing adjustment operation is triggered, the first sound signal is received using each of the aforementioned pickup modules;
[0006] Identify the first sound signal received by each of the aforementioned pickup modules, and obtain the intensity data and frequency data of the first sound signal received by each of the aforementioned pickup modules;
[0007] Based on the intensity data of the first sound signal received by each of the pickup modules, the intensity parameters of the first sound signal received by each of the pickup modules are obtained; based on the frequency data of the first sound signal received by each of the pickup modules, the frequency characteristic parameters of the first sound signal received by each of the pickup modules are obtained; and the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated.
[0008] Turn off the pickup modules that do not meet the preset conditions, so that the pickup modules that meet the preset conditions can be used to receive the second sound signal;
[0009] The preset condition for the pickup module is that the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are preset by the user.
[0010] Specifically, the microphone pickup control method provided by this invention can determine the location of a human voice source by combining sound intensity and voice characteristics, and automatically adjust the pickup direction to improve the accuracy of audio acquisition. At the same time, this invention can flexibly adjust the microphone's directivity and control the pickup function of each pickup module to automatically switch between multiple pickup modes according to the scenario, thus improving the flexibility of pickup control.
[0011] In one optional approach, frequency characteristic parameters of the first sound signal received by each of the pickup modules are acquired, and the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated, including:
[0012] The correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated using the Pearson correlation coefficient.
[0013] The expression for calculating the relevant value is:
[0014]
[0015] Where r(F) i M) is F i The related values of M, where i is a positive integer greater than or equal to 2, F i Let M be the frequency characteristic parameters of the first sound signal received by the i-th pickup module, and let M be the human voice frequency parameters, including n human voice frequency parameters, m j Let f be the frequency parameter of the j-th person's voice, j = 1, 2, ..., n, where n is the number of frequency characteristic parameters of the first sound signal received by the i-th pickup module; ij Let j be the j-th frequency characteristic parameter of the first sound signal received by the i-th pickup module, where j is a positive integer. Let be the average value of the frequency characteristic parameters of the first sound signal received by the n pickup modules. Let be the average value of the frequency parameters of n human voices.
[0016] In one optional approach, identifying the first sound signal received by each of the pickup modules, and obtaining intensity data and frequency data of the first sound signal received by each of the pickup modules, includes:
[0017] Extract the frequency, amplitude, and period of the first sound signal picked up by each of the sound pickup modules within a preset time.
[0018] The amplitude of the first sound signal picked up by each of the aforementioned sound pickup modules within a preset time period is used as the intensity data of the first sound signal received by each of the aforementioned sound pickup modules.
[0019] The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time period is taken as the frequency data of the first sound signal received by each of the sound pickup modules.
[0020] In one optional approach, the intensity parameters of the first sound signal received by each of the pickup modules are obtained based on the intensity data of the first sound signal received by each pickup module, including:
[0021] The average amplitude of the first sound signal picked up by each of the pickup modules within a preset time is calculated as the intensity parameter of the first sound signal received by each of the pickup modules.
[0022] In one alternative approach, the periodic triggering of the microphone's pointing adjustment operation;
[0023] Alternatively, upon receiving a microphone pointing adjustment command from the user, the microphone pointing adjustment operation is triggered.
[0024] According to another aspect of the present invention, a microphone pickup control device is provided, the microphone including at least two pickup modules, each pickup module pointing in a different direction, the device including: a receiving module, an identification module, a calculation module and a control module;
[0025] A receiving module is used to receive a first sound signal using each of the pickup modules when the microphone's pointing adjustment operation is triggered;
[0026] The identification module is used to identify the first sound signal received by each of the pickup modules, and to obtain the intensity data and frequency data of the first sound signal received by each of the pickup modules.
[0027] The calculation module is used to obtain the intensity parameters of the first sound signal received by each of the sound pickup modules based on the intensity data of the first sound signal received by each of the sound pickup modules; to obtain the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules based on the frequency data of the first sound signal received by each of the sound pickup modules; and to calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameters.
[0028] The control module is used to turn off the pickup modules that do not meet the preset conditions, so as to use the pickup modules that meet the preset conditions to receive the second sound signal;
[0029] The preset condition for the pickup module is that the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are preset by the user.
[0030] In one alternative approach, the calculation module includes: a relevant value calculation unit;
[0031] The correlation value calculation unit is used to calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters using the Pearson correlation coefficient.
[0032] The expression for calculating the relevant value is:
[0033]
[0034] Where r(F) i M) is F i The related values of M, where i is a positive integer greater than or equal to 2, F i Let M be the frequency characteristic parameters of the first sound signal received by the i-th pickup module, and let M be the human voice frequency parameters, including n human voice frequency parameters, m j Let f be the frequency parameter of the j-th person's voice, j = 1, 2, ..., n, where n is the number of frequency characteristic parameters of the first sound signal received by the i-th pickup module; ij Let j be the j-th frequency characteristic parameter of the first sound signal received by the i-th pickup module, where j is a positive integer. Let be the average value of the frequency characteristic parameters of the first sound signal received by the n pickup modules. Let be the average value of the frequency parameters of n human voices.
[0035] In one alternative embodiment, the device further includes: an operation triggering module;
[0036] An operation triggering module is used to periodically trigger the microphone's pointing adjustment operation;
[0037] Alternatively, upon receiving a microphone pointing adjustment command from the user, the microphone pointing adjustment operation is triggered.
[0038] According to another aspect of the present invention, a microphone pickup control device is provided, comprising: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus; the memory is used to store at least one executable instruction, wherein the executable instruction causes the processor to perform the operation of the microphone pickup control method as described in any of the preceding embodiments.
[0039] According to another aspect of the present invention, a computer-readable storage medium is provided, the storage medium storing at least one executable instruction that causes a microphone pickup control device / apparatus to perform the operation of the microphone pickup control method as described in any of the preceding claims.
[0040] The above description is merely an overview of the technical solutions of the embodiments of the present invention. In order to better understand the technical means of the embodiments of the present invention and to implement them in accordance with the contents of the specification, and to make the above and other objects, features and advantages of the embodiments of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description
[0041] The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:
[0042] Figure 1 A schematic flowchart of an embodiment of the microphone pickup control method provided by the present invention is shown;
[0043] Figure 2 A top view of a microphone is shown, illustrating an embodiment of the microphone pickup control method provided by the present invention.
[0044] Figure 3 A schematic diagram of one embodiment of the microphone pickup control device provided by the present invention is shown;
[0045] Figure 4 A schematic diagram of an embodiment of the microphone pickup control device provided by the present invention is shown. Detailed Implementation
[0046] Exemplary embodiments of the invention will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be implemented in various forms and should not be limited to the embodiments set forth herein.
[0047] Figure 1A flowchart illustrating an embodiment of the microphone pickup control method provided by the present invention is shown. This method is executed by a microphone pickup control device. The microphone includes at least two pickup modules, each pointing in a different direction. This embodiment uses a microphone with four pickup modules as an example, where the microphone includes pickup modules pointing in four directions, such as... Figure 2 As shown, Figure 2 The diagram shows a top view of the microphone, with the microphone's pickup modules 1-4 pointing in the four horizontal directions: up, down, left, and right.
[0048] Specifically, the sound pickup module is either a sound sensor or a microphone array.
[0049] like Figure 1 As shown, the method includes the following steps:
[0050] Step 110: When the microphone's pointing adjustment operation is triggered, the first sound signal is received using each of the aforementioned pickup modules.
[0051] Specifically, when the microphone's pointing adjustment operation is triggered, all pickup modules are activated, and each pickup module receives a first sound signal to detect sounds in the surrounding environment.
[0052] Specifically, the microphone's pointing adjustment operation is triggered periodically;
[0053] Alternatively, upon receiving a microphone pointing adjustment command from the user, the microphone pointing adjustment operation is triggered.
[0054] For example, after the microphone is powered on, a microphone pointing adjustment operation is triggered, and this operation is repeated every preset time interval. Alternatively, the microphone pointing adjustment operation is triggered by the user pressing a button on the microphone to send a microphone pointing adjustment command.
[0055] Step 120: Identify the first sound signal received by each of the pickup modules, and obtain the intensity data and frequency data of the first sound signal received by each of the pickup modules.
[0056] In some embodiments of the present invention, identifying the first sound signal received by each of the pickup modules and obtaining the intensity data and frequency data of the first sound signal received by each of the pickup modules includes:
[0057] Extract the frequency, amplitude, and period of the first sound signal picked up by each of the sound pickup modules within a preset time.
[0058] The amplitude of the first sound signal picked up by each of the aforementioned sound pickup modules within a preset time period is used as the intensity data of the first sound signal received by each of the aforementioned sound pickup modules.
[0059] The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time period is taken as the frequency data of the first sound signal received by each of the sound pickup modules.
[0060] Step 130: Based on the intensity data of the first sound signal received by each of the pickup modules, obtain the intensity parameter of the first sound signal received by each of the pickup modules; based on the frequency data of the first sound signal received by each of the pickup modules, obtain the frequency characteristic parameter of the first sound signal received by each of the pickup modules; calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameter.
[0061] In some embodiments of the present invention, the intensity parameters of the first sound signal received by each of the pickup modules are obtained based on the intensity data of the first sound signal received by each pickup module, including:
[0062] The average amplitude of the first sound signal picked up by each of the pickup modules within a preset time is calculated as the intensity parameter of the first sound signal received by each of the pickup modules.
[0063] In some embodiments of the present invention, the frequency characteristic parameters of the first sound signal received by each of the pickup modules are collected, and the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated, including:
[0064] The correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated using the Pearson correlation coefficient.
[0065] The expression for calculating the relevant value is:
[0066]
[0067] Where r(F) i M) is F i The related values of M, where i is a positive integer greater than or equal to 2, F i Let M be the frequency characteristic parameters of the first sound signal received by the i-th pickup module, and let M be the human voice frequency parameters, including n human voice frequency parameters, m j Let f be the frequency parameter of the j-th person's voice, j = 1, 2, ..., n, where n is the number of frequency characteristic parameters of the first sound signal received by the i-th pickup module; ij Let j be the j-th frequency characteristic parameter of the first sound signal received by the i-th pickup module, where j is a positive integer. Let be the average value of the frequency characteristic parameters of the first sound signal received by the n pickup modules. Let be the average value of the frequency parameters of n human voices.
[0068] Specifically, human voices have a specific frequency range. The fundamental frequency of adult males is generally between 80-150Hz, and that of adult females is around 160-250Hz. They also have features such as resonance peaks. The frequency distribution is relatively concentrated and regular. In contrast, noise has a wide frequency range and a more random distribution. It may cover all frequency bands from low to high frequencies and does not have obvious concentrated frequency areas or fixed frequency characteristics.
[0069] Assuming the human voice frequency parameters include 5 frequency values and their corresponding amplitudes: fundamental frequency: 150Hz, amplitude: 0.6; second harmonic: 300Hz, amplitude: 0.4; third harmonic: 450Hz, amplitude: 0.3; first formant frequency: 800Hz, amplitude: 0.7; second formant frequency: 1200Hz, amplitude: 0.5; then the average value of the human voice frequency parameters is... The result is (0.6+0.4+0.3+0.7+0.5) / 5=0.5.
[0070] Assuming the five frequency characteristic parameters of the sound signal received by the first pickup module are: 140Hz, amplitude: 0.55; 290Hz, amplitude: 0.38; 440Hz, amplitude: 0.28; 780Hz, amplitude: 0.65; 1180Hz, amplitude: 0.45, then the average value of the frequency characteristic parameters of the sound signal received by the first pickup module is... The result is: (0.55+0.38+0.28+0.65+0.45) / 5=0.462.
[0071] According to the Pearson correlation coefficient formula:
[0072]
[0073] In the expression In the equation, for the fundamental frequency: (0.55-0.462)×(0.6-0.5)=0.0088; for the second harmonic: (0.38-0.462)×(0.4-0.5)=0.0082; for the third harmonic: (0.28-0.462)×(0.3-0.5)=0.0364; for the first resonant frequency: (0.65-0.462)×(0.7-0.5)=0.0376; for the second resonant frequency: (0.45-0.462)×(0.5-0.5)=0. Therefore, the sum is: 0.0088+0.0082+0.0364+0.0376+0=0.091, i.e., the numerator...
[0074] In expression In the context of the fundamental frequency: (0.55-0.462) 2 =0.007744; For the second harmonic: (0.38-0.462)² = 0.006724; For the third harmonic: (0.28-0.462)² = 0.032764; For the first resonant frequency: (0.65-0.462)² = 0.035344; For the second resonant frequency: (0.45-0.462)² = 0.000144; Therefore, the sum is: 0.007744+0.006724+0.032764+0.035344+0.000144 = 0.08272, and its square root is approximately 0.2876, which is expressed as:
[0075] In expression For the fundamental frequency: (0.6-0.5)² = 0.01; for the second harmonic: (0.4-0.5)² = 0.01; for the third harmonic: (0.3-0.5)² = 0.04; for the first resonant frequency: (0.7-0.5)² = 0.04; for the second resonant frequency: (0.5-0.5)² = 0; the sum is: 0.01 + 0.01 + 0.04 + 0.04 + 0 = 0.1, and its square root is 0.3162; that is, the expression...
[0076] Therefore, the denominator expression The Pearson correlation coefficient r(F1,M) between the frequency characteristic parameters of the sound signal from pickup module 1 and the pre-set human voice frequency parameters is approximately 1 (0.091 / 0.0909). Assuming a threshold of 0.8, if the calculated Pearson correlation coefficient is greater than or equal to 0.8, the sound signal received by the pickup module is considered to be primarily human voice; if it is less than 0.8, it is considered not to be a primary human voice signal.
[0077] Step 104: Turn off the pickup modules that do not meet the preset conditions, so as to use the pickup modules that meet the preset conditions to receive the second sound signal;
[0078] The preset condition for the pickup module is that the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are preset by the user.
[0079] Specifically, the intensity parameters of the first sound signal received by the four pickup modules are S1, S2, S3, and S4, respectively, with an intensity threshold of T. A larger intensity parameter value indicates a stronger received sound signal. The pickup module corresponding to the direction of a potentially important sound source is determined based on the intensity parameter exceeding the intensity threshold.
[0080] The Pearson correlation coefficient is used to measure the linear correlation between the frequency characteristic parameters of the first sound signal received by each of the aforementioned pickup modules and the corresponding human voice frequency parameters. The correlation value ranges between -1 and 1, with a higher correlation indicating a higher degree of positive correlation, i.e., a higher degree of matching between the sound signal and the human voice. The pickup module corresponding to the direction of a possible human voice source is determined based on the correlation value between the frequency parameters and the corresponding human voice frequency parameters exceeding a preset threshold.
[0081] Combining two judgment conditions—the intensity parameter exceeding an intensity threshold and the correlation value between the frequency parameter and the corresponding human voice frequency parameter exceeding a preset threshold—the microphone continues to pick up sound using a pickup module that meets both judgment conditions, while a pickup module that does not meet either judgment condition is excluded. In this embodiment, the microphone can implement four pickup modes: omnidirectional, unidirectional, bidirectional, and stereo. When all four pickup modules meet both judgment conditions, they are used for sound pickup, achieving an omnidirectional microphone pickup method. When only one of the pickup modules (e.g., pickup module 2) meets both judgment conditions, only pickup module 2 is used for sound pickup, achieving a unidirectional pickup method. When only two adjacent pickup modules (e.g., pickup modules 1 and 2) meet both judgment conditions, only pickup modules 1 and 2 are used for sound pickup, achieving a bidirectional pickup method. When only two non-adjacent pickup modules (e.g., pickup modules 1 and 3) meet both judgment conditions, only pickup modules 1 and 3 are used for sound pickup, achieving a stereo pickup method.
[0082] The microphone pickup control method provided by this invention can determine the location of a human voice source by combining sound intensity and voice characteristics, and automatically adjust the pickup direction to improve the accuracy of audio acquisition. Simultaneously, this invention can flexibly adjust the microphone's directivity and control the pickup function of each pickup module, automatically switching between multiple pickup modes according to the scenario, thus improving the flexibility of pickup control.
[0083] Figure 3 This diagram illustrates a structural schematic of an embodiment of the microphone pickup control device provided by the present invention; the microphone includes at least two pickup modules, each pickup module pointing in a different direction; as shown... Figure 3 As shown, the device 300 includes: a receiving module 310, an identification module 320, a calculation module 330, and a control module 340.
[0084] The receiving module 310 is used to receive the first sound signal using each of the pickup modules when the microphone's pointing adjustment operation is triggered;
[0085] The identification module 320 is used to identify the first sound signal received by each of the pickup modules, and to obtain the intensity data and frequency data of the first sound signal received by each of the pickup modules.
[0086] The calculation module 330 is used to obtain the intensity parameters of the first sound signal received by each of the sound pickup modules based on the intensity data of the first sound signal received by each of the sound pickup modules; to obtain the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules based on the frequency data of the first sound signal received by each of the sound pickup modules; and to calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameters.
[0087] The control module 340 is used to turn off the pickup module that does not meet the preset conditions, so as to use the pickup module that meets the preset conditions to receive the second sound signal;
[0088] The preset condition for the pickup module is that the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are preset by the user.
[0089] In one optional embodiment, the identification module 320 identifies the first sound signal received by each of the pickup modules, and obtains the intensity data and frequency data of the first sound signal received by each pickup module, including:
[0090] Extract the frequency, amplitude, and period of the first sound signal picked up by each of the sound pickup modules within a preset time.
[0091] The amplitude of the first sound signal picked up by each of the aforementioned sound pickup modules within a preset time period is used as the intensity data of the first sound signal received by each of the aforementioned sound pickup modules.
[0092] The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time period is taken as the frequency data of the first sound signal received by each of the sound pickup modules.
[0093] In one optional approach, obtaining the intensity parameter of the first sound signal received by each of the pickup modules based on the intensity data of the first sound signal received by each of the pickup modules includes:
[0094] The average amplitude of the first sound signal picked up by each of the pickup modules within a preset time is calculated as the intensity parameter of the first sound signal received by each of the pickup modules.
[0095] In one alternative embodiment, the calculation module 330 includes: a correlation value calculation unit;
[0096] The correlation value calculation unit is used to calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters using the Pearson correlation coefficient.
[0097] The expression for calculating the relevant value is:
[0098]
[0099] Where r(F) i M) is F i The related values of M, where i is a positive integer greater than or equal to 2, F i Let M be the frequency characteristic parameters of the first sound signal received by the i-th pickup module, and let M be the human voice frequency parameters, including n human voice frequency parameters, m j Let f be the frequency parameter of the j-th person's voice, j = 1, 2, ..., n, where n is the number of frequency characteristic parameters of the first sound signal received by the i-th pickup module; ij Let j be the j-th frequency characteristic parameter of the first sound signal received by the i-th pickup module, where j is a positive integer. Let be the average value of the frequency characteristic parameters of the first sound signal received by the n pickup modules. Let be the average value of the frequency parameters of n human voices.
[0100] In one alternative embodiment, the device 300 further includes an operation triggering module; the operation triggering module is used to periodically trigger the microphone's pointing adjustment operation; or, when a microphone pointing adjustment command sent by a user is received, the pointing adjustment operation of the microphone is triggered.
[0101] As the device embodiment is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment.
[0102] Figure 4 The diagram shows a schematic representation of an embodiment of the microphone pickup control device provided by the present invention. The specific embodiments of the present invention do not limit the specific implementation of the microphone pickup control device.
[0103] like Figure 4As shown, the microphone's pickup control device may include: a processor 402, a communications interface 404, a memory 404, and a communications bus 408.
[0104] The processor 402, communication interface 404, and memory 404 communicate with each other via communication bus 408. Communication interface 404 is used to communicate with other network elements such as clients or other servers. The processor 402 executes program 410, specifically performing the relevant steps in the above-described embodiment of the microphone pickup control method.
[0105] Specifically, program 410 may include program code, which includes computer-executable instructions.
[0106] Processor 402 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The microphone pickup control device includes one or more processors, which may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.
[0107] Memory 404 is used to store program 410. Memory 404 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.
[0108] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other device. Furthermore, the embodiments of this invention are not directed to any particular programming language.
[0109] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of the invention may be practiced without these specific details. Similarly, for the sake of brevity and to aid in understanding one or more aspects of the invention, in the description of exemplary embodiments of the invention above, various features of the embodiments are sometimes grouped together in a single embodiment, figure, or description thereof. The claims, which follow the detailed description, are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of the invention.
[0110] Those skilled in the art will understand that the modules in the device of the embodiment can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiment can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components, except that at least some of such features and / or processes or units are mutually exclusive.
[0111] It should be noted that the above embodiments are illustrative of the invention and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be construed as limiting the order of execution.
Claims
1. A microphone pickup control method, characterized in that, The microphone includes at least two pickup modules, each pickup module pointing in a different direction, and the method includes: When the microphone's pointing adjustment operation is triggered, the first sound signal is received using each of the aforementioned pickup modules; Identify the first sound signal received by each of the aforementioned pickup modules, and obtain the intensity data and frequency data of the first sound signal received by each of the aforementioned pickup modules; Based on the intensity data of the first sound signal received by each of the pickup modules, the intensity parameters of the first sound signal received by each of the pickup modules are obtained; based on the frequency data of the first sound signal received by each of the pickup modules, the frequency characteristic parameters of the first sound signal received by each of the pickup modules are obtained; and the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated. Turn off the pickup modules that do not meet the preset conditions, so that the pickup modules that meet the preset conditions can be used to receive the second sound signal; The preset condition for the pickup module is that the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are preset by the user.
2. The microphone pickup control method according to claim 1, characterized in that, Collect frequency characteristic parameters of the first sound signal received by each of the aforementioned pickup modules, and calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the aforementioned pickup modules and the corresponding human voice frequency parameters, including: The correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters is calculated using the Pearson correlation coefficient. The expression for calculating the relevant value is: Where r(F) i M) is F i The related values of M, where i is a positive integer greater than or equal to 2, F i Let M be the frequency characteristic parameters of the first sound signal received by the i-th pickup module, and let M be the human voice frequency parameters, including n human voice frequency parameters, m j Let f be the frequency parameter of the j-th person's voice, j = 1, 2, ..., n, where n is the number of frequency characteristic parameters of the first sound signal received by the i-th pickup module; ij f is the j-th frequency characteristic parameter of the first sound signal received by the i-th pickup module, where j is a positive integer. i Let be the average value of the frequency characteristic parameters of the first sound signal received by the n pickup modules. Let be the average value of the frequency parameters of n human voices.
3. The microphone pickup control method according to claim 1, characterized in that, Identifying the first sound signal received by each of the aforementioned pickup modules, and obtaining the intensity data and frequency data of the first sound signal received by each of the aforementioned pickup modules, including: Extract the frequency, amplitude, and period of the first sound signal picked up by each of the sound pickup modules within a preset time. The amplitude of the first sound signal picked up by each of the aforementioned sound pickup modules within a preset time period is used as the intensity data of the first sound signal received by each of the aforementioned sound pickup modules. The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time period is taken as the frequency data of the first sound signal received by each of the sound pickup modules.
4. The microphone pickup control method according to claim 3, characterized in that, Based on the intensity data of the first sound signal received by each of the aforementioned sound pickup modules, intensity parameters of the first sound signal received by each of the aforementioned sound pickup modules are obtained, including: The average amplitude of the first sound signal picked up by each of the pickup modules within a preset time is calculated as the intensity parameter of the first sound signal received by each of the pickup modules.
5. The microphone pickup control method according to any one of claims 1-4, characterized in that, Also includes: The microphone's pointing adjustment operation is triggered periodically; Alternatively, upon receiving a microphone pointing adjustment command from the user, the microphone pointing adjustment operation is triggered.
6. A microphone pickup control device, characterized in that, The microphone includes at least two pickup modules, each pickup module pointing in a different direction; the device includes: a receiving module, an identification module, a calculation module, and a control module. A receiving module is used to receive a first sound signal using each of the pickup modules when the microphone's pointing adjustment operation is triggered; The identification module is used to identify the first sound signal received by each of the pickup modules, and to obtain the intensity data and frequency data of the first sound signal received by each of the pickup modules. The calculation module is used to obtain the intensity parameters of the first sound signal received by each of the sound pickup modules based on the intensity data of the first sound signal received by each of the sound pickup modules; to obtain the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules based on the frequency data of the first sound signal received by each of the sound pickup modules; and to calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameters. The control module is used to turn off the pickup modules that do not meet the preset conditions, so as to use the pickup modules that meet the preset conditions to receive the second sound signal; The preset condition for the pickup module is that the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are preset by the user.
7. The microphone pickup control device according to claim 6, characterized in that, The calculation module includes: a correlation value calculation unit; The correlation value calculation unit is used to calculate the correlation value between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters using the Pearson correlation coefficient. The expression for calculating the relevant value is: Where r(F) i M) is F i The related values of M, where i is a positive integer greater than or equal to 2, F i Let M be the frequency characteristic parameters of the first sound signal received by the i-th pickup module, and let M be the human voice frequency parameters, including n human voice frequency parameters, m j Let f be the frequency parameter of the j-th person's voice, j = 1, 2, ..., n, where n is the number of frequency characteristic parameters of the first sound signal received by the i-th pickup module; ij Let j be the j-th frequency characteristic parameter of the first sound signal received by the i-th pickup module, where j is a positive integer. Let be the average value of the frequency characteristic parameters of the first sound signal received by the n pickup modules. Let be the average value of the frequency parameters of n human voices.
8. The microphone pickup control device according to claim 6, characterized in that, Also includes: Operation trigger module; An operation triggering module is used to periodically trigger the microphone's pointing adjustment operation; Alternatively, upon receiving a microphone pointing adjustment command from the user, the microphone pointing adjustment operation is triggered.
9. A microphone pickup control device, characterized in that, include: The processor, memory, communication interface, and communication bus are provided, wherein the processor, memory, and communication interface communicate with each other via the communication bus. The memory is used to store at least one executable instruction that causes the processor to perform the operation of the microphone pickup control method as described in any one of claims 1-7.
10. A computer-readable storage medium, characterized in that, The storage medium stores at least one executable instruction, which, when executed on the microphone pickup control device / apparatus, causes the microphone pickup control device / apparatus to perform the operation of the microphone pickup control method as described in any one of claims 1-7.