Pickup control method and device of microphone, equipment and storage medium

Abstract

The invention relates to the technical field of pickup, and discloses a pickup control method, device and equipment for a microphone and a storage medium, and the method comprises the steps: receiving a sound signal through employing each pickup module when the pointing adjustment operation of the microphone is triggered, and obtaining the intensity parameter and frequency characteristic parameter of the sound signal; calculating a correlation value between the frequency characteristic parameter of the sound signal received by each pickup module and the corresponding human voice frequency parameter; closing the pickup modules which do not accord with the preset condition, so as to receive the sound signal by using the pickup modules which accord with the preset condition; wherein the intensity parameter value of the received sound signal exceeds an intensity threshold value, and the correlation value of the frequency parameter of the received sound signal and the corresponding human voice frequency parameter exceeds a preset threshold value; the intensity threshold value and the corresponding human voice frequency parameter are preset by a user. By applying the technical scheme of the invention, the accuracy and flexibility of microphone direction adjustment can be improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of sound pickup technology, and in particular to a sound pickup control method, device, equipment and computer-readable storage medium of a microphone. Background Art

[0002] In the current field of audio equipment, existing multi-directional microphones have a significant shortcoming, which is that they are difficult to flexibly adapt to dynamically changing sound source environments. Specifically, when the speaker in the usage scenario moves, or when multiple sound sources in different directions suddenly appear in the same space, this type of microphone often exposes its limitations. Because its built-in directional adjustment mechanism is relatively rigid, it is impossible to automatically make precise adjustments based on real-time changes in the sound source, and can only rely on manual operation to change the direction of the microphone. This is not only cumbersome and labor-intensive, but also very easy to cause delays in the manual adjustment process, thereby missing some key audio information, greatly reducing the sound pickup effect in complex and changing on-site environments. Summary of the invention

[0003] In view of the above problems, embodiments of the present invention provide a method, device, equipment and computer-readable storage medium for controlling sound pickup of a microphone, which are used to improve the accuracy and flexibility of adjusting the directionality of the microphone.

[0004] According to one aspect of an embodiment of the present invention, a method for controlling sound pickup of a microphone is provided, wherein the microphone comprises at least two sound pickup modules, each of which points to a different direction, and the method comprises:

[0005] When the direction adjustment operation of the microphone is triggered, the first sound signal is received by each of the sound pickup modules;

[0006] Identify that each of the sound pickup modules receives a first sound signal, and obtain intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules;

[0007] According to the intensity data of the first sound signal received by each sound pickup module, an intensity parameter of the first sound signal received by each sound pickup module is obtained; according to the frequency data of the first sound signal received by each sound pickup module, a frequency characteristic parameter of the first sound signal received by each sound pickup module is obtained; and a correlation value between the frequency characteristic parameter of the first sound signal received by each sound pickup module and a corresponding human voice frequency parameter is calculated;

[0008] Turn off the sound pickup module that does not meet the preset conditions, so as to use the sound pickup module that meets the preset conditions to receive the second sound signal;

[0009] Among them, the pickup module with preset conditions is a pickup module in which the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are pre-set by the user.

[0010] Specifically, the microphone pickup control method provided by the present invention can determine the location of the human voice source by combining the sound intensity and the human voice characteristics, and automatically adjust the pickup direction to improve the accuracy of audio collection. At the same time, the present invention can flexibly adjust the directivity of the microphone, and can flexibly control the pickup function of each pickup module to automatically switch between multiple pickup modes according to the scene, thereby improving the flexibility of pickup control.

[0011] In an optional manner, collecting the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules, and calculating the correlation value between the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameters, includes:

[0012] Calculating the correlation value between the frequency characteristic parameter of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameter using the Pearson correlation coefficient;

[0013] The calculation expression of the correlation value is:

[0014]

[0015] Among them, r(F i , M) is F i and the correlation value of M, i is a positive integer greater than or equal to 2, F i is the frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, M is the human voice frequency parameter, including n human voice frequency parameters, m j is the jth personal voice frequency parameter, j=1, 2, ..., n, n is the number of frequency characteristic parameters of the first sound signal received by the i-th sound pickup module; f ij is the jth frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, where j is a positive integer. is the average value of the frequency characteristic parameters of the first sound signal received by the n sound pickup modules, is the average value of n voice frequency parameters.

[0016] In an optional manner, identifying that each of the sound pickup modules receives a first sound signal, and obtaining intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules includes:

[0017] Extracting the frequency, amplitude and period of the first sound signal picked up by each of the sound pickup modules within a preset time;

[0018] Using the amplitude of the first sound signal picked up by each sound pickup module within a preset time as the intensity data of the first sound signal received by each sound pickup module;

[0019] The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time is used as the frequency data of the first sound signal received by each of the sound pickup modules.

[0020] In an optional manner, obtaining the intensity parameter of the first sound signal received by each sound pickup module according to the intensity data of the first sound signal received by each sound pickup module includes:

[0021] The average value of the amplitude of the first sound signal picked up by each sound pickup module within a preset time is calculated as the intensity parameter of the first sound signal received by each sound pickup module.

[0022] In an optional manner, the periodically triggering the direction adjustment operation of the microphone;

[0023] Alternatively, when a microphone direction adjustment instruction sent by a user is received, the microphone direction adjustment operation is triggered.

[0024] According to another aspect of an embodiment of the present invention, a sound pickup control device for a microphone is provided, wherein the microphone comprises at least two sound pickup modules, each of which points to a different direction, and the device comprises: a receiving module, a recognition module, a calculation module and a control module;

[0025] A receiving module, used for receiving a first sound signal by using each of the sound pickup modules when a direction adjustment operation of the microphone is triggered;

[0026] an identification module, used for identifying that each of the sound pickup modules receives a first sound signal, and obtaining intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules;

[0027] A calculation module, used to obtain the intensity parameter of the first sound signal received by each sound pickup module according to the intensity data of the first sound signal received by each sound pickup module; obtain the frequency characteristic parameter of the first sound signal received by each sound pickup module according to the frequency data of the first sound signal received by each sound pickup module; calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each sound pickup module and the corresponding human voice frequency parameter;

[0028] A control module, used to turn off the sound pickup modules that do not meet the preset conditions, so as to use the sound pickup modules that meet the preset conditions to receive the second sound signal;

[0029] Among them, the pickup module with preset conditions is a pickup module in which the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are pre-set by the user.

[0030] In an optional manner, the calculation module includes: a correlation value calculation unit;

[0031] The correlation value calculation unit is used to calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameter by using the Pearson correlation coefficient;

[0032] The calculation expression of the correlation value is:

[0033]

[0034] Among them, r(F i , M) is F i and the correlation value of M, i is a positive integer greater than or equal to 2, F i is the frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, M is the human voice frequency parameter, including n human voice frequency parameters, m j is the jth personal voice frequency parameter, j=1, 2, ..., n, n is the number of frequency characteristic parameters of the first sound signal received by the i-th sound pickup module; f ij is the jth frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, where j is a positive integer. is the average value of the frequency characteristic parameters of the first sound signal received by the n sound pickup modules, is the average value of n voice frequency parameters.

[0035] In an optional manner, the device further includes: an operation triggering module;

[0036] An operation triggering module, used for periodically triggering a direction adjustment operation of the microphone;

[0037] Alternatively, when a microphone direction adjustment instruction sent by a user is received, the microphone direction adjustment operation is triggered.

[0038] According to another aspect of an embodiment of the present invention, a sound pickup control device for a microphone is provided, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store at least one executable instruction, wherein the executable instruction enables the processor to perform the operation of the sound pickup control method for a microphone as described in any one of the above items.

[0039] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein the storage medium stores at least one executable instruction, wherein the executable instruction enables a microphone pickup control device / apparatus to perform the operation of any one of the microphone pickup control methods described above.

[0040] The above description is only an overview of the technical solution of the embodiment of the present invention. In order to more clearly understand the technical means of the embodiment of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings are only used to illustrate the embodiments and are not to be considered as limiting the present invention. In addition, the same reference symbols are used to represent the same components throughout the accompanying drawings. In the accompanying drawings:

[0042] Figure 1 A schematic flow chart of an embodiment of a method for controlling sound pickup of a microphone provided by the present invention is shown;

[0043] Figure 2 A top view of a microphone according to an embodiment of a method for controlling sound pickup of a microphone provided by the present invention is shown;

[0044] Figure 3 A schematic structural diagram of an embodiment of a sound pickup control device for a microphone provided by the present invention is shown;

[0045] Figure 4 A structural schematic diagram of an embodiment of a sound pickup control device for a microphone provided by the present invention is shown. DETAILED DESCRIPTION

[0046] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited to the embodiments set forth herein.

[0047] Figure 1The flowchart of an embodiment of the microphone pickup control method provided by the present invention is shown, and the method is executed by the microphone pickup control device. The microphone includes at least two pickup modules, and each of the pickup modules points to a different direction. This embodiment takes a microphone with four pickup modules as an example, and the microphone includes pickup modules pointing to four directions, such as Figure 2 As shown, Figure 2 The top view of the microphone is shown, and the sound pickup modules 1-4 of the microphone are respectively directed to four horizontal directions: up, down, left, and right.

[0048] Specifically, the sound pickup module is a sound sensor or a microphone array.

[0049] like Figure 1 As shown, the method comprises the following steps:

[0050] Step 110: When the direction adjustment operation of the microphone is triggered, each of the sound pickup modules is used to receive a first sound signal.

[0051] Specifically, when the direction adjustment operation of the microphone is triggered, all the sound pickup modules are turned on, and each of the sound pickup modules is used to receive the first sound signal to detect the sound in the surrounding environment.

[0052] Specifically, regularly triggering the direction adjustment operation of the microphone;

[0053] Alternatively, when a microphone direction adjustment instruction sent by a user is received, the microphone direction adjustment operation is triggered.

[0054] Exemplarily, after the microphone is powered on, the microphone direction adjustment operation is triggered, and the microphone direction adjustment operation is triggered once every preset time. Alternatively, the user presses a button on the microphone to send a microphone direction adjustment instruction, triggering the microphone direction adjustment operation.

[0055] Step 120: Identify that each of the sound pickup modules receives a first sound signal, and obtain intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules.

[0056] In some embodiments of the present invention, identifying that each of the sound pickup modules receives a first sound signal, and obtaining intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules includes:

[0057] Extracting the frequency, amplitude and period of the first sound signal picked up by each of the sound pickup modules within a preset time;

[0058] Using the amplitude of the first sound signal picked up by each sound pickup module within a preset time as the intensity data of the first sound signal received by each sound pickup module;

[0059] The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time is used as the frequency data of the first sound signal received by each of the sound pickup modules.

[0060] Step 130: obtaining intensity parameters of the first sound signals received by the sound pickup modules according to the intensity data of the first sound signals received by the sound pickup modules; obtaining frequency characteristic parameters of the first sound signals received by the sound pickup modules according to the frequency data of the first sound signals received by the sound pickup modules; and calculating correlation values ​​between the frequency characteristic parameters of the first sound signals received by the sound pickup modules and the corresponding human voice frequency parameters;

[0061] In some embodiments of the present invention, obtaining the intensity parameter of the first sound signal received by each sound pickup module according to the intensity data of the first sound signal received by each sound pickup module includes:

[0062] The average value of the amplitude of the first sound signal picked up by each sound pickup module within a preset time is calculated as the intensity parameter of the first sound signal received by each sound pickup module.

[0063] In some embodiments of the present invention, collecting the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules, and calculating the correlation value between the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameters, includes:

[0064] Calculating the correlation value between the frequency characteristic parameter of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameter using the Pearson correlation coefficient;

[0065] The calculation expression of the correlation value is:

[0066]

[0067] Among them, r(F i , M) is F i and the correlation value of M, i is a positive integer greater than or equal to 2, F i is the frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, M is the human voice frequency parameter, including n human voice frequency parameters, m j is the jth personal voice frequency parameter, j=1, 2, ..., n, n is the number of frequency characteristic parameters of the first sound signal received by the i-th sound pickup module; f ij is the jth frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, where j is a positive integer. is the average value of the frequency characteristic parameters of the first sound signal received by the n sound pickup modules, is the average value of n voice frequency parameters.

[0068] Specifically, human voice has a specific frequency range. The fundamental frequency of adult males is generally 80-150Hz, and the fundamental frequency of adult females is around 160-250Hz. There are also characteristics such as resonance peaks, and the frequency distribution is relatively concentrated and regular. The frequency range of noise is wide and the distribution is relatively random, which may cover all frequency bands from low frequency to high frequency, without obvious concentrated frequency areas and fixed frequency characteristics.

[0069] Assume that the human voice frequency parameters include 5 frequency values ​​and corresponding amplitudes, namely: fundamental frequency: 150Hz, amplitude: 0.6; second harmonic: 300Hz, amplitude: 0.4; third harmonic: 450Hz, amplitude: 0.3; first resonance peak frequency: 800Hz, amplitude: 0.7; second resonance peak frequency: 1200Hz, amplitude: 0.5; then the average value of the human voice frequency parameters is It is (0.6+0.4+0.3+0.7+0.5) / 5=0.5.

[0070] Assuming that the five frequency characteristic parameters of the sound signal received by the first pickup module are: 140Hz, amplitude: 0.55; 290Hz, amplitude: 0.38; 440Hz, amplitude: 0.28; 780Hz, amplitude: 0.65; 1180Hz, amplitude: 0.45, then the average value of the frequency characteristic parameters of the sound signal received by the first pickup module is It is: (0.55+0.38+0.28+0.65+0.45) / 5=0.462.

[0071] According to the Pearson correlation coefficient formula:

[0072]

[0073] Among them, in the expression For the fundamental frequency: (0.55-0.462)×(0.6-0.5)=0.0088; for the second harmonic: (0.38-0.462)×(0.4-0.5)=0.0082; for the third harmonic: (0.28-0.462)×(0.3-0.5)=0.0364; for the first resonance peak frequency: (0.65-0.462)×(0.7-0.5)=0.0376; for the second resonance peak frequency: (0.45-0.462)×(0.5-0.5)=0, therefore, the sum is: 0.0088+0.0082+0.0364+0.0376+0=0.091, that is, the numerator

[0074] In the expression For the fundamental frequency: (0.55-0.462) 2 =0.007744; for the second harmonic: (0.38-0.462)2=0.006724; for the third harmonic: (0.28-0.462)2=0.032764; for the first resonance peak frequency: (0.65-0.462)2=0.035344; for the second resonance peak frequency: (0.45-0.462)2=0.000144; Therefore, the sum is: 0.007744+0.006724+0.032764+0.035344+0.000144=0.08272, and its square root is about 0.2876, that is, the expression

[0075] In the expression For the fundamental frequency: (0.6-0.5)2=0.01; for the second harmonic: (0.4-0.5)2=0.01; for the third harmonic: (0.3-0.5)2=0.04; for the first resonance peak frequency: (0.7-0.5)2=0.04; for the second resonance peak frequency: (0.5-0.5)2=0; the sum is: 0.01+0.01+0.04+0.04+0=0.1, and its square root is 0.3162; that is, the expression

[0076] Therefore, the denominator expression The Pearson correlation coefficient between the sound signal frequency characteristic parameter of the sound pickup module 1 and the preset human voice frequency parameter is r(F1,M)=0.091 / 0.0909≈1. Assuming that the threshold is set to 0.8, if the calculated Pearson correlation coefficient is greater than or equal to 0.8, it is considered that the sound signal received by the sound pickup module is mainly human voice; if it is less than 0.8, it is considered that it is not a main human voice signal.

[0077] Step 104: turning off the sound pickup modules that do not meet the preset conditions, so as to use the sound pickup modules that meet the preset conditions to receive the second sound signal;

[0078] Among them, the pickup module with preset conditions is a pickup module in which the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are pre-set by the user.

[0079] Specifically, the intensity parameters of the first sound signal received by the four sound pickup modules are S1, S2, S3 and S4 respectively, and the intensity threshold is T. The larger the intensity parameter value, the stronger the received sound signal. The sound pickup module corresponding to the direction where there may be an important sound source is determined by taking the intensity parameter greater than the intensity threshold as the judgment condition.

[0080] The Pearson correlation coefficient is used to measure the linear correlation between the frequency characteristic parameters of the first sound signal received by each of the pickup modules and the corresponding human voice frequency parameters. The correlation value is between -1 and 1, and the closer to 1, the higher the positive correlation, that is, the higher the matching degree between the sound signal and the human voice. The judgment condition is that the correlation value between the frequency parameter and the corresponding human voice frequency parameter exceeds the preset threshold, and the pickup module corresponding to the direction of the possible human voice sound source is determined.

[0081] Combined with the two judgment conditions that the intensity parameter is greater than the intensity threshold and the correlation value between the frequency parameter and the corresponding human voice frequency parameter exceeds the preset threshold, the sound pickup module that meets both judgment conditions is used to continue to pick up the sound, and the sound pickup module that does not meet any judgment condition is not used. In this embodiment, the microphone can realize four sound pickup modes: omnidirectional microphone, unidirectional, bidirectional and stereo. When the sound pickup modules 1-4 all meet the two judgment conditions, the sound pickup modules 1-4 are used to pick up sound, realizing the omnidirectional microphone sound pickup mode; when only one of the sound pickup modules 1-4 (for example, sound pickup module 2) meets the two judgment conditions, only the sound pickup module 2 is used to pick up sound, realizing the unidirectional sound pickup mode; when only two adjacent sound pickup modules (for example, sound pickup modules 1 and 2) meet the two judgment conditions, only the sound pickup modules 1 and 2 are used to pick up sound, realizing the bidirectional sound pickup mode; when only two sound pickup modules and non-adjacent sound pickup modules (for example, sound pickup modules 1 and 3) meet the two judgment conditions, only the sound pickup modules 1 and 3 are used to pick up sound, realizing the stereo sound pickup mode.

[0082] The microphone pickup control method provided by the present invention can determine the position of the human voice source by combining the sound intensity and the human voice characteristics, and automatically adjust the pickup direction to improve the accuracy of audio collection. At the same time, the present invention can flexibly adjust the directivity of the microphone, and can flexibly control the pickup function of each pickup module to automatically switch between multiple pickup modes according to the scene, thereby improving the flexibility of pickup control.

[0083] Figure 3 The structure diagram of an embodiment of the sound pickup control device of the microphone provided by the present invention is shown; the microphone comprises at least two sound pickup modules, each of which points to a different direction; Figure 3 As shown, the device 300 includes: a receiving module 310 , an identification module 320 , a calculation module 330 and a control module 340 .

[0084] The receiving module 310 is used to receive the first sound signal by using each of the sound pickup modules when the direction adjustment operation of the microphone is triggered;

[0085] The identification module 320 is used to identify that each of the sound pickup modules receives the first sound signal, and obtain the intensity data of the first sound signal received by each of the sound pickup modules and the frequency data of the first sound signal received by each of the sound pickup modules;

[0086] The calculation module 330 is used to obtain the intensity parameter of the first sound signal received by each sound pickup module according to the intensity data of the first sound signal received by each sound pickup module; obtain the frequency characteristic parameter of the first sound signal received by each sound pickup module according to the frequency data of the first sound signal received by each sound pickup module; and calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each sound pickup module and the corresponding human voice frequency parameter;

[0087] The control module 340 is used to turn off the sound pickup module that does not meet the preset conditions, so as to use the sound pickup module that meets the preset conditions to receive the second sound signal;

[0088] Among them, the pickup module with preset conditions is a pickup module in which the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are pre-set by the user.

[0089] In an optional manner, the identifying module 320 identifies that each sound pickup module receives the first sound signal, and obtains intensity data of the first sound signal received by each sound pickup module and frequency data of the first sound signal received by each sound pickup module, including:

[0090] Extracting the frequency, amplitude and period of the first sound signal picked up by each of the sound pickup modules within a preset time;

[0091] Using the amplitude of the first sound signal picked up by each sound pickup module within a preset time as the intensity data of the first sound signal received by each sound pickup module;

[0092] The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time is used as the frequency data of the first sound signal received by each of the sound pickup modules.

[0093] In an optional manner, obtaining the intensity parameter of the first sound signal received by each sound pickup module according to the intensity data of the first sound signal received by each sound pickup module includes:

[0094] The average value of the amplitude of the first sound signal picked up by each sound pickup module within a preset time is calculated as the intensity parameter of the first sound signal received by each sound pickup module.

[0095] In an optional manner, the calculation module 330 includes: a correlation value calculation unit;

[0096] The correlation value calculation unit is used to calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameter by using the Pearson correlation coefficient;

[0097] The calculation expression of the correlation value is:

[0098]

[0099] Among them, r(F i , M) is F i and the correlation value of M, i is a positive integer greater than or equal to 2, F i is the frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, M is the human voice frequency parameter, including n human voice frequency parameters, m j is the jth personal voice frequency parameter, j=1, 2, ..., n, n is the number of frequency characteristic parameters of the first sound signal received by the i-th sound pickup module; f ij is the jth frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, where j is a positive integer. is the average value of the frequency characteristic parameters of the first sound signal received by the n sound pickup modules, is the average value of n voice frequency parameters.

[0100] In an optional manner, the device 300 also includes an operation triggering module; the operation triggering module is used to periodically trigger the direction adjustment operation of the microphone; or, when receiving a microphone direction adjustment instruction sent by a user, trigger the direction adjustment operation of the microphone.

[0101] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0102] Figure 4 The schematic diagram of the structure of an embodiment of the sound pickup control device of the microphone provided by the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the sound pickup control device of the microphone.

[0103] like Figure 4As shown, the sound pickup control device of the microphone may include: a processor (processor) 402 , a communication interface (Communications Interface) 404 , a memory (memory) 404 , and a communication bus 408 .

[0104] The processor 402, the communication interface 404, and the memory 404 communicate with each other via the communication bus 408. The communication interface 404 is used to communicate with other devices such as a client or other server network elements. The processor 402 is used to execute the program 410, which can specifically execute the relevant steps in the above-mentioned embodiment of the sound pickup control method for a microphone.

[0105] Specifically, the program 410 may include program code including computer executable instructions.

[0106] The processor 402 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the microphone pickup control device may be processors of the same type, such as one or more CPUs; or may be processors of different types, such as one or more CPUs and one or more ASICs.

[0107] The memory 404 is used to store the program 410. The memory 404 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0108] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system or other device. In addition, the embodiments of the present invention are not directed to any particular programming language.

[0109] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. Similarly, in order to simplify the present invention and help understand one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. Wherein, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself is a separate embodiment of the present invention.

[0110] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and further may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive.

[0111] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.

Claims

1. A method for controlling sound pickup of a microphone, characterized in that: The microphone comprises at least two sound pickup modules, each of which points to a different direction, and the method comprises: When the direction adjustment operation of the microphone is triggered, the first sound signal is received by each of the sound pickup modules; Identify that each of the sound pickup modules receives a first sound signal, and obtain intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules; According to the intensity data of the first sound signal received by each sound pickup module, an intensity parameter of the first sound signal received by each sound pickup module is obtained; according to the frequency data of the first sound signal received by each sound pickup module, a frequency characteristic parameter of the first sound signal received by each sound pickup module is obtained; and a correlation value between the frequency characteristic parameter of the first sound signal received by each sound pickup module and a corresponding human voice frequency parameter is calculated; Turn off the sound pickup module that does not meet the preset conditions, so as to use the sound pickup module that meets the preset conditions to receive the second sound signal; Among them, the pickup module with preset conditions is a pickup module in which the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are pre-set by the user.

2. The method for controlling sound pickup of a microphone according to claim 1, characterized in that: Collecting frequency characteristic parameters of the first sound signal received by each of the sound pickup modules, and calculating correlation values ​​between the frequency characteristic parameters of the first sound signal received by each of the sound pickup modules and corresponding human voice frequency parameters, including: Calculating the correlation value between the frequency characteristic parameter of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameter using the Pearson correlation coefficient; The calculation expression of the correlation value is: Among them, r(F i , M) is F i and the correlation value of M, i is a positive integer greater than or equal to 2, F i is the frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, M is the human voice frequency parameter, including n human voice frequency parameters, m j is the jth personal voice frequency parameter, j=1, 2, ..., n, n is the number of frequency characteristic parameters of the first sound signal received by the i-th sound pickup module; f ij is the jth frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, j is a positive integer, and f i is the average value of the frequency characteristic parameters of the first sound signal received by the n sound pickup modules, is the average value of n voice frequency parameters.

3. The method for controlling sound pickup of a microphone according to claim 1, characterized in that: Identifying that each of the sound pickup modules receives a first sound signal, and obtaining intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules, includes: Extracting the frequency, amplitude and period of the first sound signal picked up by each of the sound pickup modules within a preset time; Using the amplitude of the first sound signal picked up by each sound pickup module within a preset time as the intensity data of the first sound signal received by each sound pickup module; The frequency of the first sound signal picked up by each of the sound pickup modules within a preset time is used as the frequency data of the first sound signal received by each of the sound pickup modules.

4. The method for controlling the sound pickup of a microphone according to claim 3, characterized in that: According to the intensity data of the first sound signal received by each of the sound pickup modules, obtaining the intensity parameter of the first sound signal received by each of the sound pickup modules comprises: The average value of the amplitude of the first sound signal picked up by each sound pickup module within a preset time is calculated as the intensity parameter of the first sound signal received by each sound pickup module.

5. The method for controlling the sound pickup of a microphone according to any one of claims 1 to 4, characterized in that: Also includes: Periodically triggering a direction adjustment operation of the microphone; Alternatively, when a microphone direction adjustment instruction sent by a user is received, the microphone direction adjustment operation is triggered.

6. A sound pickup control device for a microphone, characterized in that: The microphone comprises at least two sound pickup modules, each of which points to a different direction. The device comprises: a receiving module, a recognition module, a calculation module and a control module; A receiving module, used for receiving a first sound signal by using each of the sound pickup modules when a direction adjustment operation of the microphone is triggered; an identification module, used for identifying that each of the sound pickup modules receives a first sound signal, and obtaining intensity data of the first sound signal received by each of the sound pickup modules and frequency data of the first sound signal received by each of the sound pickup modules; A calculation module, used to obtain the intensity parameter of the first sound signal received by each sound pickup module according to the intensity data of the first sound signal received by each sound pickup module; obtain the frequency characteristic parameter of the first sound signal received by each sound pickup module according to the frequency data of the first sound signal received by each sound pickup module; calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each sound pickup module and the corresponding human voice frequency parameter; A control module, used to turn off the sound pickup modules that do not meet the preset conditions, so as to use the sound pickup modules that meet the preset conditions to receive the second sound signal; Among them, the pickup module with preset conditions is a pickup module in which the intensity parameter value of the received first sound signal exceeds the intensity threshold, and the correlation value between the frequency parameter of the received first sound signal and the corresponding human voice frequency parameter exceeds the preset threshold; the intensity threshold and the corresponding human voice frequency parameter are pre-set by the user.

7. The sound pickup control device of a microphone according to claim 6, characterized in that: The calculation module includes: a correlation value calculation unit; The correlation value calculation unit is used to calculate the correlation value between the frequency characteristic parameter of the first sound signal received by each of the sound pickup modules and the corresponding human voice frequency parameter by using the Pearson correlation coefficient; The calculation expression of the correlation value is: Among them, r(F i , M) is F i and the correlation value of M, i is a positive integer greater than or equal to 2, F i is the frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, M is the human voice frequency parameter, including n human voice frequency parameters, m j is the jth personal voice frequency parameter, j=1, 2, ..., n, n is the number of frequency characteristic parameters of the first sound signal received by the i-th sound pickup module; f ij is the jth frequency characteristic parameter of the first sound signal received by the i-th sound pickup module, where j is a positive integer. is the average value of the frequency characteristic parameters of the first sound signal received by the n sound pickup modules, is the average value of n voice frequency parameters.

8. The sound pickup control device of a microphone according to claim 6, characterized in that: Also includes: Operation trigger module; An operation triggering module, used for periodically triggering a direction adjustment operation of the microphone; Alternatively, when a microphone direction adjustment instruction sent by a user is received, the microphone direction adjustment operation is triggered.

9. A microphone pickup control device, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the operation of the microphone pickup control method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The storage medium stores at least one executable instruction, and when the executable instruction is executed on the sound pickup control device / apparatus of the microphone, the sound pickup control device / apparatus of the microphone performs the operation of the sound pickup control method of the microphone as described in any one of claims 1-7.

Images