Sound pickup assembly, control method and control device thereof

Abstract

This invention proposes a microphone pickup component and its control method and device. The microphone pickup component includes multiple phased arrays, each phased array having at least two microphones arranged linearly in a horizontal direction. The pickup area is divided into multiple phased array zones corresponding to a preset pickup area of ​​the microphone pickup component. The method includes: first, acquiring image information within the pickup area; then, based on the image information, determining if a user is the target for microphone pickup; determining the phased array zone where the target user is located and setting it as the target phased array zone; finally, acquiring the distances between the target phased array zone and the multiple phased arrays to obtain multiple distances; determining the target phased array zone according to the order of the multiple distances; controlling the target phased array zone to be in a working state; and controlling the other phased array zones (excluding the target phased array zone) to be in a stopped working state. This invention aims to reduce the power consumption of the microphone pickup component, while improving pickup efficiency and reducing noise introduction through phased array technology.

Description

Technical Field

[0001] This invention relates to the field of microphone component control technology, and in particular to a microphone component and its control method and control device. Background Technology

[0002] To improve the sound pickup quality of users speaking in certain public places, such as conference rooms and meeting halls, sound pickup components are often installed in these places. These components collect the user's voice through phased array microphones.

[0003] Currently, in the field of microphone components, how to reduce the power consumption of microphone components has become the main direction explored by those skilled in the art. Summary of the Invention

[0004] The main objective of this invention is to provide a method for controlling a microphone component, which aims to reduce the power consumption of the microphone component, while improving the microphone efficiency and reducing noise introduction through phase control.

[0005] To achieve the above objectives, the present invention proposes a method for controlling a microphone pickup assembly. The microphone pickup assembly includes multiple phased arrays, each of which is provided with at least two microphones arranged linearly in a horizontal direction. The pickup assembly is divided into multiple phased array regions corresponding to a preset pickup area. The method includes:

[0006] Step S100: Obtain image information within the pickup area;

[0007] Step S200: Based on the image information, if a user is determined to be the target for sound pickup, the phase control area where the target for sound pickup is located is determined and set as the target phase control area;

[0008] Step S300: Obtain the distances between the target phased array and the multiple phased arrays respectively to obtain multiple distances, and determine the target phased array according to the order of the multiple distances, and control the target phased array to be in working state and control the other phased arrays in the multiple phased arrays except the target phased array to be in stopped working state, so as to achieve accurate sound pickup of the sound pickup component while effectively reducing the power consumption of the sound pickup component.

[0009] Optionally, the step of determining the user to be picked up based on the image information specifically includes:

[0010] Step S210: Determine the user action based on the image information;

[0011] Step S220: When it is determined that a user has lip movements based on the user's actions, that user is identified as the target to be picked up.

[0012] Optionally, step S220 specifically includes:

[0013] When it is determined, based on the user's actions, that the user maintains lip movements for a preset first duration, and the opening and closing angles of the upper and lower lips are within a preset angle range, the user is identified as the target to be picked up.

[0014] Optionally, the sound pickup component includes a sound pickup device, and multiple phased arrays are integrated within the sound pickup device; the step of obtaining the distances between the target phased area and the multiple phased arrays respectively to obtain multiple distances, and determining the target phased array according to the order of the multiple distances, specifically includes:

[0015] Step S310: Obtain the distances between the target phased region and the multiple phased arrays to obtain multiple distances;

[0016] Step S320: Arrange the multiple distances from smallest to largest to obtain a first order;

[0017] Step S330: According to the first order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array.

[0018] Optionally, step S330 specifically includes:

[0019] Step S331: According to the first order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array;

[0020] Step S332: Obtain the angle between the line connecting the target to be picked up and the phased array of the target and the central axis of the phased array of the target;

[0021] Step S333: If the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is less than the first preset difference, or the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is less than the second preset difference, or the included angle is not within the preset pickup angle range, then according to the first order, the second smallest of the multiple distances is taken as the new target phased array and steps S332-S333 are repeated until the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is greater than the first preset difference, the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is greater than the second preset difference, and the included angle is within the preset pickup angle range;

[0022] Step S334: Determine the phased array to be targeted as the target phased array.

[0023] Optionally, the sound pickup component includes multiple sound pickup devices, each of which integrates multiple phased arrays; the step of obtaining the distances between the target phased region and the multiple phased arrays respectively to obtain multiple distances, and determining the target phased array according to the order of the multiple distances, specifically includes:

[0024] Step S340: Obtain the facial movements of the target to be picked up, and determine the pickup device facing the face of the target to be picked up as the target pickup device;

[0025] Step S350: Obtain the distances between the target phased array region and the multiple phased arrays in the target pickup device to obtain multiple distances;

[0026] Step S360: Arrange the multiple distances from smallest to largest to obtain a second order;

[0027] Step S370: According to the second order, the phased array corresponding to the smallest of the plurality of distances is determined as the target phased array.

[0028] Optionally, step S370 specifically includes:

[0029] Step S371: According to the second order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array;

[0030] Step S372: Obtain the angle between the line connecting the target to be picked up and the phased array of the target and the central axis of the phased array of the target;

[0031] Step S373: If the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is less than the first preset difference, or the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is less than the second preset difference, or the included angle is not within the preset pickup angle range, then according to the second order, the second smallest of the multiple distances is taken as the new target phased array and steps S372-S373 are repeated until the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is greater than the first preset difference, the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is greater than the second preset difference, and the included angle is within the preset pickup angle range;

[0032] Step S374: Determine the target phased array as the target phased array.

[0033] Optionally, the step of obtaining the distances between the target phased region and the plurality of phased arrays to obtain multiple distances, and determining the target phased array according to the order of the magnitudes of the multiple distances, further includes:

[0034] If the angle between any line connecting the target to be picked up and the phased array of the target to be picked up and the central axis of the phased array of the target to be picked up is less than the upper limit of the preset pickup angle range of the phased array of the target to be picked up by a first preset difference or less than the lower limit of the preset pickup angle range of the phased array of the target to be picked up by a second preset difference, then the side facing the face of the target to be picked up is taken as the first side, with the line connecting the two ears of the target to be picked up as the reference.

[0035] The device with the shortest distance to the target phase control area among the multiple pickup devices on the first side is identified as the target pickup device, and steps S350-S374 are executed.

[0036] The present invention also proposes a control device, the control device comprising:

[0037] Memory; and,

[0038] processor;

[0039] A pickup component control program stored in the memory and executed by the processor, wherein the pickup component control program, when executed by the processor, implements the pickup component control method as described in any of the preceding claims.

[0040] The present invention also proposes a sound pickup component, including the control device as described above and multiple phased arrays, each of the phased arrays being provided with at least two microphones arranged linearly in a horizontal direction, and the sound pickup component being divided into multiple phased arrays corresponding to a preset sound pickup area.

[0041] This invention proposes a sound pickup component control method, comprising: first, acquiring image information within the pickup area; then, based on the image information, determining if a user is the target for sound pickup; determining the phased array region where the target is located and setting it as the target phased array region; finally, determining the target phased array region based on the relative positions of the target phased array region and multiple phased arrays, controlling the target phased array region to be in a working state, and controlling the other phased arrays (excluding the target phased array) to be in a stopped working state. Thus, in practical applications, when the sound pickup component determines that there is a target in the current scene, it will only activate the phased array region with the most suitable relative position to pick up the sound emitted by the target, thereby achieving accurate sound pickup while effectively reducing the power consumption of the sound pickup component, and simultaneously improving pickup efficiency and reducing noise introduction through phased array technology. Attached Figure Description

[0042] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.

[0043] Figure 1 This is a flowchart illustrating an embodiment of the microphone component control method of the present invention;

[0044] Figure 2 This is a flowchart illustrating another embodiment of the microphone component control method of the present invention;

[0045] Figure 3 This is a flowchart illustrating another embodiment of the sound pickup component control method of the present invention;

[0046] Figure 4 This is a flowchart illustrating another embodiment of the sound pickup component control method of the present invention;

[0047] Figure 5 This is a flowchart illustrating another embodiment of the sound pickup component control method of the present invention;

[0048] Figure 6 This is a flowchart illustrating another embodiment of the microphone component control method of the present invention;

[0049] Figure 7 This is a schematic diagram of an embodiment of the pickup component of the present invention, including a pickup device;

[0050] Figure 8 This is a schematic diagram showing a plurality of pickup devices in another embodiment of the pickup component of the present invention.

[0051] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0052] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0053] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relative positional relationship and movement of each component in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indication will also change accordingly.

[0054] To improve the sound pickup quality of users speaking in certain public places, such as conference rooms and meeting halls, sound pickup components are often installed in these places. These components collect the user's voice through phased array microphones.

[0055] Currently, in the field of microphone components, how to reduce the power consumption of microphone components has become the main direction explored by those skilled in the art.

[0056] To address this, the present invention proposes a method for controlling a microphone pickup component. The pickup component includes multiple phased arrays, each containing at least two microphones arranged linearly in a horizontal direction. The pickup area of ​​the component is divided into multiple phased areas corresponding to a preset pickup region. These phased areas can be pre-defined by the developers or set by the user according to their needs. The phased arrays can be arranged in a front-to-back direction and / or vertically. The microphones in each phased array can adjust their phase difference to enhance sound pickup and achieve precise sound acquisition. It is understood that the pickup component also includes a control device for executing and storing the following method. This control device can be implemented using a main controller, such as an MCU, DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), PLC, or SOC (System on Chip).

[0057] In one embodiment of the present invention, reference is made to... Figure 1 The methods include:

[0058] Step S100: Obtain image information within the pickup area;

[0059] In this embodiment, the sound pickup component may include a camera module, such as a camera and an image processing module, for capturing images within the current sound pickup area, digitizing them, and then outputting the corresponding image information to the control device.

[0060] Step S200: Based on the image information, if a user is determined to be the target for sound pickup, the phase control area where the target for sound pickup is located is determined and set as the target phase control area;

[0061] Alternatively, in one embodiment, reference is made to... Figure 2The step of determining a user as a target for audio pickup based on the image information specifically includes:

[0062] Step S210: Determine the user action based on the image information;

[0063] Step S220: When it is determined that a user has lip movements based on the user's actions, that user is identified as the target to be picked up.

[0064] In this embodiment, the control device uses an image recognition chip electrically connected to it or its own integrated image processing unit to identify the image information acquired and output by the camera module in order to determine the user actions of all users in the conference room.

[0065] When a user is identified as having lip movements based on the aforementioned user actions, such as opening and closing their lips, it is confirmed that they are currently speaking, and the control device will identify that user as the target for sound pickup.

[0066] It is important to understand that in real-world situations, users may also make lip movements that are not intended for speaking, such as yawning or smacking their lips. Users in these situations are easily misjudged as potential targets for sound pickup.

[0067] Therefore, based on the above embodiments, in one embodiment, step S220 specifically includes:

[0068] When it is determined, based on the user's actions, that the user maintains lip movements for a preset first duration, and the opening and closing angles of the upper and lower lips are within a preset angle range, the user is identified as the target to be picked up.

[0069] In this embodiment, the control device can determine the opening angle of the user's upper and lower lips based on the user's actions obtained in the process described in the above embodiment. If the opening angle of the upper and lower lips is within a preset angle range, such as 20°-40°, and the upper and lower lips have continuous opening and closing lip movements, then the control device will determine that the user does indeed have a speaking need, and will identify the user as a target for sound pickup. Similarly, if the opening angle of the user's upper and lower lips is outside the preset angle range, or if the upper and lower lips do not have continuous opening and closing movements, then it indicates that the user does not intend to speak, and the control device will not identify the user as a target for sound pickup.

[0070] Once the control device identifies the target to be picked up, it will determine the target phase control area where the target is located based on the image of the pickup area captured above and the multiple pre-divided phase control areas.

[0071] Step S300: Obtain the distances between the target phased array and the multiple phased arrays respectively to obtain multiple distances, and determine the target phased array according to the order of the multiple distances, and control the target phased array to be in working state and control the other phased arrays in the multiple phased arrays except the target phased array to be in stopped working state, so as to achieve accurate sound pickup of the sound pickup component while effectively reducing the power consumption of the sound pickup component.

[0072] In this embodiment, after confirming the target phased array region, the control device determines the phased array with better sound pickup effect based on the positional relationship between the target phased array region and multiple phased arrays, such as distance and angle, and designates it as the target phased array. Then, the control device controls only the target phased array to be in an active state and controls the other phased arrays in the multiple phased arrays to be in a non-active state. This allows the sound pickup component to pick up the sound emitted by the target while effectively reducing the power consumption of the sound pickup component. If the power supply of the sound pickup component is an independent energy storage module, the battery life of the sound pickup component can also be effectively improved.

[0073] For example, if the relative position refers to the distance between the target phased array region and multiple phased arrays, then after confirming the target phased array region, the control device can determine the distance between the current target phased array region and the multiple phased arrays based on a phased array region-phased array distance mapping table pre-stored by the R&D personnel, or calculate and determine the distance between the current target phased array region and the multiple phased arrays based on the image of the aforementioned pickup area. The phased array region with the smallest distance is then designated as the target phased array region. Only the target phased array region is controlled to be in an active state, while the other phased array regions are controlled to be in a non-active state. This ensures that the pickup component can pick up the sound emitted by the target area while effectively reducing the power consumption of the pickup component.

[0074] This invention proposes a sound pickup component control method, comprising: first, acquiring image information within the pickup area; then, based on the image information, determining if a user is the target for sound pickup; determining the phased array region where the target is located and setting it as the target phased array region; finally, determining the target phased array region based on the relative positions of the target phased array region and multiple phased arrays, controlling the target phased array region to be in a working state, and controlling the other phased arrays (excluding the target phased array) to be in a stopped working state. Thus, in practical applications, when the sound pickup component determines that there is a target in the current scene, it will only activate the phased array region with the most suitable relative position to pick up the sound emitted by the target, thereby achieving accurate sound pickup while effectively reducing the power consumption of the sound pickup component, and simultaneously improving pickup efficiency and reducing noise introduction through phased array technology.

[0075] It is important to understand that, in practice, reference Figure 7 The pickup component includes a pickup device, and multiple phased arrays are integrated within the pickup device.

[0076] In one embodiment of the present invention, reference is made to... Figure 3 Based on the aforementioned sound pickup component including a sound pickup device, the step of obtaining the distances between the target phased array and the plurality of phased arrays to obtain multiple distances, and determining the target phased array according to the order of the magnitudes of the multiple distances, specifically includes:

[0077] Step S310: Obtain the distances between the target phased region and the multiple phased arrays to obtain multiple distances;

[0078] Step S320: Arrange the multiple distances from smallest to largest to obtain a first order;

[0079] Step S330: According to the first order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array.

[0080] In this embodiment, the control device can determine multiple distances between the target phased array region and multiple phased arrays based on the method described in the above embodiments. Then, the control device arranges these multiple distances from smallest to largest to obtain a first order, and selects the one with the smallest distance in the first order as the target phased array, that is, the phased array closest to the target (and also closest to the target phased array region) as the target phased array. Thus, in the subsequent process of controlling only the target phased array to start and perform sound pickup, not only can the sound pickup component be guaranteed to pick up the sound emitted by the target, but the power consumption of the sound pickup component can also be effectively reduced.

[0081] It's important to understand that each phased array has a limited range of angles from which it can achieve precise sound pickup. Specifically, the target must be within a certain angle (±7°) relative to the phased array's central axis for the array to pick up sound. For example, ±7° is the preset pickup angle range for the phased array. As described in the above embodiments, to ensure effective sound pickup, the phased array closest to the target is selected as the target phased array. However, the target may not be within the preset pickup angle range of this target phased array, or although it may be within the range, its position may be close to the boundary value of the preset pickup angle range. In such cases, if the target phased array starts operating, a sufficiently good pickup effect cannot be guaranteed. For example, refer to... Figure 7As can be seen from the above embodiments, the arrangement of multiple phased arrays in the pickup device can be along the front-to-back direction and / or along the left-to-right direction. Multiple phased arrays can be arranged simultaneously along the front-to-back direction and along the left-to-right direction, thereby enabling multiple phased arrays to, for example... Figure 7 The settings are shown. Figure 7 The microphone 10 has three phased arrays 20A, 20B, and 20C arranged as shown in the figure. Their preset pickup angle ranges are all [-α / 2, α / 2], for example, α is 14°. As clearly shown in the figure, phased array 20B is closest to the target (target phased array area), but its position is very close to the edge of the preset pickup angle range (near the position corresponding to -α / 2). Therefore, although phased array 20B is closest to the target, it cannot meet the requirements for effective sound pickup.

[0082] Therefore, refer to Figure 4 Based on the above Figure 3 In one embodiment of the present invention, the step S330 specifically includes:

[0083] Step S331: According to the first order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array;

[0084] Step S332: Obtain the angle between the line connecting the target to be picked up and the phased array of the target and the central axis of the phased array of the target;

[0085] Step S333: If the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is less than the first preset difference, or the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is less than the second preset difference, or the included angle is not within the preset pickup angle range, then according to the first order, the second smallest of the multiple distances is taken as the new target phased array and steps S332-S333 are repeated until the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is greater than the first preset difference, the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is greater than the second preset difference, and the included angle is within the preset pickup angle range;

[0086] Step S334: Determine the phased array to be targeted as the target phased array.

[0087] In this embodiment, after going through the process described in the previous embodiment, the smallest of the multiple distances is selected as the target phased array. Then, based on the image information of the pickup area, the angle between the line connecting the target and the target phased array and the central axis of the target phased array is determined.

[0088] If the current included angle is within the preset pickup angle range, and the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is greater than a first preset difference, and the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is greater than a second preset difference, it indicates that the target to be picked up is not only located within the preset pickup angle range of the target phased array, but its position is also not close to the boundary of the preset pickup angle range. The first and second preset differences can be the same or different, and are obtained and pre-stored by the R&D personnel through multiple tests during the R&D period. At this point, the control device confirms that the current target pickup device can meet the pickup requirements and will use that target pickup device as the final target pickup device.

[0089] If the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is less than a first preset difference, or the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is less than a second preset difference, or the included angle is not within the preset pickup angle range, it indicates that the target is not within the preset pickup angle range of the target phased array, or is close to the boundary of the preset pickup angle range. In this case, the control device will, according to the first order confirmed in the above embodiment, set the next phased array of the current target phased array as the new target phased array. That is, relative to the distance between the current target phased array and the target, according to the first order, set the phased array corresponding to a distance one order greater than the current distance as the new target phased array. Then, the above angle judgment process is repeated until the angle between the line connecting the target phased array and the target and the central axis of the target phased array is within the preset pickup angle range and not close to the boundary value of the preset pickup angle range. This setting further ensures the pickup effect of the pickup component.

[0090] For example, refer to Figure 7If the control device determines that although the target to be picked up is closest to the phased array 20B, its position is close to the boundary value of the preset pickup angle range of the phased array 20B, then the control device will consider that the current phased array 20B does not meet the pickup requirements. Therefore, according to the first order, the phased array 20A, which is the second closest to the target to be picked up, will be used as the new target phased array. Based on the above angle judgment, if it is determined that the position of the target to be picked up is within the preset pickup angle range and is not close to the boundary value of the preset pickup angle range, then the phased array 20A will be used as the target phased array, and only the phased array 20A will be activated, while the other phased arrays 20B and 20C will stop working. This effectively reduces the power consumption of the pickup components while achieving accurate pickup.

[0091] It is important to understand that, in practice, reference Figure 8 The pickup component may also include multiple pickup devices, each of which integrates multiple phased arrays.

[0092] In one embodiment of the present invention, reference is made to... Figure 5 Based on the aforementioned sound pickup component including multiple sound pickup devices, the step of obtaining the distances between the target phased array and the multiple phased arrays respectively to obtain multiple distances, and determining the target phased array according to the order of the multiple distances, specifically includes:

[0093] Step S340: Obtain the facial movements of the target to be picked up, and determine the pickup device facing the face of the target to be picked up as the target pickup device;

[0094] Step S350: Obtain the distances between the target phased array region and the multiple phased arrays in the target pickup device to obtain multiple distances;

[0095] Step S360: Arrange the multiple distances from smallest to largest to obtain a second order;

[0096] Step S370: According to the second order, the phased array corresponding to the smallest of the plurality of distances is determined as the target phased array.

[0097] It can be understood that, since the sound pickup assembly contains multiple sound pickup devices, these devices can be positioned in different locations. Furthermore, the sound pickup effect of the device facing the face of the target being picked up is better. Therefore, in this embodiment, the control device first determines the facial movement of the target being picked up based on the image information from the above embodiment, thus identifying the sound pickup device facing the target's face as the target sound pickup device, thereby effectively ensuring the sound pickup effect of the sound pickup assembly.

[0098] Then, after the target pickup device is determined, the control device, as in the embodiment where the pickup component includes a single pickup device, determines the distance between multiple phased arrays in the target pickup device and the target to be picked up, and arranges them in ascending order to obtain a second order. According to the second order, the phased array corresponding to the one with the smallest distance, that is, the phased array closest to the target to be picked up, is taken as the target phased array, thereby ensuring the subsequent pickup effect.

[0099] For the same reasons as in the above embodiments, in order to ensure that the position of the target to be picked up is within the preset pickup angle range of the target phased array and not close to the edge, refer to Figure 6 In one embodiment of the present invention, step S370 specifically includes:

[0100] Step S371: According to the second order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array;

[0101] Step S372: Obtain the angle between the line connecting the target to be picked up and the phased array of the target and the central axis of the phased array of the target;

[0102] Step S373: If the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is less than the first preset difference, or the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is less than the second preset difference, or the included angle is not within the preset pickup angle range, then according to the second order, the second smallest of the multiple distances is taken as the new target phased array and steps S372-S373 are repeated until the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is greater than the first preset difference, the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is greater than the second preset difference, and the included angle is within the preset pickup angle range;

[0103] Step S374: Determine the target phased array as the target phased array.

[0104] In this embodiment, the specific judgment process can be referred to the above. Figure 4 The process described in the above embodiments will not be repeated here. The control device will determine a target phased array that can guarantee sound pickup performance based on the process described in the above embodiments. In subsequent control processes, it will only control the target phased array in the target pickup device to start and control all other pickup devices to stop working, thereby ensuring the sound pickup performance of the target and reducing the total power consumption of the pickup components.

[0105] It's important to understand that when a pickup assembly includes multiple pickup devices, its corresponding pickup area is the sum of the pickup areas of all the pickup devices. In other words, although the target to be picked up may be located within the pickup area of ​​the pickup assembly, it may not necessarily be located within the pickup areas of all the pickup devices. For example, as described in the above embodiments, to ensure pickup effect, a pickup device facing the face of the target to be picked up is first selected as the target pickup device, and then a target phased array is selected within it. However, the location of the target to be picked up may not be within the pickup area of ​​the target pickup device (the pickup area of ​​a pickup device is the sum of the pickup ranges of multiple phased arrays within it). For example, see reference... Figure 8 If the face of the target to be picked up is as indicated by the arrow, although it is facing the pickup device 10B, it is clearly not within the preset pickup angle range of any phase array of the pickup device 10B. Therefore, the pickup device 10B cannot guarantee the pickup effect of the target.

[0106] Therefore, based on the above Figure 6 In one embodiment of the present invention, the step of obtaining the distances between the target phased region and the plurality of phased arrays to obtain a plurality of distances, and determining the target phased array according to the order of the plurality of distances, further includes:

[0107] If the angle between any line connecting the target to be picked up and the phased array of the target to be picked up and the central axis of the phased array of the target to be picked up is less than the upper limit of the preset pickup angle range of the phased array of the target to be picked up by a first preset difference or less than the lower limit of the preset pickup angle range of the phased array of the target to be picked up by a second preset difference, then the side facing the face of the target to be picked up is taken as the first side, with the line connecting the two ears of the target to be picked up as the reference.

[0108] The device with the shortest distance to the target phase control area among the multiple pickup devices on the first side is identified as the target pickup device, and steps S350-S374 are executed.

[0109] In this embodiment, if it is determined, according to the process of steps S371-S373, that the target to be picked up is not within the preset pickup angle range of any phased array in the target pickup device, that is, the target to be picked up is not within the pickup range of the target pickup device, then according to the image information of the pickup area obtained in the above embodiment, with the line connecting the two ears of the target to be picked up as the reference, the side facing the face of the target to be picked up is taken as the first side, and the one with the shortest distance to the target phased array among the multiple pickup devices on the first side is taken as the target pickup device.

[0110] For example, refer to Figure 8When the control device determines that the target to be picked up is not within the pickup range of the pickup device 10B, it will determine, according to the above process, that there is a pickup device 10A in the area in front of the target, i.e., the area on the first side, and will then use the pickup device 10A as the new target pickup device. Then, according to the process of the above embodiment, the most suitable target phased array in the pickup device 10A will be determined (the target to be picked up is within the preset pickup angle range of the target phased array in the pickup device 10A, and is not close to the boundary value of the preset pickup angle range, and the distance between it and the target phased array is as close as possible). This setting further improves the pickup effect when the pickup component includes multiple pickup devices, while reducing the power consumption of the pickup component and ensuring the pickup effect on the target.

[0111] The present invention also proposes a control device, the control device comprising:

[0112] Memory; and,

[0113] processor;

[0114] A pickup component control program stored in the memory and executed by the processor, wherein the pickup component control program, when executed by the processor, implements the pickup component control method described above.

[0115] It is worth noting that since the control device of the present invention is based on the above-described sound pickup component control method, the embodiments of the control device of the present invention include all the technical solutions of all embodiments of the above-described sound pickup component control method, and the technical effects achieved are exactly the same, so they will not be repeated here.

[0116] The present invention also proposes a sound pickup component, including the control device as described above and multiple phased arrays, each of the phased arrays being provided with at least two microphones arranged linearly in a horizontal direction, and the sound pickup component being divided into multiple phased arrays corresponding to a preset sound pickup area.

[0117] It is worth noting that since the pickup component of the present invention is based on the control device described above, the embodiments of the pickup component of the present invention include all the technical solutions of all the embodiments of the control device described above, and the technical effects achieved are exactly the same, so they will not be repeated here.

[0118] The above description is merely an optional embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural transformations made using the contents of the present invention's specification and drawings under the inventive concept of the present invention, or direct / indirect applications in other related technical fields, are included within the patent protection scope of the present invention.

Claims

1. A method for controlling a microphone pickup assembly, characterized in that, The microphone pickup assembly includes multiple phased arrays, each phased array having at least two microphones arranged linearly in a horizontal direction. The pickup assembly is divided into multiple phased array regions corresponding to a preset pickup area. The method includes: Step S100: Obtain image information within the pickup area; Step S200: Based on the image information, if a user is determined to be the target for sound pickup, the phase control area where the target for sound pickup is located is determined and set as the target phase control area; Step S300: Obtain the distances between the target phased array and the multiple phased arrays respectively to obtain multiple distances, and determine the target phased array according to the order of the multiple distances, and control the target phased array to be in working state and control the other phased arrays in the multiple phased arrays except the target phased array to be in stopped working state, so as to achieve accurate sound pickup of the sound pickup component while effectively reducing the power consumption of the sound pickup component; The sound pickup component includes multiple sound pickup devices, each of which integrates multiple phased arrays; the step of obtaining the distances between the target phased region and the multiple phased arrays to obtain multiple distances, and determining the target phased array according to the order of the multiple distances, specifically includes: Step S340: Obtain the facial movements of the target to be picked up, and determine the pickup device facing the face of the target to be picked up as the target pickup device; Step S350: Obtain the distances between the target phased array region and the multiple phased arrays in the target pickup device to obtain multiple distances; Step S360: Arrange the multiple distances from smallest to largest to obtain a second order; Step S370: According to the second order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array; Step S370 specifically includes: Step S371: According to the second order, determine the phased array corresponding to the smallest of the plurality of distances as the target phased array; Step S372: Obtain the angle between the line connecting the target to be picked up and the phased array of the target and the central axis of the phased array of the target; Step S373: If the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is less than the first preset difference, or the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is less than the second preset difference, or the included angle is not within the preset pickup angle range, then according to the second order, the second smallest of the multiple distances is taken as the new target phased array and steps S372-S373 are repeated until the difference between the included angle and the upper limit of the preset pickup angle range of the target phased array is greater than the first preset difference, the difference between the included angle and the lower limit of the preset pickup angle range of the target phased array is greater than the second preset difference, and the included angle is within the preset pickup angle range; Step S374: Determine the phased array to be targeted as the target phased array; The step of obtaining the distances between the target phased region and the plurality of phased arrays to obtain multiple distances, and determining the target phased array according to the order of the magnitude of the plurality of distances, further includes: If the angle between any line connecting the target to be picked up and the phased array of the target to be picked up and the central axis of the phased array of the target to be picked up is less than the upper limit of the preset pickup angle range of the phased array of the target to be picked up by a first preset difference or less than the lower limit of the preset pickup angle range of the phased array of the target to be picked up by a second preset difference, then the side facing the face of the target to be picked up is taken as the first side, with the line connecting the two ears of the target to be picked up as the reference. The device with the shortest distance to the target phase control area among the multiple pickup devices on the first side is identified as the target pickup device, and steps S350-S374 are executed.

2. The microphone assembly control method as described in claim 1, characterized in that, The step of determining the user to be picked up based on the image information specifically includes: Step S210: Determine the user action based on the image information; Step S220: When it is determined that a user has lip movements based on the user's actions, that user is identified as the target to be picked up.

3. The sound pickup component control method as described in claim 2, characterized in that, Step S220 specifically includes: When it is determined, based on the user's actions, that the user maintains lip movements for a preset first duration, and the opening and closing angles of the upper and lower lips are within a preset angle range, the user is identified as the target to be picked up.

4. A control device, characterized in that, The control device includes: Memory; and, processor; A pickup component control program stored in the memory and executed by the processor, wherein the pickup component control program, when executed by the processor, implements the pickup component control method as described in any one of claims 1-3.

5. A pickup assembly, characterized in that, It includes the control device as described in claim 4 and multiple phased arrays, each of the phased arrays having at least two microphones arranged linearly in a horizontal direction, and the pickup area of ​​the pickup component is divided into multiple phased areas.

Images