A Method and System for Implementing Beam-forming Function

By using positioning devices in electronic devices to determine the position information of the target device, selecting the main microphone and the secondary microphone, and building a dual microphone Beam-forming architecture, the influence of the sound source angle on the sound signal acquisition effect is solved, and the stability of the Beam-forming function is improved.

CN115103267BActive Publication Date: 2025-08-01GEER TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210763779.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-30
Publication Date
2025-08-01
Estimated Expiration
2042-06-30

AI Technical Summary

Technical Problem

In the prior art, the angle between the sound source and the dual microphone has a great impact on the sound signal acquisition effect, resulting in unstable Beam-forming function.

Method used

The positioning device collects the positioning signal of the target device, determines its position information, and selects the main microphone and the secondary microphone from the microphone array based on the position information, builds a dual microphone Beam-forming architecture to collect sound signals.

Benefits of technology

The influence of the sound source and dual microphone angle on the sound signal acquisition effect is eliminated, and the stability of the Beam-forming function is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115103267B_ABST
    Figure CN115103267B_ABST
Patent Text Reader

Abstract

The present application discloses a method, system, electronic device and storage medium for implementing a Beam-forming function, and the technical field belongs to the field of audio acquisition technology. The method for implementing the Beam-forming function includes: collecting the positioning signal of the target device by using a positioning device, and determining the position information of the target device by using the positioning signal; selecting a main microphone and a secondary microphone from the microphone array according to the position information; constructing a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collecting a sound signal by using the dual-microphone Beam-forming architecture. The present application can ensure the acquisition effect of the sound signal and improve the stability of the Beam-forming function.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of audio acquisition, and particularly relates to a method and system for implementing the Beam-forming function. Background Art

[0002] Beam-forming is a general signal processing technology used to control the propagation direction and reception of radio frequency signals. Electronic devices such as smart speakers and smartphones with the Beam-forming function are becoming more and more popular. In related technologies, a fixed dual microphone is usually used to implement the Beam-forming function, and the angle between the sound source and the dual microphone has a great influence on the acquisition effect of the sound signal.

[0003] Therefore, how to ensure the acquisition effect of the sound signal and improve the stability of the Beam-forming function is a technical problem that those skilled in the art need to solve currently. Summary of the Invention

[0004] The purpose of this application is to provide a method and system for implementing the Beam-forming function, an electronic device, and a storage medium, which can ensure the acquisition effect of the sound signal and improve the stability of the Beam-forming function.

[0005] To solve the above technical problem, this application provides a method for implementing the Beam-forming function, which is applied to an electronic device including a positioning device and a microphone array. The microphone array includes at least three microphones. The method for implementing the Beam-forming function includes:

[0006] Collect the positioning signal of the target device by using the positioning device, and determine the position information of the target device by using the positioning signal;

[0007] Select a main microphone and a secondary microphone from the microphone array according to the position information;

[0008] Construct a dual microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collect the sound signal by using the dual microphone Beam-forming architecture.

[0009] Optionally, the positioning device is a UWB module including a first antenna and a second antenna;

[0010] Correspondingly, collecting the positioning signal of the target device by using the positioning device and determining the position information of the target device by using the positioning signal includes:

[0011] Collect the UWB signals of the target device by using the first antenna and the second antenna of the UWB module respectively;

[0012] Calculate the time difference between the arrival of the UWB signal at the first antenna and the second antenna respectively;

[0013] Determine the position information of the target device according to the time difference and the antenna distance; wherein, the antenna distance is the distance between the first antenna and the second antenna.

[0014] Optionally, selecting a main microphone and a secondary microphone from the microphone array according to the position information includes:

[0015] Determine a first type of included angle ∠POM corresponding to the microphone according to the position information; where P is the coordinate point of the target device, O is the target center point, and M is the coordinate point of the microphone; the target center point is a point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane;

[0016] Set the microphone with the smallest first type of included angle ∠POM as the main microphone;

[0017] Determine a plurality of second type of included angles ∠PQN corresponding to the main microphone; where Q is the coordinate point of another microphone adjacent to the main microphone, and N is the coordinate point of the main microphone;

[0018] Set the microphone corresponding to the Q point that makes the second type of included angle ∠PQN the smallest as the secondary microphone.

[0019] Optionally, selecting a main microphone and a secondary microphone from the microphone array according to the position information includes:

[0020] Connect the target center point to each microphone to divide the area where the target device is located into multiple sub - regions; wherein, the target center point is a point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane;

[0021] Determine the sub - region where the target device is located according to the position information, and set the two microphones corresponding to the sub - region where the target device is located as alternative microphones;

[0022] Set the alternative microphone closest to the target device as the main microphone;

[0023] Set the microphone that is the second closest to the target device except for the alternative microphones as the secondary microphone.

[0024] Optionally, it further includes:

[0025] If the target device is located on the boundary line of the sub-region, the microphone closest to the target device is set as the main microphone.

[0026] This application also provides a Beam-forming function implementation system, which is applied to an electronic device including a positioning device and a microphone array. The microphone array includes at least three microphones. The Beam-forming function implementation system includes:

[0027] A position information determination module, configured to collect a positioning signal of a target device by using the positioning device, and determine the position information of the target device by using the positioning signal;

[0028] A microphone selection module, configured to select a main microphone and a secondary microphone from the microphone array according to the position information;

[0029] A Beam-forming function implementation module, configured to construct a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collect a sound signal by using the dual-microphone Beam-forming architecture.

[0030] This application also provides an electronic device, which includes a memory, a central controller, a positioning device, and a microphone array. The microphone array includes at least three microphones. When the central controller calls a computer program in the memory, the implementation steps include:

[0031] Collect a positioning signal of a target device by using the positioning device, and determine the position information of the target device by using the positioning signal;

[0032] Select a main microphone and a secondary microphone from the microphone array according to the position information;

[0033] Construct a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collect a sound signal by using the dual-microphone Beam-forming architecture.

[0034] Optionally, the electronic device is a smart speaker or a mobile phone, and the target device is a smart wearable device or a mobile phone.

[0035] Optionally, the positioning device is a UWB module or a Bluetooth module.

[0036] This application also provides a storage medium, on which a computer program is stored. When the computer program is executed, the steps executed by the above-mentioned Beam-forming function implementation method are implemented.

[0037] The present application provides a method for implementing the Beam-forming function, which is applied to an electronic device including a positioning device and a microphone array. The microphone array includes at least three microphones. The method for implementing the Beam-forming function includes: collecting the positioning signal of the target device by using the positioning device, and determining the position information of the target device by using the positioning signal; selecting a main microphone and a secondary microphone from the microphone array according to the position information; constructing a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collecting the sound signal by using the dual-microphone Beam-forming architecture.

[0038] The electronic device provided by the present application includes a positioning device and a microphone array. The microphone array includes at least three microphones. The positioning signal of the target device is collected by using the positioning device, and then the positioning information of the target device is determined by using the positioning signal. The main microphone and the secondary microphone are selected from the microphone array according to the positioning information of the target device, and a dual-microphone Beam-forming architecture is constructed by using the main microphone and the secondary microphone so as to collect the sound signal. The above solution can select the main microphone and the secondary microphone for constructing the dual-microphone Beam-forming architecture according to the position of the target device, which can eliminate the influence of the angle between the sound source and the dual microphones on the acquisition effect of the sound signal and improve the stability of the Beam-forming function. The present application also provides a system for implementing the Beam-forming function, a storage medium and an electronic device, which have the above beneficial effects and will not be elaborated herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0040] Figure 1 It is a flowchart of a method for implementing the Beam-forming function provided by an embodiment of the present application;

[0041] Figure 2 It is a schematic diagram of the structure of a microphone array provided by an embodiment of the present application;

[0042] Figure 3 It is a schematic diagram of the principle of selecting the main microphone provided by an embodiment of the present application;

[0043] Figure 4 It is a schematic diagram of the principle of selecting the secondary microphone provided by an embodiment of the present application;

[0044] Figure 5 Schematic diagram of the principle for selecting a main microphone and a secondary microphone provided by an embodiment of the present application;

[0045] Figure 6 Schematic diagram of the architecture of an intelligent speaker provided by an embodiment of the present application;

[0046] Figure 7 Schematic diagram of the positioning principle of an intelligent speaker provided by an embodiment of the present application;

[0047] Figure 8 Schematic diagram of the microphone layout of an intelligent speaker provided by an embodiment of the present application. Detailed implementation manners

[0048] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the scope of protection of the present application.

[0049] Please refer to the following Figure 1 , Figure 1 Flowchart of a method for implementing the Beam-forming function provided by an embodiment of the present application.

[0050] The specific steps may include:

[0051] S101: Collect the positioning signal of the target device by using a positioning device, and determine the position information of the target device by using the positioning signal;

[0052] Among them, this embodiment can be applied to an electronic device including a positioning device and a microphone array. The above-mentioned electronic device can be a device with a sound collection function such as an intelligent speaker or a mobile phone. The above-mentioned target device can be a device that users can carry with them, such as an intelligent wearable device or a mobile phone. The above-mentioned intelligent wearable device can be an intelligent watch, an intelligent bracelet, a VR helmet, an AR glasses, etc.

[0053] The scenarios to which this embodiment can be applied include, but are not limited to, the following scenarios:

[0054] Scenario 1: There is an intelligent speaker A with the Beam-forming function installed indoors. When user A carrying mobile phone B speaks indoors, the intelligent speaker A collects the user's voice signal through a dual-microphone Beam-forming architecture, so that the intelligent speaker A can execute the instruction corresponding to what user A said;

[0055] Scenario 2: User A and User B are in the same room. When User A, who is carrying Phone B, is speaking indoors, User B uses Phone A' with Beam-forming function to collect the user's voice signal so that Phone A' can record the speech content of User A.

[0056] The above microphone array includes at least three microphones, and the distance between each microphone can be a fixed value. Please refer to Figure 2 , Figure 2 which is a schematic diagram of the microphone array structure provided by the embodiment of the present application. Figure 2 In [the figure], a, b, c, and d are four microphone array arrangement methods, and L represents the distance between two adjacent microphones. Of course, in this embodiment, on the premise that the distances between adjacent microphones are the same, other microphone array arrangement methods can be used in addition to Figure 2 those shown.

[0057] In this step, a positioning device can be used to collect the positioning signal sent by the target device, and then the position information of the target device can be determined using the positioning signal. The above position information specifically refers to the relative position of the target device relative to the electronic device.

[0058] S102: Select a main microphone and a secondary microphone from the microphone array according to the position information;

[0059] Among them, after obtaining the position information of the target device, two microphones that are most suitable for implementing the dual-microphone Beam-forming function can be selected as the main microphone and the secondary microphone according to the position information.

[0060] S103: Construct a dual-microphone Beam-forming architecture using the main microphone and the secondary microphone, and collect voice signals using the dual-microphone Beam-forming architecture.

[0061] Among them, after determining the main microphone and the secondary microphone, a dual-microphone Beam-forming architecture can be constructed using the main microphone and the secondary microphone, and the main microphone and the secondary microphone in the dual-microphone Beam-forming architecture can be used to collect voice signals.

[0062] The position where the above target device is located is the position where the sound source is located. When the user wears the target device and speaks to the electronic device, the electronic device can collect the user's voice signal using the dual-microphone Beam-forming architecture.

[0063] The electronic device provided in this embodiment includes a positioning device and a microphone array. The microphone array includes at least three microphones. The positioning device is used to collect the positioning signal of the target device, and then the positioning information of the target device is determined by using the positioning signal. The main microphone and the secondary microphone are selected from the microphone array according to the positioning information of the target device, and a dual-microphone Beam-forming architecture is constructed by using the main microphone and the secondary microphone to collect sound signals. The above solution can select the main microphone and the secondary microphone for constructing the dual-microphone Beam-forming architecture according to the position of the target device, eliminate the influence of the angle between the sound source and the dual microphones on the acquisition effect of the sound signal, and improve the stability of the Beam-forming function.

[0064] As a further introduction to Figure 1 the corresponding embodiment, the above positioning device can be a UWB module or a Bluetooth module. Taking the UWB module including the first antenna and the second antenna as an example of the positioning device, the process of determining the position information of the target device is described as follows: the UWB signals of the target device are collected by using the first antenna and the second antenna of the UWB module respectively; the time difference between the UWB signals reaching the first antenna and the second antenna is calculated; the position information of the target device is determined according to the time difference and the antenna distance; where the antenna distance is the distance between the first antenna and the second antenna.

[0065] As a further introduction to Figure 1 the corresponding embodiment, the main microphone can be selected by comparing the included angles. The specific process is as follows: the first type of included angle ∠POM corresponding to the microphone is determined according to the position information; where P is the coordinate point of the target device, O is the target center point, and M is the coordinate point of the microphone; the target center point is a point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane; the microphone with the smallest first type of included angle ∠POM is set as the main microphone. Please refer to Figure 3 , Figure 3 which is a schematic diagram of the principle for selecting the main microphone provided by the embodiment of the present application; Figure 3 where P is the coordinate point of the target device, O is the target center point, M1, M2, M3, and M4 are the coordinate points of four microphones. By comparison, it can be seen that ∠POM1 is the microphone with the smallest first type of included angle, and the microphone corresponding to M1 is set as the main microphone.

[0066] The secondary microphone can be selected by comparing the included angles. The specific process is as follows: Determine multiple second-class included angles ∠PQN corresponding to the main microphone, where Q is the coordinate point of other microphones adjacent to the main microphone, and N is the coordinate point of the main microphone; Set the microphone corresponding to the Q point that makes the second-class included angle ∠PQN the smallest as the secondary microphone. In the above method, the position where the target device is located is regarded as the position where the sound source is located. By comparing the included angles to select the main microphone and the secondary microphone, the included angle between the sound source direction and the central axis of the dual microphones can be minimized. Please refer to Figure 4 , Figure 4 which is a schematic diagram of the principle for selecting a secondary microphone provided by an embodiment of the present application. Figure 4 In it, Q1 and Q2 are the coordinate points of other microphones adjacent to the main microphone, and N is the coordinate point of the main microphone. By comparison, it can be known that Q1 is the Q point that makes the second-class included angle the smallest, and the microphone corresponding to Q1 can be set as the secondary microphone.

[0067] As another feasible implementation method, the main microphone and the secondary microphone can be selected according to the distances between each microphone and the target device. The specific process includes: Connect the target center point to each microphone to divide the area where the target device is located into multiple sub-areas, where the target center point is the point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane; Determine the sub-area where the target device is located according to the position information, and set the two microphones corresponding to the sub-area where the target device is located as alternative microphones; Set the alternative microphone closest to the target device as the main microphone; Set the microphone other than the alternative microphones that is closest to the target device as the secondary microphone. Further, if the target device is equidistant from the two alternative microphones, either of the alternative microphones can be selected as the main microphone. In the process of using the above method to determine the main microphone, if the target device is located on the boundary line of the sub-area, set the microphone closest to the target device as the main microphone, and select a microphone other than the alternative microphones that is closest to the target device as the secondary microphone.

[0068] Please refer to Figure 5 , Figure 5 which is a schematic diagram of the principle for selecting a main microphone and a secondary microphone provided by an embodiment of the present application. Figure 5Among them, M1, M2, M3, and M4 are microphones, P1 and P2 are two target devices, and O is the target center point that is equidistant from all the microphones. Connect the target center point O to each of the microphones M1, M2, M3, and M4, and divide the area where the target device is located into 4 sub-regions M1OM2, M2OM3, M3OM4, and M4OM1. If P1 is in M4OM1, then M1 and M4 are used as alternative microphones; since M1 is the closest to P1, M1 is used as the main microphone. Among M2 and M3, since M2 is the closest to P1, M2 is used as the secondary microphone. If P2 is on the boundary line of the sub-region and M4 is the closest to P2, then M4 is used as the main microphone, and M1 or M3 is used as the secondary microphone.

[0069] The following uses an example in actual application to illustrate the process described in the above embodiment.

[0070] As the core device of smart home, the smart speaker has multiple attributes such as audio and video, and has been initially popularized. In the smart speaker, the voice assistant, as the core feature of user interaction and intelligent functions, has extremely high requirements for the accuracy of human voice collection. Relying on its ultra-high positioning accuracy, high bandwidth, anti-interference and other characteristics, UWB technology has gradually become the most important wireless communication and IOT control technology in smart home. Relying on the UWB interconnection and positioning of multiple devices, smart home devices can be controlled more precisely.

[0071] Please refer to Figure 6 , Figure 6 which is a schematic diagram of the architecture of a smart speaker provided by an embodiment of the present application. The electronic device includes a central control machine, a Codec module, microphones A - D, and a UWB module including antenna one and antenna two. The Codec module is a codec. In this embodiment, the UWB module is used to obtain the user's position, realize the switching of the Beam-forming mode, and improve the accuracy and intelligence of voice command recognition.

[0072] The UWB module is built with dual antennas, which can detect distance and angle to achieve precise positioning of the user's position. Coordinate calculations are completed through the dual antennas in the smart speaker and the antenna in the smart watch, and then the distance and angle are calculated. Please refer to Figure 7 , Figure 7 which is a schematic diagram of the positioning principle of a smart speaker provided by an embodiment of the present application. Figure 7Antenna A represents Antenna 1 and Antenna B represents Antenna 2. Antenna Tx represents the antenna of the smartwatch. r represents the distance from the antenna of the smartwatch to Antenna 1, r-p represents the distance from the antenna of the smartwatch to Antenna 2, y represents the Y-axis difference between the antenna of the smartwatch and Antenna 2, x represents the X-axis difference between the antenna of the smartwatch and Antenna 1, x-d represents the X-axis difference between the antenna of the smartwatch and Antenna 1, and d is the distance between Antenna 1 and Antenna 2. The X-axis is the connection direction between Antenna 1 and Antenna 2, and the Y-axis is perpendicular to the X-axis.

[0073] This embodiment is for UWB communication positioning between a smart speaker based on UWB technology and devices such as a smartwatch with a UWB module, to intelligently switch the microphone selection and switching of Beam-forming. The Beam-forming technology has clear requirements. First, for dual-microphone Beam-forming, it is required that the microphone spacing is consistent, and the smaller the angle between the sound source direction and the mid-axis of the dual microphones (the connection line between Antenna 1 and Antenna 2), the better (generally not exceeding 30 degrees).

[0074] Please refer to Figure 8 , Figure 8 is a schematic diagram of the microphone layout of a smart speaker provided by an embodiment of the present application. Taking the microphone array including Microphone A, Microphone B, Microphone C, and Microphone D as an example, the distance between adjacent microphones is the same and the four microphones are evenly distributed to ensure the consistency of the algorithm when switching dual-microphone Beam-forming. In the figure, L is the distance between adjacent microphones, O is the point with the same distance from the four microphones, that is, the target center point mentioned above. P represents the position of the smartwatch, OP is the connection line between the smartwatch and point O, α is the angle between OP and OD, and β is the angle between OP and OC.

[0075] When it is detected through the UWB module that the user is within the COD area range, since Microphones C and D are closer to the user, it is determined that either Microphone C or D is the main Mic of the dual-microphone Beam-forming architecture. And by calculating the two angles α and β, when α>β, the user is closer to the side of Microphone C, select Microphone C as the main microphone, select Microphone B as the secondary microphone, and then use Microphone C and B to construct dual-microphone beam-forming. Conversely, select Microphone D as the main microphone, select Microphone A as the secondary microphone, and then use Microphone D and A to construct the dual-microphone Beam-forming architecture. Similarly, when it is detected that the user is in the three areas of DOA, AOB, and BOC, the corresponding main microphone can also be selected according to this scheme and the corresponding dual-microphone beam-forming architecture can be constructed.

[0076] In the above embodiments, the UWB module of the smart speaker device and the UWB module in the smart watch device carried by the user himself can accurately determine the precise position of the user indoors. This embodiment can dynamically adjust the selection of the main and auxiliary microphones in the Beam-forming mechanism of the smart speaker in combination with the precise positioning of the user, so as to optimize the performance of the Beam-forming architecture and improve the recognition accuracy of voice commands.

[0077] The embodiments of the present application also provide a Beam-forming function implementation system, which can be applied to an electronic device including a positioning device and a microphone array. The microphone array includes at least three microphones. The Beam-forming function implementation system includes:

[0078] A position information determination module, configured to collect a positioning signal of a target device by using the positioning device, and determine the position information of the target device by using the positioning signal;

[0079] A microphone selection module, configured to select a main microphone and an auxiliary microphone from the microphone array according to the position information;

[0080] A Beam-forming function implementation module, configured to construct a dual-microphone Beam-forming architecture by using the main microphone and the auxiliary microphone, and collect sound signals by using the dual-microphone Beam-forming architecture.

[0081] The electronic device provided in this embodiment includes a positioning device and a microphone array. The microphone array includes at least three microphones. The positioning device is used to collect the positioning signal of the target device, and then the positioning signal is used to determine the positioning information of the target device. The main microphone and the auxiliary microphone are selected from the microphone array according to the positioning information of the target device, and a dual-microphone Beam-forming architecture is constructed by using the main microphone and the auxiliary microphone to collect sound signals. This embodiment completes the precise positioning of the user through UWB technology, and rebuilds the dual-Mic Beam-forming architecture according to the actual position of the user, improving the accuracy and intelligence of voice recognition. The above solution can select the main microphone and the auxiliary microphone for constructing the dual-microphone Beam-forming architecture according to the position of the target device, which can eliminate the influence of the sound source and the angle of the dual microphones on the sound signal acquisition effect and improve the stability of the Beam-forming function.

[0082] Further, the positioning device is a UWB module including a first antenna and a second antenna;

[0083] Correspondingly, the position information determination module is used to collect the UWB signals of the target device by using the first antenna and the second antenna of the UWB module respectively; it is also used to calculate the time difference between the UWB signals arriving at the first antenna and the second antenna respectively; it is also used to determine the position information of the target device according to the time difference and the antenna distance; wherein, the antenna distance is the distance between the first antenna and the second antenna.

[0084] Further, the microphone selection module is used to determine the first type of included angle ∠POM corresponding to the microphone according to the position information; where P is the coordinate point of the target device, O is the target center point, and M is the coordinate point of the microphone; the target center point is a point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane; it is also used to set the microphone with the smallest first type of included angle ∠POM as the main microphone; it is also used to determine a plurality of second type of included angles ∠PQN corresponding to the main microphone; where Q is the coordinate point of the other microphone adjacent to the main microphone, and N is the coordinate point of the main microphone; it is also used to set the microphone corresponding to the Q point that makes the second type of included angle ∠PQN the smallest as the auxiliary microphone.

[0085] Further, the microphone selection module is used to connect the target center point to each microphone, so as to divide the area where the target device is located into multiple sub-areas; where the target center point is a point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane; it is also used to determine the sub-area where the target device is located according to the position information, and set the two microphones corresponding to the sub-area where the target device is located as alternative microphones; it is also used to set the alternative microphone closest to the target device as the main microphone; it is also used to set the microphone closest to the target device except the alternative microphones as the auxiliary microphone.

[0086] Further, the microphone selection module is also used to, if the target device is located on the boundary line of the sub-area, set the microphone closest to the target device as the main microphone.

[0087] The present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed, the steps provided in the above embodiments can be implemented. The storage medium may include: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical discs that can store program codes.

[0088] The present application also provides an electronic device, which includes a memory, a central controller, a positioning device, and a microphone array. The microphone array includes at least three microphones. When the central controller calls a computer program in the memory, the implementation steps include:

[0089] Collect the positioning signal of the target device by using the positioning device, and determine the position information of the target device by using the positioning signal;

[0090] Select a main microphone and a secondary microphone from the microphone array according to the position information;

[0091] Construct a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collect sound signals by using the dual-microphone Beam-forming architecture.

[0092] Further, the electronic device is a smart speaker or a mobile phone, and the target device is a smart wearable device or a mobile phone.

[0093] Further, the positioning device is a UWB module or a Bluetooth module.

[0094] Since the embodiments of the system part and the method part of the electronic device correspond to each other, for the embodiments of the system part, please refer to the description of the embodiments of the method part, and will not be elaborated here.

[0095] The various embodiments in the specification are described in a progressive manner. The key point of each embodiment is to illustrate the differences from other embodiments. The same or similar parts among the various embodiments can be referred to each other. For the system disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method part. It should be noted that for those of ordinary skill in the art in the technical field of the present application, without departing from the principle of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.

[0096] It should also be noted that in this specification, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or device comprising the said element.

Claims

1. A method for implementing Beam-forming function, characterized in that Applied to an electronic device including a positioning device and a microphone array, the microphone array includes at least three microphones, and the method for realizing the Beam-forming function includes: Collect the positioning signal of the target device by using the positioning device, and determine the position information of the target device by using the positioning signal; Select a main microphone and a secondary microphone from the microphone array according to the position information; Construct a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collect sound signals by using the dual-microphone Beam-forming architecture; Among them, selecting a main microphone and a secondary microphone from the microphone array according to the position information includes: Determine a first type of included angle corresponding to the microphone according to the position information POM; where P is the coordinate point of the target device, O is the target center point, and M is the coordinate point of the microphone; the target center point is a point that is equidistant from all the microphones, and the target center point and all the microphones are in the same plane; Set the microphone with the smallest POM among the first type of included angles as the main microphone; Set the microphone with the smallest POM among the first type of included angles as the main microphone; Determine multiple second - type included angles corresponding to the main microphone PQN; where Q is the coordinate point of other microphones adjacent to the main microphone, and N is the coordinate point of the main microphone; will minimize the second included angle Set the microphone corresponding to the Q point with the smallest PQN as the secondary microphone.

2. The method for implementing the Beam-forming function according to claim 1, wherein, The positioning device is a UWB module including a first antenna and a second antenna; Correspondingly, collecting the positioning signal of the target device by using the positioning device, and determining the position information of the target device by using the positioning signal includes: Collect the UWB signals of the target device by using the first antenna and the second antenna of the UWB module respectively; Calculate the time difference between the UWB signals reaching the first antenna and the second antenna respectively; Determine the position information of the target device according to the time difference and the antenna distance; where the antenna distance is the distance between the first antenna and the second antenna.

3. The method for implementing the Beam-forming function according to claim 1, wherein Selecting a main microphone and a secondary microphone from the microphone array according to the position information includes: Connect the target center point to each microphone to divide the area where the target device is located into multiple sub-areas; where the target center point is a point with the same distance from all microphones, and the target center point and all microphones are in the same plane; Determine the sub-area where the target device is located according to the position information, and set the two microphones corresponding to the sub-area where the target device is located as alternative microphones; Set the alternative microphone closest to the target device as the main microphone; Set the microphone closest to the target device except the alternative microphones as the secondary microphone.

4. The method for implementing the Beam-forming function according to claim 3, wherein, It also includes: If the target device is located on the boundary line of the sub-area, set the microphone closest to the target device as the main microphone.

5. A Beam-forming function implementation system, characterized in that, Applied to an electronic device including a positioning device and a microphone array, the microphone array includes at least three microphones, and the Beam-forming function realization system includes: A position information determination module, configured to collect the positioning signal of the target device by using the positioning device, and determine the position information of the target device by using the positioning signal; A microphone selection module, configured to select a main microphone and a secondary microphone from the microphone array according to the position information; A Beam-forming function realization module, configured to construct a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collect sound signals by using the dual-microphone Beam-forming architecture; Among them, the microphone selection module is used to determine the first type of included angle corresponding to the microphone according to the position information POM; where P is the coordinate point of the target device, O is the target center point, and M is the coordinate point of the microphone; the target center point is the point with the same distance from all the microphones, and the target center point and all the microphones are in the same plane; it is also used to set the microphone with the smallest first type of included angle POM as the main microphone; it is also used to determine multiple second type of included angles PQN corresponding to the main microphone; where Q is the coordinate point of the other microphone adjacent to the main microphone, and N is the coordinate point of the main microphone; it is also used to set the microphone corresponding to the Q point with the smallest second type of included angle PQN as the auxiliary microphone.

6. An electronic device, characterized in that, The electronic device includes a memory, a central controller, a positioning device, and a microphone array. The microphone array includes at least three microphones. When the central controller calls a computer program in the memory, the steps implemented include: Collecting a positioning signal of a target device by using the positioning device, and determining position information of the target device by using the positioning signal; Selecting a main microphone and a secondary microphone from the microphone array according to the position information; Constructing a dual-microphone Beam-forming architecture by using the main microphone and the secondary microphone, and collecting a sound signal by using the dual-microphone Beam-forming architecture; Among them, selecting a main microphone and a secondary microphone from the microphone array according to the position information includes: Determine a first type of included angle corresponding to the microphone according to the position information POM; where P is the coordinate point of the target device, O is the target center point, and M is the coordinate point of the microphone; the target center point is a point that is equidistant from all the microphones, and the target center point and all the microphones are in the same plane; Set the microphone with the smallest POM among the first type of included angles as the main microphone; Set the microphone with the smallest POM among the first type of included angles as the main microphone; Determine a plurality of second included angles corresponding to the main microphone PQN; where Q is the coordinate point of other microphones adjacent to the main microphone, and N is the coordinate point of the main microphone; will minimize the second type of included angle Set the microphone corresponding to the Q point that minimizes PQN as the auxiliary microphone.

7. The electronic device according to claim 6, wherein The electronic device is a smart speaker or a mobile phone, and the target device is a smart wearable device or a mobile phone.

8. The electronic device according to claim 6, wherein The positioning device is a UWB module or a Bluetooth module.

9. A storage medium, characterized in that, Computer-executable instructions are stored in the storage medium. When the computer-executable instructions are loaded and executed by a processor, the steps of the Beam-forming function implementation method according to any one of claims 1 to 4 are implemented.

Citation Information

Patent Citations

  • Speech recognition method and device for robot and robot

    CN114596848A