Constant beam width beamformer design method, device, equipment and storage medium

Abstract

The present invention discloses a design method, device, electronic device and storage medium of a beamformer with a constant beam width based on a multi-ring array. The method comprises: constructing a multi-ring array; establishing an objective function; constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function; solving the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array. In the process of beamforming with a constant beam width, the effect of beamforming with a constant beam width is improved, and at the same time, the array form of the multi-ring array improves the robustness of the array.

Description

Technical Field

[0001] The present invention relates to the technical field of array signal processing, and in particular to a design method, device, electronic device and storage medium of a constant beam width beam former based on a multi-ring array. Background Art

[0002] Existing microphone array signal processing mostly uses conventional beamforming. Conventional beamforming has the advantages of high stability and low computational complexity, but it also has the disadvantage of poor beamforming effect. For example, the main lobe widths of different frequencies are different and the side lobes are high. At the same time, when the signal frequency is high, grating lobes are prone to appear, which greatly affects the performance of the array and the beam forming effect.

[0003] In some existing optimization schemes for obtaining a beam with a constant beam width, in addition to the problem of poor effect described above, there is also the problem of optimization stability due to the lack of stability constraints.

[0004] Therefore, there is an urgent need for a constant beamwidth beamformer design method that improves the constant beamwidth beamforming effect and stability. Summary of the invention

[0005] The purpose of the embodiments of the present invention is to provide a method, device, electronic device and storage medium for designing a constant beamwidth beamformer based on a multi-ring array, which improves the effect and stability of the constant beamwidth beamforming and improves the robustness of the array.

[0006] In a first aspect, to achieve the above-mentioned object, an embodiment of the present invention provides a method for designing a beamformer with a constant beam width based on a multi-ring array, comprising:

[0007] Constructing multi-ring arrays;

[0008] Establish the objective function;

[0009] Constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function;

[0010] Solving the optimization function, obtaining weight matrix coefficients corresponding to each ring array in the multi-ring array.

[0011] In a second aspect, in order to solve the same technical problem, an embodiment of the present invention provides a device for designing a beamformer with a constant beam width based on a multi-ring array, comprising:

[0012] Array building module, used to build multi-ring arrays;

[0013] Function building module, used to build the target function;

[0014] A constraint establishment module, used to constrain the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function;

[0015] The coefficient solving module is used to solve the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array.

[0016] In a third aspect, in order to solve the same technical problem, an embodiment of the present invention provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the memory is coupled to the processor, and when the processor executes the computer program, the steps in the method for designing a constant beamwidth beamformer based on a multi-ring array are implemented as described in any one of the above items.

[0017] In a fourth aspect, in order to solve the same technical problem, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to perform any of the steps in the method for designing a constant beamwidth beamformer based on a multi-ring array as described above.

[0018] The embodiment of the present invention provides a design method, device, electronic device and storage medium of a beamformer with a constant beam width based on a multi-ring array. When optimizing the beamforming of the constant beam width, the method first constructs a corresponding multi-ring array, wherein the multi-ring array is formed by a plurality of ring arrays, and each ring array corresponds to a different frequency band for optimization processing, then establishes a corresponding objective function, and then adds relevant constraints, including main lobe width, side lobe suppression and weight matrix second norm. By constraining the objective function, a corresponding optimization function is established, and finally, by solving the established optimization function, the weight matrix coefficient of each ring array in the multi-ring array is solved. At the same time, a certain number of optimization points are set on each ring array, and each optimization point corresponds to a weight matrix coefficient, that is, when solving the weight matrix coefficient corresponding to each ring array, the weight matrix coefficients of all optimization points on each ring are solved. It is realized that in the multi-ring array, each ring array corresponds to a frequency band signal in a different frequency band, and different weight matrix coefficients are set for different frequency bands and different frequency points, thereby effectively improving the forming effect and stability of the beam with a constant beam width. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A schematic flow chart of a method for designing a beamformer with a constant beam width based on a multi-ring array provided in an embodiment of the present application;

[0020] Figure 2A schematic plan view of a multi-ring array provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of a process for constructing a multi-ring array provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of a flow chart of the steps of determining weight matrix coefficients provided in an embodiment of the present application;

[0023] Figure 5 A schematic flow chart of the steps of a process for forming a beam with a constant beam width provided in an embodiment of the present application;

[0024] Figure 6 A schematic structural diagram of a device for designing a beamformer with a constant beam width based on a multi-ring array provided in an embodiment of the present invention;

[0025] Figure 7 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention;

[0026] Figure 8 Another structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0030] See also Figure 1 , Figure 1 A schematic flow chart of a method for designing a beamformer with a constant beam width based on a multi-ring array provided in an embodiment of the present application is shown in FIG. Figure 1As shown, the method for designing a beamformer with a constant beam width based on a multi-ring array provided in an embodiment of the present invention includes steps S101 to S106;

[0031] Step S101, constructing a multi-ring array.

[0032] The constant beam width needs to be optimized during the formation process to reduce the interference and noise that need to be suppressed. In fact, the formation of a constant beam is to obtain audio information in the desired direction when processing audio, and suppress audio and noise in undesired directions.

[0033] When processing audio, the audio is first Fourier transformed to obtain the corresponding time domain sequence, and then optimized using the optimized processing array on the time domain sequence so that the audio obtained after the second transformation is a beam with a constant beam width.

[0034] In one embodiment, for an array used to optimize audio processing, it is necessary to pre-construct and perform parameter optimization. Specifically, a multi-ring array is first constructed, and then parameters of the constructed multi-ring array are determined and optimized.

[0035] The constructed multi-ring array can be designed as a multi-ring array composed of several rings, and the radius of each ring is different. Figure 2 As shown, in Figure 2 In the constructed multi-ring array, the number of circular ring arrays is set to 5, and the radius of each circular ring array is different, and the frequency bands covered by all circular ring arrays include the frequency bands corresponding to general speaking sounds.

[0036] In practical applications, for the constructed multi-ring array, when processing the received audio to be processed, the audio to be processed is optimized according to the optimization method corresponding to each circular ring array, so that the beam of the processed audio can be a beam with a constant beam width. Specifically, the constant beam width is a desired beam width.

[0037] exist Figure 2 In the multi-ring array shown, the frequency band processed by each circular ring array during optimization will be set, such as 300-500 Hz, 500 Hz-1 kHz, 1 kHz-2 kHz, 2 kHz-4 kHz and 4 kHz-8 kHz, where the lower the frequency band, the larger the corresponding circular ring radius. The frequency band corresponding to each circular ring can be set based on experience. Since the setting of the frequency band is related to the main lobe width, side lobe suppression and the second norm of the weight matrix, the frequency band corresponding to each circular ring can also be determined by the main lobe width, side lobe suppression and the second norm of the weight matrix, and the specific determination method is the existing method.

[0038] Specifically, reasonable frequency band settings can improve the stability of the optimization model. For example, the frequency band of the first ring can be set to 300-1000 Hz, but there will be unstable operation during use after optimization. Generally speaking, it can be set according to experience in the above manner, and in order to set the corresponding frequency band more accurately, it can be determined based on the existing method according to the main lobe width, sidelobe suppression, and the mutual suppression relationship between the second norm of the weight matrix and the frequency band, without specific restrictions.

[0039] When constructing a multi-ring array, in addition to setting the optimized frequency band for each ring, it is also necessary to determine the radius of each ring, that is, the size of the ring. Figure 3 , Figure 3 A schematic flow chart of the steps of constructing a multi-ring array provided in an embodiment of the present application, wherein the steps include steps S301 to S303.

[0040] Step S301, determining the number of rings corresponding to the multi-ring array, and setting the frequency band information and frequency point information corresponding to each ring in the multi-ring array;

[0041] Step S302: obtaining a ring size corresponding to each ring in the multi-ring array according to the frequency band information;

[0042] Step S303: construct a multi-ring array according to the number of rings, the plurality of optimization points and the ring size.

[0043] In one embodiment, when constructing a multi-ring array, as described above, it is known that the number of rings corresponding to the currently constructed multi-ring array needs to be determined, and the frequency band information and frequency point information corresponding to each ring are set accordingly, and then the ring size of each ring is determined according to the set frequency band information, and finally the constructed multi-ring array is obtained according to the set number of rings, the frequency point information set on each ring, and the ring size of each ring.

[0044] For example, the constructed multi-ring array can be set as a circular ring array, which can be specifically configured as follows: Figure 2 Here, a circular ring array is used as an example for explanation.

[0045] For the constructed multi-ring array, the corresponding number of rings can be set according to actual needs. In practical applications, the more rings are set, the better the optimization effect during optimization processing, but the cost will be higher. For example, the optimization effect of a 10-ring multi-ring array is better than that of a 5-ring multi-ring array, but the design cost of a 10-ring multi-ring array is higher than that of a 5-ring multi-ring array. Therefore, the setting of the number of rings of the multi-ring array can be determined according to actual needs.

[0046] After determining the number of rings of the constructed multi-ring array, the ring size corresponding to each ring is determined according to the set frequency band information corresponding to each ring. For example, when the ring is a circular ring, the radius of the circular ring is determined according to the frequency band information. Finally, after determining the number of rings of the multi-ring array, the frequency band information and frequency point information corresponding to each ring, and the ring size, the corresponding multi-ring array can be constructed.

[0047] When determining the ring size of each ring in the multi-ring array, since the set ring is a circular ring, it is necessary to determine the circle radius corresponding to each circular ring, which can be determined according to the frequency band information corresponding to each ring.

[0048] For the constructed multi-ring array, a corresponding frequency point will be set on each ring, and the set frequency point is in the frequency band corresponding to the ring. For the set frequency point, when the optimization is completed, the signal at the frequency point is optimized, and after the processing of all frequency points is completed, the optimized beam can be obtained.

[0049] by Figure 2 The constructed multi-ring array is based on a certain number (M) of non-directional sensors set on each ring, where each non-directional sensor represents a frequency point. According to the basic knowledge of the array, the sound pressure received by the mth sensor of the ith ring is:

[0050]

[0051] Among them, θ is the pitch angle, φ is the azimuth angle, λ i is the wavelength of the reference incident wave of the i-th circular array.

[0052] Expanding it can be expressed in another form:

[0053]

[0054] Among them, s n =i n J n (k i r i sinθ), and J n is the nth order cylindrical Bessel function.

[0055] Then the beam pattern is expressed as follows:

[0056]

[0057] Calculate the minimum mean square error between the desired beam and the synthesized beam, which is expressed as follows:

[0058]

[0059] in,

[0060] Further deduction can be obtained:

[0061]

[0062] in, and λ m They are the circulant matrix ρ at the reference frequency k i r i The eigenvalue at the frequency kr to be calculated is: is a circulant matrix From the error formula, we can see that the square error value depends on the eigenvalue of the expected weight item and the related circulant matrix, and the sum of the M value errors. By simulating the error, we can get i r i =3, there is a minimum value, this equation can be used as an estimation standard to determine the radius of each ring.

[0063] Furthermore, when determining the radius of each ring, we can use where f i is the lower limit of the frequency band information. Combined with the frequency band information of each ring, the ring radius of each ring is obtained.

[0064] After the number of rings, the ring size, the setting of the optimization point and the frequency information of each ring of the constructed multi-ring array are determined, the required multi-ring array is constructed.

[0065] Step S102: Establish an objective function.

[0066] When optimizing the constructed multi-ring array, it is necessary to first determine the objective function, and then optimize the objective function by setting corresponding constraints to obtain the corresponding optimization parameters.

[0067] In one embodiment, the objective function constructed is:

[0068] arg min||ω||2

[0069] Among them, ω is the parameter that needs to be optimized, that is, the weight matrix parameter.

[0070] When optimizing and determining parameters based on the objective function, the parameters are optimized according to the set constraints. For the entire multi-ring array, different frequency points correspond to different weight matrix parameters, but the corresponding objective functions are the same. In the subsequent constraints and optimization determination, the weight matrix coefficients corresponding to each frequency point will be obtained according to the different frequency points.

[0071] Step S103, constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function.

[0072] After the objective function is established, it is necessary to optimize the established objective function. When performing the actual optimization, the corresponding parameters are determined by setting corresponding constraints and then solving the optimization function obtained based on the constraints.

[0073] In one embodiment, after obtaining the objective function, the established objective function is constrained according to the set main lobe width, side lobe suppression and second norm of the weight matrix. Specifically, when performing the constraints, the corresponding optimization function is established, and then the corresponding parameters are determined by solving the optimization function.

[0074] The constrained main lobe width, side lobe suppression and weight matrix second norm are determined according to actual needs, specifically, according to the frequency band information of the desired audio, the size of the suppression and the stability.

[0075] For example, for audio playback / collection devices, such as speakers, whose positions and orientations are fixed, the position of the sound source point relative to the device can be determined when collecting and processing sound. For example, when constructing plane coordinates based on the device, the orientation of the sound source point relative to the device can also be determined. When it is necessary to enhance the sound in a certain orientation, the angle corresponding to the orientation is the main lobe width, and the sound generated in the area outside the main lobe width needs to be suppressed. How to suppress and to what extent is determined by sidelobe suppression.

[0076] For the bi-norm of the weight matrix, it represents the stability of the model. Of course, if the model needs to have better stability during use, a longer optimization process is required.

[0077] Therefore, the main lobe width, side lobe suppression and weight matrix second norm can be determined and set according to actual needs without specific limitation.

[0078] When constraining the objective function according to the set constraints, a corresponding optimization function is established, where the optimization function can be:

[0079] ω H a(θ0)=1;

[0080] ω H a(Θ SL )≤SLL;

[0081] Where Θ0 is the desired direction, SLL is the sidelobe level, and the sidelobe level is

[0082] and,

[0083] in, R is the radius of a ring array, λ is the wavelength, γ m =2πm / M, m=0,1,2...M-1, M is the number of microphones in a circular array (i.e. the number of optimization points), θ0 is the azimuth angle, φ0 is the pitch angle. The pitch angle is a fixed value, and in the above embodiments, it is set to 90°, but it can also be other angles. The specific range of the pitch angle is 0-180.

[0084] According to the optimization function obtained above, it can be known that the values ​​of the objective functions corresponding to different rings are different. At the same time, for different optimization points on the same ring, the values ​​of the objective functions corresponding to them are also different. That is to say, in the constructed multi-ring array, in the process of processing the audio to be processed and obtaining a beam with a constant beam width, the processing and optimization of different optimization points are different, which can better optimize the audio in different frequency bands and better improve the optimization effect.

[0085] Step S104: Solve the optimization function to obtain weight matrix coefficients corresponding to each ring array in the multi-ring array.

[0086] After obtaining the optimization function according to the constraint conditions, the corresponding parameters can be obtained by solving the optimization function. Specifically, according to the established objective function, in the process of solving the optimization function, when it is necessary to determine the weight matrix coefficient corresponding to a certain frequency point, the weight matrix coefficient of the corresponding frequency point is obtained by inputting the relevant data into the optimization function.

[0087] From the above description, it can be known that the weight matrix coefficients corresponding to different frequency points are different, which can also be obtained according to the obtained optimization function. Therefore, when determining the weight matrix coefficients corresponding to the frequency points, the weight matrix coefficients corresponding to the frequency points can be obtained by bringing in the relevant information of the frequency points, including the relevant information of the frequency points and the information of the ring in which they are located, such as the frequency value of the frequency point and the radius of the ring.

[0088] After determining the weight matrix coefficients corresponding to each frequency point in the multi-ring array, that is, completing the training and optimization of the constructed multi-ring array, when setting the parameters of the multi-ring array according to the obtained weight matrix coefficients, the multi-ring array used for optimization is obtained.

[0089] Reference Figure 4 , Figure 4 A flowchart of the steps of determining weight matrix coefficients provided in an embodiment of the present application, wherein the steps include steps S401 to S403.

[0090] Step S401: obtaining a first frequency point included in a first ring array, wherein the first ring array is a ring array in the multi-ring array;

[0091] Step S402: solving the optimization function according to the frequency information corresponding to each frequency in the first frequency to obtain a weight matrix coefficient corresponding to each frequency, wherein the number of the weight matrix coefficients corresponding to each frequency is consistent with the number of optimization points on the first ring array;

[0092] Step S403: When the weight matrix coefficient corresponding to each frequency point in each frequency point is obtained, the weight matrix coefficient corresponding to the first ring array is obtained.

[0093] When optimizing each ring array, the frequency point for optimization will be set, that is, the frequency point information described above, and then the weight matrix coefficients of each optimization point will be determined at each frequency point to achieve the optimization of the multi-ring array.

[0094] Therefore, when obtaining the weight matrix coefficient of each ring array, for the first ring array, where the first ring array is a ring array in the multi-ring array, the weight matrix coefficient corresponding to each optimization point when determining a frequency point, since the number of optimization points set on each ring is unlimited, when determining the weight matrix coefficient corresponding to a frequency point, multiple weight matrix coefficients will be obtained.

[0095] Exemplarily, when determining the weight matrix coefficients of each frequency point corresponding to the first ring array, it includes: determining the azimuth information of each optimization point in the first optimization point set contained in the first ring array; solving the optimization function according to the azimuth information to obtain the weight matrix coefficient corresponding to each optimization point in the first optimization point set. Specifically, for the first ring array of the multi-ring array, the corresponding frequency band is 300-500 Hz, and the frequency points contained therein are 5 frequency points such as 300 Hz, 350 Hz, 400 Hz, 450 Hz and 500 Hz. At the same time, 8 microphones are arranged on the ring array, and one microphone corresponds to one optimization point. Then, when determining the weight matrix coefficient corresponding to the frequency point of 350 Hz, according to the set optimization function, the weight matrix coefficients corresponding to the 8 microphones will be obtained, and the set of the 8 weight matrix coefficients is the weight matrix coefficient corresponding to the frequency point of 350 Hz.

[0096] When determining the weight matrix coefficient corresponding to each frequency point, according to the set optimization function, it can be known that when the ring array where the optimization point is located is determined, the weight matrix coefficient is related to the actual position of the optimization point, which is specifically reflected in the optimization of the azimuth information of the optimization point. When the multi-ring array is in a fixed state, the azimuth information can be used to represent the position information of each optimization point. Then, based on the obtained position information, the weight matrix coefficient of the optimization point at the frequency point is determined, and the weight matrix coefficients corresponding to all optimization points at the frequency point can also be obtained.

[0097] In addition, after the weight matrix coefficients corresponding to each optimization point in the multi-ring array are determined, the training of the multi-ring array is completed. At this time, the obtained weight matrix coefficients are used to set the parameters in the multi-ring array, and a usable multi-ring array is obtained.

[0098] Reference Figure 5 , Figure 5 A schematic flow chart of the steps of forming a beam with a constant beam width provided in an embodiment of the present application, wherein the steps include steps S501 to S503.

[0099] Step S501: receiving input audio to be processed, and processing the audio to be processed to obtain a corresponding frequency domain sequence;

[0100] Step S502: input the frequency domain sequence into the optimized multi-ring array to obtain the optimized frequency domain sequence;

[0101] Step S503: transform the optimized frequency domain sequence to obtain optimized presentation audio corresponding to the audio to be processed.

[0102] After optimizing and training the constructed multi-ring array to obtain a multi-ring array that can be used, during use, when processing audio, the frequency band actually covered by the audio is 300 Hz to 8000 Hz. Since the weight matrix coefficients corresponding to different optimization points are different, when the multi-ring array is used for optimization processing, the optimization methods and results of different optimization points, such as suppression at different optimization points, are different.

[0103] In one embodiment, when the audio to be processed is received, the audio is transformed accordingly to obtain a corresponding frequency domain sequence, and then the frequency domain sequence is input into a multi-ring array for processing. The time domain sequence is processed at different frequency points according to the weight matrix coefficients corresponding to different frequency points to obtain an optimized frequency domain sequence. Finally, the processed frequency domain sequence is inversely transformed to obtain the optimized display audio.

[0104] Exemplarily, when processing the frequency domain sequence obtained by conversion, the frequency domain sequences of different frequency points are optimized accordingly. For example, when optimizing, if every 50 Hz interval is taken as a frequency point, then there are 161 frequency points in the entire frequency band of 0 to 8000 Hz, and each frequency point has a different corresponding weight matrix coefficient, and the optimization processing will be performed according to the corresponding weight matrix coefficient.

[0105] For an audio, the frequency domain sequence obtained after processing is Y k,i , where k is a ring of the multi-ring array, i is a microphone on a ring (optimization point), when optimizing the frequency domain sequence corresponding to a certain frequency point, if there are 8 microphones on the ring array where the frequency point is located, that is, 8 optimization points, then when optimizing, it is assumed that the effective frequency band at the frequency point is Y k,i ′, the optimization result is Among them, ω k,i is the weight matrix coefficient corresponding to the i-th microphone on the k-th ring. In this way, the optimization result corresponding to each ring can be determined.

[0106] After obtaining the optimization results of each ring, the optimization results corresponding to each ring are integrated, and the integrated result is Z = [Z0, Z1...Z k ], where in the multi-ring array, the optimization result of each ring array is Z M-1 , and the number of rings of the multi-ring array is M. Finally, after inverse processing and transformation, the final optimized audio information can be obtained.

[0107] In actual applications, when an audio is obtained, it will first be processed accordingly. If the voice information is s k,i (n), first perform frame processing, and then obtain the frame signal s through windowing frame processing k,i,l (n), where win(n) is a window function. There is no restriction on the use of the window function, and it can be implemented using a sqrt-hanning window.

[0108] Perform FFT transformation, i.e. Fourier transform, on the windowed framed speech to obtain the frequency domain sequence Y corresponding to the audio. k,i =fft(s k,i,l (n)), and finally when the obtained Z is transformed, the optimized audio can be obtained according to z=ifft(Z).

[0109] In summary, the constant beam width beam former design method based on a multi-ring array provided by the embodiment of the present invention, when optimizing the beam forming of the constant beam width, firstly constructs a corresponding multi-ring array, wherein the multi-ring array is formed by a plurality of ring arrays, and each ring array corresponds to a different frequency band for optimization processing, and then establishes a corresponding objective function, and then adds relevant constraints, including main lobe width, side lobe suppression, and weight matrix second norm, constrains the objective function, establishes a corresponding optimization function, and finally solves the established optimization function to solve the weight matrix coefficient of each ring array in the multi-ring array, and at the same time, a certain number of optimization points are set on each ring array, and each optimization point corresponds to a weight matrix coefficient, that is, when solving the weight matrix coefficient corresponding to each ring array, the weight matrix coefficients of all optimization points on each ring are solved. After completing the solution of the weight matrix coefficient, a multi-ring array that can be used is obtained by parameter setting, thereby realizing the formation of a beam with a constant beam width. It is achieved that in a multi-ring array, each ring array corresponds to a frequency band signal in a different frequency band, different weight matrix coefficients are set for different frequency bands and different frequency points, the beamforming effect is improved, and the stability of the multi-ring array is improved by setting constraint conditions.

[0110] According to the method described in the above embodiment, this embodiment will be further described from the perspective of a beamformer design device with a constant beamwidth based on a multi-ring array. The beamformer design device with a constant beamwidth based on a multi-ring array can be implemented as an independent entity or integrated in an electronic device, such as a terminal. The terminal may include a mobile phone, a tablet computer, etc.

[0111] See also Figure 6 , Figure 6 A structural schematic diagram of a constant beam width beamformer design device based on a multi-ring array provided in an embodiment of the present invention, such as Figure 6 As shown, the embodiment of the present invention provides a multi-ring array-based constant beam width beamformer design device 600, comprising:

[0112] An array construction module 601 is used to construct a multi-ring array;

[0113] Function establishment module 602, used to establish the target function;

[0114] A constraint establishing module 603 is used to constrain the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function;

[0115] The coefficient solving module 604 is used to solve the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array.

[0116] During specific implementation, the above modules and / or units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above modules and / or units can refer to the previous method embodiments. The specific beneficial effects that can be achieved can also refer to the beneficial effects in the previous method embodiments, which will not be repeated here.

[0117] Also, see Figure 7 , Figure 7 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, the electronic device may be a mobile terminal such as a smart phone, a tablet computer, etc. Figure 7 As shown, the electronic device 700 includes a processor 701 and a memory 702. The processor 701 is electrically connected to the memory 702.

[0118] The processor 701 is the control center of the electronic device 700. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device 700 and processes data by running or loading applications stored in the memory 702 and calling data stored in the memory 702, thereby monitoring the electronic device 700 as a whole.

[0119] In this embodiment, the processor 701 in the electronic device 700 loads instructions corresponding to the processes of one or more application programs into the memory 702 according to the following steps, and the processor 701 runs the application programs stored in the memory 702 to implement various functions:

[0120] Constructing multi-ring arrays;

[0121] Establish the objective function;

[0122] Constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function;

[0123] Solving the optimization function, obtaining weight matrix coefficients corresponding to each ring array in the multi-ring array.

[0124] The electronic device 700 can implement the steps in any embodiment of the method for designing a beamformer with a constant beamwidth based on a multi-ring array provided in the embodiments of the present invention. Therefore, it can achieve the beneficial effects that can be achieved by any method for designing a beamformer with a constant beamwidth based on a multi-ring array provided in the embodiments of the present invention. For details, please refer to the previous embodiments and will not be repeated here.

[0125] See also Figure 8 , Figure 8 Another structural diagram of an electronic device provided by an embodiment of the present invention is as follows: Figure 8 As shown, Figure 8 The specific structural block diagram of the electronic device provided by the embodiment of the present invention is shown, and the electronic device can be used to implement the constant beam width beamformer design method based on multi-ring array provided in the above embodiment. The electronic device 800 can be a mobile terminal such as a smart phone or a laptop computer.

[0126] The RF circuit 810 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The RF circuit 810 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity module (SIM) cards, memories, etc. The RF circuit 810 can communicate with various networks such as the Internet, corporate intranets, wireless networks, or communicate with other devices through wireless networks. The above-mentioned wireless networks may include cellular telephone networks, wireless local area networks, or metropolitan area networks. The above-mentioned wireless networks can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wi-Fi) (such as Institute of Electrical and Electronics Engineers standards IEEE 802.11a, IEEE 802.11b, IEEE802.11g and / or IEEE802.11n), Voice over Internet Protocol (VoIP), Worldwide Interoperability for Microwave Access (Wi-Max), other protocols for email, instant messaging and short messages, and any other suitable communication protocols, even those that have not yet been developed.

[0127] The memory 820 may be used to store software programs and modules, such as program instructions / modules corresponding to the method for designing a beamformer with a constant beamwidth based on a multi-ring array in the above-mentioned embodiment. The processor 880 executes various functional applications and the design of a beamformer with a constant beamwidth based on a multi-ring array by running the software programs and modules stored in the memory 820, that is, to realize the following functions:

[0128] Constructing multi-ring arrays;

[0129] Establish the objective function;

[0130] Constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function;

[0131] Solving the optimization function, obtaining weight matrix coefficients corresponding to each ring array in the multi-ring array.

[0132] The memory 820 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 820 may further include a memory remotely arranged relative to the processor 880, and these remote memories may be connected to the electronic device 800 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0133] The input unit 830 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 830 may include a touch-sensitive surface 831 and other input devices 832. The touch-sensitive surface 831, also known as a touch display screen or touchpad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 831), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 831 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 880, and can receive and execute commands sent by the processor 880. In addition, the touch-sensitive surface 831 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 831, the input unit 830 may further include other input devices 832. Specifically, the other input devices 832 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0134] The display unit 840 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device 800, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 840 may include a display panel 841, and optionally, the display panel 841 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 831 may cover the display panel 841, and when the touch-sensitive surface 831 detects a touch operation on or near it, it is transmitted to the processor 880 to determine the type of the touch event, and then the processor 880 provides corresponding visual output on the display panel 841 according to the type of the touch event. Although in the figure, the touch-sensitive surface 831 and the display panel 841 are implemented as two independent components to implement input and output functions, in some embodiments, the touch-sensitive surface 831 can be integrated with the display panel 841 to implement input and output functions.

[0135] The electronic device 800 may also include at least one sensor 850, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 841 according to the brightness of the ambient light, and the proximity sensor may generate an interrupt when the flip cover is closed or closed. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in the electronic device 800, they will not be repeated here.

[0136] The audio circuit 860, the speaker 861, and the microphone 862 can provide an audio interface between the user and the electronic device 800. The audio circuit 860 can transmit the electrical signal converted from the received audio data to the speaker 861, which is converted into a sound signal for output; on the other hand, the microphone 862 converts the collected sound signal into an electrical signal, which is received by the audio circuit 860 and converted into audio data, and then the audio data is output to the processor 880 for processing, and then sent to another terminal through the RF circuit 810, or the audio data is output to the memory 820 for further processing. The audio circuit 860 may also include an earplug jack to provide communication between an external headset and the electronic device 800.

[0137] The electronic device 800 can help the user receive requests, send information, etc. through the transmission module 870 (such as a Wi-Fi module), which provides the user with wireless broadband Internet access. Although the transmission module 870 is shown in the figure, it is understandable that it is not a necessary component of the electronic device 800 and can be omitted as needed without changing the essence of the invention.

[0138] The processor 880 is the control center of the electronic device 800. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 820, and calling data stored in the memory 820, it executes various functions of the electronic device 800 and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 880 may include one or more processing cores; in some embodiments, the processor 880 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the processor 880.

[0139] The electronic device 800 also includes a power supply 890 (such as a battery) for supplying power to various components. In some embodiments, the power supply can be logically connected to the processor 880 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 890 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0140] Although not shown, the electronic device 800 also includes a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the display unit of the electronic device is a touch screen display, and the mobile terminal also includes a memory, and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors. One or more programs include instructions for performing the following operations:

[0141] Constructing multi-ring arrays;

[0142] Establish the objective function;

[0143] Constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function;

[0144] Solving the optimization function, obtaining weight matrix coefficients corresponding to each ring array in the multi-ring array.

[0145] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above modules can be found in the previous method embodiments, which will not be repeated here.

[0146] A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions, and the instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. To this end, an embodiment of the present invention provides a storage medium, which stores a plurality of instructions, and the instructions can be loaded by a processor to execute the steps of any embodiment of the method for designing a constant beam width beamformer based on a multi-ring array provided in an embodiment of the present invention.

[0147] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0148] Since the instructions stored in the storage medium can execute the steps in any embodiment of the method for designing a beamformer with a constant beamwidth based on a multi-ring array provided in the embodiments of the present invention, the beneficial effects that can be achieved by any method for designing a beamformer with a constant beamwidth based on a multi-ring array provided in the embodiments of the present invention can be achieved. For details, please refer to the previous embodiments and will not be repeated here.

[0149] The above is a detailed introduction to a method, device, electronic device and storage medium for designing a beamformer with a constant beam width based on a multi-ring array provided in an embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application. Moreover, for those of ordinary skill in the art, several improvements and modifications can be made without departing from the principles of the present invention, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. A method for designing a beamformer with a constant beam width based on a multi-ring array, characterized in that: include: Constructing multi-ring arrays; Establish the objective function; Constraining the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function; Solving the optimization function to obtain weight matrix coefficients corresponding to each ring array in the multi-ring array; The establishing of the multi-ring array includes: determining the number of rings corresponding to the multi-ring array, and setting the frequency band information and frequency point information corresponding to each ring array in the multi-ring array, wherein each ring array is provided with a plurality of optimization points; obtaining the ring size corresponding to each ring in the multi-ring array according to the frequency band information, wherein the frequency band information includes a low boundary frequency and a high boundary frequency, and the ring size is inversely proportional to the low boundary frequency; constructing the multi-ring array according to the number of rings, the plurality of optimization points and the ring size; The solving of the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array includes: obtaining a first frequency point included in a first ring array, wherein the first ring array is a ring array in the multi-ring array; solving the optimization function according to frequency point information corresponding to each frequency point in the first frequency points to obtain the weight matrix coefficient corresponding to each frequency point, wherein the number of weight matrix coefficients corresponding to each frequency point is consistent with the number of optimization points on the first ring array; when the weight matrix coefficient corresponding to each frequency point in each frequency point is obtained, the weight matrix coefficient corresponding to the first ring array is obtained.

2. The method according to claim 1, characterized in that The step of solving the optimization function according to the frequency information corresponding to each frequency in the first frequency to obtain a weight matrix coefficient corresponding to each frequency includes: Determine the position information of each optimized point in the first optimized point set included in the first ring array; The optimization function is solved according to the orientation information to obtain a weight matrix coefficient corresponding to each optimization point in the first optimization point set.

3. The method according to claim 2, characterized in that After solving the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array, the method further includes: According to the weight matrix coefficient corresponding to each ring array, parameters are set for each optimization point in the multi-ring array to obtain an optimized multi-ring array.

4. The method according to claim 3, characterized in that After obtaining the optimized multi-ring array, the method further comprises: Receiving input audio to be processed, and processing the audio to be processed to obtain a corresponding frequency domain sequence; Inputting the frequency domain sequence into the optimized multi-ring array to obtain the optimized frequency domain sequence; The optimized frequency domain sequence is transformed to obtain optimized presentation audio corresponding to the audio to be processed.

5. The method according to claim 4, characterized in that The step of inputting the frequency domain sequence into the optimized multi-ring array to obtain the optimized frequency domain sequence comprises: Inputting the frequency domain sequence into the optimized multi-ring array, and obtaining the processing result of the frequency domain sequence at each frequency point based on the weight matrix coefficient; Based on the frequency magnitude corresponding to the frequency point, the processing result of each frequency point in the multi-ring array is spliced ​​to obtain the optimized frequency domain sequence.

6. A constant beam width beamformer design device based on a multi-ring array, characterized in that: include: Array building module, used to build multi-ring arrays; Function building module, used to build the target function; A constraint establishment module, used to constrain the objective function according to the main lobe width, side lobe suppression and the second norm of the weight matrix to establish an optimization function; A coefficient solving module, used for solving the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array; The establishing of the multi-ring array includes: determining the number of rings corresponding to the multi-ring array, and setting the frequency band information and frequency point information corresponding to each ring array in the multi-ring array, wherein each ring array is provided with a plurality of optimization points; obtaining the ring size corresponding to each ring in the multi-ring array according to the frequency band information, wherein the frequency band information includes a low boundary frequency and a high boundary frequency, and the ring size is inversely proportional to the low boundary frequency; constructing the multi-ring array according to the number of rings, the plurality of optimization points and the ring size; The solving of the optimization function to obtain the weight matrix coefficient corresponding to each ring array in the multi-ring array includes: obtaining a first frequency point included in a first ring array, wherein the first ring array is a ring array in the multi-ring array; solving the optimization function according to frequency point information corresponding to each frequency point in the first frequency points to obtain the weight matrix coefficient corresponding to each frequency point, wherein the number of weight matrix coefficients corresponding to each frequency point is consistent with the number of optimization points on the first ring array; when the weight matrix coefficient corresponding to each frequency point in each frequency point is obtained, the weight matrix coefficient corresponding to the first ring array is obtained.

7. An electronic device, characterized in that: The invention comprises a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the memory is coupled to the processor, and when the processor executes the computer program, the steps in the method for designing a beamformer with a constant beamwidth based on a multi-ring array are implemented as claimed in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the steps in the method for designing a constant beamwidth beamformer based on a multi-ring array according to any one of claims 1 to 5.

Images