Sound source positioning method, electronic equipment, sound processing equipment and storage medium

Abstract

The invention provides a sound source positioning method, electronic equipment, sound processing equipment and a storage medium. The sound source positioning method comprises the following steps: acquiring sound signals emitted by a sound source and acquired by a plurality of sound acquisition modules; determining the number of delay points between the sound signals acquired by the sound acquisition modules based on the sound signals, and establishing a first calculation formula of delay time based on the number of delay points; establishing a second calculation formula of the delay time based on the distance difference between each sound acquisition module and the sound source; establishing a noise positioning function based on the first calculation formula and the second calculation formula; determining a calculation position of the sound source based on the noise positioning function; and determining the target position of the sound source based on the calculation position and the angle range corresponding to the target area, so that the established noise localization function can be an explicit function, an expression is not required to be obtained through iterative convergence, and the calculation complexity when the position of the sound source is calculated can be reduced.

Description

Technical Field

[0001] The present application belongs to the technical field of sound information processing, and in particular, relates to a sound source positioning method, electronic equipment, sound processing equipment and storage medium. Background Art

[0002] The cochlea is a spiral bone cavity with an average length of 32 to 43.5 mm. In normal hearing listeners, high-frequency sounds are transmitted by the displacement of the membrane and fluid near the bottom of the cochlea, while low-frequency sounds produce stronger displacements of the top of the cochlea. For normal people, the outer ear and the middle ear are mechanical transmission devices for external sound signals. The outer ear is used to collect sound, and the middle ear ossicular chain is used to amplify mechanical vibrations. The amplified signal of the middle ear is transmitted to the inner ear. The auditory signal is converted into a bioelectric signal by the hair cells. The bioelectric signal stimulates the auditory nerve to produce auditory perception. The residual auditory nerve in the cochlea of ​​deaf patients can be excited by electrical stimulation, which is transmitted to the brain through the auditory pathway, producing auditory perception similar to that of normal people. The electronic cochlea stimulates the spiral ganglion neurons of the auditory nerve through an electrode array embedded in the perilymph of the inner ear cochlea. When weak electrical pulses act on the auditory nerve, it causes the auditory nerve to be excited and is transmitted to the brain along the auditory pathway to produce auditory perception. The electronic cochlea has two parts: the outer and the inner. The external part consists of a behind-the-ear device connected to an external transmission coil that provides a radio frequency connection to a matching coil in the implant. The implant in the cochlear implant includes a microshell equipped with electronics connected to a plurality of electrodes. The electrode array is surgically inserted into the cochlea to stimulate current between selected electrodes and activate neural structures near the electrode-neuron interface. The cochlear implant thus replaces the functions of the outer ear, middle ear, and part of the inner ear. By stimulating the auditory nerve, it produces a pattern of innervation and auditory perception similar to that of a normal ear. The cochlear implant has a high speech recognition rate in quiet environments, but a low speech recognition rate in noisy environments. Noise reduction methods are an indispensable part of the signal processing chain and an important way to improve the speech recognition rate of the cochlear implant. In order to suppress the noise of the electronic cochlear implant, various algorithms such as time-frequency masking, spectral subtraction, Wiener filtering, beamforming, multi-channel speech enhancement, adaptive denoising, Frost algorithm, multi-input / output inverse algorithm, frequency domain beamformer, generalized sidelobe cancellation or maximum likelihood technology for speaker positioning have been proposed and used for denoising. However, the problem with these algorithms is that they require iterative convergence to obtain expressions and use the expressions to calculate the position, and the computational complexity of the iterative convergence method is relatively high. Summary of the invention

[0003] The embodiments of the present application provide a method for locating a sound source, an electronic device, a sound processing device, and a storage medium, which can reduce the complexity of calculating the position of the sound source.

[0004] In a first aspect, an embodiment of the present application provides a method for locating a sound source, which is applied to a sound processing device, wherein the sound processing device has at least three sound collection modules, and the distances between the sound collection modules are fixed, including:

[0005] Acquire sound signals emitted by the sound sources collected by the multiple sound collection modules;

[0006] Determine the number of delay points between the sound signals collected by each of the sound collection modules based on the sound signal, and establish a first calculation formula for the delay time based on the number of delay points;

[0007] Establishing a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source;

[0008] Establishing a noise localization function based on the first calculation formula and the second calculation formula;

[0009] determining a calculated position of the sound source based on the noise localization function;

[0010] The target position of the sound source is determined based on the calculated position and the angular range corresponding to the target area.

[0011] In some embodiments, determining the target position of the sound source based on the calculated position and the angle range corresponding to the target area includes:

[0012] Determine the angle corresponding to each calculated position based on each calculated position;

[0013] The target position of the sound source is determined based on the angle range corresponding to the preset target area and the angle.

[0014] In some embodiments, the sound processing device is an electronic cochlear implant, the number of the sound collection modules is three, the three sound collection modules include: a first sound collection module, a second sound collection module and a third sound collection module, the three sound collection modules form an isosceles right triangle, the distance between the first sound collection module and the second sound collection module is equal to the distance between the second sound collection module and the third sound collection module, and the noise localization function includes:

[0015] and Wherein, r is the distance between the first sound collection module and the second sound collection module, N1 is the number of delay points between the sound signal collected by the first sound collection module and the sound signal collected by the second sound collection module, N2 is the number of delay points between the sound signal collected by the second sound collection module and the sound signal collected by the third sound collection module, and f sis the signal sampling rate, c is the propagation speed of sound;

[0016] The coordinates of the calculated position include:

[0017]

[0018]

[0019] Among them, (x i ,y i ) are the coordinates of the calculated position, where i = 1, 2, 3, 4.

[0020] In some embodiments, the method further comprises:

[0021] determining a delay parameter based on the target position;

[0022] The sound signal collected by the sound collection module is denoised based on the delay parameter, and the denoised signal is output.

[0023] In some embodiments, the denoising process of the sound signal collected by the sound collection module based on the delay parameter includes:

[0024] A wave former is used based on the delay parameter to perform denoising on the sound signal collected by the sound collection module.

[0025] In some embodiments, determining a delay parameter based on the target position includes:

[0026] The coordinates of the target position are input into a delay parameter calculation formula to calculate the delay parameter, wherein the delay parameter calculation formula is:

[0027]

[0028] In a second aspect, an embodiment of the present application provides a device for locating a sound source, which is applied to a sound processing device, wherein the sound processing device has at least three sound collection modules, and the distances between the sound collection modules are fixed, including:

[0029] An acquisition module, used to acquire sound signals emitted by the sound sources collected by the multiple sound collection modules;

[0030] A first establishing module, configured to determine the number of delay points between the sound signals collected by the sound collecting modules based on the sound signal, and to establish a first calculation formula for the delay time based on the number of delay points;

[0031] A second establishing module, used for establishing a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source;

[0032] A third establishing module, used to establish a noise localization function based on the first calculation formula and the second calculation formula;

[0033] A calculation module, used for determining a calculation position of the sound source based on the noise localization function;

[0034] A positioning module is used to determine the target position of the sound source based on the calculated position and the angle range corresponding to the target area.

[0035] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described above when executing the computer program.

[0036] In a fourth aspect, an embodiment of the present application provides a sound processing device, comprising: the electronic device described in the third aspect and at least three sound collection modules, wherein the electronic device is communicatively connected to the at least three sound collection modules.

[0037] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, any of the methods described above is implemented.

[0038] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the electronic device to execute any of the methods described above.

[0039] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0040] The method for locating a sound source provided in an embodiment of the present application obtains sound signals emitted by a sound source collected by a plurality of sound collection modules; determines the number of delay points between the sound signals collected by each of the sound collection modules based on the sound signals, and establishes a first calculation formula for the delay time based on the number of delay points; establishes a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source; establishes a noise localization function based on the first calculation formula and the second calculation formula; determines a calculated position of the sound source based on the noise localization function; and determines a target position of the sound source based on an angle range corresponding to the calculated position and a target area. The established noise localization function can be an explicit function without obtaining an expression through iterative convergence, thereby reducing the complexity of calculation when calculating the position of the sound source. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0042] Figure 1 A schematic diagram of a sound source positioning method for implementing the present application;

[0043] Figure 2 A schematic diagram of the location of the sound collection module provided in an embodiment of the present application and its relationship with the position of the user of the cochlear implant;

[0044] Figure 3 A schematic diagram of sound information collected by a sound collection module provided in an embodiment of the present application;

[0045] Figure 4 A schematic diagram of the distance between a sound source and each microphone provided in an embodiment of the present application;

[0046] Figure 5 A schematic diagram of the angle of a sound source in a coordinate system provided in an embodiment of the present application;

[0047] Figure 6 A schematic diagram of an angle range corresponding to a target area provided in an embodiment of the present application;

[0048] Figure 7 A schematic diagram of noise removal provided in an embodiment of the present application;

[0049] Figure 8 A schematic diagram of a noise angle provided in an embodiment of the present application;

[0050] Fig. 9 A schematic diagram of a noise localization and denoising method according to an embodiment of the present application;

[0051] Fig.10 A schematic diagram of the structure of a sound source positioning device provided in an embodiment of the present application;

[0052] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0054] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0055] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0056] As used in the specification of this application and the appended claims, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrases "if it is determined" or "if it is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce detected" or "in response to detecting" depending on the context.

[0057] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0058] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.

[0059] Based on the problems in the related art, an embodiment of the present application provides a method for locating a sound source that can be applied to a sound processing device. The sound processing device may include: a mobile phone, a tablet computer, a wearable device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an electronic cochlear implant, etc. In an embodiment of the present application, the method for locating a sound source can be applied to an electronic device in the sound processing device, and the electronic device may be a controller / processor in the sound processing device, etc.

[0060] In an embodiment of the present application, the sound processing device may include: an electronic device and at least three sound collection modules, the sound collection modules may be microphones, and the distances between the sound collection modules are fixed.

[0061] Based on the aforementioned sound processing device, the present application embodiment provides a method for locating a sound source. Figure 1 A schematic diagram of the implementation flow of a sound source positioning method provided for the implementation of this application is as follows: Figure 1 As shown, the method for locating the sound source includes:

[0062] Step S101, obtaining sound signals emitted by sound sources collected by multiple sound collection modules.

[0063] In the embodiments of the present application, the sound collection module generally refers to a hardware device that can capture and record sound signals, such as a microphone. Sound signals are physical phenomena generated when sound waves propagate in a medium, which are converted into electrical signals by the sound collection module. The sound source can be a noise source.

[0064] In the embodiment of the present application, multiple sound collection modules can be used to simultaneously collect sound signals emitted by a sound source, thereby obtaining sound signals emitted by the sound source collected by the multiple sound collection modules.

[0065] Step S102: determining the number of delay points between the sound signals collected by the sound collection modules based on the sound signals, and establishing a first calculation formula for the delay time based on the number of delay points.

[0066] In the embodiment of the present application, the number of delay points is the time difference required for the sound signal to propagate from the sound source to different sound collection modules, which is usually expressed as the number of sampling points. The arrival time of the sound signals collected by different sound collection modules can be compared to determine the number of delay points between them. The number of delay points can be calculated by a cross-correlation function.

[0067] In the embodiment of the present application, the delay time is the actual time required for the sound signal to propagate from the sound source to different sound collection modules. The delay time can be calculated by dividing the number of delay points by the sampling rate to obtain the first calculation formula.

[0068] For example, two sound signals are used as an example. The sound signals are: s1(n) and s2(n). S1(n) and s2(n) directly obtain the cross-correlation function under different delay points through cross-correlation calculation, and obtain the delay point number corresponding to the maximum similarity. The delay point number of s1(n) and s2(n) obtained by the cross-correlation function method is N1. According to the signal sampling rate f s , the first calculation formula of the corresponding delay time t1 can be obtained as follows:

[0069]

[0070] Step S103: establishing a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source.

[0071] In the embodiment of the present application, when the sound source emits a sound, the sound will spread to all directions at the same time. Since the sound collection modules are distributed in different locations, the time they receive the sound signal will be different. This time difference (delay time) is mainly caused by the different time required for the sound to propagate to different sound collection modules.

[0072] If we know the distance difference Δd between the two sound collection modules and the sound source, and the propagation speed c of the sound in the medium, we can calculate the delay time t1 between the sound source and the two collection modules by the following formula:

[0073] t1=c / Δd;

[0074] Here, Δd is the distance difference between the two acquisition modules and the sound source (in meters), c is the speed of sound propagation in the medium (in meters per second), and Δt is the delay time between the sound propagation to the two acquisition modules (in seconds).

[0075] Exemplarily, the sound processing device is an electronic cochlear implant, and there are three sound collection modules, which include: a first sound collection module, a second sound collection module and a third sound collection module. The three sound collection modules form an isosceles right triangle, and the distance between the first sound collection module and the second sound collection module is equal to the distance between the second sound collection module and the third sound collection module. Figure 2 A schematic diagram of the location of the sound collection module provided in the embodiment of the present application and its relationship with the position of the user of the electronic cochlear implant, as shown in FIG. Figure 2As shown, the spacing is r, where the positive direction refers to the direction the cochlear implant user is facing, the sides of the ears are lateral, and the back is the rear.

[0076] In the embodiment of the present application, the three microphones are respectively defined as a first microphone, a second microphone, and a third microphone. Figure 3 A schematic diagram of sound information collected by a sound collection module provided in an embodiment of the present application, such as Figure 3 As shown, a rectangular coordinate system can be established based on the vertical relationship, where the position coordinates of the sound source (target noise) are (x, y), the coordinates of the noise are (x, y), and the waveforms of the signals reaching the three microphones are similar, but due to the specific differences, the time of arrival at the microphones is different, resulting in a time delay. The signals collected by the first microphone, the second microphone, and the third microphone are s1(n), s2(n), and s3(n) respectively.

[0077] In the embodiment of the present application, the delay time can be calculated by the distance difference. Figure 4 A schematic diagram of the distance between a sound source and each microphone provided in an embodiment of the present application, the sound source is represented by N, the first microphone is represented by A, the second microphone is represented by B, the third microphone is represented by C, and the speed of sound is c, then the delay time t1 of s1(n) and s2(n) is expressed as follows:

[0078]

[0079] Similarly, the delay time t2 of s3(n) and s2(n) is expressed as follows:

[0080]

[0081] Step S104: establishing a noise localization function based on the first calculation formula and the second calculation formula.

[0082] In the embodiment of the present application, a noise localization function is constructed by combining the first calculation formula of the delay time (based on the number of delay points) and the second calculation formula (based on the distance difference between the sound collection module and the sound source). The noise localization function includes: the correspondence between the sound propagation speed, the layout of the sound collection module, the sampling rate and the calculation position.

[0083] Following the above example, compare and You can get:

[0084]

[0085] According to the coordinates of point N (x, y), point A (r, 0), point B (0, 0), and point C (0, r), we can get the values ​​of line segments NA, NB, and NC respectively, and get:

[0086]

[0087] Similarly, through s3(n) and s2(n) we can get

[0088] The above two equations are the noise localization functions. It can be seen that although the expression of the noise position coordinates is a bit complicated, the expression is an explicit function rather than an expression obtained by iterative convergence. Therefore, directly inserting the formula function into the algorithm can help greatly reduce the complexity of the algorithm.

[0089] Step S105: determining the calculated position of the sound source based on the noise localization function.

[0090] The embodiment of the present application obtains the coordinates (x, y) of the noise position through the above equation. Through deduction, the function equation has 4 solutions, namely (x1, y1), (x2, y2), (x3, y3) and (x4, y4).

[0091] In the embodiment of the present application, calculating the coordinates of the position includes:

[0092]

[0093] Among them, (x i ,y i ) are the coordinates of the calculated position, where i = 1, 2, 3, 4.

[0094] Step S106: determining the target position of the sound source based on the calculated position and the angle range corresponding to the target area.

[0095] In the embodiment of the present application, the target position of the sound source is further screened and determined according to the angle range corresponding to the calculated position and the target area. If the target area is a specific angle range, the calculated position within the range can be selected as the target position of the sound source.

[0096] In the embodiment of the present application, step S106 can be implemented by the following steps:

[0097] Step S1061, determining the angle corresponding to each calculated position based on the calculated position.

[0098] In the embodiment of the present application, Figure 5 A schematic diagram of the angle of a sound source in a coordinate system provided in an embodiment of the present application, such as Figure 5 As shown, the angle of the sound source in the two-dimensional coordinate system is represented by θ. The entire azimuth range is [0°, 360°), and the angle θ where the noise is located can be determined by the previously determined calculated position (x i ,y i), where i = 1, 2, 3, 4. The azimuth angle θ is as follows:

[0099] Where i=1~4.

[0100] Step S1062: determining the target position of the sound source based on the angle range corresponding to the preset target area and the angle.

[0101] In the embodiment of the present application, the signal corresponding to the angle determined by the algorithm in the range of [0°, 360°) is not all noise, but also includes target signals. Considering that the user of the cochlear implant is most concerned about the forward position when communicating, according to the actual use, the area [0°, 360°) is divided into a target area and a non-target area. Figure 6 A schematic diagram of an angle range corresponding to a target area provided in an embodiment of the present application, such as Figure 6 As shown, the target area ranges from 0° to 60° and from 300° to 360°.

[0102] In the embodiment of the present application, the θ values ​​when i=1 to 4 are calculated in sequence. When 0°≤θ≤60° and 300°≤θ<360°, the coordinate values ​​(x i ,y i ), the target position of the sound source is obtained.

[0103] The method provided in the embodiment of the present application can screen out the calculated positions within the target area and use these positions as the target positions of the sound source by determining the angle of each calculated position and comparing it with the angle range of the target area.

[0104] In some embodiments, after step S106, the method further includes:

[0105] Step S107: determining a delay parameter based on the target position.

[0106] In the embodiment of the present application, the coordinates of the target position are input into a delay parameter calculation formula to calculate the delay parameter, wherein the delay parameter calculation formula is:

[0107]

[0108] In the embodiment of the present application, the first microphone and the third microphone can be used to collect signals respectively, and delay parameters can be set to form outputs, and noise can be removed by a beamformer. Figure 7 A schematic diagram of noise removal provided in an embodiment of the present application is shown in FIG. Figure 7As shown, since the signals collected by the first microphone and the third microphone are used to perform delayed beamforming operations and form directional signal outputs, according to the delayed beam method, it is necessary to establish a new angle mark with the straight line where the first microphone A and the third microphone C are located. (Originally, the direction faced by the user wearing the electronic cochlear implant was 0°, and now the direction of the straight line A where AC is located is 0°. Since the distance AB=CB when the three microphones are configured, the actual angle difference is 45°.) Combined with the original noise direction calculated in the previous step Therefore, the noise position in the new coordinates is Figure 8 A schematic diagram of a noise angle provided in an embodiment of the present application, such as Figure 8 As shown, when locating the noise, the coordinates of a single noise source are considered. When denoising is performed on it, since the distance between the microphones when using the cochlear implant is very small, it is considered to be approximately parallel propagation and the delay value is obtained.

[0109] By deduction, the expression of the system function is as follows (note the geometric relationship: BA = r, BC = r, ):

[0110]

[0111] when When |H(e jω )|=0, thereby the system function of this position can be generated to be 0 (that is, 0 output at this direction), so the noise at this direction can be removed.

[0112] Step S108: denoising the sound signal collected by the sound collection module based on the delay parameter, and outputting the denoised signal.

[0113] In the embodiment of the present application, after the delay parameters are determined, denoising processing can be performed, and the output denoised signal is: S1(n)-S3(n-τ).

[0114] In the embodiment of the present application, a wave former can be used to perform denoising on the sound signal collected by the sound collection module based on the delay parameter.

[0115] Based on the above-mentioned embodiments, the present application further provides a noise localization and denoising method, which is applied to an electronic cochlear implant. Fig. 9 A schematic diagram of the implementation flow of a noise localization and denoising method provided in an embodiment of the present application is shown in FIG. Fig. 9 Shown include:

[0116] A 3-microphone acquisition system is constructed, and the sound signal of the sound source can be collected by 3 microphones. The number of delay points can be determined by the cross-correlation function, and the time difference caused by the distance difference can be determined by the geometric relationship of signal propagation. The noise localization function can be determined by the number of delay points and the time difference. The noise coordinates (the same as the calculated coordinates in the above embodiment) can be determined by the noise localization function. After the noise coordinates are determined, the azimuth (equivalent to the angle) of the noise can be determined, and the coordinate points in the non-target area can be removed. Then, the angle mark is established with the first microphone and the third microphone, and the delay parameters of the algorithm adaptive setting are determined. After the delay parameters are determined, the differential signal can be output through the beamformer to obtain the signal after the noise is removed.

[0117] The method provided in the embodiment of the present application combines geometric analysis to perform noise localization, obtains a specific expression of an explicit function of the noise position to reduce the amount of calculation, and uses a specific microphone acquisition structure to achieve localization and denoising.

[0118] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0119] According to the aforementioned embodiments, the embodiments of the present application provide a device for locating a sound source. The modules included in the device and the units included in the modules can be implemented by a processor in a computer device; of course, they can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU, Central Processing Unit), a microprocessor (MPU, Microprocessor Unit), a digital signal processor (DSP, Digital Signal Processing) or a field programmable gate array (FPGA, Field Programmable Gate Array), etc.

[0120] The present application provides a device for locating a sound source. Fig.10 A schematic diagram of a sound source positioning device provided in an embodiment of the present application is shown in FIG. Fig.10 As shown, the sound source positioning device 1000 includes:

[0121] An acquisition module 1001 is used to acquire sound signals emitted by the sound sources collected by the multiple sound collection modules;

[0122] A first establishing module 1002, configured to determine the number of delay points between the sound signals collected by the sound collecting modules based on the sound signals, and to establish a first calculation formula for the delay time based on the number of delay points;

[0123] A second establishing module 1003, configured to establish a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source;

[0124] A third establishing module 1004, configured to establish a noise localization function based on the first calculation formula and the second calculation formula;

[0125] A calculation module 1005, configured to determine a calculation position of the sound source based on the noise localization function;

[0126] The positioning module 1006 is used to determine the target position of the sound source based on the calculated position and the angle range corresponding to the target area.

[0127] In some embodiments, determining the target position of the sound source based on the calculated position and the angle range corresponding to the target area includes:

[0128] Determine the angle corresponding to each calculated position based on each calculated position;

[0129] The target position of the sound source is determined based on the angle range corresponding to the preset target area and the angle.

[0130] In some embodiments, the sound processing device is an electronic cochlear implant, the number of the sound collection modules is three, the three sound collection modules include: a first sound collection module, a second sound collection module and a third sound collection module, the three sound collection modules form an isosceles right triangle, the distance between the first sound collection module and the second sound collection module is equal to the distance between the second sound collection module and the third sound collection module, and the noise localization function includes:

[0131] and Wherein, r is the distance between the first sound collection module and the second sound collection module, N1 is the number of delay points between the sound signal collected by the first sound collection module and the sound signal collected by the second sound collection module, N2 is the number of delay points between the sound signal collected by the second sound collection module and the sound signal collected by the third sound collection module, and f s is the signal sampling rate, c is the propagation speed of sound;

[0132] The coordinates of the calculated position include:

[0133]

[0134]

[0135] Among them, (x i ,yi ) are the coordinates of the calculated position, where i = 1, 2, 3, 4.

[0136] In some embodiments, the sound source positioning device further includes:

[0137] A determination module, configured to determine a delay parameter based on the target position;

[0138] The denoising module is used to perform denoising processing on the sound signal collected by the sound collection module based on the delay parameter, and output the denoised signal.

[0139] In some embodiments, the denoising process of the sound signal collected by the sound collection module based on the delay parameter includes:

[0140] A wave former is used based on the delay parameter to perform denoising on the sound signal collected by the sound collection module.

[0141] In some embodiments, determining a delay parameter based on the target position includes:

[0142] The coordinates of the target position are input into a delay parameter calculation formula to calculate the delay parameter, wherein the delay parameter calculation formula is:

[0143]

[0144] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0145] in addition, Fig.10 The sound source positioning device shown may be a software unit, a hardware unit, or a unit combining software and hardware, or may be integrated into the electronic device as an independent pendant, or may exist as an independent terminal device.

[0146] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0147] Fig.11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.11 As shown, the electronic device 3 of this embodiment may include: at least one processor 30 ( Fig.11 Only one processor 30 is shown in the figure), a memory 31, and a computer program 32 stored in the memory 31 and executable on at least one processor 30. When the processor 30 executes the computer program 32, the steps in any of the above-mentioned method embodiments are implemented; or, when the processor 30 executes the computer program 32, the functions of the modules / units in the above-mentioned device embodiments are implemented.

[0148] Exemplarily, the computer program 32 may be divided into one or more modules / units, one or more modules / units are stored in the memory 31, and are executed by the processor 30 to complete the present application. One or more modules / units may be a series of computer program 32 instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 32 in the electronic device 3.

[0149] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program 32. When the computer program 32 is executed by the processor 30, the steps in the above-mentioned method embodiments can be implemented.

[0150] An embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0151] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. According to this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program 32, and the computer program 32 can be stored in a computer-readable storage medium, and the computer program 32 can implement the steps of the above-mentioned various method embodiments when executed by the processor 30. Among them, the computer program 32 includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to the terminal, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0152] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0153] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0154] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0155] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0156] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for locating a sound source, characterized in that: Applied to a sound processing device, the sound processing device has at least three sound collection modules, and the distances between the sound collection modules are fixed, including: Acquire sound signals emitted by the sound sources collected by the multiple sound collection modules; Determine the number of delay points between the sound signals collected by each of the sound collection modules based on the sound signal, and establish a first calculation formula for the delay time based on the number of delay points; Establishing a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source; Establishing a noise localization function based on the first calculation formula and the second calculation formula; determining a calculated position of the sound source based on the noise localization function; The target position of the sound source is determined based on the calculated position and the angular range corresponding to the target area.

2. The method according to claim 1, characterized in that The determining the target position of the sound source based on the calculated position and the angle range corresponding to the target area includes: Determine the angle corresponding to each calculated position based on each calculated position; The target position of the sound source is determined based on the angle range corresponding to the preset target area and the angle.

3. The method according to claim 2, characterized in that The sound processing device is an electronic cochlea, and there are three sound collection modules, which include: a first sound collection module, a second sound collection module, and a third sound collection module. The three sound collection modules form an isosceles right triangle, and the distance between the first sound collection module and the second sound collection module is equal to the distance between the second sound collection module and the third sound collection module. The noise localization function includes: and Wherein, r is the distance between the first sound collection module and the second sound collection module, N1 is the number of delay points between the sound signal collected by the first sound collection module and the sound signal collected by the second sound collection module, N2 is the number of delay points between the sound signal collected by the second sound collection module and the sound signal collected by the third sound collection module, and f s is the signal sampling rate, c is the propagation speed of sound; The coordinates of the calculated position include: Among them, (x i ,y i ) are the coordinates of the calculated position, where i = 1, 2, 3, 4.

4. The method according to claim 3, characterized in that The method further comprises: determining a delay parameter based on the target position; The sound signal collected by the sound collection module is denoised based on the delay parameter, and the denoised signal is output.

5. The method according to claim 4, characterized in that The denoising process of the sound signal collected by the sound collection module based on the delay parameter includes: A wave former is used based on the delay parameter to perform denoising on the sound signal collected by the sound collection module.

6. The method according to claim 4, characterized in that The determining of a delay parameter based on the target position comprises: The coordinates of the target position are input into a delay parameter calculation formula to calculate the delay parameter, wherein the delay parameter calculation formula is:

7. A sound source positioning device, characterized in that: Applied to a sound processing device, the sound processing device has at least three sound collection modules, and the distances between the sound collection modules are fixed, including: An acquisition module, used to acquire sound signals emitted by the sound sources collected by the multiple sound collection modules; A first establishing module, configured to determine the number of delay points between the sound signals collected by the sound collecting modules based on the sound signal, and to establish a first calculation formula for the delay time based on the number of delay points; A second establishing module, used for establishing a second calculation formula for the delay time based on the distance difference between each of the sound collection modules and the sound source; A third establishing module, used to establish a noise localization function based on the first calculation formula and the second calculation formula; A calculation module, used for determining a calculation position of the sound source based on the noise localization function; A positioning module is used to determine the target position of the sound source based on the calculated position and the angle range corresponding to the target area.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.

9. A sound processing device, characterized in that: include: The electronic device and at least three sound collection modules as described in claim 8, wherein the electronic device is communicatively connected to the at least three sound collection modules.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images