Audio signal processing method and device, hearing aid and storage medium

Abstract

The invention discloses an audio signal processing method and device, a hearing aid and a storage medium, relates to the technical field of audio data processing, and discloses an audio signal processing method which is applied to the hearing aid and comprises the following steps: dynamically acquiring an audio source signal acquired by an associated microphone; according to the audio source signal, a target angle range is determined from a plurality of preset angle ranges, the target angle range is the angle range with the maximum angle sound intensity, and the angle sound intensity is the sound intensity corresponding to the audio signal in the angle range; enhancing an audio signal in a target angle range in the audio source signal to obtain a target signal; and outputting the target signal. According to the invention, the flexibility of audio data processing in the hearing aid is effectively improved, and the hearing experience of a hearing aid wearer is enhanced.

Description

Technical Field

[0001] The present application relates to the technical field of audio data processing, and in particular to an audio signal processing method, device, hearing aid and storage medium. Background Art

[0002] In the field of hearing assistance technology, conventional hearing aid design mainly focuses on enhancing the intensity of sound coming from a specific, fixed direction. This technology is based on a basic assumption that users usually need to improve the clarity and recognizability of sound in specific environments or scenarios, such as face-to-face conversations. Conventional hearing aids usually use directional microphones or sound amplification circuits to capture and amplify sound signals from a preset angle range to achieve sound enhancement effects.

[0003] However, this fixed-angle enhancement design has obvious limitations. First, in complex and changing auditory environments, such as noisy public places or outdoor environments, users often need to receive sound information from different directions, and conventional hearing aids are difficult to flexibly adapt to such changes in demand, resulting in incomplete information reception or serious background noise interference. Second, when users are engaged in daily activities, the movement and rotation of their heads will also change the position of the sound source relative to the hearing aid, further limiting the effectiveness and comfort of conventional hearing aids. Summary of the invention

[0004] The main purpose of this application is to provide an audio signal processing method, device, hearing aid and storage medium, aiming to improve the flexibility of audio data processing in the hearing aid and enhance the auditory experience of the hearing aid wearer.

[0005] To achieve the above object, an embodiment of the present application provides an audio signal processing method, which is applied to a hearing aid and includes:

[0006] Dynamically obtain the audio source signal collected by the associated microphone;

[0007] According to the audio source signal, determining a target angle range from a plurality of preset angle ranges, wherein the target angle range is an angle range with a maximum angle sound intensity, and the angle sound intensity is a sound intensity corresponding to the audio signal within the angle range;

[0008] enhancing the audio signal within the target angle range in the audio source signal to obtain a target signal;

[0009] The target signal is output.

[0010] In one embodiment, the step of enhancing the audio signal within the target angle range in the audio source signal to obtain the target signal comprises:

[0011] Enhance the first signal to obtain an enhanced signal, wherein the first signal is an audio signal within the target angle range in the audio source signal;

[0012] Suppressing a second signal to obtain a noise reduction signal, wherein the second signal is an audio signal in the audio source signal other than the first signal;

[0013] The enhanced signal and the noise reduction signal are fused to obtain the target signal.

[0014] In one embodiment, the step of suppressing the second signal to obtain a noise reduction signal includes:

[0015] generating a cancellation signal according to the frequency component and phase characteristic of the second signal, wherein the frequency component of the cancellation signal is the same as the frequency component of the second signal, and the phase characteristic of the cancellation signal is opposite to the phase characteristic of the second signal;

[0016] The second signal and the cancellation signal are superimposed to generate the noise reduction signal.

[0017] In one embodiment, the step of enhancing the first signal to obtain an enhanced signal includes:

[0018] Obtaining hearing loss information of the wearer of the hearing aid;

[0019] Determining compensation values ​​corresponding to the first signals in each frequency band according to the hearing loss condition;

[0020] The first signal is compensated according to the compensation value to obtain the enhanced signal.

[0021] In one embodiment, the step of determining a target angle range from a plurality of preset angle ranges according to the audio source signal comprises:

[0022] Determine a candidate angle range from each of the angle ranges according to the audio source signal, wherein a speech signal exists in the audio signal within the candidate angle range;

[0023] The candidate angle range with the largest angle sound intensity is determined as the target angle range.

[0024] In one embodiment, the step of determining a candidate angle range from each of the angle ranges according to the audio source signal comprises:

[0025] Determining, according to the audio source signal, a target amplitude variance of the audio signal within each of the angle ranges;

[0026] The angle range in which the target amplitude variance is less than a preset amplitude variance threshold is determined as the candidate angle range, wherein the amplitude variance threshold is determined according to the amplitude variance corresponding to the audio signal without a speech signal.

[0027] In one embodiment, the step of determining, according to the audio source signal, the target amplitude variance of the audio signal within each of the angle ranges comprises:

[0028] Determine, according to the audio source signal, a first amplitude peak of the audio signal within each of the angle ranges, wherein the first amplitude peak is a peak with the largest amplitude in the audio signal within each of the angle ranges;

[0029] Determining an amplitude threshold value according to the first amplitude peak, wherein the amplitude threshold value is smaller than the amplitude of the first amplitude peak;

[0030] Determine a peak in the audio signal within the angle range whose amplitude is greater than the amplitude threshold as a second amplitude peak;

[0031] The target amplitude variance is determined according to the amplitude variance between the first amplitude peak and the second amplitude peak.

[0032] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further proposes an audio signal processing device, which is applied to a hearing aid and includes:

[0033] An acquisition module is configured to dynamically acquire an audio source signal collected by an associated microphone;

[0034] a determination module, configured to determine a target angle range from a plurality of preset angle ranges according to the audio source signal, wherein the target angle range is an angle range with a maximum angle sound intensity, and the angle sound intensity is a sound intensity corresponding to the audio signal within the angle range;

[0035] an enhancement module, configured to enhance the audio signal within the target angle range in the audio source signal to obtain a target signal;

[0036] The output module is configured to output the target signal.

[0037] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a hearing aid, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the audio signal processing method described above.

[0038] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the audio signal processing method described above are implemented.

[0039] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further proposes a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the audio signal processing method described above are implemented.

[0040] The embodiment of the present application proposes an audio signal processing method, which is applied to a hearing aid. By dynamically acquiring the audio source signal collected by the associated microphone, the target angle range for audio signal enhancement is determined from multiple preset angle ranges, and then the audio signal within the target angle range in the audio source signal is enhanced. The target signal is obtained and output through the hearing aid, so that the hearing-impaired can more easily capture key sounds in a noisy environment, thereby enhancing the hearing experience of the hearing aid wearer. The embodiment of the present application enhances the audio signal within the angle range with the largest angle sound intensity, so that the hearing aid can more flexibly adapt to changes in different auditory environments, ensuring that the user has a clear and interference-free listening experience, whether in a quiet indoor environment or a noisy public place. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0043] Figure 1 A flowchart of the first embodiment of the audio signal processing method of the present application is provided;

[0044] Figure 2 A schematic diagram of a scenario provided for Embodiment 1 of the audio signal processing method of the present application;

[0045] Figure 3 This is a flow chart of a more complete embodiment of the present application;

[0046] Figure 4 This is a schematic diagram of the framework structure of the audio signal processing device in the embodiment of the present application;

[0047] Figure 5Schematic diagram of the device structure of the hardware operating environment of the hearing aid involved in the audio signal processing method in the embodiment of the present application.

[0048] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0050] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0051] In conventional technology, hearing aids mainly focus on enhancing the intensity of sound coming from a specific, fixed direction. However, in complex and changing auditory environments, such as noisy public places or outdoor environments, users often need to receive sound information from different directions, and conventional hearing aids are difficult to flexibly adapt to such changes in demand, resulting in incomplete information reception or serious background noise interference. At the same time, when users are engaged in daily activities, the movement and rotation of their heads will also change the position of the sound source relative to the hearing aid, further limiting the effectiveness and comfort of conventional hearing aids.

[0052] The embodiment of the present application provides a solution, which dynamically obtains the audio source signal collected by the associated microphone, determines the target angle range for audio signal enhancement from multiple preset angle ranges, and then enhances the audio signal within the target angle range in the audio source signal, obtains the target signal and outputs it through the hearing aid, so that the hearing-impaired can more easily capture key sounds in a noisy environment, and enhances the hearing experience of the hearing aid wearer. The embodiment of the present application enhances the audio signal within the angle range with the largest angle sound intensity, so that the hearing aid can more flexibly adapt to changes in different auditory environments, whether in a quiet indoor environment or a noisy public place, to ensure that the user has a clear and interference-free listening experience.

[0053] Reference Figure 1 , Figure 1 This is a flowchart diagram of the first embodiment of the audio signal processing method of the present application.

[0054] It should be noted that the execution subject of the audio signal processing method may be a hearing aid, or other electronic devices or network devices, which is not limited in this embodiment. For ease of description, the following description of each embodiment is omitted. The audio signal processing method includes:

[0055] Step S10, dynamically acquiring an audio source signal collected by an associated microphone;

[0056] In a feasible embodiment, the audio source signal is collected by at least one microphone provided on the hearing aid.

[0057] Step S20, determining a target angle range from a plurality of preset angle ranges according to the audio source signal, wherein the target angle range is an angle range with the maximum angle sound intensity, and the angle sound intensity is the sound intensity corresponding to the audio signal within the angle range;

[0058] In a feasible embodiment, the sound intensity corresponding to the audio information in each preset angle range is determined from the audio source signal as the angle sound intensity of each angle range; and then the angle range with the maximum angle sound intensity is determined as the target angle range.

[0059] Sound intensity refers to the strength of sound, which describes the distribution of sound energy per unit area.

[0060] For example, refer to Figure 2 , the audio source signal is divided according to the preset angle range to obtain the audio signal from each angle range 101, and then the angle sound intensity corresponding to the audio signal in each angle range 101 is determined, and the angle range 101 with the largest angle sound intensity is determined as the target angle range 102, so as to perform targeted enhancement processing to improve the hearing experience of the hearing aid wearer.

[0061] Each angle range can be pre-set, for example, including: [0°, 45°), [45°, 90°), [90°, 135°), [135°, 180°), [180°, 225°), [225°, 270°), [270°, 360°), and can also be adjusted in real time according to actual conditions, which is not limited to the embodiments of the present application.

[0062] Step S30, enhancing the audio signal within the target angle range in the audio source signal to obtain a target signal;

[0063] Step S40, outputting the target signal.

[0064] In one feasible embodiment, in order to enhance the auditory experience of the hearing aid wearer, the audio signal within the target angle range in the audio source signal is enhanced to obtain a target signal, which is then output through the hearing aid, making it easier for the hearing-impaired to capture key sounds in a noisy environment, ensuring that the user has a clear, undisturbed auditory experience.

[0065] Exemplarily, the enhancement of the audio signal within the target angle range in the audio source signal can be achieved through noise suppression, volume standardization, frequency equalization, three-dimensional stereo enhancement, dynamic range compression, etc. For example, through algorithm detection, the background noise of the audio signal within the target angle range is reduced to improve the signal-to-noise ratio (SNR) of the audio and achieve noise suppression. The loudness of the audio signal is made uniform by adjusting the volume of the audio signal within the target angle range. The gain of the specific frequency of the audio signal within the target angle range is adjusted to enhance or reduce the amplitude of the specific frequency band, thereby improving the frequency balance of the audio and making it sound fuller. The stereo effect is enhanced by adjusting the spatial characteristics of the audio signal to improve the spatial sense of the audio. The dynamic range of the audio signal is controlled to improve the overall sound quality, enhance the loudness, and improve the intelligibility of the speech in a noisy environment.

[0066] In this embodiment, by dynamically acquiring the audio source signal collected by the associated microphone, the target angle range for audio signal enhancement is determined from multiple preset angle ranges, and then the audio signal within the target angle range in the audio source signal is enhanced, and the target signal is obtained and output through the hearing aid, so that the hearing-impaired can more easily capture key sounds in a noisy environment, thereby enhancing the hearing experience of the hearing aid wearer. By enhancing the audio signal within the angle range with the largest angle sound intensity, the embodiment of the present application enables the hearing aid to more flexibly adapt to changes in different auditory environments, ensuring that the user has a clear and interference-free listening experience, whether in a quiet indoor environment or a noisy public place.

[0067] Based on the above first embodiment, a second embodiment of the audio signal processing method of the present application is proposed. In this embodiment, step S20, the step of determining a target angle range from a plurality of preset angle ranges according to the audio source signal includes:

[0068] Step S21, determining a candidate angle range from each angle range according to the audio source signal, wherein the audio signal within the candidate angle range contains a speech signal;

[0069] Step S22, determining the candidate angle range with the maximum angle sound intensity as the target angle range.

[0070] In a feasible embodiment, considering that the hearing aid needs of the hearing-impaired are more focused on hearing the content of the communicator clearly, the audio signals with voice signals are screened out from the audio signals in each angle range, and the angle range is determined as the candidate angle range. Then, the candidate angle range with the largest angle sound intensity is screened out from the candidate angle range with voice signals, and the target angle range is used for targeted audio signal enhancement processing.

[0071] Exemplarily, according to the audio source signal, an alternative angle range is determined from each angle range, wherein the alternative angle range is an angle range whose angle sound intensity is greater than a preset sound intensity threshold value; then, a candidate angle range is determined from the alternative angle range, and the candidate angle range with the largest angle sound intensity is determined as the target angle range. The angle ranges are preliminarily screened by the sound intensity threshold value in advance to avoid interference of irrelevant speech content in the environment with the screening of the target angle range, thereby improving the accuracy and flexibility of the screening of the target angle range.

[0072] Exemplarily, the audio signal within the angle range is subjected to noise reduction processing to obtain a noise-reduced signal, and the signal-to-noise ratio between the original signal and the noise-reduced signal is calculated; then, the signal-to-noise ratio is compared with a preset signal-to-noise ratio threshold, and if the signal-to-noise ratio is greater than the signal-to-noise ratio threshold, it is determined that there is a speech signal in the audio signal.

[0073] Exemplarily, the audio signal within the angle range is transformed into the frequency domain to obtain a spectrum; then the peak frequency points in the spectrum are identified, wherein the peak frequency points correspond to the resonance peaks of the speech signal; then the number of frequency points that meet the preset peak condition is determined; when the number of frequency points exceeds the preset number, it is determined that there is a speech signal in the audio signal.

[0074] Exemplarily, deep learning models, such as convolutional neural networks (CNNs) and recurrent neural networks (RNNs), are used to extract audio features and perform speech recognition; the models are trained to distinguish between speech and non-speech signals, and then the models are used to classify audio signals.

[0075] Exemplarily, the audio signal is filtered to remove noise in a specific frequency range, and the energy of the audio signal is calculated; when the energy exceeds a preset energy threshold, it is determined that a speech signal exists in the audio signal.

[0076] In this embodiment, considering that the hearing aid needs of the hearing-impaired are more focused on hearing the communicator's speech clearly, the target angle range is screened from the angle range where the voice signal exists, so that the hearing-impaired can more easily capture the key voice content in a noisy environment, thereby enhancing the hearing experience of the hearing aid wearer.

[0077] In one feasible implementation, step S21, the step of determining a candidate angle range from each angle range according to the audio source signal, comprises:

[0078] Step S211, determining a target amplitude variance of the audio signal within each angle range according to the audio source signal;

[0079] In a feasible embodiment, since the amplitude fluctuation of the speech signal in the audio signal has a certain periodicity, while the non-speech signal is usually random and irregular; therefore, the target amplitude variance corresponding to the audio signal within each angle range can be determined.

[0080] In one feasible implementation, step S211, the step of determining the target amplitude variance of the audio signal within each angle range according to the audio source signal, includes:

[0081] Step A10, determining a first amplitude peak of the audio signal within each angle range according to the audio source signal, wherein the first amplitude peak is a peak with the largest amplitude in the audio signal within each angle range;

[0082] Step A20, determining an amplitude threshold value according to the first amplitude peak, wherein the amplitude threshold value is smaller than the amplitude of the first amplitude peak;

[0083] Step A30, determining a peak in the audio signal within the angle range whose amplitude is greater than the amplitude threshold as a second amplitude peak;

[0084] Step A40: determining a target amplitude variance according to the amplitude variance between the first amplitude peak and the second amplitude peak.

[0085] In a feasible embodiment, in order to accurately reflect the periodic characteristics of the audio signal, the maximum amplitude peak of the audio signal within each angle range is determined as the first amplitude peak; then the amplitude threshold is set according to the amplitude of the first amplitude peak, wherein the amplitude threshold is smaller than the amplitude of the first amplitude peak. The peak of the audio signal within the angle range whose amplitude is greater than the amplitude threshold is determined as the second amplitude peak; then the amplitude variance between the first amplitude peak and the second amplitude peak is calculated as the target amplitude variance.

[0086] Step S212: determine the angle range in which the target amplitude variance is less than a preset amplitude variance threshold as a candidate angle range, wherein the amplitude variance threshold is determined according to the amplitude variance corresponding to the audio signal without a speech signal.

[0087] In a feasible embodiment, since the amplitude fluctuation of a speech signal has a certain periodicity, its target amplitude variance is usually small, while the target amplitude variance of a non-speech signal is usually large. Therefore, the amplitude variance threshold value can be determined according to the amplitude variance corresponding to the audio signal without a speech signal; and then the angle range in which the target amplitude variance is less than the preset amplitude variance threshold value is determined as the candidate angle range.

[0088] In this embodiment, since the amplitude fluctuation of the speech signal has a certain periodicity, the target amplitude variance of the audio signal in each angle range can be used to accurately screen out the candidate angle range where the speech signal exists, thereby improving the accuracy of subsequent audio signal enhancement and enhancing the auditory experience of the hearing aid wearer.

[0089] Based on the above first and / or second embodiments, a third embodiment of the audio signal processing method of the present application is proposed. In this embodiment, step S30, the step of enhancing the audio signal within the target angle range in the audio source signal to obtain the target signal includes:

[0090] Step S31, enhancing the first signal to obtain an enhanced signal, wherein the first signal is an audio signal within a target angle range in the audio source signal;

[0091] In a feasible embodiment, the audio signal within the target angle range is determined as the first signal, and then the first signal is enhanced to obtain an enhanced signal.

[0092] Exemplarily, the enhancement of the first signal can be achieved through noise suppression, volume standardization, frequency equalization, three-dimensional stereo enhancement, dynamic range compression, etc. For example, through algorithm detection, the background noise of the first signal is reduced to improve the signal-to-noise ratio (SNR) of the audio and achieve noise suppression. The loudness of the audio signal is made uniform by adjusting the volume of the first signal. The gain of a specific frequency of the first signal is adjusted to enhance or reduce the amplitude of a specific frequency band, thereby improving the frequency equalization of the audio and making it sound fuller. The stereo effect is enhanced by adjusting the spatial characteristics of the first signal to improve the spatial sense of the audio. The dynamic range of the first signal is controlled to improve the overall sound quality, enhance the loudness, and improve the intelligibility of speech in a noisy environment.

[0093] In one feasible implementation, step S31, enhancing the first signal, the step of obtaining the enhanced signal includes:

[0094] Step S311, obtaining hearing loss of the hearing aid wearer;

[0095] Step S312, determining compensation values ​​corresponding to the first signals in each frequency band according to the hearing loss condition;

[0096] Step S313: Compensate the first signal according to the compensation value to obtain an enhanced signal.

[0097] In a feasible embodiment, the hearing loss of the wearer of the hearing aid is obtained, and then the compensation values ​​corresponding to the first signals in each frequency band are determined according to the hearing loss; then, targeted compensation is performed on each frequency band of the first signal based on the compensation values ​​to obtain an enhanced signal.

[0098] In this embodiment, since the hearing loss of each hearing-impaired person is unique, the degree of hearing loss at different frequencies is different. Therefore, the embodiment of the present application performs targeted compensation for different frequency bands of the audio signal based on the actual hearing loss of the hearing aid wearer to ensure that the compensated signal can be better perceived by the hearing-impaired person.

[0099] Step S32, suppressing the second signal to obtain a noise reduction signal, wherein the second signal is an audio signal in the audio source signal except the first signal;

[0100] In a feasible embodiment, the audio signal other than the first signal in the audio source signal is determined as the second signal; in order to further enhance the auditory experience of the hearing-impaired person, the second signal is suppressed to obtain a noise reduction signal.

[0101] In one feasible implementation, step S32, suppressing the second signal to obtain a noise reduction signal, includes:

[0102] Step S321, generating a cancellation signal according to the frequency component and phase characteristic of the second signal, wherein the frequency component of the cancellation signal is the same as the frequency component of the second signal, and the phase characteristic of the cancellation signal is opposite to the phase characteristic of the second signal;

[0103] Step S322: superimpose the second signal and the cancellation signal to generate a noise reduction signal.

[0104] In one feasible embodiment, the frequency component and phase characteristics of the second signal are determined, and then a cancellation signal having the same frequency component as the second signal and opposite phase characteristics is generated based on the frequency component and phase characteristics of the second signal; then the second signal and the cancellation signal are superimposed, and a noise reduction signal is generated through phase cancellation.

[0105] Step S33: fuse the enhanced signal and the noise reduction signal to obtain the target signal.

[0106] In a feasible embodiment, the enhanced signal obtained after enhancement is fused with the noise reduction signal obtained after noise reduction suppression to obtain a target signal, which is then output.

[0107] In order to assist in understanding the above technical solution, a more complete embodiment of the audio data processing method is provided, referring to Figure 3; Step S101, collecting the audio source signal through the microphone provided on the hearing aid. Step S102, dividing into multiple angle ranges, and determining the audio signal within each angle range from the audio source signal. Step S103, determining the sound intensity corresponding to each audio signal within each angle range as the angle sound intensity. Step S104, taking the angle range with the largest angle sound intensity as the target angle range, and determining the audio signal within the target angle range as the first signal; and then enhancing the first signal to obtain an enhanced signal. Step S105, determining the audio signal other than the first signal in the audio source signal as the second signal, and suppressing the second signal to obtain a noise reduction signal. Step S106, fusing the enhanced signal and the noise reduction signal to obtain the target signal, and outputting the target signal through the hearing aid.

[0108] In this embodiment, by enhancing the first signal and suppressing the second signal, the clarity and intelligibility of the signal can be effectively improved, especially in a noisy environment, where the target signal (i.e., the first signal) is often drowned out by background noise. By enhancing the first signal, it is possible to ensure that the audience can more easily capture key information and improve communication effects. Secondly, suppressing the remaining signals can reduce interference and auditory fatigue, making the user more comfortable when listening for a long time.

[0109] The present application provides an audio signal processing device, referring to Figure 4 , the device is applied to a hearing aid, the device comprising:

[0110] An acquisition module 10 is configured to dynamically acquire an audio source signal collected by an associated microphone;

[0111] The determination module 20 is configured to determine a target angle range from a plurality of preset angle ranges according to the audio source signal, wherein the target angle range is an angle range with the maximum angle sound intensity, and the angle sound intensity is a sound intensity corresponding to the audio signal within the angle range;

[0112] The enhancement module 30 is configured to enhance the audio signal within the target angle range in the audio source signal to obtain a target signal;

[0113] The output module 40 is configured to output a target signal.

[0114] The audio signal processing device provided in the embodiment of the present application adopts the audio signal processing method in the above embodiment, which can improve the flexibility of audio data processing in the hearing aid and enhance the auditory experience of the hearing aid wearer. Compared with conventional technology, the beneficial effects of the audio signal processing device provided in the embodiment of the present application are the same as the beneficial effects of the audio signal processing method provided in the above embodiment, and other technical features in the audio signal processing device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0115] An embodiment of the present application provides a hearing aid, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the audio signal processing method in the above-mentioned embodiment 1.

[0116] Reference below Figure 5 , respectively show the structural schematic diagrams of hearing aids suitable for implementing the embodiments of the present application. The hearing aids in the embodiments of the present application may include but are not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The hearing aid shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0117] like Figure 5 As shown, the hearing aid may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM) 1004. In the RAM 1004, various programs and data required for the operation of the hearing aid are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the hearing aid to communicate with other devices wirelessly or by wire to exchange data. Although the figures show hearing aids with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have instead.

[0118] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0119] The hearing aid provided in the embodiment of the present application adopts the audio signal processing method in the above embodiment, which can improve the flexibility of audio data processing in the hearing aid and enhance the auditory experience of the hearing aid wearer. Compared with conventional technology, the beneficial effects of the hearing aid provided in the embodiment of the present application are the same as the beneficial effects of the audio signal processing method provided in the above embodiment, and other technical features in the hearing aid are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0120] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0121] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0122] An embodiment of the present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer program) stored thereon, and the computer-readable program instructions are used to execute the audio signal processing method in the above embodiment.

[0123] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that includes or stores a program that can be used by or in combination with an instruction execution system, system or device. The program code included on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0124] The computer-readable storage medium may be included in the hearing aid, or may exist independently without being installed in the hearing aid.

[0125] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the hearing aid, the hearing aid is enabled to: dynamically obtain the audio source signal collected by the associated microphone; determine the target angle range from multiple preset angle ranges according to the audio source signal, wherein the target angle range is the angle range with the maximum angle sound intensity, and the angle sound intensity is the sound intensity corresponding to the audio signal within the angle range; enhance the audio signal within the target angle range in the audio source signal to obtain the target signal; and output the target signal.

[0126] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0127] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code includes one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0128] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0129] The readable storage medium provided in the embodiment of the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned audio signal processing method, which can improve the flexibility of audio data processing in the hearing aid and enhance the auditory experience of the hearing aid wearer. Compared with conventional technologies, the beneficial effects of the computer-readable storage medium provided in the embodiment of the present application are the same as the beneficial effects of the audio signal processing method provided in the above-mentioned embodiment, and will not be repeated here.

[0130] The above are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. An audio signal processing method, characterized in that: The method is applied to a hearing aid, and the method comprises: Dynamically obtain the audio source signal collected by the associated microphone; According to the audio source signal, determining a target angle range from a plurality of preset angle ranges, wherein the target angle range is an angle range with the maximum angle sound intensity, and the angle sound intensity is a sound intensity corresponding to the audio signal within the angle range; enhancing the audio signal within the target angle range in the audio source signal to obtain a target signal; The target signal is output.

2. The method according to claim 1, characterized in that The step of enhancing the audio signal within the target angle range in the audio source signal to obtain the target signal comprises: Enhance the first signal to obtain an enhanced signal, wherein the first signal is an audio signal within the target angle range in the audio source signal; Suppressing a second signal to obtain a noise reduction signal, wherein the second signal is an audio signal in the audio source signal other than the first signal; The enhanced signal and the noise reduction signal are fused to obtain the target signal.

3. The method according to claim 2, characterized in that The step of suppressing the second signal to obtain a noise reduction signal comprises: generating a cancellation signal according to the frequency component and phase characteristic of the second signal, wherein the frequency component of the cancellation signal is the same as the frequency component of the second signal, and the phase characteristic of the cancellation signal is opposite to the phase characteristic of the second signal; The second signal and the cancellation signal are superimposed to generate the noise reduction signal.

4. The method according to claim 2, characterized in that The step of enhancing the first signal to obtain an enhanced signal comprises: Obtaining hearing loss information of the wearer of the hearing aid; Determining compensation values ​​corresponding to the first signals in each frequency band according to the hearing loss condition; The first signal is compensated according to the compensation value to obtain the enhanced signal.

5. The method according to claim 1, characterized in that The step of determining a target angle range from a plurality of preset angle ranges according to the audio source signal comprises: Determine a candidate angle range from each of the angle ranges according to the audio source signal, wherein a speech signal exists in the audio signal within the candidate angle range; The candidate angle range with the largest angle sound intensity is determined as the target angle range.

6. The method according to claim 5, characterized in that The step of determining a candidate angle range from each of the angle ranges according to the audio source signal comprises: Determining, according to the audio source signal, a target amplitude variance of the audio signal within each of the angle ranges; The angle range in which the target amplitude variance is less than a preset amplitude variance threshold is determined as the candidate angle range, wherein the amplitude variance threshold is determined according to the amplitude variance corresponding to the audio signal without a speech signal.

7. The method according to claim 6, characterized in that The step of determining the target amplitude variance of the audio signal within each of the angle ranges according to the audio source signal comprises: Determine, according to the audio source signal, a first amplitude peak of the audio signal within each of the angle ranges, wherein the first amplitude peak is a peak with the largest amplitude in the audio signal within each of the angle ranges; Determining an amplitude threshold value according to the first amplitude peak, wherein the amplitude threshold value is smaller than the amplitude of the first amplitude peak; Determine a peak in the audio signal within the angle range whose amplitude is greater than the amplitude threshold as a second amplitude peak; The target amplitude variance is determined according to the amplitude variance between the first amplitude peak and the second amplitude peak.

8. An audio signal processing device, characterized in that: The device comprises: An acquisition module is configured to dynamically acquire an audio source signal collected by an associated microphone; a determination module, configured to determine a target angle range from a plurality of preset angle ranges according to the audio source signal, wherein the target angle range is an angle range with a maximum angle sound intensity, and the angle sound intensity is a sound intensity corresponding to the audio signal within the angle range; an enhancement module, configured to enhance the audio signal within the target angle range in the audio source signal to obtain a target signal; The output module is configured to output the target signal.

9. A hearing aid, characterized in that: The hearing aid comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the audio signal processing method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the audio signal processing method according to any one of claims 1 to 7 are implemented.

Images