Audio playing method and device, hearing aid and storage medium

Abstract

The invention discloses an audio playing method and device, a hearing aid and a storage medium, and relates to the technical field of audio data processing, the audio playing method is applied to the hearing aid, and the audio playing method comprises the following steps: determining a current environment according to an environment audio signal collected by an associated microphone; and under the condition that the current environment belongs to the quiet environment, switching the mode of the hearing aid to a first anti-dementia mode, and playing a preset anti-dementia audio through the hearing aid. According to the method and the device, the corresponding anti-dementia mode is automatically switched, and the corresponding anti-dementia audio is played, so that the risk of dementia induced by hearing loss is effectively reduced.

Description

Technical Field

[0001] The present application relates to the technical field of audio data processing, and in particular to an audio playback method, device, hearing aid and storage medium. Background Art

[0002] Alzheimer's disease, also known as senile dementia, is a degenerative disease of the central nervous system with an insidious onset and a chronic progressive course. It is the most common type of senile dementia. It is mainly manifested by neuropsychiatric symptoms such as progressive memory impairment, cognitive dysfunction, personality changes and language disorders, which seriously affect social, occupational and life functions. Studies have shown that long-term uninterventional hearing loss can lead to a decrease in the amount of sound information received by the brain, which in turn leads to a decrease in brain activity and cognitive impairment. Over time, this physiological change may intensify, increasing the risk of hearing-impaired patients developing cognitive impairment diseases such as Alzheimer's disease. Summary of the invention

[0003] The main purpose of this application is to provide an audio playback method, device, hearing aid and storage medium, aiming to reduce the risk of dementia induced by hearing loss.

[0004] To achieve the above object, an embodiment of the present application provides an audio playback method, which is applied to a hearing aid and includes:

[0005] Determine the current environment based on the ambient audio signal collected by the associated microphone;

[0006] When the current environment is a quiet environment, the mode of the hearing aid is switched to the first anti-dementia mode, and the preset anti-dementia audio is played through the hearing aid.

[0007] In one embodiment, after the step of determining the current environment according to the ambient audio signal collected by the associated microphone, the method further includes:

[0008] When the current environment is a mildly noisy environment, switching the mode of the hearing aid to a second anti-dementia mode, and playing the anti-dementia audio through the charging box of the hearing aid;

[0009] When the current environment is a highly noisy environment, the mode of the hearing aid is switched to a normal hearing aid mode.

[0010] In one embodiment, the step of playing the anti-dementia audio through the charging box of the hearing aid includes:

[0011] Determining position information of the hearing aid relative to the charging box;

[0012] Adjusting the audio playback parameters of the charging box according to the location information;

[0013] The anti-dementia audio is played in a directionally manner through the charging box after the audio playback parameters are adjusted.

[0014] In one embodiment, the step of determining the current environment according to the ambient audio signal collected by the associated microphone includes:

[0015] When the sound intensity of the ambient audio signal is less than a preset first sound intensity threshold, determining that the current environment is a quiet environment;

[0016] When the sound intensity of the ambient audio signal is greater than or equal to the first sound intensity threshold and less than a preset second sound intensity threshold, determining that the current environment is a slightly noisy environment;

[0017] When the sound intensity of the ambient audio signal is greater than or equal to the second sound intensity threshold, it is determined that the current environment belongs to a highly noisy environment, wherein the first sound intensity threshold is less than the second sound intensity threshold.

[0018] In one embodiment, before the step of determining the current environment according to the ambient audio signal collected by the associated microphone, the step further includes:

[0019] Determining whether there is a voice signal in the ambient audio signal;

[0020] In a case where there is a speech signal in the ambient audio signal, determining the second sound intensity threshold to be a first preset value;

[0021] In a case where there is no speech signal in the ambient audio signal, the second sound intensity threshold is determined to be a second preset value, wherein the first preset value is smaller than the second preset value.

[0022] In one embodiment, the step of determining whether there is a voice signal in the ambient audio signal comprises:

[0023] Calculating a target amplitude variance of the ambient audio signal;

[0024] When the target amplitude variance is less than a preset amplitude variance threshold, determining that a speech signal exists in the ambient audio signal;

[0025] When the target amplitude variance is greater than or equal to the amplitude variance threshold, it is determined that no speech signal exists in the ambient audio signal.

[0026] In one embodiment, the step of calculating the target amplitude variance of the ambient audio signal comprises:

[0027] Determine a first amplitude peak of the ambient audio signal, wherein the first amplitude peak is a peak with the largest amplitude in the ambient audio signal;

[0028] Determining an amplitude threshold value according to the first amplitude peak, wherein the amplitude threshold value is smaller than the amplitude of the first amplitude peak;

[0029] Determine a peak in the ambient audio signal whose amplitude is greater than the amplitude threshold as a second amplitude peak;

[0030] The target amplitude variance is determined according to the amplitude variance between the first amplitude peak and the second amplitude peak.

[0031] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further proposes an audio playback device, which is applied to a hearing aid and includes:

[0032] A determination module, configured to determine a current environment based on an ambient audio signal collected by an associated microphone;

[0033] The switching module is configured to switch the mode of the hearing aid to the first anti-dementia mode when the current environment is a quiet environment, and play the preset anti-dementia audio through the hearing aid.

[0034] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a hearing aid, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the audio playback method described above.

[0035] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the audio playback method described above are implemented.

[0036] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further proposes a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the audio playback method described above are implemented.

[0037] An embodiment of the present application proposes an audio playback method, which is applied to a hearing aid, and determines the current environment of the hearing aid wearer based on the ambient audio signal collected by the associated microphone; then, when the current environment is a quiet environment, the mode of the hearing aid is automatically switched to a first anti-dementia mode, and a preset anti-dementia audio is played through the hearing aid; the brain is stimulated by the anti-dementia audio, effectively reducing the risk of senile dementia caused by hearing loss. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0040] Figure 1 A flowchart of the first embodiment of the audio playback method of the present application is provided;

[0041] Figure 2 A flowchart of the third embodiment of the audio playback method of the present application is provided;

[0042] Figure 3 A schematic diagram of a scenario provided in Embodiment 3 of the audio playback method of the present application;

[0043] Figure 4 This is a schematic diagram of the framework structure of the audio playback device in the embodiment of the present application;

[0044] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment of the hearing aid involved in the audio playback method in the embodiment of the present application.

[0045] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0046] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0047] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0048] Studies have shown that long-term untreated hearing loss can lead to a decrease in the amount of sound information received by the brain, which in turn leads to a decrease in brain activity and cognitive impairment. Over time, this physiological change may intensify, increasing the risk of hearing-impaired patients developing cognitive impairment diseases such as Alzheimer's disease.

[0049] An embodiment of the present application provides a solution, which is applied to a hearing aid, and determines the current environment of the hearing aid wearer through the ambient audio signal collected by the associated microphone; then, when the current environment is a quiet environment, the hearing aid mode is automatically switched to the first anti-dementia mode, and the preset anti-dementia audio is played through the hearing aid; the brain is stimulated by the anti-dementia audio, effectively reducing the risk of senile dementia caused by hearing loss.

[0050] Reference Figure 1 , Figure 1 This is a flowchart of the first embodiment of the audio playback method of the present application.

[0051] It should be noted that the execution subject of the audio playback method may be a hearing aid, or other electronic devices or network devices, which is not limited in this embodiment. For ease of description, the following description of each embodiment is omitted. The audio playback method includes:

[0052] Step S10, determining the current environment according to the ambient audio signal collected by the associated microphone;

[0053] In a feasible embodiment, at least one microphone provided on the hearing aid collects ambient audio signals in the current environment; and then, based on the collected ambient audio signals, the current environment in which the hearing aid wearer is located is determined.

[0054] Step S20, when the current environment is a quiet environment, the mode of the hearing aid is switched to the first anti-dementia mode, and the preset anti-dementia audio is played through the hearing aid.

[0055] In a feasible embodiment, when the current environment of the hearing aid wearer is relatively quiet, it indicates that the current environment is relatively quiet and there are fewer surrounding sound stimuli. Because the hearing aid wearers themselves have hearing loss, the sound information received by their brains is significantly less than that of normal people. Being in such a quiet environment for a long time, the risk of hearing aid wearers suffering from cognitive impairment diseases such as Alzheimer's disease may increase. In order to effectively reduce this risk, the hearing aid mode is automatically switched to the first anti-dementia mode, and the preset anti-dementia audio is played through the hearing aid to stimulate the brain of the hearing aid wearer, effectively reducing the risk of senile dementia caused by hearing loss. At the same time, the method of playing audio directly through the hearing aid can not only ensure that the user receives the necessary sound stimulation, but also avoid disturbing others around in a quiet environment.

[0056] Exemplarily, the anti-dementia audio may be audio that the hearing aid wearer is interested in, such as music, opera, cross talk, and the like.

[0057] Exemplarily, electronic devices associated with hearing aids (e.g., mobile phones, smart watches, tablets, computers, etc.) can also display a preset anti-dementia user interface, and the anti-dementia audio can be a preset interactive instruction audio, prompting the user to enter the anti-dementia user interface to perform specified operations to stimulate the user's brain.

[0058] In this embodiment, the ambient audio signal collected by the associated microphone is used to determine the current environment of the hearing aid wearer; then, when the current environment is a quiet environment, the mode of the hearing aid is automatically switched to the first anti-dementia mode, and the preset anti-dementia audio is played through the hearing aid; the brain is stimulated by the anti-dementia audio, effectively reducing the risk of senile dementia caused by hearing loss.

[0059] In a feasible implementation manner, after the step of determining the current environment according to the ambient audio signal collected by the associated microphone in step S10, the method further includes:

[0060] Step S30, when the current environment is a mildly noisy environment, switching the mode of the hearing aid to the second anti-dementia mode, and playing the anti-dementia audio through the charging box of the hearing aid;

[0061] In one feasible embodiment, when the current environment of the hearing aid wearer is relatively mildly noisy, it indicates that there is a certain degree of background noise in the current environment; but since the hearing aid wearer itself is less sensitive to sound than normal people, the mild noise in the environment is difficult to effectively stimulate their brains. In order to reduce the risk of hearing aid wearers suffering from cognitive impairment diseases such as Alzheimer's disease, the hearing aid mode can be automatically switched to the second anti-dementia mode, and anti-dementia audio can be played through the hearing aid charging box. Playing anti-dementia audio through the charging box, combined with the audio signal enhancement function of the hearing aid, ensures that the hearing aid wearer can receive appropriate sound stimulation, which helps to activate the brain's cognitive function; at the same time, it can avoid the direct audio playback through the hearing aid affecting the communication between other individuals in the environment and the hearing aid wearer.

[0062] The charging box of a hearing aid refers to the outer shell used to store and charge the hearing aid. Its built-in battery can provide charging services for the hearing aid, ensuring that the hearing aid has sufficient power when needed; in addition, the charging box can also be provided with an audio output unit (for example, a speaker) for audio playback.

[0063] Step S40: When the current environment is a highly noisy environment, the mode of the hearing aid is switched to a normal hearing aid mode.

[0064] In a feasible implementation, when the current environment of the hearing aid wearer is a highly noisy environment, it indicates that there is a large background noise in the current environment, which can effectively stimulate the brain of the hearing aid wearer, so the mode of the hearing aid can be switched to the conventional hearing aid mode. It can be understood that for the mode switching of the hearing aid, when the current mode of the hearing aid is the target mode determined according to the current environment, the current mode of the hearing aid is maintained.

[0065] In this embodiment, by analyzing the current environment of the hearing aid wearer, a variety of functional modes are set for the hearing aid. These modes not only ensure the wearer's daily quality of life, but also provide necessary brain stimulation in a timely manner, thereby effectively reducing the risk of dementia caused by hearing loss.

[0066] Based on the above first embodiment, a second embodiment of the audio playback method of the present application is proposed. In this embodiment, step S10, the step of determining the current environment according to the ambient audio signal collected by the associated microphone includes:

[0067] Step S11, when the sound intensity of the ambient audio signal is less than a preset first sound intensity threshold, determining that the current environment is a quiet environment;

[0068] Step S12: when the sound intensity of the ambient audio signal is greater than or equal to the first sound intensity threshold and less than a preset second sound intensity threshold, determining that the current environment is a slightly noisy environment;

[0069] Step S13: when the sound intensity of the ambient audio signal is greater than or equal to the second sound intensity threshold, it is determined that the current environment is a highly noisy environment, wherein the first sound intensity threshold is less than the second sound intensity threshold.

[0070] In a feasible embodiment, the sound intensity of the ambient audio signal is determined, and the magnitude relationship between the sound intensity of the ambient audio signal and the preset first sound intensity threshold and the second sound intensity threshold is compared, wherein the first sound intensity threshold is smaller than the second sound intensity threshold. When the sound intensity of the ambient audio signal is smaller than the preset first sound intensity threshold, it indicates that the sound intensity in the current environment is low, and the current environment is determined to be a quiet environment. When the sound intensity of the ambient audio signal is greater than or equal to the first sound intensity threshold, and less than the preset second sound intensity threshold, it indicates that there is slight ambient noise in the current environment, and the current environment is determined to be a slightly noisy environment. When the sound intensity of the ambient audio signal is greater than or equal to the second sound intensity threshold, it indicates that the sound intensity in the current environment is large, and the current environment is determined to be a highly noisy environment.

[0071] In this embodiment, by comparing the magnitude relationship between the sound intensity of the ambient audio signal and the preset sound intensity threshold, the current environment of the hearing aid wearer is quickly determined, and the hearing aid function mode is automatically switched in time.

[0072] In a feasible implementation manner, before the step of determining the current environment according to the ambient audio signal collected by the associated microphone in step S10, the method further includes:

[0073] Step A10, determining whether there is a voice signal in the ambient audio signal;

[0074] Step A20, when there is a voice signal in the ambient audio signal, determining the second sound intensity threshold to be a first preset value;

[0075] Step A30: when there is no speech signal in the ambient audio signal, determine the second sound intensity threshold as a second preset value, wherein the first preset value is smaller than the second preset value.

[0076] In a feasible embodiment, the specific value of the second sound intensity threshold can be adjusted according to whether there is a voice signal in the ambient audio signal. When there is a voice signal in the ambient audio signal, it indicates that there is a user who is speaking in the current environment. In order to avoid affecting the communication between other users in the environment and the hearing aid wearer, the second sound intensity threshold is adjusted to a smaller first preset value. When there is a voice signal in the ambient audio signal, it indicates that the sound in the current environment is mainly noise without actual meaning, and the second sound intensity threshold can be adjusted to a larger second preset value, wherein the first preset value is smaller than the second preset value.

[0077] In this embodiment, the trigger condition value when switching the hearing aid function mode can be dynamically adjusted according to whether there is a voice signal in the ambient audio signal of the current environment, so as to improve the convenience of using the hearing aid.

[0078] In one feasible implementation, step A10, the step of determining whether there is a voice signal in the ambient audio signal includes:

[0079] Step A11, calculating the target amplitude variance of the ambient audio signal;

[0080] In a feasible embodiment, since the amplitude fluctuation of the speech signal in the audio signal has a certain periodicity, while the non-speech signal is usually random and irregular; therefore, the target amplitude variance corresponding to the ambient audio signal can be determined.

[0081] In one feasible implementation, step A11, the step of calculating the target amplitude variance of the ambient audio signal includes:

[0082] Step A111, determining a first amplitude peak of the ambient audio signal, wherein the first amplitude peak is a peak with the largest amplitude in the ambient audio signal;

[0083] Step A112, determining an amplitude threshold value according to the first amplitude peak, wherein the amplitude threshold value is smaller than the amplitude of the first amplitude peak;

[0084] Step A113, determining a peak in the ambient audio signal whose amplitude is greater than the amplitude threshold as a second amplitude peak;

[0085] Step A114: determining a target amplitude variance according to the amplitude variance between the first amplitude peak and the second amplitude peak.

[0086] In a feasible embodiment, in order to accurately reflect the periodic characteristics of the audio signal, the maximum amplitude peak of the ambient audio signal is determined as the first amplitude peak; then the amplitude threshold is set according to the amplitude of the first amplitude peak, wherein the amplitude threshold is smaller than the amplitude of the first amplitude peak. The peak of the audio signal within the angle range whose amplitude is greater than the amplitude threshold is determined as the second amplitude peak; then the amplitude variance between the first amplitude peak and the second amplitude peak is calculated as the target amplitude variance.

[0087] Step A12, when the target amplitude variance is less than a preset amplitude variance threshold, determining that there is a speech signal in the ambient audio signal;

[0088] Step A13: When the target amplitude variance is greater than or equal to the amplitude variance threshold, determine that there is no speech signal in the ambient audio signal.

[0089] In a feasible embodiment, since the amplitude fluctuation of the speech signal has a certain periodicity, its target amplitude variance is usually small, while the target amplitude variance of the non-speech signal is usually large. Therefore, the amplitude variance threshold value can be determined based on the amplitude variance corresponding to the audio signal of the non-speech signal. When the target amplitude variance is less than the preset amplitude variance threshold value, it is determined that there is a speech signal in the ambient audio signal. When the target amplitude variance is greater than or equal to the amplitude variance threshold value, it is determined that there is no speech signal in the ambient audio signal. Thereby, accurate recognition of the speech signal is achieved.

[0090] In this embodiment, since the amplitude fluctuation of the speech signal has a certain periodicity, the target amplitude variance of the ambient audio signal can be used to accurately identify the speech signal, improve the accuracy of subsequent hearing aid function mode switching, and enhance the auditory experience of the hearing aid wearer.

[0091] Based on the above-mentioned first and / or second embodiments, a third embodiment of the audio playback method of the present application is proposed, referring to Figure 2In this embodiment, step S30, the step of playing the anti-dementia audio through the charging box of the hearing aid includes:

[0092] Step S31, determining the position information of the hearing aid relative to the charging box;

[0093] Step S32, adjusting the audio playback parameters of the charging box according to the location information;

[0094] Step S33, playing anti-dementia audio in a targeted manner through the charging box after adjusting the audio playback parameters.

[0095] In one feasible embodiment, when playing anti-dementia audio through the charging box of the hearing aid, in order to minimize the impact of audio playback on other users in the environment, the sound can be transmitted directly to the direction of the hearing aid wearer through directional audio technology to reduce the impact on the surrounding environment and other people. Then, the position information of the hearing aid relative to the charging box is determined, and the audio playback parameters of the charging box are adjusted according to the position information. For example, the delay and gain parameters of each speaker on the charging box are adjusted to form a sound wave beam in a specific direction, thereby controlling the propagation direction of the sound wave. Then, through the charging box with adjusted audio playback parameters, directional playback of anti-dementia audio is achieved.

[0096] Exemplarily, the modulation of the sound wave is achieved by adjusting the phase and amplitude of each ultrasonic source in the ultrasonic gradient array, so that the superposition phase of the sound waves in a certain direction is consistent to form a directional sound beam.

[0097] In this embodiment, directional audio technology is used to ensure that the audio played by the hearing aid charging box is mainly received by the hearing-impaired patient, reducing the impact on surrounding users.

[0098] Exemplarily, when the hearing aid is in the second anti-dementia mode, the audio source signal collected by the microphone is dynamically acquired; based on the audio source signal, a target angle range is determined from multiple preset angle ranges, wherein the target angle range is the angle range with the maximum angle sound intensity, and the angle sound intensity is the sound intensity corresponding to the audio signal within the angle range; the audio signal within the target angle range in the audio source signal is enhanced to obtain the target signal, and the target signal is output through the hearing aid. While the charging box of the hearing aid plays the anti-dementia audio through directional audio technology, the hearing aid can further enhance the playback effect of the anti-dementia audio through audio enhancement technology, while minimizing the impact of the audio playback on surrounding users.

[0099] In a feasible implementation manner, after the step of switching the mode of the hearing aid to the normal hearing aid mode in step S40, the method further includes:

[0100] Dynamically acquire an audio source signal collected by a microphone; determine a target angle range from a plurality of preset angle ranges according to the audio source signal, wherein the target angle range is an angle range with the largest angle sound intensity, and the angle sound intensity is the sound intensity corresponding to the audio signal within the angle range; enhance the audio signal within the target angle range in the audio source signal to obtain a target signal, and output the target signal.

[0101] In one feasible embodiment, the audio source signal collected by the microphone of the hearing aid is obtained, and the sound intensity corresponding to the audio information in each preset angle range is determined from the audio source signal to serve as the angle sound intensity of each angle range; and then the angle range with the largest angle sound intensity is determined as the target angle range. In order to enhance the hearing experience of the hearing aid wearer, the audio signal in the target angle range in the audio source signal is enhanced to obtain the target signal, and then the target signal is output through the hearing aid, so that the hearing-impaired person can more easily capture the key sound in a noisy environment, ensuring that the user has a clear and interference-free hearing experience.

[0102] For example, refer to Figure 3 , the audio source signal is divided according to the preset angle range to obtain the audio signal from each angle range 101, and then the angle sound intensity corresponding to the audio signal in each angle range 101 is determined, and the angle range 101 with the largest angle sound intensity is determined as the target angle range 102, so as to perform targeted enhancement processing to improve the hearing experience of the hearing aid wearer.

[0103] Each angle range can be pre-set, for example, including: [0°, 45°), [45°, 90°), [90°, 135°), [135°, 180°), [180°, 225°), [225°, 270°), [270°, 360°), and can also be adjusted in real time according to actual conditions, which is not limited to the embodiments of the present application.

[0104] In this embodiment, by enhancing the audio signal within the angular range with the maximum angular sound intensity, the hearing aid can more flexibly adapt to changes in different auditory environments, ensuring that the user has a clear and undisturbed auditory experience regardless of whether it is a quiet indoor environment or a noisy public place.

[0105] In one feasible implementation, the step of determining the target angle range from a plurality of preset angle ranges according to the audio source signal comprises:

[0106] According to the audio source signal, a candidate angle range is determined from each angle range, wherein the audio signal within the candidate angle range contains a speech signal; and the candidate angle range with the largest angle sound intensity is determined as the target angle range.

[0107] In a feasible embodiment, considering that the hearing aid needs of the hearing-impaired are more focused on hearing the content of the communicator clearly, the audio signal with the voice signal is screened out from the ambient audio signal, and the angle range is determined as the candidate angle range. Then, the candidate angle range with the maximum angle sound intensity is screened out from the candidate angle range with the voice signal, and the target angle range is used for targeted audio signal enhancement processing.

[0108] It can be understood that the method for determining the candidate angle range can be implemented by the above-mentioned method of determining whether a speech signal exists by using the target amplitude variance.

[0109] Exemplarily, according to the audio source signal, an alternative angle range is determined from each angle range, wherein the alternative angle range is an angle range whose angle sound intensity is greater than a preset sound intensity threshold value; then, a candidate angle range is determined from the alternative angle range, and the candidate angle range with the largest angle sound intensity is determined as the target angle range. The angle ranges are preliminarily screened by the sound intensity threshold value in advance to avoid interference of irrelevant speech content in the environment with the screening of the target angle range, thereby improving the accuracy and flexibility of the screening of the target angle range.

[0110] Exemplarily, the audio signal within the angle range is subjected to noise reduction processing to obtain a noise-reduced signal, and the signal-to-noise ratio between the original signal and the noise-reduced signal is calculated; then, the signal-to-noise ratio is compared with a preset signal-to-noise ratio threshold, and if the signal-to-noise ratio is greater than the signal-to-noise ratio threshold, it is determined that there is a speech signal in the audio signal.

[0111] Exemplarily, the audio signal within the angle range is transformed into the frequency domain to obtain a spectrum; then the peak frequency points in the spectrum are identified, wherein the peak frequency points correspond to the resonance peaks of the speech signal; then the number of frequency points that meet the preset peak condition is determined; when the number of frequency points exceeds the preset number, it is determined that there is a speech signal in the audio signal.

[0112] Exemplarily, deep learning models, such as convolutional neural networks (CNNs) and recurrent neural networks (RNNs), are used to extract audio features and perform speech recognition; the models are trained to distinguish between speech and non-speech signals, and then the models are used to classify audio signals.

[0113] Exemplarily, the audio signal is filtered to remove noise in a specific frequency range, and the energy of the audio signal is calculated; when the energy exceeds a preset energy threshold, it is determined that a speech signal exists in the audio signal.

[0114] In this embodiment, considering that the hearing aid needs of the hearing-impaired are more focused on hearing the communicator's speech clearly, the target angle range is screened from the angle range where the voice signal exists, so that the hearing-impaired can more easily capture the key voice content in a noisy environment, thereby enhancing the hearing experience of the hearing aid wearer.

[0115] The present application embodiment provides an audio playback device, referring to Figure 4 , the device is applied to a hearing aid, the device comprising:

[0116] A determination module 10 is configured to determine a current environment based on an ambient audio signal collected by an associated microphone;

[0117] The switching module 20 is configured to switch the mode of the hearing aid to the first anti-dementia mode when the current environment is a quiet environment, and play the preset anti-dementia audio through the hearing aid.

[0118] The audio playback device provided in the embodiment of the present application adopts the audio playback method in the above embodiment, which can reduce the risk of dementia caused by hearing loss. Compared with conventional technology, the beneficial effects of the audio playback device provided in the embodiment of the present application are the same as the beneficial effects of the audio playback method provided in the above embodiment, and other technical features in the audio playback device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0119] An embodiment of the present application provides a hearing aid, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the audio playback method in the above-mentioned embodiment 1.

[0120] Reference below Figure 5 , respectively show the structural schematic diagrams of hearing aids suitable for implementing the embodiments of the present application. The hearing aids in the embodiments of the present application may include but are not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The hearing aid shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0121] like Figure 5As shown, the hearing aid may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM) 1004. In the RAM 1004, various programs and data required for the operation of the hearing aid are also stored. The processing device 1001, the ROM 1002, and the RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the hearing aid to communicate with other devices wirelessly or by wire to exchange data. Although the figures show hearing aids with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have instead.

[0122] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0123] The hearing aid provided in the embodiment of the present application, using the audio playback method in the above embodiment, can reduce the risk of dementia caused by hearing loss. Compared with conventional technology, the beneficial effects of the hearing aid provided in the embodiment of the present application are the same as the beneficial effects of the audio playback method provided in the above embodiment, and the other technical features in the hearing aid are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0124] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0125] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0126] An embodiment of the present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the audio playback method in the above embodiment.

[0127] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that includes or stores a program that can be used by or in combination with an instruction execution system, system or device. The program code included on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0128] The computer-readable storage medium may be included in the hearing aid, or may exist independently without being installed in the hearing aid.

[0129] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the hearing aid, the hearing aid: determines the current environment based on the ambient audio signal collected by the associated microphone; when the current environment is a quiet environment, switches the mode of the hearing aid to the first anti-dementia mode, and plays the preset anti-dementia audio through the hearing aid.

[0130] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0131] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code includes one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0132] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0133] The readable storage medium provided in the embodiment of the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned audio playback method, and can reduce the risk of dementia induced by hearing loss. Compared with conventional technologies, the beneficial effects of the computer-readable storage medium provided in the embodiment of the present application are the same as the beneficial effects of the audio playback method provided in the above-mentioned embodiment, and will not be repeated here.

[0134] The above are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. An audio playback method, characterized in that: The method is applied to a hearing aid, and the method comprises: Determine the current environment based on the ambient audio signal collected by the associated microphone; When the current environment is a quiet environment, the mode of the hearing aid is switched to the first anti-dementia mode, and the preset anti-dementia audio is played through the hearing aid.

2. The method according to claim 1, characterized in that After the step of determining the current environment according to the ambient audio signal collected by the associated microphone, the method further includes: When the current environment is a mildly noisy environment, switching the mode of the hearing aid to a second anti-dementia mode, and playing the anti-dementia audio through the charging box of the hearing aid; When the current environment is a highly noisy environment, the mode of the hearing aid is switched to a normal hearing aid mode.

3. The method according to claim 2, characterized in that The step of playing the anti-dementia audio through the charging box of the hearing aid comprises: Determining position information of the hearing aid relative to the charging box; Adjusting the audio playback parameters of the charging box according to the location information; The anti-dementia audio is played in a directionally manner through the charging box after the audio playback parameters are adjusted.

4. The method according to claim 2, characterized in that The step of determining the current environment according to the ambient audio signal collected by the associated microphone comprises: When the sound intensity of the ambient audio signal is less than a preset first sound intensity threshold, determining that the current environment is a quiet environment; When the sound intensity of the ambient audio signal is greater than or equal to the first sound intensity threshold and less than a preset second sound intensity threshold, determining that the current environment is a slightly noisy environment; When the sound intensity of the ambient audio signal is greater than or equal to the second sound intensity threshold, it is determined that the current environment belongs to a highly noisy environment, wherein the first sound intensity threshold is less than the second sound intensity threshold.

5. The method according to claim 4, characterized in that Before the step of determining the current environment according to the ambient audio signal collected by the associated microphone, the method further includes: Determining whether there is a voice signal in the ambient audio signal; In a case where there is a speech signal in the ambient audio signal, determining the second sound intensity threshold to be a first preset value; In a case where there is no speech signal in the ambient audio signal, the second sound intensity threshold is determined to be a second preset value, wherein the first preset value is smaller than the second preset value.

6. The method according to claim 5, characterized in that The step of determining whether there is a voice signal in the ambient audio signal comprises: Calculating a target amplitude variance of the ambient audio signal; When the target amplitude variance is less than a preset amplitude variance threshold, determining that a speech signal exists in the ambient audio signal; When the target amplitude variance is greater than or equal to the amplitude variance threshold, it is determined that no speech signal exists in the ambient audio signal.

7. The method according to claim 6, characterized in that The step of calculating the target amplitude variance of the ambient audio signal comprises: Determine a first amplitude peak of the ambient audio signal, wherein the first amplitude peak is a peak with the largest amplitude in the ambient audio signal; Determining an amplitude threshold value according to the first amplitude peak, wherein the amplitude threshold value is smaller than the amplitude of the first amplitude peak; Determine a peak in the ambient audio signal whose amplitude is greater than the amplitude threshold as a second amplitude peak; The target amplitude variance is determined according to the amplitude variance between the first amplitude peak and the second amplitude peak.

8. An audio playback device, characterized in that: The device comprises: A determination module, configured to determine a current environment based on an ambient audio signal collected by an associated microphone; The switching module is configured to switch the mode of the hearing aid to the first anti-dementia mode when the current environment is a quiet environment, and play the preset anti-dementia audio through the hearing aid.

9. A hearing aid, characterized in that: The hearing aid comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the audio playback method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the audio playback method according to any one of claims 1 to 7 are implemented.

Images