Method, apparatus, electronic device, and storage medium for processing audio signals
By performing hearing tests and configurations in the human-computer interactive interface and generating hearing assistance strategies, the cumbersome problem of hearing aid fitting process is solved, efficient and convenient audio equipment configuration is achieved, and user experience is improved.
Patent Information
- Application Number
- CN202210771358.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-30
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2042-06-30
AI Technical Summary
The process of fitting existing hearing aids is cumbersome and inefficient, and requires communication with the listener from the offline line.
By displaying hearing test controls on the human-computer interactive interface, outputting test audio signals, displaying hearing test results, and generating hearing assistance policies based on the results to configure the audio device.
It realizes efficient and convenient audio equipment matching, lowers the operating threshold, and improves configuration efficiency and user experience.
Smart Images

Figure CN115175076B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communication technologies, and in particular, to a method, apparatus, electronic device, and storage medium for processing audio signals. Background Art
[0002] As a professional device, the fitting of a hearing aid usually needs to be completed through face-to-face communication with an audiologist in an offline store. For example, the existing fitting process includes: the audiologist first needs to test the user's hearing, and then adjust the parameters of the hearing aid worn by the user according to the hearing test results using a prescription formula. It can be seen that in the related art, the fitting process for hearing aids is relatively cumbersome, resulting in low efficiency. Summary of the Invention
[0003] Embodiments of this application provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for processing audio signals, which can achieve the fitting of audio devices in an efficient manner.
[0004] The technical solution of the embodiments of this application is implemented as follows:
[0005] Embodiments of this application provide a method for processing audio signals, including:
[0006] Displaying a hearing test control in a human-computer interaction interface;
[0007] In response to a trigger operation on the hearing test control, outputting a first test audio signal;
[0008] In response to a feedback operation on the first test audio signal, displaying a first hearing test result of a target object;
[0009] In response to a configuration operation on an audio device, sending a first hearing assistance strategy generated according to the first hearing test result to the audio device, where the first hearing assistance strategy is used to make the audio device output a first audio signal adapted to the first hearing test result.
[0010] Embodiments of this application provide an apparatus for processing audio signals, including:
[0011] A display module, configured to display a hearing test control in a human-computer interaction interface;
[0012] An output module, configured to output a first test audio signal in response to a trigger operation on the hearing test control;
[0013] The display module is further configured to display a first hearing test result of a target object in response to a feedback operation on the first test audio signal;
[0014] A sending module, configured to send, in response to a configuration operation for an audio device, a first hearing assistance strategy generated according to the first hearing test result to the audio device, where the first hearing assistance strategy is used to enable the audio device to output a first audio signal adapted to the first hearing test result.
[0015] An embodiment of the present application provides a method for processing an audio signal, including:
[0016] Obtaining a first hearing test result of a target object;
[0017] Based on the first hearing test result, determining filter parameters for each sub-band in the audible frequency range in descending order of the frequency of each sub-band, where the filter parameters of the low-frequency sub-bands are determined based on the filter parameters of the high-frequency sub-bands;
[0018] Combining the filter parameters of each sub-band, and using the combined filter bank parameters as the first hearing assistance strategy for the target object;
[0019] Sending the first hearing assistance strategy to an audio device, where the first hearing assistance strategy is used for the audio device to output a first audio signal adapted to the first hearing test result.
[0020] An embodiment of the present application provides a device for processing an audio signal, including:
[0021] An obtaining module, configured to obtain a first hearing test result of a target object;
[0022] A determining module, configured to determine filter parameters for each sub-band in the audible frequency range in descending order of the frequency of each sub-band based on the first hearing test result, where the filter parameters of the low-frequency sub-bands are determined based on the filter parameters of the high-frequency sub-bands;
[0023] A combining module, configured to combine based on the filter parameters of each sub-band, and use the obtained filter bank parameters as the first hearing assistance strategy for the target object;
[0024] A sending module, configured to send the first hearing assistance strategy to an audio device, where the first hearing assistance strategy is used for the audio device to output a first audio signal adapted to the first hearing test result.
[0025] An embodiment of the present application provides a method for processing an audio signal, including:
[0026] Receive a first hearing assistance strategy for a target object, where the first hearing assistance strategy includes filter bank parameters, the filter bank parameters include filter parameters for each sub-band in the audible frequency range, the filter parameters for each sub-band are determined based on the first hearing test result of the target object in the order of decreasing frequency, and the filter parameters for the low-frequency sub-bands are determined based on the filter parameters for the high-frequency sub-bands;
[0027] Output a first audio signal adapted to the first hearing test result according to the first hearing assistance strategy.
[0028] An embodiment of the present application provides a processing device for audio signals, including:
[0029] A receiving module, configured to receive a first hearing assistance strategy for a target object, where the first hearing assistance strategy includes filter bank parameters, the filter bank parameters include filter parameters for each sub-band in the audible frequency range, the filter parameters for each sub-band are determined based on the first hearing test result of the target object in the order of decreasing frequency, and the filter parameters for the low-frequency sub-bands are determined based on the filter parameters for the high-frequency sub-bands;
[0030] An output module, configured to output a first audio signal adapted to the first hearing test result according to the first hearing assistance strategy.
[0031] An embodiment of the present application provides an electronic device, including:
[0032] A memory, configured to store executable instructions;
[0033] A processor, configured to implement the audio signal processing method provided by the embodiment of the present application when executing the executable instructions stored in the memory.
[0034] An embodiment of the present application provides a computer-readable storage medium, storing executable instructions, which are used to implement the audio signal processing method provided by the embodiment of the present application when executed by a processor.
[0035] An embodiment of the present application provides a computer program product, including a computer program or instruction, which is used to implement the audio signal processing method provided by the embodiment of the present application when executed by a processor.
[0036] The embodiment of the present application has the following beneficial effects:
[0037] By integrating the hearing test function and the function of configuring the audio device based on the hearing test results into a computer program, users can configure the audio device through the interaction with the computer program. In this way, compared with the related art where users need to go to an offline store to configure the audio device, the operation threshold is reduced, and the efficiency of configuring the audio device is improved, thereby enhancing the user's auditory experience. Description of the Drawings
[0038] Figure 1 is a schematic diagram of the architecture of the audio signal processing system 100 provided by an embodiment of the present application;
[0039] Figure 2A is a schematic diagram of the structure of the terminal device 200 provided by an embodiment of the present application;
[0040] Figure 2B is a schematic diagram of the structure of the audio device 300 provided by an embodiment of the present application;
[0041] Figure 3 is a schematic diagram of the process of the audio signal processing method provided by an embodiment of the present application;
[0042] Figure 4 is a schematic diagram of the process of the audio signal processing method provided by an embodiment of the present application;
[0043] Figure 5 is a schematic diagram of the process of the audio signal processing method provided by an embodiment of the present application;
[0044] Figure 6 is a schematic diagram of the functional layout provided by an embodiment of the present application;
[0045] Figure 7 is a schematic diagram of the process of pure tone audiometry and pain threshold test provided by an embodiment of the present application;
[0046] Figure 8 is a schematic diagram of the process of audiometry provided by an embodiment of the present application;
[0047] Figure 9 is a schematic diagram of the process of pain threshold test provided by an embodiment of the present application;
[0048] Figures 10A to 10C is a schematic diagram of the application scenario of the audio signal processing method provided by an embodiment of the present application;
[0049] Figure 11 is a schematic diagram of the process of pitch test provided by an embodiment of the present application;
[0050] Figure 12 is a schematic diagram of the application scenario of the audio signal processing method provided by an embodiment of the present application;
[0051] Figure 13A is a schematic diagram of the frequency response curve provided by the related art;
[0052] Figure 13B is a schematic diagram of the frequency response curve provided by an embodiment of the present application;
[0053] Figure 14 is a schematic diagram of the personalized equalization process provided by an embodiment of the present application;
[0054] Figure 15 is a schematic diagram of the tone adjustment process provided by an embodiment of the present application;
[0055] Figure 16 is a schematic diagram of the application scenario of the audio signal processing method provided by an embodiment of the present application;
[0056] Figure 17 is a schematic diagram of the listening experience adjustment process provided by an embodiment of the present application;
[0057] Figure 18 is a schematic diagram of the application scenario of the audio signal processing method provided by an embodiment of the present application. Detailed implementation manners
[0058] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limiting the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.
[0059] In the following description, "some embodiments" are involved, which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.
[0060] It can be understood that in the embodiments of the present application, data related to user information etc. (such as the user's hearing test results) are involved. When the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use and processing of the relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0061] In the following description, the terms "first / second / ..." involved are only used to distinguish similar objects and do not represent a specific order for the objects. It can be understood that "first / second / ..." can be interchanged with a specific order or sequence when allowed, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
[0062] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terms used herein are for the purpose of describing embodiments of this application only and are not intended to limit this application.
[0063] Before further elaborating on the embodiments of this application, the nouns and terms involved in the embodiments of this application are described. The nouns and terms involved in the embodiments of this application are applicable to the following explanations.
[0064] 1) In response to: used to represent the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more executed operations can be real-time or can have a set delay; without special instructions, there is no restriction on the execution order of multiple executed operations.
[0065] 2) Hearing Threshold: That is, the Minimal Audible Level, the minimum sound intensity that the human ear can just hear, or the minimum sound intensity required for a person to distinguish the presence of a sound.
[0066] 3) Pain Threshold: The minimum sound intensity that can cause physiological discomfort or pain in the human ear.
[0067] 4) Sound Pressure Level (SPL): A physical quantity used to describe the magnitude of sound pressure, defined as taking the common logarithm of the ratio of the measured sound pressure p to the reference sound pressure p(ref), and then multiplying by 20. Its unit is decibel (dB).
[0068] 5) Pitch: The high or low of the sound frequency, which is one of the three main subjective attributes of sound, namely volume (loudness), pitch, and timbre (also called tone quality). It represents the degree to which a person's hearing can distinguish the pitch of a sound. The main pitches are limited, for example, including: a / ah, i / yi, u / wu, m / me, s / si, and sh / shi, etc.
[0069] 6) Prescription formula: A formula for determining the gain value of each frequency band based on the hearing threshold of the target object in each frequency band, aiming to provide recommended gains for each hearing test frequency and input intensity. Common prescription formulas include Desired Sensation Level (DSL) and the National Acoustic Laboratory (NAL) series. Among them, the purpose of the DSL series of formulas is to enable hearing aid wearers to obtain maximum audibility in each frequency band; the purpose of the NAL series of formulas is to improve speech intelligibility while satisfying the listening comfort of hearing-impaired persons.
[0070] Embodiments of the present application provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for processing audio signals, which can configure audio devices in an efficient and portable manner. The following describes an exemplary application of the electronic device provided by the embodiments of the present application. The electronic device provided by the embodiments of the present application can be implemented as various types of terminal devices such as a laptop computer, a tablet computer, a desktop computer, a set-top box, a mobile device (for example, a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable game device), a vehicle-mounted terminal, etc.; it can also be implemented as an audio device, or implemented in cooperation with a terminal device and an audio device. Among them, the audio device can be a power amplifier, a speaker, a multimedia console, a digital mixer, an audio sampling card, a synthesizer, a mid-high frequency speaker, a microphone, a sound card in a laptop computer, a headphone, a hearing aid, etc., or other peripheral audio devices, such as a professional microphone series, a headphone, a sound reinforcement system, etc.
[0071] The following takes the cooperation between a terminal device and an audio device to implement the audio signal processing method provided by the embodiments of the present application as an example for description.
[0072] See Figure 1 , Figure 1 is a schematic diagram of the architecture of the audio signal processing system 100 provided by the embodiments of the present application. To implement an application that can configure audio devices in an efficient and convenient manner, as Figure 1 shown, the audio signal processing system 100 includes: a terminal device 200 (for example, a mobile phone) and an audio device 300 (for example, a hearing aid). Among them, the terminal device 200 and the audio device 300 can be connected by wire (such as a universal serial bus protocol) or wirelessly (such as based on Bluetooth, ZigBee communication protocol, etc.).
[0073] In some embodiments, a client is running on the terminal device 200 ( Figure 1 not shown in the figure). The client can be various types of clients, such as an instant messaging client, a web conferencing client, an audio and video playback client, a client dedicated to hearing tests and audio device configuration, etc. A hearing test function and a function for configuring the audio device 300 based on the hearing test results are integrated in the client. In this way, through the interaction between the user and the client, the user can achieve hearing tests and the configuration of the audio device based on the hearing test results, improving the configuration efficiency while saving the user's operation cost and enhancing the user's usage experience.
[0074] The terminal device 200 can implement the audio signal processing method provided in the embodiments of the present application by running a computer program. For example, the computer program can be a native program or software module in an operating system; it can be a local (Native) application (APP, Application), that is, a program that needs to be installed in the operating system to run, such as various types of clients like a network conference APP, an instant messaging APP, an audio and video playback APP, etc.; it can also be a small program, that is, a program that only needs to be downloaded to the browser environment to run; it can also be a small program that can be embedded in any APP. In short, the above computer program can be any form of application program, module or plug-in.
[0075] Next, continue to Figure 1 describe the structure of the terminal device 200 shown in Figure 2A , Figure 2A is a schematic structural diagram of the terminal device 200 provided in the embodiments of the present application. Figure 2A The terminal device 200 shown in Figure 2A includes: at least one processor 210, a memory 250, at least one network interface 220, and a user interface 230. Each component in the terminal device 200 is coupled together through a bus system 240. It can be understood that the bus system 240 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 240 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear description, in
[0076] all kinds of buses are labeled as the bus system 240.
[0076] The processor 210 can be an integrated circuit chip with signal processing capability parameters, such as a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0077] The user interface 230 includes one or more output devices 231 that enable the presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 230 also includes one or more input devices 232, including user interface components that facilitate user input, such as a keyboard, a mouse, a microphone, a touch screen display, a camera, other input buttons, and controls.
[0078] The memory 250 can be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard disk drives, optical disk drives, etc. The memory 250 optionally includes one or more storage devices that are physically located far from the processor 210.
[0079] The memory 250 includes a volatile memory or a non-volatile memory, or may include both a volatile memory and a non-volatile memory. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 250 described in the embodiments of the present application is intended to include any suitable type of memory.
[0080] In some embodiments, the memory 250 is capable of storing data to support various operations. Examples of such data include programs, modules, and data structures, or subsets or supersets thereof, which are exemplarily described below.
[0081] The operating system 251 includes system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks;
[0082] The network communication module 252 is used to reach other computing devices via one or more (wired or wireless) network interfaces 220. Exemplary network interfaces 220 include: Bluetooth, Wi-Fi (Wireless Fidelity), and USB (Universal Serial Bus), etc.;
[0083] The presentation module 253 is used to enable the presentation of information (such as a user interface for operating peripheral devices and displaying content and information) via one or more output devices 231 associated with the user interface 230 (such as a display screen, a speaker, etc.).
[0084] The input processing module 254 is used to detect and translate one or more user inputs or interactions from one of one or more input devices 232.
[0085] In some embodiments, the processing device for audio signals provided in the embodiments of the present application may be implemented in software. Figure 2A Shown is a processing device 255 for audio signals stored in the memory 250, which may be software in the form of programs and plugins, etc. It includes the following software modules: a display module 2551, an output module 2552, a sending module 2553, a generating module 2554, a recording module 2555, a detecting module 2556, a transferring module 2557, a determining module 2558, a combining module 2559, a compensating module 25510, an interpolating module 25511, an adjusting module 25512, and an obtaining module 25513. These modules are logical, and thus can be arbitrarily combined or further split according to the functions implemented. It should be noted that Figure 2AFor the convenience of expression, all the above modules are shown at once, but it should not be construed that the audio signal processing device 255 excludes embodiments that may include only the display module 2551, the output module 2552, and the transmission module 2553, or embodiments that include only the acquisition module 25513, the determination module 2558, the combination module 2559, and the transmission module 2553. The functions of each module will be described below.
[0086] Continue to Figure 1 describe the structure of the audio device 300 shown in Figure 2B , Figure 2B is a schematic structural diagram of the audio device 300 provided by an embodiment of the present application. As Figure 2B shown, the audio device 300 includes: a processor 310, a network interface 320, a user interface 330 (including an output device 331 and an input device 332), a bus system 340, and a memory 350. Among them, the memory 350 includes: an operating system 351, a network communication module 352, a presentation module 353, an input processing module 354, and an audio signal processing device 355. In addition, the audio signal processing device 355 stored in the memory 350, which may be software in the form of programs and plugins, etc., includes the following software modules: a receiving module 3551 and an output module 3552. These modules are logical, so they can be combined or further split arbitrarily according to the functions implemented. The functions of each module will be described below. Additionally, Figure 2B the functions of the above components in Figure 2A are similar to the functions of the corresponding components in Figure 2A , and the description in
[0087] will not be repeated here in the embodiments of the present application.
[0088] It should be noted that the steps executed by the terminal device are specifically executed by various forms of computer programs running on the terminal device, not limited to the client, and can also be the operating system, software modules, and scripts described above. Therefore, the client should not be regarded as a limitation to the embodiments of the present application. In addition, for the convenience of expression, the terminal device and the computer program running on the terminal device will not be specifically distinguished hereinafter.
[0089] See Figure 3 , Figure 3 is a schematic flowchart of the audio signal processing method provided by an embodiment of the present application, and will be described in conjunction with Figure 3 the steps shown.
[0090] In step 101, the terminal device displays a hearing test control in the human-computer interaction interface.
[0091] In some embodiments, a client is running on a terminal device associated with a target object (i.e., the object to be subjected to a hearing test, such as User A), and a hearing test control (such as a "Start Test" button) is displayed in a human-computer interaction interface provided by the client.
[0092] In some other embodiments, before the terminal device displays the hearing test control in the human-computer interaction interface, the following processing may also be performed: in response to the existence of historical hearing test results of the target object (for example, the historical hearing test results of the target object can be obtained from a third-party hearing detection agency, or the hearing test results obtained by the target object based on an APP before can also be obtained from the local of the terminal device or the server), and the historical hearing test results are within the validity period (for example, 3 months), the historical hearing test results are displayed in the human-computer interaction interface; in response to a configuration operation for an audio device, a fourth hearing assistance strategy generated according to the historical hearing test results is sent to the audio device, where the fourth hearing assistance strategy is used to make the audio device output a fourth audio signal adapted to the historical hearing test results. In this way, the time required for the user to conduct a hearing test can be saved, and the efficiency of configuring the audio device is further improved.
[0093] In step 102, the terminal device outputs a first test audio signal in response to a trigger operation for the hearing test control.
[0094] In some embodiments, when the terminal device receives a trigger operation from the target object for the hearing test control (such as a "Start Test" button) displayed in the human-computer interaction interface, it obtains a first test audio signal from the server (or calls the computing power of the terminal device itself to generate a first test audio signal locally based on factors such as sound channels, frequencies, and sound pressure levels, or obtains a first test audio signal from multiple test audio signals pre-stored locally in the terminal device), and sends the first test audio signal to an audio device (such as a speaker) built in the terminal device, and the audio device outputs the first test audio signal; of course, the terminal device can also send the first test audio signal to an external audio device, and the audio device outputs the first test audio signal.
[0095] In some other embodiments, before the terminal device outputs the first test audio signal, it can also detect the sound pressure level of the environment where the target object is currently located; when the average sound pressure level of the environment where the target object is currently located is less than a sound pressure level threshold (such as 40 dB) within a set time period (such as 2 seconds), it proceeds to execute the step of outputting the first test audio signal. In this way, before conducting a hearing test, the environment is first detected to ensure that the target object is in a relatively quiet environment, thereby improving the accuracy of subsequent hearing test results.
[0096] Exemplarily, refer to Figure 10A , Figure 10A which is a schematic diagram of an application scenario of the audio signal processing method provided in an embodiment of the present application. As Figure 10A shown, a hearing test control, such as a "Start Test" button 1001, is displayed in the human-computer interaction interface 1000. In addition, three detection controls are also displayed in the human-computer interaction interface 1000, namely a "Select Quiet Environment" control 1002 for detecting whether the environment where the target object is currently located meets the requirements of the hearing test; a "Wear Headphones" control 1003 for detecting whether the target object has worn headphones; and a "Adjust Mobile Phone to Comfortable Volume" control 1004 for detecting whether the volume currently output by the mobile phone is appropriate.
[0097] It should be noted that when the above three detection steps are not completed, the "Start Test" button 1001 can be in a disabled state (for example, the "Start Test" button 1001 can be grayed out and the click operation on the "Start Test" button 1001 can be blocked), that is, when the detection steps are not completed, the user cannot perform a hearing test to ensure the accuracy of the subsequent hearing test; of course, the user can also directly perform a hearing test by clicking the "Direct Test" button 1005 displayed in the human-computer interaction interface 1000 to save the user's time.
[0098] In step 103, the terminal device displays the first hearing test result of the target object in response to the feedback operation on the first test audio signal.
[0099] In some embodiments, the first hearing test result may include at least one of a hearing parameter and a language recognition ability parameter, and the first test audio signal may include at least one of the following types of test audio signals: a hearing test audio signal for testing the hearing of the target object; a language recognition ability test audio signal for testing the language recognition ability of the target object. Then, the terminal device can implement the above step 103 in the following manner: generate the hearing parameter of the target object in response to the feedback operation on the hearing test audio signal; generate the language recognition ability parameter of the target object in response to the feedback operation on the language recognition ability test audio signal; and display the hearing test result including at least one of the hearing parameter and the language recognition ability parameter.
[0100] In some other embodiments, continuing from the above, the hearing parameters may include the hearing thresholds of each sub-band in the audible frequency range of the target object (for example, according to the response characteristics of the human ear to different frequencies, the audible frequency range may be divided into 6 sub-bands, and the center frequencies of these 6 sub-bands are 250 Hz, 500 Hz, 1000 Hz, 2000 Hz, 4000 Hz, and 8000 Hz respectively). Then, the above-mentioned generation of the hearing parameters of the target object in response to the feedback operation for the hearing test audio signal can be achieved through the following method: For any sub-band in the audible frequency range, perform the following processing: Display a sound pressure level control (for indicating the sound pressure level of the currently output hearing test audio signal) and the following feedback controls on the human-computer interaction interface: A first feedback control (such as a "didn't hear" button), which is used to represent that the target object did not hear the hearing test audio signal; A second feedback control (such as a "heard" button), which is used to represent that the target object heard the hearing test audio signal; In response to the triggering operation for the first feedback control, re-output the hearing test audio signal in a manner higher than the currently output sound pressure level (the hearing test audio signal has a certain duration); In response to the triggering operation for the second feedback control, re-output the hearing test audio signal in a manner lower than the currently output sound pressure level; For any sound pressure level used in the current output, when the triggering operation for the second feedback control is received again at any sound pressure level, determine any sound pressure level as the hearing threshold of the target object in this sub-band.
[0101] Exemplarily, referring to Figure 10B , Figure 10B is a schematic diagram of the application scenario of the audio signal processing method provided by the embodiments of the present application. As Figure 10B shown, a sound pressure level control 1006 for indicating the sound pressure level of the currently output hearing test audio signal (such as 35 dB), a first feedback control (such as a "didn't hear" button 1007), and a second feedback control (such as a "heard" button 1008) are displayed on the human-computer interaction interface 1000. In addition, the numerical value 1009 of the center frequency of the current sub-band (such as 1000 Hz) and the prompt information 1010 of the currently tested ear (such as testing the right ear) are also displayed on the human-computer interaction interface 1000.
[0102] Continue to refer to Figure 10B, when receiving a click operation of the target object on the "Didn't hear" button 1007, re-output the hearing test audio signal in a manner with a sound pressure level higher than the current output (e.g., 40 dB), and at the same time update the value 1006 of the currently output sound pressure level displayed in the human-computer interaction interface 1000 from 35 dB to 40 dB; when receiving a click operation of the target object on the "Heard" button 1008, re-output the hearing test audio signal in a manner with a sound pressure level lower than the current output (e.g., 25 dB), and at the same time update the value 1006 of the currently output sound pressure level displayed in the human-computer interaction interface 1000 from 35 dB to 25 dB. Repeat this process. When receiving the second click operation of the target object on the "Heard" button 1008 at a certain sound pressure level, record the current sound pressure level as the hearing threshold of the target object in the current sub-band.
[0103] Taking the sub-band with a center frequency of 1000 Hz as an example, first output the hearing test audio signal to the target object (such as user A) at a sound pressure level of 30 dB. If at this time a click operation of user A on the "Heard" button 1008 is received, then reduce the sound pressure level of the hearing test audio signal by 10 dB (i.e., output the hearing test audio signal to user A at a sound pressure level of 20 dB). If a click operation of user A on the "Didn't hear" button 1007 is received at a sound pressure level of 20 dB, then increase the sound pressure level of the hearing test audio signal by 5 dB (i.e., output the hearing test audio signal to user A at a sound pressure level of 25 dB). If a click operation of user A on the "Didn't hear" button 1007 is received at a sound pressure level of 25 dB, then continue to increase the sound pressure level of the hearing test audio signal by 5 dB (i.e., output the hearing test audio signal to user A at a sound pressure level of 30 dB). If a click operation of user A on the "Heard" button 1008 is received again at a sound pressure level of 30 dB, then 30 dB can be used as the hearing threshold of user A in the sub-band with a center frequency of 1000 Hz.
[0104] In some other embodiments, for any sub-band in the audible frequency range, the following processing can also be performed: for any sound pressure level used in the current output, when a trigger operation of the target object on the second feedback control is received at any sound pressure level, determine the any sound pressure level as the hearing threshold of the target object in the sub-band.
[0105] Exemplarily, taking the sub-band with a center frequency of 1000 Hz as an example, the hearing test audio signals with different sound pressure levels are successively output to the target object (such as user A) in a manner that the sound pressure level continuously increases. For example, first, the hearing test audio signal is output to user A at a sound pressure level of 20 dB. If at this time, a click operation of user A on the "didn't hear" button 1007 is received, the sound pressure level of the hearing test audio signal is increased by 5 dB (that is, the hearing test audio signal is output to user A at a sound pressure level of 25 dB). If a click operation of user A on the "didn't hear" button 1007 is still received at a sound pressure level of 25 dB, the sound pressure level of the hearing test audio signal is continuously increased by 5 dB (that is, the hearing test audio signal is output to user A at a sound pressure level of 30 dB). If at a sound pressure level of 30 dB, a click operation of user A on the "heard" button 1008 is received, 30 dB can be used as the hearing threshold of user A in the sub-band with a center frequency of 1000 Hz. In this way, the process of hearing threshold test is simplified, thus saving the user's time.
[0106] It should be noted that the hearing threshold is not a fixed value, that is, the user will not be able to hear the sound completely at a certain sound pressure level, and below this sound pressure level, the sound pressure cannot be heard at all. In fact, this is a gradual transition process from "didn't hear" to "sometimes heard" to "heard" as the sound intensity increases. Therefore, multiple hearing threshold tests can also be performed on the target object, and the average value of the hearing thresholds obtained from multiple hearing threshold tests can be used as the hearing threshold of the target object to further improve the accuracy of the test results.
[0107] In some embodiments, the hearing parameter may further include the pain threshold of each sub-band of the target object in the auditory frequency range. Then, the above-mentioned generation of the hearing parameter of the target object in response to the feedback operation on the hearing test audio signal can be achieved through the following method: For any sub-band in the auditory frequency range, perform the following processing: Display a sound pressure level control (for indicating the sound pressure level of the currently output hearing test audio signal), a first adjustment control (such as a slider), and a third feedback control (such as an "ear discomfort" button) on the human-computer interaction interface, where the third feedback control is used to represent that the target object has physiological discomfort when hearing the hearing test audio signal; In response to the triggering operation on the first adjustment control, adjust the sound pressure level of the currently output hearing test audio signal; In response to the triggering operation on the third feedback control, determine the sound pressure level when the triggering operation is received as the pain threshold of the target object in this sub-band.
[0108] Exemplarily, referring to Figure 10C , Figure 10C is a schematic diagram of the application scenario of the audio signal processing method provided by the embodiments of the present application. As Figure 10CAs shown, in the human-machine interaction interface 1000, a sound pressure level control 1011 is displayed, which is used to indicate the sound pressure level of the currently output hearing test audio signal (e.g., 77 dB), a first adjustment control (e.g., a slider 1012, on which an adjustment button 1013 is displayed, and the user can adjust the sound pressure level of the currently output hearing test audio signal by sliding the adjustment button 1013), and a third feedback control (e.g., an "ear discomfort" button 1014). In addition, in the human-machine interaction interface 1000, a value 1015 of the center frequency of the current sub-band (e.g., 2000 Hz) and a prompt message 1016 for the currently tested ear (e.g., testing the right ear) are also displayed. For example, assuming that when the sound pressure level of the output hearing test audio signal is 80 dB, a click operation of the target object (e.g., user A) on the "ear discomfort" button 1014 displayed in the human-machine interaction interface 1000 is received, then 80 dB can be determined as the pain threshold of user A in the sub-band with a center frequency of 2000 Hz.
[0109] In some embodiments, the terminal device can also implement the above-mentioned generation of the language recognition ability parameter of the target object in response to the feedback operation on the language recognition ability test audio signal in the following manner: a decibel control (used to indicate the decibel value of the currently output language recognition ability test audio signal) and a plurality of fourth feedback controls are displayed in the human-machine interaction interface, where each fourth feedback control corresponds to a tone; a plurality of language recognition ability test audio signals are output in sequence, and each time a language recognition ability test audio signal is output, the fourth feedback control triggered by the target object among the plurality of fourth feedback controls is recorded; based on the tones respectively corresponding to the plurality of language recognition ability test audio signals and the fourth feedback controls respectively triggered by the target object during multiple tests, the correct rate of the target object's tone recognition is determined (i.e., each time a language recognition ability test audio signal is output, it is judged whether the tone corresponding to the language recognition ability test audio signal output by the audio device is consistent with the tone corresponding to the fourth feedback control triggered by the target object. When they are consistent, it is determined that the target object successfully recognizes the sound, and when they are inconsistent, it is determined that the target object fails to recognize the sound), and the determined correct rate of the tone recognition is used as the language recognition ability parameter of the target object.
[0110] Exemplarily, refer to Figure 12 , Figure 12 is a schematic diagram of the application scenario of the audio signal processing method provided by the embodiments of the present application. As Figure 12As shown in the figure, a decibel control 1201 is displayed in the human-computer interaction interface 1200, which is used to indicate the decibel value of the currently output language recognition ability test audio signal (for example, 50 dB), and a plurality of fourth feedback controls, where each fourth feedback control corresponds to a tone, for example, including an "a / ah" button 1202, an "m / me" button 1203, an "i / yi" button 1204, an "s / si" button 1205, a "u / wu" button 1207, and a "sh / shi" button 1207. In addition, a "can't hear clearly" button 1208 is also displayed in the human-computer interaction interface 1200. When a click operation of the target object on the "can't hear clearly" button 1208 is received, the language recognition ability test audio signal can be re-output, or the language recognition ability test audio signal can be re-output in a manner higher than the current decibel value. In addition, a prompt message 1209 of the currently tested ear (for example, testing the right ear) is also displayed in the human-computer interaction interface 1200.
[0111] For example, taking the target object as user A, assume that 10 language recognition ability test audio signals are output to user A in sequence, and the tones corresponding to these 10 language recognition ability test audio signals are: u / wu, s / si, i / yi, sh / shi, a / ah, u / wu, s / si, m / me, u / wu, i / yi. At the same time, assume that the fourth feedback controls triggered by user A during these 10 tests are: the "u / wu" button 1207, the "sh / shi" button 1207, the "i / yi" button 1204, the "s / si" button 1205, the "a / ah" button 1202, the "u / wu" button 1207, the "sh / shi" button 1207, the "m / me" button 1203, the "u / wu" button 1207, and the "i / yi" button 1204. Among them, user A misrecognized 3 tones, then it can be determined that the correct rate of user A's tone recognition is 70%, and the correct rate of 70% is used as the language recognition ability parameter of user A.
[0112] In step 104, the terminal device responds to the configuration operation for the audio device and sends a first hearing assistance strategy generated according to the first hearing test result to the audio device.
[0113] In some embodiments, before the terminal device sends the first hearing assistance strategy generated according to the first hearing test result to the audio device, the following processing can also be performed: in the order from high to low frequency, determine the filter parameters of each sub-band in the audible frequency range based on the first hearing test result; combine the filter parameters of each sub-band, and use the obtained filter bank parameters as the first hearing assistance strategy for the target object.
[0114] Exemplarily, the first hearing test result may include the hearing thresholds of each sub - band in the hearing frequency range. Then, the terminal device may determine the filter parameters of each sub - band in the audible frequency range in the order from high to low frequency based on the first hearing test result in the following manner: Based on the hearing threshold of the target object in each sub - band and a prescription formula (such as the prescription formula of the NAL series or the prescription formula of the DSL series, etc.), obtain the gain value of each sub - band (for example, for the hearing threshold of the target object in each sub - band, for example, the hearing threshold can be substituted into the prescription formula for calculation to obtain the gain value of the corresponding sub - band); In the order from high to low frequency, based on the gain value of each sub - band, obtain the filter parameters of each sub - band. In this way, by using the "reverse" calculation method to determine the filter parameters, that is, first determining the filter parameters corresponding to the high - frequency sub - bands, and then calculating the filter parameters of the low - frequency sub - bands according to the characteristics of the frequency response after filtering, it can be closer to the desired frequency response curve, thereby achieving a better gain effect and improving the user's auditory experience.
[0115] For example, taking the hearing frequency range including N sub - bands (such as 6 sub - bands, where the 6th sub - band is the sub - band with a center frequency of 8000 Hz, the 5th sub - band is the sub - band with a center frequency of 4000 Hz, the 4th sub - band is the sub - band with a center frequency of 2000 Hz, the 3rd sub - band is the sub - band with a center frequency of 1000 Hz, the 2nd sub - band is the sub - band with a center frequency of 500 Hz, and the 1st sub - band is the sub - band with a center frequency of 250 Hz) as an example, where N is an integer greater than 1, then the terminal device may determine the filter parameters of each sub - band in the order from high to low frequency based on the gain value of each sub - band in the following manner: Substitute the gain value of the Nth sub - band into the filter function for calculation to obtain the filter parameters of the Nth sub - band; Based on the difference between the gain value of the ith sub - band and the frequency response of the filter of the (i + 1)th sub - band at the frequency of the ith sub - band, determine the filter parameters of the ith sub - band (for example, first calculate the filter parameters of the 6th sub - band according to the gain value of the 6th sub - band, then calculate the filter parameters of the 5th sub - band according to the gain value of the 5th sub - band and the difference between the frequency response of the filter of the 6th sub - band at the frequency of the 5th sub - band, and so on, to obtain the filter parameters corresponding to these 6 sub - bands); where the value range of i satisfies 1 ≤ i ≤ N - 1, and the frequency of the (i + 1)th sub - band is greater than that of the ith sub - band.
[0116] It should be noted that the first hearing assistance strategy may be generated in real - time in response to a configuration operation triggered by the target object, or may be pre - generated; it may be generated locally on the terminal device or generated in the server (for example, the terminal device sends the first hearing test result of the target object to the server, and the server generates the first hearing assistance strategy). The embodiments of the present application do not make specific limitations on this.
[0117] In step 105, the audio device outputs a first audio signal adapted to the first hearing test result.
[0118] In some embodiments, the audio device may output the first audio signal adapted to the first hearing test result in the following manner: controlling the filters of each sub-band in the filter bank in the order from low frequency to high frequency, and filtering the original audio signal successively according to the filter parameters of the corresponding sub-bands in the filter bank parameters to obtain the first audio signal adapted to the first hearing test result.
[0119] For example, taking the filter bank parameters being composed of the filter parameters of 6 sub-bands as an example, after receiving the original audio signal, the audio device can, in the order from low frequency to high frequency, perform filtering through the filters of these 6 sub-bands (that is, successively pass through the processing of 6 filters from low frequency to high frequency), and then obtain the first audio signal adapted to the first hearing test result (that is, the audio signal after personalized equalization). In addition, in order to prevent the "clipping" phenomenon from occurring in the finally output first audio signal and affecting the listening experience of the target object, dynamic range control (DRC) can be added before outputting the first audio signal to ensure the integrity of the first audio signal.
[0120] In some other embodiments, refer to Figure 4 , Figure 4 which is a schematic flowchart of the method for processing an audio signal provided by an embodiment of the present application. As Figure 4 shown, after executing Figure 3 the step 105 shown, steps 106 to 109 shown in Figure 4 may also be executed, and will be described in combination with the steps shown in Figure 4 .
[0121] In step 106, the terminal device amplifies the first audio signal according to at least one gain curve to obtain second test audio signals with at least one volume.
[0122] In some embodiments, before the terminal device amplifies the first audio signal according to at least one gain curve, the following processing may also be performed: obtaining the characteristic information of the target object (such as age, wearing side, wearing years, etc.); determining the gain factor of the first audio signal according to the characteristic information of the target object; generating at least one gain curve according to the hearing parameters included in the first hearing test result (including at least one of the hearing threshold and pain threshold of each sub-band of the target object in the audible frequency range), the gain factor, and the prescription formula, where each gain curve corresponds to a sound volume (for example, 3 gain curves can be calculated according to the gain factor, hearing threshold, and pain threshold using the prescription formula, respectively corresponding to multiple sound volumes, including soft sound, medium sound, and loud sound, where multiple sound volumes can be obtained by uniformly or non-uniformly dividing the interval of the decibels of the sound that humans can perceive. For example, when the decibel value is between 0 - 20 dB, it can be defined as soft sound; when the decibel value is between 20 - 60 dB, it can be defined as medium sound; when the decibel value is greater than 60 dB, it can be defined as loud sound); performing interpolation processing on each gain curve in a band mapping manner (for example, when mapping the sub-bands of the gain curve to the channels of the filter bank, since the number of sub-bands of the gain curve is less than the number of channels of the filter bank. For example, assuming that the original number of sub-bands of the gain curve is 5, and the number of channels of the filter bank is 8, therefore, interpolation processing needs to be performed on the gain curve. For example, linear interpolation or parabolic interpolation can be used to perform interpolation processing on the gain curve so that the number of sub-bands of the gain curve after interpolation processing increases to 8), so that the number of sub-bands of the gain curve is consistent with the number of channels of the filter bank.
[0123] In step 107, the terminal device generates a second hearing test result of the target object in response to the feedback operation for the second test audio signal.
[0124] In some embodiments, the terminal device may implement step 107 in the following manner: display a second adjustment control (such as a slider), a plurality of fifth feedback controls, and a plurality of volume controls in the human-computer interaction interface, where each fifth feedback control corresponds to a pitch, and the volume represented by the selected volume control is used as the volume for outputting the second test audio signal; in response to a trigger operation on the second adjustment control, adjust the gain of the currently output second test audio signal; sequentially output a plurality of second test audio signals, and record the fifth feedback control triggered by the target object among the plurality of fifth feedback controls each time a second test audio signal is output; based on the pitches corresponding to the plurality of second test audio signals and the fifth feedback controls triggered by the target object during multiple tests, obtain the pitch that the target object misidentifies (for example, each time a second test audio signal is output, determine whether the pitch corresponding to the second test audio signal is consistent with the pitch corresponding to the fifth feedback control triggered by the target object. If not, determine the pitch corresponding to the second test audio signal as the pitch misidentified by the target object), and use the misidentified pitch as the second hearing test result of the target object.
[0125] Exemplarily, refer to Figure 16 , Figure 16 is a schematic diagram of an application scenario of the audio signal processing method provided by an embodiment of the present application. As Figure 16 shown, the test ear is highlighted in the human-computer interaction interface 1600 (for example, the control 1601 of the left ear is highlighted), and the selected volume is highlighted (for example, the control 1602 of the low volume is highlighted). In addition, a second adjustment control, such as a slider 1603, is also displayed in the human-computer interaction interface 1600. An adjustment button 1604 is displayed on the slider 1603. The user can adjust the main gain (i.e., the gain of the currently output second test audio signal) and a plurality of fifth feedback controls by sliding the adjustment button 1604. Each fifth feedback control corresponds to a pitch, for example, including an "a / ah" button 1605, an "m / me" button 1606, an "i / yi" button 1607, an "s / si" button 1608, a "u / wu" button 1609, and a "sh / shi" button 1610. In this way, by outputting a plurality of second test audio signals to the target object (such as user A) and recording the fifth feedback control triggered by user A each time the second test audio signal is heard, the pitch misidentified by user A (i.e., the second hearing test result) can be obtained.
[0126] In addition, a "can't hear clearly" button 1611 is also displayed in the human-computer interaction interface 1600. When a click operation of the target object on the "can't hear clearly" button 1611 is received, the second test audio signal can be re-output, or the second test audio signal can be re-output in a manner higher than the current decibel value.
[0127] In step 108, the terminal device sends a second hearing assistance strategy to the audio device.
[0128] In some embodiments, the second hearing assistance strategy may be obtained by adjusting the first hearing assistance strategy according to the second hearing test result. The second hearing test result includes the tones misrecognized by the target object. Before the terminal device sends the second hearing assistance strategy to the audio device, the following processing may further be performed: according to the tones misrecognized by the target object, perform targeted compensation processing on the first hearing assistance strategy to obtain the second hearing assistance strategy.
[0129] Among them, the process of targeted compensation processing may be: for the tones misrecognized by the target object, according to the frequency corresponding to the tone, perform compensation processing on the filter parameters of the corresponding sub-band in the filter bank parameters included in the first hearing assistance strategy (that is, according to the frequency corresponding to the tone, determine the filter corresponding to the frequency from the filter bank, and then perform compensation processing on the parameters of the filter. For example, assume that the frequency corresponding to the tone is 500 Hz, and the center frequency of the 3rd sub-band is exactly 500 Hz, then it can be determined that the filter parameters of the 3rd sub-band in the filter bank need to be compensated), that is, increase a certain adjustment amount so that the target object can perceive the tone as the compensation target.
[0130] As an example of compensation processing, assume that the tone misrecognized by the target object is "sh / ten", then according to the tone "sh / ten" misrecognized by the target object, perform targeted compensation processing on the filter parameters of the corresponding sub-band in the filter bank parameters included in the first hearing assistance strategy. For example, the volume of the tone "sh / ten" can be increased so that the target object can clearly hear the tone. In addition, for different error situations, the corresponding compensation may be different, but the adjustment amount of the compensation may be preset, and the user does not need to manually adjust.
[0131] In step 109, the audio device outputs a second audio signal adapted to the second hearing test result to replace the first audio signal.
[0132] In some embodiments, after receiving the second hearing assistance strategy sent by the terminal device, the audio device may use the second hearing assistance strategy to replace the first hearing assistance strategy received in step 104. Thus, when the original audio signal is received subsequently, the second hearing assistance strategy can be used to adjust and process the received original audio signal. For example, based on the filter bank parameters after targeted compensation processing included in the second hearing assistance strategy, the original audio signal can be filtered in sequence from low frequency to high frequency, so as to output a second audio signal adapted to the second hearing test result (i.e., an audio signal with tone adjustment based on the first audio signal). In this way, the user's auditory experience can be further improved.
[0133] In some embodiments, referring to Figure 5 , Figure 5 is a schematic flowchart of the method for processing an audio signal provided by an embodiment of the present application. As Figure 5 shown, after executing Figure 4 the step 109 shown, Figure 5 the steps 110 to 113 shown can also be executed, which will be described in combination with Figure 5 the steps shown.
[0134] In step 110, the terminal device adjusts and processes the second audio signal based on multiple candidate hearing perception adjustment strategies to obtain multiple third test audio signals.
[0135] In some embodiments, the audio device may not output the second audio signal, but directly output the third audio signal after hearing perception adjustment of the second audio signal. For example, multiple different types of candidate hearing perception adjustment strategies can be displayed on the human-computer interaction interface of the terminal device for the target object to select; then, the terminal device can perform hearing perception adjustment processing on the second audio signal based on the multiple hearing perception adjustment strategies selected by the target object to obtain multiple third test audio signals.
[0136] As an example of the terminal device performing auditory perception adjustment processing on the second audio signal based on the auditory perception adjustment strategy, first obtain the pitch carried by the auditory perception adjustment strategy, and then based on the frequency corresponding to the obtained pitch, adjust the second audio signal through wide dynamic range compression (that is, as the sound intensity of the input audio signal changes, the corresponding gain will also change in real time, so that the amplified audio signal is completely within the reduced auditory dynamic range of the hearing-impaired user) to obtain a third test audio signal. For example, the second audio signal can be downsampled, and at the same time, according to the sound intensity (such as decibel value) of the second audio signal, the corresponding gain value is adjusted in real time, so that the finally obtained third test audio signal sounds lower than the second audio signal, and the auditory perception corresponding to each third test audio signal is different. For example, four different types of auditory perception adjustment strategies can be used to perform auditory perception adjustment processing on the second audio signal to obtain four third test audio signals with different auditory perceptions, namely the original auditory perception, higher pitch, lower pitch, and clearer voice.
[0137] In step 111, the terminal device generates a third hearing test result of the target object in response to feedback operations on multiple third test audio signals.
[0138] In some embodiments, the third hearing test result may include the auditory perception preferred by the target object. Then, the terminal device can implement step 111 in the following manner: display multiple sixth feedback controls in the human-computer interaction interface, where each sixth feedback control corresponds to an auditory perception; sequentially output multiple third test audio signals corresponding one-to-one to the multiple sixth feedback controls, and determine the auditory perception corresponding to the sixth feedback control triggered by the target object among the multiple sixth feedback controls as the auditory perception preferred by the target object.
[0139] Exemplarily, refer to Figure 18 , Figure 18 is a schematic diagram of the application scenario of the audio signal processing method provided by the embodiments of the present application. As Figure 18 shown, multiple sixth feedback controls are displayed in the human-computer interaction interface 1800, where each sixth feedback control corresponds to an auditory perception, for example, including a "soft" button 1801, a "medium" button 1802, a "high" button 1803, and a "low" button 1804. Then, sequentially output 4 third test audio signals corresponding one-to-one to "soft", "medium", "high", and "low". At the same time, assume that a click operation of the target object on the "soft" button 1801 is received during the auditory perception adjustment process, then "soft" can be determined as the auditory perception preferred by the target object.
[0140] In step 112, the terminal device sends a third hearing assistance strategy to the audio device.
[0141] In some embodiments, the third hearing assistance strategy may be obtained by adjusting the second hearing assistance strategy according to the results of the third hearing test. Before the terminal device sends the third hearing assistance strategy to the audio device, the following processing may also be performed: adjusting the gain curve included in the second hearing assistance strategy according to the target object's preferred listening sensation (for example, assuming that the target object's preferred listening sensation is "soft", then the gain curve included in the second hearing assistance strategy may be adjusted specifically based on factors such as the timbre corresponding to "soft") to obtain the third hearing assistance strategy.
[0142] In step 113, the audio device outputs a third audio signal adapted to the results of the third hearing test to replace the second audio signal.
[0143] In some embodiments, after receiving the third hearing assistance strategy sent by the terminal device, the audio device may use the third hearing assistance strategy to replace the second hearing assistance strategy received in step 108. In this way, when the original audio signal is received subsequently, the third hearing assistance strategy may be used to adjust the original audio signal and output a third audio signal adapted to the results of the third hearing test (i.e., the audio signal after listening sensation adjustment based on the second audio signal), thereby further improving the user's auditory experience.
[0144] The audio signal processing method provided by the embodiments of the present application provides a solution in the form of a computer program, which integrates personalized hearing tests and the function of configuring audio devices based on hearing test results. Compared with the related art where users need to go to offline stores to configure audio devices, the operation threshold is reduced, and the efficiency of configuring audio devices is also improved, thereby enhancing the user's auditory experience.
[0145] Next, taking the audio device as a hearing aid as an example, the exemplary application of the embodiments of the present application in an actual application scenario will be described. The embodiments of the present application provide an autonomous fitting and tuning machine solution based on the APP form, which integrates comprehensive personalized hearing tests and portable autonomous fitting functions to enhance the auditory experience of hearing-impaired users when using hearing aids.
[0146] The following specifically describes the audio signal processing method provided by the embodiments of the present application.
[0147] Exemplarily, refer to Figure 6 , Figure 6 which is the functional layout schematic diagram provided by the embodiments of the present application. As Figure 6As shown in the figure, according to the functional area division, at least two buttons, namely "Personalized Hearing Test" and "Independent Fitting", are included on the home page of the APP. Among them, "Personalized Hearing Test" includes: hearing threshold test and pain threshold test, that is, users can independently complete the hearing threshold test and pain threshold test through the APP. Specifically, before the test, sound analysis can be performed through ambient sound detection to confirm whether the environment where the user is currently located is quiet enough to meet the acoustic requirements of the test. In addition, users can also independently complete the pitch test through the APP to evaluate the intelligibility of speech (also known as speech clarity, that is, the percentage of language signals that users can understand transmitted through a certain sound transmission system). After the test is completed, the results of the personalized hearing test can be saved as a hearing file.
[0148] Next, continue to describe Figure 6 the "Independent Fitting" part shown in
[0149] In some embodiments, after the user wears the hearing aid, it is connected to the mobile phone APP via Bluetooth. Then, the user can select the hearing file. After starting, the hearing aid parameters are updated, and the basic hearing assistance function (corresponding to the above-mentioned first hearing assistance strategy) takes effect; then, the user can also adjust the pitch through the link designed in the APP, the hearing aid parameters are updated, and the first enhanced hearing assistance function (corresponding to the above-mentioned second hearing assistance strategy) takes effect; subsequently, the user can further adjust the hearing perception through the link designed in the APP, the hearing aid parameters are updated, and the second enhanced hearing assistance function (corresponding to the above-mentioned third hearing assistance strategy) takes effect.
[0150] It can be seen from Figure 6 that the independent fitting and tuning scheme based on the mobile phone APP provided by the embodiments of the present application can be divided into two parts: personalized hearing test and independent fitting. Among them, the personalized hearing test refers to performing a frequency-band hearing test based on the terminal device (such as a mobile phone) that the user often uses to obtain the user's personalized hearing curve (i.e., audiogram, also known as hearing status).
[0151] For the convenience of description, the main constants in the quantitative description part of the embodiments of the present application are uniformly:
[0152] The sampling rate of the speech signal is 16000Hz;
[0153] The frame length is 20ms, that is, the number of samples per frame is 320 points;
[0154] If the overlapping time-frequency transform is used, such as the short-time Fourier transform (STFT), the overlap is 50% in both cases; thus, the Hop-size (i.e., the number of samples staggered between two adjacent windows) is 320 points, and a discrete Fourier transform (DFT) of 640 points is performed.
[0155] The personalized audiometry part will be described first below.
[0156] The first part of the personalized audiometry is: pure tone audiometry and pain threshold test.
[0157] In some embodiments, referring to Figure 7 , Figure 7 is a schematic flowchart of the pure tone audiometry and pain threshold test provided by the embodiments of the present application. As Figure 7 shown, the process of the pure tone audiometry and pain threshold test mainly includes 4 steps: 1. Preparation before measurement; 2. Audiometry; 3. Pain threshold measurement; 4. Measurement results. These 4 steps will be specifically described below.
[0158] 1. Preparation before measurement
[0159] In some embodiments, the preparation before measurement mainly includes environmental sound detection (such as Figure 10A the "select a quiet environment" control 1002 shown in Figure 10A ), volume adjustment (such as Figure 10A the "adjust the mobile phone to a comfortable volume" control 1004 shown in
[0160] 2. Audiometry
[0161] In some embodiments, referring to Figure 8 , Figure 8 is a schematic flowchart of the audiometry provided by the embodiments of the present application. As Figure 8As shown, the hearing of each frequency band of the user in the audible frequency range can be tested by using the sub-band ascending method. For example, according to the response characteristics of the human ear to different frequencies, the audible frequency range can be divided into 6 sub-bands, and the center frequencies of these 6 sub-bands are 250 Hz, 500 Hz, 1000 Hz, 2000 Hz, 4000 Hz, and 8000 Hz respectively. The audiometry in the embodiments of the present application can use the simplified ascending method to test the hearing of the left and right ears of the subject in each frequency band respectively, that is, a total of 12 groups of tests. The complete ascending method requires the subject to make 5 responses at the same sound pressure level, so it takes a long time to test the complete audiogram of both ears. Therefore, the audiometry method provided by the embodiments of the present application simplifies the ascending method to meet the needs of general users. The simplified ascending method is that in each group of audiometry, the test tone is given to the subject at a preset first sound pressure level. If the click operation of the "didn't hear" button 1007 shown in Figure 10B is received, the test sound pressure level is increased by 5 dB; if the click operation of the "heard" button 1008 is received, the test sound pressure level is decreased by 10 dB, and so on. When the second click operation of the "heard" button 1008 by the subject at a certain sound pressure level is received, the current sound pressure level is recorded as the hearing value of the current test ear in the current frequency band, and then the next group of tests is jumped to until the 12 groups of tests for both ears are completed.
[0162] III. Pain Threshold Audiometry
[0163] In some embodiments, when performing the pain threshold test, in order to save the user's test time, the initial value of the pain threshold test can be set at a value x dB higher than the hearing threshold (for example, the value of x can be 30 dB, which can be judged according to the hearing threshold. At the same time, when the hearing threshold is higher than a certain threshold (for example, 60 dB), the value of x can be appropriately reduced). In addition, the pain threshold test can add a protection mechanism. For example, when the sound pressure level of the currently output test audio signal is higher than 75 dB, the user's adjustment step size can be forced to decrease to prevent the sudden increase in volume and damage the user's hearing.
[0164] Exemplarily, referring to Figure 9 , Figure 9 is a schematic flow chart of the pain threshold test provided by the embodiments of the present application. As shown in Figure 9 , the process of the pain threshold test mainly includes the following steps: 1. Import the audiogram and confirm the hearing threshold of each frequency band according to the audiogram; 2. Add an increment to the hearing threshold as the initial sound pressure level of the pain threshold test; 3. Play the test audio signal and update the sound pressure level of the test audio signal according to the user's feedback; 4. Receive the user's response to Figure 10CThe sound pressure level when the "ear discomfort" button 1014 is clicked is determined as the user's pain threshold in the current frequency band; 5. Switch the frequency to determine whether the test ear needs to be switched; 6. Repeat steps 3, 4, and 5 until all the frequencies to be tested in both ears are traversed; 7. Record the pain threshold test results.
[0165] 4. Audiometry Results
[0166] In some embodiments, after the hearing threshold and pain threshold of the user in each sub-band of the auditory frequency range are obtained through the hearing threshold test and the pain threshold test, an audiogram of the user can be generated based on the hearing threshold and the pain threshold and saved. In addition, the audiogram can be displayed, or relevant results and suggestions can be given based on the audiogram.
[0167] Next, we will continue to explain the process of the second part of personalized audiometry, namely the tone test.
[0168] It should be noted that the main scenario for hearing-impaired users to wear hearing aids is to have conversations and communicate with people. Therefore, the main purpose of the tone test is to evaluate the user's speech recognition rate when no auxiliary listening means are taken. For example, taking Chinese as an example, the main tones of Chinese are limited, and the embodiment of the present application adopts the six-tone combination of a / 啊, i / 依, u / 呜, m / 么, s / 丝 and sh / 十. Of course, it can also be expanded on this basis, for example, h / 呵, etc. For the convenience of description, only six tones are used here; of course, other more combinations can also be included, and the embodiment of the present application does not limit this.
[0169] For example, see Figure 11 , Figure 11 is a flowchart of the tone test provided in the embodiment of the present application, such as Figure 11 As shown, the main steps of the tone test include: 1. Select the test ear; 2. Select the test sound pressure (for example, including three levels of soft, medium and loud); 3. Generate and play the six-tone test audio signal; 4. Record user feedback and judge whether it is correct or not (for example, the APP background plays a sound, assuming it is a / ah, and the user can make a choice based on what he hears. For example, assuming that the user receives a Figure 12 The "a / ah" button 1202 shown in FIG. 1 is clicked, and the background records the user's accurate listening; if the user receives a Figure 12 12. If the user misidentifies the sound, play it a second time and record the feedback status; 6. Repeat the above steps until both ears and six sounds are traversed.
[0170] The following is an explanation of the self-fitting process.
[0171] The first part of self-fitting is to obtain the basic hearing for hearing-impaired users through hearing aids based on the audiogram obtained from personalized audiometry.
[0172] In some embodiments, the above-mentioned basic hearing aid function solution refers to calculating the gain of each frequency band according to the user's personalized hearing status (for example, by loading the audiogram), and then compensating for the user's hearing loss in the full frequency band range through the differential gain of each frequency band, so as to improve the user's perception ability of the hearing-impaired frequency band, and further improve the user's speech intelligibility to meet the needs of daily communication. The solution of the basic hearing aid function will be specifically described below.
[0173] Step 1: Load the user's audiogram (i.e., the hearing test result obtained from personalized hearing test). As mentioned above, the embodiments of the present application do not limit the audiogram obtained by the user through the personalized audiometry module in the APP provided by the embodiments of the present application, and can also directly input the audiogram obtained from a third party (such as an accurate pure tone audiogram obtained from a professional institution).
[0174] Step 2: Calculate the gain value of each frequency band according to the audiogram and the prescription formula. Here, the prescription formula refers to the formula for determining the gain value of a frequency band according to the hearing threshold of each frequency band. For example, taking the prescription formula given in Table 1 as an example, where TH represents the corresponding hearing threshold and G is the calculated gain. The formula in Table 1 is a non-linear prescription formula, and the gain values of each frequency band can be calculated according to the sound pressure level of the input audio signal and the hearing threshold. The specific process of gain calculation is as follows: First, calculate the sound pressure level of the input audio signal, and then determine the sound intensity according to the sound pressure level of the input audio signal, so as to determine the gain interval of the formula in Table 1; among them, when the sound pressure level is below 40 dB, it is a low-intensity sound; when the sound pressure level is between 40 dB and 65 dB, it is a comfortable sound; when the sound pressure level is between 65 dB and 90 dB, it is a high-intensity sound; subsequently, confirm the hearing threshold of each frequency band and substitute it into the prescription formula given in Table 1 for calculation to obtain the gain value of the current frequency band.
[0175] It should be noted that in the embodiments of the present application, restrictions are added to the gain output by the prescription formula. That is, in order to ensure that the intensity of the balanced audio signal will not cause further damage to the user's hearing, when the sum of the sound pressure level of the input audio signal and the gain value exceeds the user's pain threshold, the part of the gain that exceeds the pain threshold will be removed.
[0176] Table 1 Prescription formula
[0177]
[0178] Step 3: Substitute the gain values corresponding to the 6 subbands obtained by calculation into the filter calculation function to calculate the filter bank parameters. Among them, the filter bank can be composed of shelving filters and peaking filters, and the shelving filter can include a low shelf filter and a high shelf filter. The characteristic of the low shelf filter is that the high-frequency part is directly passed, and the low-frequency part is adjustable (i.e., it can be used to adjust the gain of the low-frequency subband); the characteristic of the high shelf filter is that the low-frequency part is directly passed, and the high-frequency part is adjustable (i.e., it can be used to adjust the gain of the high-frequency subband); the peaking filter is located between the low shelf filter and the high shelf filter and is used to raise the center frequency response and adjust the gain of the middle subband.
[0179] In addition, it should be noted that the embodiment of the present application uses "reverse" filter parameter calculation, that is, first determine the filter parameters corresponding to the high-frequency subband, and then calculate the filter parameters of the low-frequency subband according to the frequency response characteristics after filtering, and gradually obtain the filter parameters.
[0180] Exemplarily, see Figure 13A and Figure 13B , where Figure 13A is a schematic diagram of the frequency response curve provided by the related art, Figure 13B is a schematic diagram of the frequency response curve provided by the embodiment of the present application. The circles and × in the figure are the expected gains of the corresponding subbands respectively. Combining Figure 13A and Figure 13B it can be seen that compared with the method of directly calculating the parameters of individual filters, the solution provided by the embodiment of the present application can be closer to the expected frequency response curve. For example, the gain of the solution provided by the embodiment of the present application at the target subband is closer to the expected value.
[0181] Step 4: Filter the input audio signal to achieve equalization to obtain the output audio signal (corresponding to the first audio signal above). The input original audio signal is successively filtered through each filter (from low frequency to high frequency), and the obtained output audio signal is the equalized audio signal.
[0182] Exemplarily, see Figure 14 , Figure 14 is a schematic diagram of the personalized equalization process provided by the embodiment of the present application. As shown in Figure 14 , the time-domain signal s(n) obtained by splicing the nth frame and the (n - 1)th frame is input into the sound pressure level calculation module to obtain the sound pressure level of the current frame signal. The calculation formula of the sound pressure level is as follows:
[0183]
[0184] For example, assume that the calculated sound pressure level spl = 60 dB, and at the same time assume that the hearing thresholds of the 6 sub-bands corresponding to the left ear are pta_L = [30 35 35 40 45 45]; then first determine the corresponding gain range according to the sound pressure level. Referring to Table 1, the input sound pressure level of 60 dB corresponds to the comfortable threshold sound. Then, the corresponding gain can be calculated according to the hearing threshold of each sub-band. Taking the first sub-band as an example, the hearing threshold is 30 dB, then corresponding to the formula (2) in the comfortable threshold sound range, substituting the values for calculation gives g[1] = 0.6×(30 - 20) = 6 dB. Similarly, the gain values of the other 5 sub-bands can be calculated in turn.
[0185] Subsequently, when calculating the filter parameters according to the gain value g, the embodiment of the present application adopts a "reverse" calculation method to approach the desired response curve. That is, first calculate the parameters of the high shelf filter according to the gain value g[6] of the sixth sub-band, and then calculate the filter parameters of the fifth sub-band according to the difference g′[5] between the gain value g[5] of the fifth sub-band and the frequency response h_6[5] of the filter at the fifth sub-band. By analogy, the parameters a of the entire filter bank can be obtained. ij b ij , which will not be elaborated in the embodiment of the present application.
[0186] After obtaining the filter bank parameters, the input original audio signal can be processed by 6 filters in sequence from low frequency to high frequency, and then the personalized equalized speech signal s′(n) can be obtained. The filtering operation is a convolution in the time domain and a point-by-point multiplication in the frequency domain, which is a basic operation of signal processing and will not be elaborated in the embodiment of the present application.
[0187] Finally, in order to prevent the "clipping" phenomenon from occurring in the output audio signal and affecting the listening experience, the embodiment of the present application also adds a dynamic range control (DRC) module after the equalization output to protect the integrity of the audio signal.
[0188] Next, the second part of the self-fitting process, that is, the tone adjustment process, will be further described.
[0189] The purpose of tone adjustment is to, on the basis of realizing the basic hearing aid function, through interaction with the tone adjustment link designed in the APP, that is, after the hearing-impaired user wears the hearing aid and conducts a real-time tone test, according to the test results, fine-tune the parameters and update the adjusted parameters to the hearing aid through the Bluetooth protocol, so as to improve the user's listening experience (that is, realize the first enhanced hearing aid function).
[0190] In some embodiments, referring to Figure 15 , Figure 15It is a schematic flowchart of tone adjustment provided by an embodiment of the present application. As Figure 15 shown, the main process of tone adjustment is as follows: 1. Determine the gain factor (factor1, where the gain factor is for the overall gain of the audio signal) according to the user's age, wearing side, and wearing duration; 2. Import the audiogram, where the audiogram includes the hearing thresholds and pain thresholds of the user in different frequency bands; 3. Calculate 3 gain curves corresponding to soft voice, medium voice, and loud voice respectively according to the gain factor, hearing threshold, and pain threshold using the prescription formula; 4. Interpolate the number of sub-bands of the gain curve to be the same as the number of channels of the personalized equalization filter (corresponding to the above filter bank) through frequency band mapping, where the frequency band mapping can be implemented by linear interpolation; 5. Perform personalized assisted listening processing (such as amplification processing) on the given tone signal according to the gain curve and play it to the user for audition, and record the user's recognition result; 6. Perform targeted compensation on the gain curve for the tones misrecognized by the user. Among them, different error situations correspond to different compensations, but the adjustment amount of the compensation can be preset, and the user does not need to manually adjust; 7. Repeat the above steps 5 and 6 until the adjustment ends; 8. Save the current adjustment result (corresponding to the above second hearing assistance strategy).
[0191] It should be noted that the purpose of tone adjustment is to play any tone and adjust the user's perception of tones at different frequencies according to the user's feedback, which can help improve the speech recognition rate. In addition, the interaction method of tone adjustment provided by the embodiment of the present application is also different from the fitting provided by the related art. The solutions provided by the related art generally adopt a three-stage self-adjustment. On the one hand, the channel resolution is insufficient, and on the other hand, the professionalism is relatively strong, resulting in a relatively high operation threshold. In contrast, as Figure 16 shown, in the solution provided by the embodiment of the present application, the user only needs to use a button to feedback the recognition status, and the background will perform adaptive compensation according to the user's recognition results of different tones. For the user, the operation threshold is relatively low, and the user experience is relatively friendly. The latest parameters selected by the user can be updated to the hearing aid through the Bluetooth protocol, so that the user can obtain a better listening effect.
[0192] Next, the process of listening perception adjustment, which is the third part of self-fitting, will be described.
[0193] The main process of listening perception adjustment is: on the basis of realizing the basic assisted listening function and the first enhanced assisted listening function, through the interaction with the listening perception adjustment link designed in the APP, after the hearing-impaired user wears the hearing aid, perform real-time listening perception tests, and according to the results of the listening perception tests, fine-tune the parameters, and update the adjusted parameters to the hearing aid through the Bluetooth protocol, so as to improve the user's listening perception (that is, realize the second enhanced assisted listening function).
[0194] Exemplarily, refer toFigure 17 , Figure 17 is a schematic flowchart of the listening experience adjustment provided by the embodiments of the present application. As Figure 17 shown, the main process of the listening experience adjustment is as follows: 1. Import the assisted listening scheme after tone adjustment; 2. Randomly select a voice signal from the voice library, generate 4 types of candidate voice signals according to the assisted listening scheme, and play them to the user. Among them, the 4 types of candidate voice signals are the original hearing aid scheme, higher pitched, lower pitched, and clearer voice respectively; 3. Estimate the user's preference according to the user's choice and further strengthen this trend. For example, if the user selects B, and B corresponds to the lower pitched characteristic, then in the next round of adjustment, the lower pitched characteristic will be further strengthened. At this time, the adjustment amount can be pre-set according to the algorithm and does not require manual adjustment by the user; 4. After a total of N rounds of adjustment, it is considered that the pure voice listening experience adjustment is completed, and the assisted listening scheme is saved; 5. Perform the listening experience adjustment of the noisy voice. For example, different levels (as close to the real value as possible) of noise can be processed together with the voice signal for assisted listening (the types of noise can be several common ones that cause discomfort to the user, such as the sound of a flute, the sound of a machine, etc.); 6. Record whether the user's feedback on the voice listening experience and the noise causes discomfort, and adjust the gain curve according to the user's feedback results; 7. The sound image correction is played simultaneously in both ears, and the binaural gain is adjusted according to the sound image position perceived by the user's feedback to make the sound image located in the middle to achieve binaural balance; 8. Save the assisted listening scheme (corresponding to the above-mentioned third hearing assistance strategy).
[0195] Exemplarily, refer to Figure 18 , Figure 18 is a schematic diagram of the application scenario of the audio signal processing method provided by the embodiments of the present application. As Figure 18 shown, the user can select four candidate strategies, and the background plays the sound adjusted according to the corresponding strategy. After the user makes a choice according to their own preference, click Next. The latest parameters selected by the user can be updated to the hearing aid through the Bluetooth protocol to obtain a better listening effect.
[0196] Next, the technical effects brought by the embodiments of the present application will be described by comparing the related technologies with the audio signal processing method provided by the embodiments of the present application.
[0197] For related technologies, first of all, as a professional device, hearing aids require fitting based on offline stores and face-to-face communication with audiologists to complete the fitting, resulting in low timeliness. In addition, related technologies generally rely on audiometry results and apply general prescription formulas for hearing assistance. However, considering the uniqueness of each person's hearing, it is very necessary to implement more personalized hearing assistance based on user feedback. In addition, in terms of self-fitting, the solutions provided by related technologies are to directly provide the gain adjustment interface for each frequency band to the user for adjustment through a segmented adjustment method. However, this adjustment method requires a high level of professionalism and has too high an operation threshold; on the other hand, when the user cannot control the adjustment amount well, it will instead reduce the hearing assistance effect.
[0198] Through research on the above solutions provided by related technologies, the applicant found the following several improvement directions:
[0199] 1. Support users to perform self-tests at any time to understand their current hearing status. In addition, for ordinary users (such as those with healthy hearing or those who have not been clinically defined as hearing-impaired), detecting their hearing status at any time based on a lightweight APP is also beneficial to the hearing health of ordinary users;
[0200] 2. Support targeted hearing assistance based on the user's personalized hearing status. For example, assisting in hearing for the frequencies where hearing loss occurs has a better effect; through the method of self-fitting, optimizing the hearing assistance effect of hearing aids can better suit personalized needs; optimizing the tuning interaction method makes tuning more convenient and efficient.
[0201] In view of this, on the one hand, the embodiment of the present application integrates a comprehensive personalized audiometry function and a convenient self-fitting function in the APP. In this way, users only need to interact with the APP to achieve hearing tests, meeting the user's need to perform hearing tests at any time. On the other hand, when configuring the hearing aid, the embodiment of the present application generates corresponding hearing assistance strategies based on the user's personalized hearing test results, so that the generated hearing assistance strategies can better suit the user's personalized needs. Further, when the solution provided by the embodiment of the present application performs tone adjustment, the user only needs to use a button to feedback the recognition status, and then targeted compensation can be performed according to the user's feedback results, reducing the user's operation threshold, making the adjustment process more convenient and fast, and improving the user experience.
[0202] Next, continue to describe the exemplary structure of the software module implementation of the audio signal processing device 255 provided by the embodiment of the present application. In some embodiments, as Figure 2A shown, the software module stored in the audio signal processing device 255 in the memory 250 may include: a display module 2551, an output module 2552, and a sending module 2553.
[0203] A display module 2551 for displaying a hearing test control in a human - machine interaction interface; an output module 2552 for outputting a first test audio signal in response to a trigger operation on the hearing test control; the display module 2551 is further configured to display a first hearing test result of a target object in response to a feedback operation on the first test audio signal; a sending module 2553 for sending a first hearing assistance strategy generated according to the first hearing test result to an audio device in response to a configuration operation on the audio device, wherein the first hearing assistance strategy is used to enable the audio device to output a first audio signal adapted to the first hearing test result.
[0204] In some embodiments, the first hearing test result includes at least one of a hearing parameter and a language recognition ability parameter, and the first test audio signal includes at least one of the following types of test audio signals: a hearing test audio signal for testing the hearing of a target object; a language recognition ability test audio signal for testing the language recognition ability of the target object; the processing device 255 of the audio signal further includes a generation module 2554 for generating a hearing parameter of the target object in response to a feedback operation on the hearing test audio signal; and for generating a language recognition ability parameter of the target object in response to a feedback operation on the language recognition ability test audio signal; the display module 2551 is further configured to display the hearing test result of the target object, wherein the hearing test result includes at least one of a hearing parameter and a language recognition ability parameter.
[0205] In some embodiments, the hearing parameter includes the hearing threshold of each sub - band in the auditory frequency range of the target object; the generation module 2554 is further configured to perform the following processing for any sub - band in the auditory frequency range: display a first feedback control and a second feedback control in the human - machine interaction interface, wherein the first feedback control is used to indicate that the hearing test audio signal is not heard; the second feedback control is used to indicate that the hearing test audio signal is heard; in response to a trigger operation on the first feedback control, re - output the hearing test audio signal in a manner with a sound pressure level higher than the currently output sound pressure level; in response to a trigger operation on the second feedback control, re - output the hearing test audio signal in a manner with a sound pressure level lower than the currently output sound pressure level; for any sound pressure level used in the current output, when a trigger operation on the second feedback control is received again at any sound pressure level, determine the any sound pressure level as the hearing threshold of the target object in the sub - band.
[0206] In some embodiments, the display module 2551 is further configured to perform the following processing when the first feedback control and the second feedback control are displayed in the human - machine interaction interface: display a sound pressure level control in the human - machine interaction interface, wherein the sound pressure level control is used to indicate the sound pressure level of the currently output hearing test audio signal.
[0207] In some embodiments, the hearing parameter includes the pain threshold of each sub-band of the target object within the audible frequency range; the generating module 2554 is further configured to perform the following processing for any sub-band within the audible frequency range: display a first adjustment control and a third feedback control on the human-computer interaction interface, where the first adjustment control is used to adjust the sound pressure level, and the third feedback control is used to represent physiological discomfort when hearing the hearing test audio signal; in response to a triggering operation on the third feedback control, determine the sound pressure level at the time of receiving the triggering operation as the pain threshold of the target object in the sub-band.
[0208] In some embodiments, the display module 2551 is further configured to display a plurality of fourth feedback controls on the human-computer interaction interface, where each fourth feedback control corresponds to a tone; the output module 2552 is further configured to sequentially output a plurality of language recognition ability test audio signals; the audio signal processing device 255 further includes a recording module 2555, configured to record the fourth feedback control triggered among the plurality of fourth feedback controls each time a language recognition ability test audio signal is output; the generating module 2554 is further configured to generate the language recognition ability parameter of the target object based on the tones respectively corresponding to the plurality of language recognition ability test audio signals and the fourth feedback controls respectively triggered during multiple tests.
[0209] In some embodiments, when displaying a plurality of fourth feedback controls on the human-computer interaction interface, the display module 2551 is further configured to perform the following processing: display a decibel control on the human-computer interaction interface, where the decibel control is used to indicate the decibel value of the currently output language recognition ability test audio signal.
[0210] In some embodiments, the audio signal processing device 255 further includes a detection module 2556 and a transfer module 2557, where the detection module 2556 is configured to detect the sound pressure level of the environment where the target object is located before outputting the first test audio signal; the transfer module 2557 is configured to transfer to the step of outputting the first test audio signal when the average sound pressure level of the environment within a set duration is less than the sound pressure level threshold.
[0211] In some embodiments, the audio signal processing device 255 further includes a determination module 2558 and a combination module 2559, where the determination module 2558 is configured to, before sending the first hearing assistance strategy generated according to the first hearing test result to the audio device, determine the filter parameters of each sub-band based on the first hearing test result in the order of decreasing frequency of each sub-band within the audible frequency range, where the filter parameters of the low-frequency sub-bands are determined based on the filter parameters of the high-frequency sub-bands; the combination module 2559 is configured to combine the filter parameters of each sub-band and use the combined filter bank parameters as the first hearing assistance strategy for the target object.
[0212] In some embodiments, the first hearing test result includes the hearing thresholds of the target object in each sub-band; the determination module 2558 is further configured to obtain the gain value of each sub-band based on the hearing thresholds of the target object in each sub-band and a prescription formula; and obtain the filter parameters of each sub-band based on the gain values of each sub-band in the order from high to low frequency.
[0213] In some embodiments, the audible frequency range includes N sub-bands, where N is an integer greater than 1; the determination module 2558 is further configured to substitute the gain value of the Nth sub-band into a filter function for calculation to obtain the filter parameters of the Nth sub-band; and determine the filter parameters of the ith sub-band based on the difference between the gain value of the ith sub-band and the frequency response of the filter of the (i + 1)th sub-band at the frequency of the ith sub-band; where the value range of i satisfies 1 ≤ i ≤ N - 1, and the frequency of the (i + 1)th sub-band is greater than that of the ith sub-band.
[0214] In some embodiments, the determination module 2558 is further configured to amplify the first audio signal according to at least one gain curve to obtain second test audio signals of at least one volume; the generation module 2554 is further configured to generate a second hearing test result of the target object in response to a feedback operation on the second test audio signals; and the sending module 2553 is further configured to send a second hearing assistance strategy to the audio device, where the second hearing assistance strategy is obtained by adjusting the first hearing assistance strategy according to the second hearing test result and is used to make the audio device output a second audio signal adapted to the second test result to replace the first audio signal.
[0215] In some embodiments, the display module 2551 is further configured to display a second adjustment control and a plurality of fifth feedback controls in a human-machine interaction interface, where the second adjustment control is used to adjust the gain of the second test audio signal, and each fifth feedback control corresponds to a tone; the output module 2552 is further configured to output a plurality of second test audio signals in sequence; the recording module 2555 is further configured to record the fifth feedback control triggered among the plurality of fifth feedback controls each time the second test audio signal is output; and the generation module 2554 is further configured to generate a second hearing test result of the target object based on the tones respectively corresponding to the plurality of second test audio signals and the fifth feedback controls triggered respectively during multiple tests.
[0216] In some embodiments, when the display module 2551 displays the second adjustment control and the plurality of fifth feedback controls in the human-machine interaction interface, the following processing is performed: a plurality of volume controls are displayed in the human-machine interaction interface, and the volume represented by the volume control in the selected state is used as the volume used when outputting the second test audio signal.
[0217] In some embodiments, the second hearing test result includes the tones misrecognized by the target object; the audio signal processing device 255 further includes a compensation module 25510, configured to perform targeted compensation processing on the first hearing assistance strategy according to the tones misrecognized by the target object before sending the second hearing assistance strategy to the audio device, so as to obtain the second hearing assistance strategy.
[0218] In some embodiments, the determination module 2558 is further configured to determine a gain factor of the first audio signal according to the characteristic information of the target object before amplifying the first audio signal according to at least one gain curve; the generation module 2554 is further configured to generate at least one gain curve according to the hearing parameters, the gain factor, and the prescription formula included in the first hearing test result, where each gain curve corresponds to a sound volume, and the hearing parameters include at least one of the hearing threshold and the pain threshold of each sub-band in the auditory frequency range of the target object; the audio signal processing device 255 further includes an interpolation module 25511, configured to perform interpolation processing on each gain curve in a manner of frequency band mapping, so that the number of sub-bands of the gain curve is consistent with the number of channels of the filter bank.
[0219] In some embodiments, the audio signal processing device 255 further includes an adjustment module 25512, configured to perform adjustment processing on the second audio signal based on different candidate listening perception adjustment strategies to obtain a plurality of third test audio signals; the generation module 2554 is further configured to generate a third hearing test result of the target object in response to a feedback operation on the plurality of third test audio signals; the sending module 2553 is configured to send a third hearing assistance strategy to the audio device, where the third hearing assistance strategy is obtained by adjusting the second hearing assistance strategy according to the third hearing test result, and is used to make the audio device output a third audio signal adapted to the third hearing test result to replace the second audio signal.
[0220] In some embodiments, the third hearing test result includes the listening perception preferred by the target object; the display module 2551 is further configured to display a plurality of sixth feedback controls in the human-computer interaction interface, where each sixth feedback control corresponds to a listening perception; the output module 2552 is further configured to sequentially output a plurality of third test audio signals corresponding to the plurality of sixth feedback controls one by one; the determination module 2558 is further configured to determine the listening perception corresponding to the triggered sixth feedback control among the plurality of sixth feedback controls as the listening perception preferred by the target object.
[0221] In some embodiments, the adjustment module 25512 is further configured to perform adjustment processing on the gain curve included in the second hearing assistance strategy according to the listening perception preferred by the target object before sending the third hearing assistance strategy to the audio device, so as to obtain the third hearing assistance strategy.
[0222] In some embodiments, the display module 2551 is further configured to display the historical hearing test result of the target object in the man-machine interaction interface in response to the existence of the historical hearing test result of the target object and the historical hearing test result being within the validity period; the sending module 2553 is further configured to send a fourth hearing assistance strategy generated according to the historical hearing test result to the audio device in response to a configuration operation for the audio device, where the fourth hearing assistance strategy is used to enable the audio device to output a fourth audio signal adapted to the historical hearing test result.
[0223] In other embodiments, as Figure 2A shown, the software module in the audio signal processing device 255 stored in the memory 250 may include: an acquisition module 25513, a determination module 2558, a combination module 2559, and a sending module 2553, where the acquisition module 25513 is configured to acquire the first hearing test result of the target object; the determination module 2558 is configured to determine the filter parameters of each sub-band in the audible frequency range based on the first hearing test result in the order from high to low frequency, where the filter parameters of the low-frequency sub-band are determined based on the filter parameters of the high-frequency sub-band; the combination module 2559 is configured to combine the filter parameters of each sub-band and use the combined filter bank parameters as the first hearing assistance strategy for the target object; the sending module 2553 is configured to send the first hearing assistance strategy to the audio device, where the first hearing assistance strategy is used for the audio device to output a first audio signal adapted to the first hearing test result.
[0224] Next, continue to describe the exemplary structure of the software module of the audio signal processing device 355 provided in the embodiments of the present application. In some embodiments, as Figure 2B shown, the software module in the audio signal processing device 355 stored in the memory 350 may include: a receiving module 3551 and an output module 3552.
[0225] The receiving module 3551 is configured to receive the first hearing assistance strategy for the target object, where the first hearing assistance strategy includes filter bank parameters, the filter bank parameters include the filter parameters of each sub-band in the audible frequency range, the filter parameters of each sub-band are determined based on the first hearing test result of the target object in the order from high to low frequency, and the filter parameters of the low-frequency sub-band are determined based on the filter parameters of the high-frequency sub-band; the output module 3552 is configured to output a first audio signal adapted to the first hearing test result according to the first hearing assistance strategy.
[0226] In some embodiments, the receiving module 3551 is further configured to receive a second hearing assistance strategy for a target object, where the second hearing assistance strategy is obtained by adjusting the first hearing assistance strategy according to a second hearing test result, the second hearing test result is obtained based on the feedback operation of the target object on a second test audio signal, and the second test audio signal is obtained by amplifying a first audio signal according to a gain curve; the output module 3552 is further configured to output a second audio signal adapted to the second hearing test result according to the second hearing assistance strategy to replace the first audio signal.
[0227] In some embodiments, the receiving module 3551 is further configured to receive a third hearing assistance strategy for a target object, where the third hearing assistance strategy is obtained by adjusting the second hearing assistance strategy according to a third hearing test result, the third hearing test result is obtained based on the feedback operation of the target object on a plurality of third test audio signals, and the plurality of third test audio signals are obtained by adjusting the second audio signal based on different candidate hearing adjustment strategies; the output module 3552 is further configured to output a third audio signal adapted to the third hearing test result according to the third hearing assistance strategy to replace the second audio signal.
[0228] In some embodiments, the output module 3552 is further configured to control the filters of each sub-band in the filter bank in ascending order of frequency, and perform filtering processing on the original audio signal in sequence according to the filter parameters of the corresponding sub-band in the filter bank parameters to obtain a first audio signal adapted to the first hearing test result.
[0229] It should be noted that the description of the device in the embodiments of the present application is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments, so details will not be repeated. For the technical details not described in the audio signal processing device provided in the embodiments of the present application, they can be understood according to Figures 3 to 5 the description of any one of the drawings.
[0230] The embodiments of the present application provide a computer program product or a computer program, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the audio signal processing method described above in the embodiments of the present application.
[0231] The embodiments of the present application provide a computer-readable storage medium storing executable instructions, where the executable instructions are stored, and when the executable instructions are executed by a processor, the processor will be caused to execute the audio signal processing method provided in the embodiments of the present application. For example, as Figures 3 to 5A method for processing an audio signal shown in any one of the accompanying drawings.
[0232] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; or it may be various devices including one or any combination of the above memories.
[0233] In some embodiments, the executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as an independent program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.
[0234] As an example, the executable instructions may or may not correspond to a file in the file system, may be stored as part of a file that stores other programs or data, for example, in one or more scripts in a HyperText Markup Language (HTML) document, stored in a single file dedicated to the program under discussion, or stored in multiple cooperating files (e.g., files that store one or more modules, subroutines, or code portions).
[0235] As an example, the executable instructions may be deployed to execute on one electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed at multiple locations and interconnected by a communication network.
[0236] As described above, the above are only embodiments of the present application and are not used to limit the protection scope of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.
Claims
1. A method for processing an audio signal, characterized in that, The method includes: Displaying a hearing test control in a human-computer interaction interface; In response to a trigger operation on the hearing test control, detecting the sound pressure level of the environment where the target object is located; When the average sound pressure level of the environment within a set duration is less than the sound pressure level threshold, outputting a first test audio signal; In response to a feedback operation on the first test audio signal, displaying the first hearing test result of the target object, where the first hearing test result includes the hearing threshold of each sub-band in the auditory frequency range of the target object; In response to a configuration operation on the audio device, based on the hearing threshold of each sub-band of the target object and a prescription formula, obtaining the gain value of each sub-band; based on the gain value of the high-frequency sub-band, determining the filter parameters of the high-frequency sub-band, and calculating the filter parameters of the low-frequency sub-band according to the characteristics of the frequency response after filtering; Combining the filter parameters of each sub-band, taking the combined filter bank parameters as the first hearing assistance strategy for the target object, and sending the first hearing assistance strategy to the audio device, where the first hearing assistance strategy is used to make the audio device output a first audio signal adapted to the first hearing test result.
2. The method according to claim 1, wherein: The first hearing test result includes at least one of a hearing parameter and a language recognition ability parameter, and the first test audio signal includes at least one of the following types of test audio signals: a hearing test audio signal for testing the hearing of the target object; a language recognition ability test audio signal for testing the language recognition ability of the target object; The displaying the first hearing test result of the target object in response to a feedback operation on the first test audio signal includes: Generating the hearing parameter of the target object in response to a feedback operation on the hearing test audio signal; Generating the language recognition ability parameter of the target object in response to a feedback operation on the language recognition ability test audio signal; Displaying the first hearing test result of the target object, where the first hearing test result includes at least one of the hearing parameter and the language recognition ability parameter.
3. The method according to claim 2, wherein: The hearing parameter includes the hearing threshold of each sub-band in the auditory frequency range of the target object; The generating the hearing parameter of the target object in response to a feedback operation on the hearing test audio signal includes: For any sub-band in the auditory frequency range, performing the following processing: Displaying a first feedback control and a second feedback control in the human-computer interaction interface, where the first feedback control is used to represent that the target object does not hear the hearing test audio signal; the second feedback control is used to represent that the target object hears the hearing test audio signal; In response to a trigger operation on the first feedback control, re-outputting the hearing test audio signal in a manner with a sound pressure level higher than the currently output sound pressure level; In response to a triggering operation on the second feedback control, re - output the hearing test audio signal at a sound pressure level lower than the current output. For any sound pressure level used in the current output, when a triggering operation on the second feedback control is received again at the any sound pressure level, determine the any sound pressure level as the hearing threshold of the target object in the sub - band.
4. The method according to claim 3, characterized in that, When the first feedback control and the second feedback control are displayed in the human - machine interaction interface, the method further includes: Display a sound pressure level control in the human - machine interaction interface, where the sound pressure level control is used to indicate the display of the sound pressure level of the current output hearing test audio signal.
5. The method according to claim 2, wherein: The hearing parameter includes the pain threshold of the target object in each sub - band within the audible frequency range. The generating the hearing parameter of the target object in response to a feedback operation on the hearing test audio signal includes: For any sub - band within the audible frequency range, perform the following processing: Display a first adjustment control and a third feedback control in the human - machine interaction interface, where the third feedback control is used to represent that the target object has physiological discomfort when hearing the hearing test audio signal. In response to a triggering operation on the first adjustment control, adjust the sound pressure level of the currently output hearing test audio signal. In response to a triggering operation on the third feedback control, determine the sound pressure level at the time of receiving the triggering operation as the pain threshold of the target object in the sub - band.
6. The method according to claim 2, wherein The generating the language recognition ability parameter of the target object in response to a feedback operation on the language recognition ability test audio signal includes: Display a plurality of fourth feedback controls in the human - machine interaction interface, where each fourth feedback control corresponds to a tone. Output a plurality of the language recognition ability test audio signals in sequence, and record the fourth feedback control triggered among the plurality of fourth feedback controls each time the language recognition ability test audio signal is output. Generate the language recognition ability parameter of the target object based on the tones respectively corresponding to the plurality of language recognition ability test audio signals and the fourth feedback controls triggered respectively during multiple tests.
7. The method according to claim 6, characterized in that When a plurality of fourth feedback controls are displayed in the human - machine interaction interface, the method further includes: Display a decibel control in the human - machine interaction interface, where the decibel control is used to indicate the decibel value of the currently output language recognition ability test audio signal.
8. The method according to claim 1, wherein: The audible frequency range includes N sub - bands, where N is an integer greater than 1. The determining the filter parameters of the high - frequency sub - band based on the gain value of the high - frequency sub - band and calculating the filter parameters of the low - frequency sub - band according to the characteristics of the frequency response after filtering includes: Substitute the gain value of the Nth sub - band into the filter function for calculation to obtain the filter parameters of the Nth sub - band. Determine the filter parameters of the \(i\)-th sub-band based on the gain value of the \(i\)-th sub-band and the difference in the frequency response of the filter of the \((i + 1)\)-th sub-band at the frequency of the \(i\)-th sub-band; where the value range of \(i\) satisfies \(1\leq i\leq N - 1\), and the frequency of the \((i + 1)\)-th sub-band is greater than that of the \(i\)-th sub-band.
9. The method according to claim 1, characterized in that, The method further includes: Amplify the first audio signal according to at least one gain curve to obtain second test audio signals with at least one volume level. Generate a second hearing test result of the target object in response to a feedback operation on the second test audio signal. Send a second hearing assistance strategy to the audio device, where the second hearing assistance strategy is obtained by adjusting the first hearing assistance strategy according to the second hearing test result, and is used to make the audio device output a second audio signal adapted to the second test result to replace the first audio signal.
10. The method according to claim 9, wherein The generating a second hearing test result of the target object in response to a feedback operation on the second test audio signal includes: Display a second adjustment control and a plurality of fifth feedback controls in the human-computer interaction interface, where each of the fifth feedback controls corresponds to a tone. In response to a triggering operation on the second adjustment control, adjust the gain of the currently output second test audio signal. Output a plurality of the second test audio signals in sequence, and record the fifth feedback controls triggered among the plurality of fifth feedback controls each time the second test audio signal is output. Generate a second hearing test result of the target object based on the tones corresponding to the plurality of second test audio signals and the fifth feedback controls triggered during multiple tests.
11. The method according to claim 10, wherein When the second adjustment control and a plurality of fifth feedback controls are displayed in the human-computer interaction interface, the method further includes: Display a plurality of volume controls in the human-computer interaction interface, where the volume represented by the volume control in the selected state is used as the volume when outputting the second test audio signal.
12. The method according to claim 9, wherein: The second hearing test result includes the tones misidentified by the target object. Before sending the second hearing assistance strategy to the audio device, the method further includes: Perform targeted compensation processing on the first hearing assistance strategy according to the tones misidentified by the target object to obtain a second hearing assistance strategy.
13. The method according to claim 9, wherein Before amplifying the first audio signal according to at least one gain curve, the method further includes: Determine a gain factor of the first audio signal according to the characteristic information of the target object. Generate at least one gain curve according to the hearing parameters included in the first hearing test result, the gain factor, and a prescription formula, where each gain curve corresponds to a volume level, and the hearing parameters include at least one of the following: the hearing threshold of each sub-band of the target object in the audible frequency range, the pain threshold of each sub-band of the target object in the audible frequency range. Interpolate each of the gain curves by means of band mapping so that the number of sub-bands of the gain curve is the same as the number of channels of the filter bank.
14. The method according to claim 9, wherein The method further includes: Adjusting the second audio signal respectively based on a plurality of candidate auditory perception adjustment strategies to obtain a plurality of third test audio signals correspondingly; Generating a third hearing test result of the target object in response to a feedback operation on the plurality of third test audio signals; Sending a third hearing assistance strategy to the audio device, where the third hearing assistance strategy is obtained by adjusting the second hearing assistance strategy according to the third hearing test result and is used to make the audio device output a third audio signal adapted to the third hearing test result to replace the second audio signal.
15. The method according to claim 14, wherein The third hearing test result includes the auditory perception preferred by the target object; The generating the third hearing test result of the target object in response to a feedback operation on the plurality of third test audio signals includes: Displaying a plurality of sixth feedback controls in the human-computer interaction interface, where each of the sixth feedback controls corresponds to an auditory perception; Sequentially outputting the plurality of third test audio signals corresponding to the plurality of sixth feedback controls one by one, and determining the auditory perception corresponding to the triggered sixth feedback control among the plurality of sixth feedback controls as the auditory perception preferred by the target object.
16. The method according to claim 15, wherein Before sending the third hearing assistance strategy to the audio device, the method further includes: Adjusting the gain curve included in the second hearing assistance strategy according to the auditory perception preferred by the target object to obtain a third hearing assistance strategy.
17. The method according to claim 1, wherein Before displaying the hearing test control in the human-computer interaction interface, the method further includes: In response to the existence of a historical hearing test result of the target object and the historical hearing test result being within the validity period, displaying the historical hearing test result in the human-computer interaction interface; In response to a configuration operation on the audio device, sending a fourth hearing assistance strategy generated according to the historical hearing test result to the audio device, where the fourth hearing assistance strategy is used to make the audio device output a fourth audio signal adapted to the historical hearing test result.
18. A method for processing an audio signal, characterized in that, The method includes: Obtaining a first hearing test result of a target object, where the first hearing test result includes the hearing threshold of each sub-band of the target object in the auditory frequency range; Based on the hearing threshold of the target object in each sub-band and a prescription formula, obtaining the gain value of each sub-band; based on the gain value of the high-frequency sub-band, determining the filter parameters of the high-frequency sub-band, and calculating the filter parameters of the low-frequency sub-band according to the characteristics of the frequency response after filtering; Combining the filter parameters of each sub-band, and using the combined filter bank parameters as the first hearing assistance strategy for the target object; Send the first hearing assistance strategy to the audio device, where the first hearing assistance strategy is used for the audio device to output a first audio signal adapted to the first hearing test result.
19. A method for processing an audio signal, characterized in that The method includes: Receiving a first hearing assistance strategy for a target object, where the first hearing assistance strategy is generated according to the first hearing test result of the target object. The first hearing test result includes the hearing thresholds of each sub-band in the audible frequency range of the target object. The first hearing assistance strategy includes filter bank parameters, and the filter bank parameters include the filter parameters of each sub-band. The filter parameters of each sub-band are determined by the following method: based on the hearing threshold of the target object in each sub-band and a prescription formula, obtain the gain value of each sub-band; based on the gain value of the high-frequency sub-band, determine the filter parameters of the high-frequency sub-band, and calculate the filter parameters of the low-frequency sub-band according to the characteristics of the frequency response after filtering. Control the filters of each sub-band in the filter bank in ascending order of frequency, and sequentially filter the original audio signal according to the filter parameters of the corresponding sub-band in the filter bank parameters to obtain a first audio signal adapted to the first hearing test result, and output the first audio signal.
20. The method according to claim 19, wherein The method further includes: Receiving a second hearing assistance strategy for the target object, where the second hearing assistance strategy is obtained by adjusting the first hearing assistance strategy according to the second hearing test result. The second hearing test result is based on the feedback operation of the target object for a second test audio signal, and the second test audio signal is obtained by amplifying the first audio signal according to a gain curve. Output a second audio signal adapted to the second hearing test result according to the second hearing assistance strategy to replace the first audio signal.
21. The method according to claim 20, wherein The method further includes: Receiving a third hearing assistance strategy for the target object, where the third hearing assistance strategy is obtained by adjusting the second hearing assistance strategy according to the third hearing test result. The third hearing test result is based on the feedback operation of the target object for a plurality of third test audio signals, and the plurality of third test audio signals are obtained by adjusting the second audio signal based on a plurality of candidate hearing perception adjustment strategies. Output a third audio signal adapted to the third hearing test result according to the third hearing assistance strategy to replace the second audio signal.
22. A processing device for an audio signal, characterized in that, The device includes: A display module for displaying hearing test controls in a human-computer interaction interface; An output module for detecting the sound pressure level of the environment where the target object is located in response to a trigger operation on the hearing test control; when the average sound pressure level of the environment within a set duration is less than the sound pressure level threshold, output a first test audio signal. The display module is further configured to display a first hearing test result of a target object in response to a feedback operation on the first test audio signal, where the first hearing test result includes the hearing thresholds of the target object in each sub-band within the audible frequency range; The sending module is configured to, in response to a configuration operation on an audio device, obtain a gain value for each sub-band based on the hearing thresholds of the target object in each sub-band and a prescription formula; determine filter parameters for the high-frequency sub-bands based on the gain values of the high-frequency sub-bands, and calculate filter parameters for the low-frequency sub-bands according to the characteristics of the frequency response after filtering; combine the filter parameters for each sub-band, and use the combined filter bank parameters as a first hearing assistance strategy for the target object, and send the first hearing assistance strategy to the audio device, where the first hearing assistance strategy is used to cause the audio device to output a first audio signal adapted to the first hearing test result.
23. A processing device for an audio signal, characterized in that, The device includes: The obtaining module is configured to obtain a first hearing test result of a target object, where the first hearing test result includes the hearing thresholds of the target object in each sub-band within the audible frequency range; The determining module is configured to obtain a gain value for each sub-band based on the hearing thresholds of the target object in each sub-band and a prescription formula; determine filter parameters for the high-frequency sub-bands based on the gain values of the high-frequency sub-bands, and calculate filter parameters for the low-frequency sub-bands according to the characteristics of the frequency response after filtering; The combining module is configured to combine the filter parameters for each sub-band, and use the combined filter bank parameters as a first hearing assistance strategy for the target object; The sending module is configured to send the first hearing assistance strategy to an audio device, where the first hearing assistance strategy is used for the audio device to output a first audio signal adapted to the first hearing test result.
24. A processing device for an audio signal, characterized in that, The device includes: The receiving module is configured to receive a first hearing assistance strategy for a target object, where the first hearing assistance strategy is generated according to the first hearing test result of the target object, the first hearing test result includes the hearing thresholds of the target object in each sub-band within the audible frequency range, the first hearing assistance strategy includes filter bank parameters, the filter bank parameters include the filter parameters for each sub-band, and the filter parameters for each sub-band are determined by: obtaining a gain value for each sub-band based on the hearing thresholds of the target object in each sub-band and a prescription formula; determining filter parameters for the high-frequency sub-bands based on the gain values of the high-frequency sub-bands, and calculating filter parameters for the low-frequency sub-bands according to the characteristics of the frequency response after filtering; The output module is configured to control the filters of each sub-band in the filter bank in ascending order of frequency, perform filtering processing on the original audio signal in sequence according to the filter parameters of the corresponding sub-band in the filter bank parameters, obtain a first audio signal adapted to the first hearing test result, and output the first audio signal.
25. An electronic device, characterized in that, Includes: A memory for storing executable instructions; A processor, when executing the executable instructions stored in the memory, implements the audio signal processing method according to any one of claims 1 to 17, or claim 18, or any one of claims 19 to 21.
26. A computer-readable storage medium stores executable instructions, characterized in that, When the executable instructions are executed by the processor, the audio signal processing method according to any one of claims 1 to 17, or claim 18, or any one of claims 19 to 21 is implemented.
27. A computer program product comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by the processor, the audio signal processing method according to any one of claims 1 to 17, or claim 18, or any one of claims 19 to 21 is implemented.
Citation Information
Patent Citations
Smart earphone capable of improving personalized sound quality, and method
CN109246515A
Method for fitting an audio signal to a hearing device based on hearing-related parameter of the user
EP3276983A1